Jul 20 16:29:32.728308 ip-10-0-133-157 systemd[1]: Starting Kubernetes Kubelet... Jul 20 16:29:33.302347 ip-10-0-133-157 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 16:29:33.302347 ip-10-0-133-157 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 20 16:29:33.302347 ip-10-0-133-157 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 16:29:33.302347 ip-10-0-133-157 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 20 16:29:33.302347 ip-10-0-133-157 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 16:29:33.302347 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.163108 2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 20 16:29:33.302347 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174049 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 16:29:33.302347 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174066 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 16:29:33.302347 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174069 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 16:29:33.302347 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174072 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 16:29:33.302347 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174075 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 16:29:33.302347 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174078 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 16:29:33.302347 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174081 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 16:29:33.302347 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174084 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 16:29:33.239109 ip-10-0-133-157 systemd[1]: Started Kubernetes Kubelet. Jul 20 16:29:33.303340 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174087 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 16:29:33.303340 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174090 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 16:29:33.303340 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174093 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 16:29:33.303340 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174095 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 16:29:33.303340 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174098 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 16:29:33.303340 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174100 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 16:29:33.303340 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174103 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 16:29:33.303340 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174106 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 16:29:33.303340 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174108 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 16:29:33.303340 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174111 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 16:29:33.303340 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174113 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 16:29:33.303340 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174116 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 16:29:33.303340 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174118 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 16:29:33.303340 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174122 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 16:29:33.303340 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174127 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 16:29:33.303340 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174130 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 16:29:33.303340 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174134 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 16:29:33.303340 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174137 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 16:29:33.303340 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174141 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 16:29:33.303340 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174145 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 16:29:33.304320 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174148 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 20 16:29:33.304320 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174151 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 16:29:33.304320 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174154 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 16:29:33.304320 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174157 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 16:29:33.304320 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174159 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 16:29:33.304320 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174162 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 16:29:33.304320 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174165 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 16:29:33.304320 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174167 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 16:29:33.304320 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174170 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 16:29:33.304320 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174173 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 16:29:33.304320 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174175 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 16:29:33.304320 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174178 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 16:29:33.304320 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174181 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 16:29:33.304320 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174185 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 16:29:33.304320 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174188 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 16:29:33.304320 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174191 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 16:29:33.304320 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174194 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 16:29:33.304320 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174197 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 16:29:33.304320 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174200 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 16:29:33.304974 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174203 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 16:29:33.304974 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174205 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 16:29:33.304974 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174208 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 16:29:33.304974 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174213 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 16:29:33.304974 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174216 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 16:29:33.304974 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174219 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 16:29:33.304974 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174221 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 16:29:33.304974 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174224 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 16:29:33.304974 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174227 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 16:29:33.304974 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174230 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 16:29:33.304974 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174233 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 16:29:33.304974 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174236 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 16:29:33.304974 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174238 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 16:29:33.304974 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174241 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 16:29:33.304974 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174244 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 16:29:33.304974 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174246 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 16:29:33.304974 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174249 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 16:29:33.304974 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174251 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 16:29:33.304974 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174254 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 16:29:33.305624 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174257 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 16:29:33.305624 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174260 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 16:29:33.305624 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174262 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 16:29:33.305624 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174265 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 16:29:33.305624 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174267 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 16:29:33.305624 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174270 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 16:29:33.305624 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174272 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 16:29:33.305624 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174275 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 16:29:33.305624 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174277 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 16:29:33.305624 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174280 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 16:29:33.305624 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174282 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 16:29:33.305624 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174284 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 16:29:33.305624 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174287 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 16:29:33.305624 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174289 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 16:29:33.305624 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174292 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 16:29:33.305624 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174294 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 16:29:33.305624 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174297 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 16:29:33.305624 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174299 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 16:29:33.305624 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174302 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 16:29:33.305624 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174304 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 16:29:33.306302 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174306 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 16:29:33.306302 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174309 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 16:29:33.306302 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174312 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 16:29:33.306302 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174315 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 16:29:33.306302 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174317 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 16:29:33.306302 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174320 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 16:29:33.306302 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174322 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 16:29:33.306302 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174325 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 16:29:33.306302 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174327 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 16:29:33.306302 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174330 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 16:29:33.306302 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174333 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 16:29:33.306302 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174335 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 16:29:33.306302 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.174338 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 16:29:33.306302 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175044 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 16:29:33.306302 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175052 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 16:29:33.306302 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175055 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 16:29:33.306302 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175057 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 16:29:33.306302 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175060 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 16:29:33.306302 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175063 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 16:29:33.306970 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175066 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 16:29:33.306970 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175068 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 16:29:33.306970 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175071 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 16:29:33.306970 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175073 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 16:29:33.306970 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175076 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 16:29:33.306970 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175079 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 16:29:33.306970 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175082 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 16:29:33.306970 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175084 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 16:29:33.306970 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175087 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 16:29:33.306970 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175090 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 16:29:33.306970 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175092 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 16:29:33.306970 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175095 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 16:29:33.306970 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175098 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 16:29:33.306970 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175100 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 16:29:33.306970 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175103 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 16:29:33.306970 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175106 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 16:29:33.306970 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175108 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 16:29:33.306970 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175111 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 16:29:33.306970 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175113 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 16:29:33.307662 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175116 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 16:29:33.307662 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175119 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 16:29:33.307662 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175124 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 16:29:33.307662 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175128 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 16:29:33.307662 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175131 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 16:29:33.307662 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175134 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 16:29:33.307662 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175137 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 16:29:33.307662 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175139 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 16:29:33.307662 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175142 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 16:29:33.307662 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175145 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 16:29:33.307662 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175147 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 16:29:33.307662 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175150 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 16:29:33.307662 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175153 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 16:29:33.307662 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175156 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 16:29:33.307662 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175159 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 16:29:33.307662 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175162 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 16:29:33.307662 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175165 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 16:29:33.307662 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175168 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 16:29:33.307662 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175170 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 16:29:33.307662 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175173 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 16:29:33.308458 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175176 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 16:29:33.308458 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175181 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 16:29:33.308458 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175184 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 16:29:33.308458 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175187 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 16:29:33.308458 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175190 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 16:29:33.308458 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175193 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 16:29:33.308458 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175195 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 16:29:33.308458 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175199 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 16:29:33.308458 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175202 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 16:29:33.308458 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175205 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 16:29:33.308458 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175207 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 16:29:33.308458 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175211 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 16:29:33.308458 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175215 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 16:29:33.308458 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175218 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 16:29:33.308458 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175220 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 16:29:33.308458 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175223 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 16:29:33.308458 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175226 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 16:29:33.308458 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175228 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 20 16:29:33.308458 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175231 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 16:29:33.309177 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175233 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 16:29:33.309177 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175236 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 16:29:33.309177 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175238 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 16:29:33.309177 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175241 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 16:29:33.309177 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175243 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 16:29:33.309177 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175247 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 16:29:33.309177 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175250 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 16:29:33.309177 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175253 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 16:29:33.309177 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175256 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 16:29:33.309177 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175258 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 16:29:33.309177 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175261 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 16:29:33.309177 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175263 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 16:29:33.309177 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175266 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 16:29:33.309177 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175268 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 16:29:33.309177 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175272 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 16:29:33.309177 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175275 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 16:29:33.309177 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175277 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 16:29:33.309177 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175280 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 16:29:33.309177 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175282 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 16:29:33.309177 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175286 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 16:29:33.309805 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175289 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 16:29:33.309805 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175291 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 16:29:33.309805 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175294 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 16:29:33.309805 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175296 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 16:29:33.309805 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175299 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 16:29:33.309805 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175301 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 16:29:33.309805 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175304 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 16:29:33.309805 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175307 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 16:29:33.309805 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175309 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 16:29:33.309805 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175312 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 16:29:33.309805 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175315 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 16:29:33.309805 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175317 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 16:29:33.309805 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175320 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 16:29:33.309805 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175322 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 16:29:33.309805 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175325 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 16:29:33.309805 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175741 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 16:29:33.309805 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175746 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 16:29:33.309805 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175749 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 16:29:33.309805 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175752 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 16:29:33.309805 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175755 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 16:29:33.310577 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175757 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 16:29:33.310577 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175760 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 16:29:33.310577 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175763 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 16:29:33.310577 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175765 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 16:29:33.310577 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175768 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 16:29:33.310577 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175773 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 16:29:33.310577 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175777 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 16:29:33.310577 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175779 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 16:29:33.310577 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175782 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 16:29:33.310577 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175784 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 16:29:33.310577 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175787 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 16:29:33.310577 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175790 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 16:29:33.310577 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175793 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 16:29:33.310577 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175796 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 16:29:33.310577 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175798 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 16:29:33.310577 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175801 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 16:29:33.310577 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175804 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 16:29:33.310577 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175806 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 16:29:33.310577 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175809 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 16:29:33.310577 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175811 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 16:29:33.311296 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175814 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 16:29:33.311296 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175817 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 16:29:33.311296 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175819 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 16:29:33.311296 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175822 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 16:29:33.311296 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175824 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 16:29:33.311296 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175827 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 16:29:33.311296 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175830 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 16:29:33.311296 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175833 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 16:29:33.311296 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175835 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 16:29:33.311296 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175837 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 16:29:33.311296 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175840 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 16:29:33.311296 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175843 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 16:29:33.311296 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175845 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 16:29:33.311296 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175848 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 16:29:33.311296 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175850 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 16:29:33.311296 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175853 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 16:29:33.311296 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175855 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 16:29:33.311296 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175859 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 16:29:33.311296 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175863 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 16:29:33.311296 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175865 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 16:29:33.311851 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175868 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 16:29:33.311851 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175870 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 16:29:33.311851 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175873 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 16:29:33.311851 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175875 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 16:29:33.311851 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175879 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 16:29:33.311851 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175881 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 16:29:33.311851 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175884 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 16:29:33.311851 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175886 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 16:29:33.311851 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175889 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 16:29:33.311851 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175891 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 16:29:33.311851 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175894 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 16:29:33.311851 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175896 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 16:29:33.311851 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175899 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 16:29:33.311851 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175901 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 16:29:33.311851 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175905 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 16:29:33.311851 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175908 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 16:29:33.311851 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175911 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 16:29:33.311851 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175914 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 16:29:33.311851 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175917 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 16:29:33.312741 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175921 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 16:29:33.312741 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175923 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 16:29:33.312741 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175926 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 16:29:33.312741 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175929 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 16:29:33.312741 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175931 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 16:29:33.312741 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175933 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 20 16:29:33.312741 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175936 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 16:29:33.312741 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175938 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 16:29:33.312741 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175941 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 16:29:33.312741 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175943 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 16:29:33.312741 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175947 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 16:29:33.312741 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175953 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 16:29:33.312741 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175955 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 16:29:33.312741 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175958 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 16:29:33.312741 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175961 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 16:29:33.312741 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175963 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 16:29:33.312741 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175966 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 16:29:33.312741 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175969 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 16:29:33.312741 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175973 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 16:29:33.312741 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175976 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 16:29:33.313358 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175979 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 16:29:33.313358 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175982 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 16:29:33.313358 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175984 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 16:29:33.313358 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175987 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 16:29:33.313358 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175989 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 16:29:33.313358 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175992 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 16:29:33.313358 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175995 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 16:29:33.313358 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175997 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 16:29:33.313358 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.175999 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 16:29:33.313358 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176002 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 16:29:33.313358 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176004 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 16:29:33.313358 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176007 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 16:29:33.313358 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176009 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 16:29:33.313358 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176012 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 16:29:33.313358 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176014 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 16:29:33.313358 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176106 2575 flags.go:64] FLAG: --address="0.0.0.0" Jul 20 16:29:33.313358 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176114 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 20 16:29:33.313358 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176120 2575 flags.go:64] FLAG: --anonymous-auth="true" Jul 20 16:29:33.313358 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176124 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 20 16:29:33.313358 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176129 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 20 16:29:33.313358 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176132 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 20 16:29:33.314400 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176137 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 20 16:29:33.314400 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176143 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 20 16:29:33.314400 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176148 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 20 16:29:33.314400 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176151 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 20 16:29:33.314400 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176155 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 20 16:29:33.314400 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176158 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 20 16:29:33.314400 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176161 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 20 16:29:33.314400 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176164 2575 flags.go:64] FLAG: --cgroup-root="" Jul 20 16:29:33.314400 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176167 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 20 16:29:33.314400 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176169 2575 flags.go:64] FLAG: --client-ca-file="" Jul 20 16:29:33.314400 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176173 2575 flags.go:64] FLAG: --cloud-provider="external" Jul 20 16:29:33.314400 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176176 2575 flags.go:64] FLAG: --cluster-dns="[]" Jul 20 16:29:33.314400 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176181 2575 flags.go:64] FLAG: --cluster-domain="" Jul 20 16:29:33.314400 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176183 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 20 16:29:33.314400 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176186 2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 20 16:29:33.314400 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176189 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 20 16:29:33.314400 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176193 2575 flags.go:64] FLAG: --container-log-max-files="5" Jul 20 16:29:33.314400 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176197 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 20 16:29:33.314400 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176200 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 20 16:29:33.314400 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176202 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 20 16:29:33.314400 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176206 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 20 16:29:33.314400 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176209 2575 flags.go:64] FLAG: --contention-profiling="false" Jul 20 16:29:33.314400 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176212 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 20 16:29:33.314400 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176214 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 20 16:29:33.315415 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176217 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 20 16:29:33.315415 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176220 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 20 16:29:33.315415 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176224 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 20 16:29:33.315415 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176227 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 20 16:29:33.315415 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176230 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 20 16:29:33.315415 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176232 2575 flags.go:64] FLAG: --enable-load-reader="false" Jul 20 16:29:33.315415 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176235 2575 flags.go:64] FLAG: --enable-server="true" Jul 20 16:29:33.315415 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176238 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 20 16:29:33.315415 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176242 2575 flags.go:64] FLAG: --event-burst="100" Jul 20 16:29:33.315415 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176247 2575 flags.go:64] FLAG: --event-qps="50" Jul 20 16:29:33.315415 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176251 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 20 16:29:33.315415 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176254 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 20 16:29:33.315415 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176256 2575 flags.go:64] FLAG: --eviction-hard="" Jul 20 16:29:33.315415 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176260 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 20 16:29:33.315415 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176263 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 20 16:29:33.315415 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176266 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 20 16:29:33.315415 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176269 2575 flags.go:64] FLAG: --eviction-soft="" Jul 20 16:29:33.315415 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176271 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 20 16:29:33.315415 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176274 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 20 16:29:33.315415 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176281 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 20 16:29:33.315415 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176284 2575 flags.go:64] FLAG: --experimental-mounter-path="" Jul 20 16:29:33.315415 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176287 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 20 16:29:33.315415 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176290 2575 flags.go:64] FLAG: --fail-swap-on="true" Jul 20 16:29:33.315415 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176292 2575 flags.go:64] FLAG: --feature-gates="" Jul 20 16:29:33.315415 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176298 2575 flags.go:64] FLAG: --file-check-frequency="20s" Jul 20 16:29:33.316296 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176302 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 20 16:29:33.316296 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176305 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 20 16:29:33.316296 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176308 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 20 16:29:33.316296 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176311 2575 flags.go:64] FLAG: --healthz-port="10248" Jul 20 16:29:33.316296 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176314 2575 flags.go:64] FLAG: --help="false" Jul 20 16:29:33.316296 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176316 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-133-157.ec2.internal" Jul 20 16:29:33.316296 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176320 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 20 16:29:33.316296 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176322 2575 flags.go:64] FLAG: --http-check-frequency="20s" Jul 20 16:29:33.316296 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176325 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 20 16:29:33.316296 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176328 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 20 16:29:33.316296 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176331 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 20 16:29:33.316296 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176334 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 20 16:29:33.316296 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176337 2575 flags.go:64] FLAG: --image-service-endpoint="" Jul 20 16:29:33.316296 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176339 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 20 16:29:33.316296 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176342 2575 flags.go:64] FLAG: --kube-api-burst="100" Jul 20 16:29:33.316296 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176345 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 20 16:29:33.316296 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176349 2575 flags.go:64] FLAG: --kube-api-qps="50" Jul 20 16:29:33.316296 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176353 2575 flags.go:64] FLAG: --kube-reserved="" Jul 20 16:29:33.316296 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176357 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 20 16:29:33.316296 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176359 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 20 16:29:33.316296 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176362 2575 flags.go:64] FLAG: --kubelet-cgroups="" Jul 20 16:29:33.316296 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176365 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 20 16:29:33.316296 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176368 2575 flags.go:64] FLAG: --lock-file="" Jul 20 16:29:33.316296 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176371 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 20 16:29:33.316947 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176373 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 20 16:29:33.316947 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176376 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 20 16:29:33.316947 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176382 2575 flags.go:64] FLAG: --log-json-split-stream="false" Jul 20 16:29:33.316947 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176392 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 20 16:29:33.316947 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176396 2575 flags.go:64] FLAG: --log-text-split-stream="false" Jul 20 16:29:33.316947 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176398 2575 flags.go:64] FLAG: --logging-format="text" Jul 20 16:29:33.316947 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176401 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 20 16:29:33.316947 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176404 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 20 16:29:33.316947 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176407 2575 flags.go:64] FLAG: --manifest-url="" Jul 20 16:29:33.316947 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176410 2575 flags.go:64] FLAG: --manifest-url-header="" Jul 20 16:29:33.316947 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176414 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 20 16:29:33.316947 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176417 2575 flags.go:64] FLAG: --max-open-files="1000000" Jul 20 16:29:33.316947 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176421 2575 flags.go:64] FLAG: --max-pods="110" Jul 20 16:29:33.316947 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176424 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 20 16:29:33.316947 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176427 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 20 16:29:33.316947 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176430 2575 flags.go:64] FLAG: --memory-manager-policy="None" Jul 20 16:29:33.316947 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176433 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 20 16:29:33.316947 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176436 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 20 16:29:33.316947 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176439 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 20 16:29:33.316947 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176442 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 20 16:29:33.316947 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176449 2575 flags.go:64] FLAG: --node-status-max-images="50" Jul 20 16:29:33.316947 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176452 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 20 16:29:33.316947 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176454 2575 flags.go:64] FLAG: --oom-score-adj="-999" Jul 20 16:29:33.316947 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176457 2575 flags.go:64] FLAG: --pod-cidr="" Jul 20 16:29:33.317711 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176462 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 20 16:29:33.317711 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176467 2575 flags.go:64] FLAG: --pod-manifest-path="" Jul 20 16:29:33.317711 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176471 2575 flags.go:64] FLAG: --pod-max-pids="-1" Jul 20 16:29:33.317711 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176474 2575 flags.go:64] FLAG: --pods-per-core="0" Jul 20 16:29:33.317711 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176477 2575 flags.go:64] FLAG: --port="10250" Jul 20 16:29:33.317711 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176480 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 20 16:29:33.317711 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176482 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-003e6c8924026662c" Jul 20 16:29:33.317711 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176485 2575 flags.go:64] FLAG: --qos-reserved="" Jul 20 16:29:33.317711 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176488 2575 flags.go:64] FLAG: --read-only-port="10255" Jul 20 16:29:33.317711 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176491 2575 flags.go:64] FLAG: --register-node="true" Jul 20 16:29:33.317711 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176494 2575 flags.go:64] FLAG: --register-with-taints="" Jul 20 16:29:33.317711 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176497 2575 flags.go:64] FLAG: --registry-burst="10" Jul 20 16:29:33.317711 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176501 2575 flags.go:64] FLAG: --registry-qps="5" Jul 20 16:29:33.317711 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176504 2575 flags.go:64] FLAG: --reserved-cpus="" Jul 20 16:29:33.317711 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176507 2575 flags.go:64] FLAG: --reserved-memory="" Jul 20 16:29:33.317711 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176510 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 20 16:29:33.317711 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176513 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 20 16:29:33.317711 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176516 2575 flags.go:64] FLAG: --rotate-certificates="false" Jul 20 16:29:33.317711 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176519 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 20 16:29:33.317711 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176521 2575 flags.go:64] FLAG: --runonce="false" Jul 20 16:29:33.317711 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176524 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 20 16:29:33.317711 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176527 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 20 16:29:33.317711 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176530 2575 flags.go:64] FLAG: --seccomp-default="false" Jul 20 16:29:33.317711 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176533 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 20 16:29:33.317711 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176536 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 20 16:29:33.318540 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176539 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 20 16:29:33.318540 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176541 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 20 16:29:33.318540 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176545 2575 flags.go:64] FLAG: --storage-driver-password="root" Jul 20 16:29:33.318540 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176547 2575 flags.go:64] FLAG: --storage-driver-secure="false" Jul 20 16:29:33.318540 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176550 2575 flags.go:64] FLAG: --storage-driver-table="stats" Jul 20 16:29:33.318540 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176553 2575 flags.go:64] FLAG: --storage-driver-user="root" Jul 20 16:29:33.318540 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176556 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 20 16:29:33.318540 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176560 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 20 16:29:33.318540 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176563 2575 flags.go:64] FLAG: --system-cgroups="" Jul 20 16:29:33.318540 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176567 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 20 16:29:33.318540 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176572 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 20 16:29:33.318540 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176575 2575 flags.go:64] FLAG: --tls-cert-file="" Jul 20 16:29:33.318540 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176578 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 20 16:29:33.318540 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176582 2575 flags.go:64] FLAG: --tls-min-version="" Jul 20 16:29:33.318540 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176585 2575 flags.go:64] FLAG: --tls-private-key-file="" Jul 20 16:29:33.318540 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176588 2575 flags.go:64] FLAG: --topology-manager-policy="none" Jul 20 16:29:33.318540 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176590 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 20 16:29:33.318540 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176594 2575 flags.go:64] FLAG: --topology-manager-scope="container" Jul 20 16:29:33.318540 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176596 2575 flags.go:64] FLAG: --v="2" Jul 20 16:29:33.318540 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176600 2575 flags.go:64] FLAG: --version="false" Jul 20 16:29:33.318540 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176605 2575 flags.go:64] FLAG: --vmodule="" Jul 20 16:29:33.318540 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176608 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 20 16:29:33.318540 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.176612 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 20 16:29:33.318540 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176729 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 16:29:33.319233 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176734 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 16:29:33.319233 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176737 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 16:29:33.319233 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176740 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 16:29:33.319233 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176742 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 16:29:33.319233 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176745 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 16:29:33.319233 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176748 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 16:29:33.319233 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176750 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 16:29:33.319233 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176753 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 16:29:33.319233 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176755 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 16:29:33.319233 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176758 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 16:29:33.319233 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176760 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 16:29:33.319233 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176763 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 16:29:33.319233 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176765 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 16:29:33.319233 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176767 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 16:29:33.319233 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176770 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 16:29:33.319233 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176774 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 16:29:33.319233 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176776 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 16:29:33.319233 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176780 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 16:29:33.319233 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176783 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 16:29:33.319233 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176786 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 16:29:33.319818 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176788 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 16:29:33.319818 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176791 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 16:29:33.319818 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176793 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 16:29:33.319818 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176796 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 16:29:33.319818 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176798 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 16:29:33.319818 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176801 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 16:29:33.319818 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176804 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 16:29:33.319818 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176806 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 16:29:33.319818 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176809 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 16:29:33.319818 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176817 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 16:29:33.319818 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176820 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 16:29:33.319818 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176823 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 16:29:33.319818 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176825 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 16:29:33.319818 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176828 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 16:29:33.319818 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176830 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 16:29:33.319818 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176833 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 16:29:33.319818 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176835 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 16:29:33.319818 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176838 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 16:29:33.319818 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176840 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 16:29:33.319818 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176842 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 16:29:33.320398 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176845 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 16:29:33.320398 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176848 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 16:29:33.320398 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176850 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 16:29:33.320398 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176852 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 16:29:33.320398 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176855 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 16:29:33.320398 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176858 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 16:29:33.320398 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176860 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 16:29:33.320398 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176864 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 16:29:33.320398 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176867 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 16:29:33.320398 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176870 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 16:29:33.320398 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176873 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 16:29:33.320398 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176875 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 16:29:33.320398 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176878 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 16:29:33.320398 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176881 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 16:29:33.320398 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176884 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 16:29:33.320398 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176886 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 16:29:33.320398 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176888 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 16:29:33.320398 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176891 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 20 16:29:33.320398 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176893 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 16:29:33.320398 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176896 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 16:29:33.320398 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176898 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 16:29:33.321003 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176901 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 16:29:33.321003 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176909 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 16:29:33.321003 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176912 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 16:29:33.321003 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176914 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 16:29:33.321003 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176917 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 16:29:33.321003 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176919 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 16:29:33.321003 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176922 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 16:29:33.321003 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176925 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 16:29:33.321003 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176927 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 16:29:33.321003 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176929 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 16:29:33.321003 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176932 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 16:29:33.321003 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176935 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 16:29:33.321003 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176937 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 16:29:33.321003 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176940 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 16:29:33.321003 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176942 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 16:29:33.321003 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176945 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 16:29:33.321003 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176947 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 16:29:33.321003 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176950 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 16:29:33.321003 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176953 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 16:29:33.321003 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176956 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 16:29:34.998821 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176961 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 16:29:34.998821 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176965 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 16:29:34.998821 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176968 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 16:29:34.998821 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176971 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 16:29:34.998821 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176974 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 16:29:34.998821 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176977 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 16:29:34.998821 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176980 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 16:29:34.998821 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176982 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 16:29:34.998821 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176985 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 16:29:34.998821 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176987 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 16:29:34.998821 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176990 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 16:29:34.998821 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176993 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 16:29:34.998821 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.176996 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 16:29:34.998821 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.177000 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 16:29:34.998821 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.177004 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 16:29:34.998821 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.177006 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 16:29:34.998821 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.177009 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 16:29:35.022384 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.177844 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 16:29:35.022384 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.184694 2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 20 16:29:35.022384 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.184710 2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 20 16:29:35.022384 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.184732 2575 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 20 16:29:35.022384 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.184742 2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 20 16:29:35.022384 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184797 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 16:29:35.022384 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184803 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 16:29:35.022384 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184806 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 16:29:35.022384 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184809 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 16:29:35.022384 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184812 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 16:29:35.022384 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184816 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 16:29:35.022384 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184819 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 16:29:35.022384 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184822 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 16:29:35.022384 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184824 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 16:29:35.022384 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184827 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 16:29:35.023040 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184830 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 16:29:35.023040 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184833 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 16:29:35.023040 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184835 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 16:29:35.023040 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184838 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 16:29:35.023040 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184841 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 16:29:35.023040 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184843 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 16:29:35.023040 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184846 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 16:29:35.023040 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184848 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 16:29:35.023040 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184851 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 16:29:35.023040 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184853 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 16:29:35.023040 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184856 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 16:29:35.023040 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184859 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 16:29:35.023040 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184862 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 16:29:35.023040 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184864 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 16:29:35.023040 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184867 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 16:29:35.023040 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184870 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 16:29:35.023040 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184873 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 16:29:35.023040 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184875 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 16:29:35.023040 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184878 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 16:29:35.023040 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184881 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 16:29:35.023714 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184884 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 16:29:35.023714 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184886 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 16:29:35.023714 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184889 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 16:29:35.023714 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184891 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 16:29:35.023714 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184894 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 16:29:35.023714 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184897 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 16:29:35.023714 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184899 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 16:29:35.023714 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184902 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 16:29:35.023714 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184904 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 16:29:35.023714 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184907 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 16:29:35.023714 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184910 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 16:29:35.023714 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184912 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 16:29:35.023714 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184916 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 16:29:35.023714 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184920 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 16:29:35.023714 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184922 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 16:29:35.023714 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184925 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 16:29:35.023714 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184928 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 16:29:35.023714 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184931 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 16:29:35.023714 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184933 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 16:29:35.025169 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184936 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 16:29:35.025169 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184938 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 16:29:35.025169 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184941 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 16:29:35.025169 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184943 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 16:29:35.025169 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184946 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 16:29:35.025169 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184949 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 16:29:35.025169 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184952 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 16:29:35.025169 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184954 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 16:29:35.025169 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184957 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 16:29:35.025169 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184960 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 16:29:35.025169 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184962 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 16:29:35.025169 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184965 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 16:29:35.025169 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184967 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 16:29:35.025169 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184970 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 16:29:35.025169 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184973 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 16:29:35.025169 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184977 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 16:29:35.025169 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184981 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 16:29:35.025169 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184984 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 16:29:35.025169 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184987 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 16:29:35.025722 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184991 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 16:29:35.025722 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184994 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 16:29:35.025722 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184996 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 16:29:35.025722 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.184999 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 16:29:35.025722 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185002 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 16:29:35.025722 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185005 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 16:29:35.025722 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185008 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 16:29:35.025722 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185010 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 16:29:35.025722 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185013 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 16:29:35.025722 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185015 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 20 16:29:35.025722 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185018 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 16:29:35.025722 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185021 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 16:29:35.025722 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185036 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 16:29:35.025722 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185039 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 16:29:35.025722 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185042 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 16:29:35.025722 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185045 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 16:29:35.025722 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185049 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 16:29:35.025722 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185053 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 16:29:35.025722 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185056 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 16:29:35.025722 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185059 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 16:29:35.026383 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185062 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 16:29:35.026383 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185065 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 16:29:35.026383 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185068 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 16:29:35.026383 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185071 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 16:29:35.026383 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185074 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 16:29:35.026383 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185077 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 16:29:35.026383 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185079 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 16:29:35.026383 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185083 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 16:29:35.026383 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185085 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 16:29:35.026383 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185088 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 16:29:35.026383 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185091 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 16:29:35.026383 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.185096 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 16:29:35.026383 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185212 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 16:29:35.026383 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185218 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 16:29:35.026809 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185222 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 16:29:35.026809 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185226 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 16:29:35.026809 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185230 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 16:29:35.026809 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185233 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 16:29:35.026809 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185236 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 16:29:35.026809 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185239 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 20 16:29:35.026809 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185242 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 16:29:35.026809 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185244 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 16:29:35.026809 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185248 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 16:29:35.026809 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185250 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 16:29:35.026809 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185253 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 16:29:35.026809 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185256 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 16:29:35.026809 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185258 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 16:29:35.026809 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185261 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 16:29:35.026809 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185263 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 16:29:35.026809 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185268 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 16:29:35.026809 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185271 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 16:29:35.026809 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185276 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 16:29:35.026809 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185279 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 16:29:35.026809 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185281 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 16:29:35.028035 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185285 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 16:29:35.028035 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185289 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 16:29:35.028035 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185292 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 16:29:35.028035 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185294 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 16:29:35.028035 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185297 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 16:29:35.028035 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185300 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 16:29:35.028035 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185306 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 16:29:35.028035 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185309 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 16:29:35.028035 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185312 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 16:29:35.028035 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185314 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 16:29:35.028035 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185317 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 16:29:35.028035 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185320 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 16:29:35.028035 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185322 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 16:29:35.028035 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185325 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 16:29:35.028035 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185327 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 16:29:35.028035 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185330 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 16:29:35.028035 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185332 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 16:29:35.028035 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185335 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 16:29:35.028035 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185337 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 16:29:35.028035 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185340 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 16:29:35.028822 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185342 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 16:29:35.028822 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185345 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 16:29:35.028822 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185347 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 16:29:35.028822 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185350 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 16:29:35.028822 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185352 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 16:29:35.028822 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185355 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 16:29:35.028822 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185357 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 16:29:35.028822 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185362 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 16:29:35.028822 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185364 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 16:29:35.028822 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185368 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 16:29:35.028822 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185371 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 16:29:35.028822 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185373 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 16:29:35.028822 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185376 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 16:29:35.028822 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185378 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 16:29:35.028822 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185381 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 16:29:35.028822 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185383 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 16:29:35.028822 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185386 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 16:29:35.028822 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185388 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 16:29:35.028822 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185391 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 16:29:35.028822 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185394 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 16:29:35.030395 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185396 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 16:29:35.030395 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185399 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 16:29:35.030395 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185401 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 16:29:35.030395 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185403 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 16:29:35.030395 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185406 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 16:29:35.030395 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185408 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 16:29:35.030395 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185411 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 16:29:35.030395 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185413 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 16:29:35.030395 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185416 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 16:29:35.030395 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185418 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 16:29:35.030395 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185421 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 16:29:35.030395 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185423 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 16:29:35.030395 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185426 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 16:29:35.030395 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185428 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 16:29:35.030395 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185431 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 16:29:35.030395 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185433 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 16:29:35.030395 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185435 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 16:29:35.030395 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185438 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 16:29:35.030395 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185440 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 16:29:35.030395 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185444 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 16:29:35.030970 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185447 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 16:29:35.030970 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185450 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 16:29:35.030970 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185452 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 16:29:35.030970 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185455 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 16:29:35.030970 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185458 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 16:29:35.030970 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185460 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 16:29:35.030970 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185463 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 16:29:35.030970 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185465 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 16:29:35.030970 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185468 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 16:29:35.030970 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185470 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 16:29:35.030970 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185473 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 16:29:35.030970 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185476 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 16:29:35.030970 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185478 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 16:29:35.030970 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185481 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 16:29:35.030970 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185483 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 16:29:35.030970 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185486 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 16:29:35.030970 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:33.185488 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 16:29:35.031689 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.185493 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 16:29:35.031689 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.185602 2575 server.go:962] "Client rotation is on, will bootstrap in background" Jul 20 16:29:35.031689 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.187451 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 20 16:29:35.031689 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.188713 2575 server.go:1019] "Starting client certificate rotation" Jul 20 16:29:35.031689 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.188813 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 20 16:29:35.031689 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.188844 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 20 16:29:35.031689 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.191761 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 20 16:29:35.031689 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.196781 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 20 16:29:35.031689 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.208547 2575 log.go:25] "Validated CRI v1 runtime API" Jul 20 16:29:35.031689 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.210722 2575 log.go:25] "Validated CRI v1 image API" Jul 20 16:29:35.031689 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.212132 2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 20 16:29:35.031689 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.215148 2575 fs.go:135] Filesystem UUIDs: map[10c7ee53-8e6d-42eb-a9df-7ea93c7ab3fd:/dev/nvme0n1p4 529ead5d-4478-4c4d-95ea-7662b3989cc8:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 20 16:29:35.230539 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.215166 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 20 16:29:35.230539 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.216179 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 20 16:29:35.230962 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.219559 2575 manager.go:216] Machine: {Timestamp:2026-07-20 16:29:33.219087164 +0000 UTC m=+0.365028006 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3120444 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d76e74d69678ca684d2e4410e4ab0 SystemUUID:ec2d76e7-4d69-678c-a684-d2e4410e4ab0 BootID:8f213cd4-334d-48d0-8db6-d1f900f9dc15 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:9a:b3:3d:3d:41 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:9a:b3:3d:3d:41 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6a:c3:55:30:63:18 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 20 16:29:35.230962 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.219660 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 20 16:29:35.230962 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.219742 2575 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 20 16:29:35.230962 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.220723 2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 20 16:29:35.230962 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.220746 2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-157.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 20 16:29:35.230962 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.221990 2575 topology_manager.go:138] "Creating topology manager with none policy" Jul 20 16:29:35.230962 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.222001 2575 container_manager_linux.go:309] "Creating device plugin manager" Jul 20 16:29:35.230962 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.222009 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 20 16:29:35.230962 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.222020 2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 20 16:29:35.230962 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.223255 2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 20 16:29:35.230962 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.226782 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 20 16:29:35.230962 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.226898 2575 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 20 16:29:35.230962 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.226925 2575 kubelet.go:486] "Attempting to sync node with API server" Jul 20 16:29:35.230962 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.226934 2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 20 16:29:35.230962 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.226952 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 20 16:29:35.230962 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.226963 2575 kubelet.go:398] "Adding apiserver pod source" Jul 20 16:29:35.230962 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.226977 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 20 16:29:35.230962 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.227340 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.227361 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.229760 2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.233354 2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.233399 2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.234384 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.234398 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.234405 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.234410 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.234418 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.234423 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.234431 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.234436 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.234443 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.234448 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.234456 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.234462 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.235097 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.235104 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.238265 2575 server.go:1268] "Started kubelet" Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.238355 2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.238429 2575 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:33.238690 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-157.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:33.238691 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.238838 2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-157.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.238866 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.239935 2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.240019 2575 server.go:310] "Adding debug handlers to kubelet server" Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:33.243441 2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:33.246280 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-157.ec2.internal.18c40c635c783bdb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-157.ec2.internal,UID:ip-10-0-133-157.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-157.ec2.internal,},FirstTimestamp:2026-07-20 16:29:33.238238171 +0000 UTC m=+0.384179006,LastTimestamp:2026-07-20 16:29:33.238238171 +0000 UTC m=+0.384179006,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-157.ec2.internal,}" Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.249443 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.249455 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:33.249513 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-157.ec2.internal\" not found" Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.249947 2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.249951 2575 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.249972 2575 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.250309 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.250324 2575 factory.go:55] Registering systemd factory Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.250333 2575 factory.go:223] Registration of the systemd container factory successfully Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.250561 2575 factory.go:153] Registering CRI-O factory Jul 20 16:29:35.231799 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.250576 2575 factory.go:223] Registration of the crio container factory successfully Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.250599 2575 factory.go:103] Registering Raw factory Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.250658 2575 manager.go:1196] Started watching for new ooms in manager Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.251014 2575 reconstruct.go:97] "Volume reconstruction finished" Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.251040 2575 reconciler.go:29] "Reconciler: start to sync state" Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.251241 2575 manager.go:349] Starting recovery of all containers Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:33.256929 2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-157.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:33.257060 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.261046 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kbttp" Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.268200 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kbttp" Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.268701 2575 manager.go:354] Recovery completed Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.273617 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.275358 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-157.ec2.internal" event="NodeHasSufficientMemory" Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.275389 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-157.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.275400 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-157.ec2.internal" event="NodeHasSufficientPID" Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.275999 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.275993 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.276013 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.276042 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.276661 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-157.ec2.internal" event="NodeHasSufficientMemory" Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.276684 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-157.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.276693 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-157.ec2.internal" event="NodeHasSufficientPID" Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:33.277355 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-157.ec2.internal.18c40c635eaeda41 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-157.ec2.internal,UID:ip-10-0-133-157.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-157.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-157.ec2.internal,},FirstTimestamp:2026-07-20 16:29:33.275372097 +0000 UTC m=+0.421312941,LastTimestamp:2026-07-20 16:29:33.275372097 +0000 UTC m=+0.421312941,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-157.ec2.internal,}" Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.277903 2575 policy_none.go:49] "None policy: Start" Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.277920 2575 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.277931 2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.279759 2575 policy_none.go:47] "Start" Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.325563 2575 manager.go:337] "Starting Device Plugin manager" Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:33.325712 2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.325722 2575 server.go:87] "Starting device plugin registration server" Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.325960 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.325970 2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.326080 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.326173 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.326184 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:33.326688 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:33.326732 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-157.ec2.internal\" not found" Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.350622 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.351792 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.351829 2575 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.351847 2575 kubelet.go:2448] "Starting kubelet main sync loop" Jul 20 16:29:35.232938 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:33.351885 2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 20 16:29:35.234312 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:33.353861 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 16:29:35.234312 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:34.921943 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 16:29:35.234312 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:34.922952 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-157.ec2.internal" event="NodeHasSufficientMemory" Jul 20 16:29:35.234312 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:34.922980 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-157.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 16:29:35.234312 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:34.922992 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-157.ec2.internal" event="NodeHasSufficientPID" Jul 20 16:29:35.234312 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:34.923035 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-157.ec2.internal" Jul 20 16:29:35.234312 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:34.933731 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-157.ec2.internal" Jul 20 16:29:35.234312 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:34.933752 2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-157.ec2.internal\": node \"ip-10-0-133-157.ec2.internal\" not found" Jul 20 16:29:35.234312 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:34.947870 2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-157.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-157.ec2.internal"] Jul 20 16:29:35.234312 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:34.947931 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 16:29:35.234312 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:34.948680 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-157.ec2.internal" event="NodeHasSufficientMemory" Jul 20 16:29:35.234312 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:34.948705 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-157.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 16:29:35.234312 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:34.948714 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-157.ec2.internal" event="NodeHasSufficientPID" Jul 20 16:29:35.234312 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:34.950810 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 16:29:35.234312 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:34.950930 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-157.ec2.internal" Jul 20 16:29:35.234312 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:34.950971 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 16:29:35.234312 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:34.951459 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-157.ec2.internal" event="NodeHasSufficientMemory" Jul 20 16:29:35.234312 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:34.951478 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-157.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 16:29:35.234312 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:34.951490 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-157.ec2.internal" event="NodeHasSufficientPID" Jul 20 16:29:35.234312 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:34.952030 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-157.ec2.internal" event="NodeHasSufficientMemory" Jul 20 16:29:35.234312 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:34.952057 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-157.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 16:29:35.234312 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:34.952071 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-157.ec2.internal" event="NodeHasSufficientPID" Jul 20 16:29:35.234312 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:34.953464 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-157.ec2.internal" Jul 20 16:29:35.234312 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:34.953488 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 16:29:35.234312 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:34.954419 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-157.ec2.internal" event="NodeHasSufficientMemory" Jul 20 16:29:35.234312 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:34.954450 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-157.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 16:29:35.234312 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:34.954468 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-157.ec2.internal" event="NodeHasSufficientPID" Jul 20 16:29:35.234312 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:34.962304 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-157.ec2.internal\" not found" Jul 20 16:29:35.234312 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:34.988665 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-157.ec2.internal\" not found" node="ip-10-0-133-157.ec2.internal" Jul 20 16:29:35.234312 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:34.993003 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-157.ec2.internal\" not found" node="ip-10-0-133-157.ec2.internal" Jul 20 16:29:35.234312 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:35.048819 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/712c64cf1d9c1af507f39dac3e30cbe7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-157.ec2.internal\" (UID: \"712c64cf1d9c1af507f39dac3e30cbe7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-157.ec2.internal" Jul 20 16:29:35.234312 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:35.048848 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/712c64cf1d9c1af507f39dac3e30cbe7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-157.ec2.internal\" (UID: \"712c64cf1d9c1af507f39dac3e30cbe7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-157.ec2.internal" Jul 20 16:29:35.234312 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:35.048866 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b50f7e977174ad9e7171a45678a56bb-config\") pod \"kube-apiserver-proxy-ip-10-0-133-157.ec2.internal\" (UID: \"8b50f7e977174ad9e7171a45678a56bb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-157.ec2.internal" Jul 20 16:29:35.235231 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:35.063046 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-157.ec2.internal\" not found" Jul 20 16:29:35.235231 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:35.149588 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/712c64cf1d9c1af507f39dac3e30cbe7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-157.ec2.internal\" (UID: \"712c64cf1d9c1af507f39dac3e30cbe7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-157.ec2.internal" Jul 20 16:29:35.235231 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:35.149618 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/712c64cf1d9c1af507f39dac3e30cbe7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-157.ec2.internal\" (UID: \"712c64cf1d9c1af507f39dac3e30cbe7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-157.ec2.internal" Jul 20 16:29:35.235231 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:35.149635 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b50f7e977174ad9e7171a45678a56bb-config\") pod \"kube-apiserver-proxy-ip-10-0-133-157.ec2.internal\" (UID: \"8b50f7e977174ad9e7171a45678a56bb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-157.ec2.internal" Jul 20 16:29:35.235231 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:35.149671 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b50f7e977174ad9e7171a45678a56bb-config\") pod \"kube-apiserver-proxy-ip-10-0-133-157.ec2.internal\" (UID: \"8b50f7e977174ad9e7171a45678a56bb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-157.ec2.internal" Jul 20 16:29:35.235231 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:35.149685 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/712c64cf1d9c1af507f39dac3e30cbe7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-157.ec2.internal\" (UID: \"712c64cf1d9c1af507f39dac3e30cbe7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-157.ec2.internal" Jul 20 16:29:35.235231 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:35.149696 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/712c64cf1d9c1af507f39dac3e30cbe7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-157.ec2.internal\" (UID: \"712c64cf1d9c1af507f39dac3e30cbe7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-157.ec2.internal" Jul 20 16:29:35.235231 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:35.163669 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-157.ec2.internal\" not found" Jul 20 16:29:35.438295 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:35.264408 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-157.ec2.internal\" not found" Jul 20 16:29:35.438295 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:35.292612 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-157.ec2.internal" Jul 20 16:29:35.438295 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:35.295791 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-157.ec2.internal" Jul 20 16:29:35.438295 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:35.364797 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-157.ec2.internal\" not found" Jul 20 16:29:35.632316 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:35.465403 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-157.ec2.internal\" not found" Jul 20 16:29:35.632316 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:35.565844 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-157.ec2.internal\" not found" Jul 20 16:29:35.815291 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:35.666333 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-157.ec2.internal\" not found" Jul 20 16:29:35.815291 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:35.683493 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 20 16:29:35.815291 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:35.683616 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 20 16:29:35.815291 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:35.767373 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-157.ec2.internal\" not found" Jul 20 16:29:35.815291 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:35.767388 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 16:24:34 +0000 UTC" deadline="2028-04-23 20:18:46.979097454 +0000 UTC" Jul 20 16:29:35.815291 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:35.767416 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15435h49m11.211684605s" Jul 20 16:29:36.008608 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:35.868029 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-157.ec2.internal\" not found" Jul 20 16:29:36.008608 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:35.892810 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 16:29:36.008608 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:35.935367 2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 16:29:36.008608 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:35.968886 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-157.ec2.internal\" not found" Jul 20 16:29:36.069176 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:36.069150 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-157.ec2.internal\" not found" Jul 20 16:29:36.169681 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:36.169640 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-157.ec2.internal\" not found" Jul 20 16:29:36.270500 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:36.270429 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-157.ec2.internal\" not found" Jul 20 16:29:36.294163 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.294135 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 16:29:36.317890 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:36.317854 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b50f7e977174ad9e7171a45678a56bb.slice/crio-69ddc20234cfa297c340c3fced14f70b0f7b6e3cac37cc8b6d69c784ad8c8a95 WatchSource:0}: Error finding container 69ddc20234cfa297c340c3fced14f70b0f7b6e3cac37cc8b6d69c784ad8c8a95: Status 404 returned error can't find the container with id 69ddc20234cfa297c340c3fced14f70b0f7b6e3cac37cc8b6d69c784ad8c8a95 Jul 20 16:29:36.321674 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.321658 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 16:29:36.345112 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.345069 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-157.ec2.internal" Jul 20 16:29:36.355664 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.355643 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 20 16:29:36.356738 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.356726 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-157.ec2.internal" Jul 20 16:29:36.363367 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.363352 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 20 16:29:36.673097 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.673000 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 16:29:36.723543 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.723506 2575 apiserver.go:52] "Watching apiserver" Jul 20 16:29:36.730602 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.730568 2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 20 16:29:36.730951 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.730928 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-wnqv5","openshift-network-operator/iptables-alerter-5wqdx","openshift-ovn-kubernetes/ovnkube-node-s5dt7","kube-system/global-pull-secret-syncer-bpbjs","kube-system/konnectivity-agent-r7vpx","openshift-image-registry/node-ca-m275f","openshift-multus/multus-845hr","openshift-multus/multus-additional-cni-plugins-htg96","openshift-network-diagnostics/network-check-target-z8hpf","kube-system/kube-apiserver-proxy-ip-10-0-133-157.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4qcp","openshift-cluster-node-tuning-operator/tuned-ckf7n","openshift-dns/node-resolver-kh6zc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-157.ec2.internal"] Jul 20 16:29:36.734745 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.734721 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-845hr" Jul 20 16:29:36.736857 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.736838 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kh6zc" Jul 20 16:29:36.737259 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.737242 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 20 16:29:36.737372 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.737352 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vfjp6\"" Jul 20 16:29:36.737475 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.737380 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 20 16:29:36.737638 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.737622 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 20 16:29:36.737678 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.737652 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 20 16:29:36.738950 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.738929 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpbjs" Jul 20 16:29:36.739072 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.739010 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 20 16:29:36.739072 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:36.739039 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bpbjs" podUID="e60cf0cf-f42e-4d8c-a1be-977d5eab29ef" Jul 20 16:29:36.739259 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.739221 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 20 16:29:36.739362 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.739344 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6lrf6\"" Jul 20 16:29:36.741118 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.741101 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnqv5" Jul 20 16:29:36.741205 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:36.741161 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnqv5" podUID="e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d" Jul 20 16:29:36.743457 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.743433 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r7vpx" Jul 20 16:29:36.744843 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.744829 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 20 16:29:36.745535 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.745520 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m275f" Jul 20 16:29:36.746590 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.746573 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 20 16:29:36.746590 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.746583 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-clxcx\"" Jul 20 16:29:36.746749 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.746578 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 20 16:29:36.747775 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.747756 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4x88t\"" Jul 20 16:29:36.747862 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.747821 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 20 16:29:36.747911 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.747879 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 20 16:29:36.747911 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.747762 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 20 16:29:36.748137 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.748116 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.750215 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.750200 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-htg96" Jul 20 16:29:36.750465 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.750352 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 20 16:29:36.750648 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.750629 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 20 16:29:36.750940 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.750924 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 20 16:29:36.750991 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.750943 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 20 16:29:36.751731 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.751714 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 20 16:29:36.751813 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.751750 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-thc65\"" Jul 20 16:29:36.751813 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.751758 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 20 16:29:36.752596 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.752561 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 20 16:29:36.752714 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.752629 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pwqdw\"" Jul 20 16:29:36.752816 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.752566 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 20 16:29:36.753764 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.753476 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8hpf" Jul 20 16:29:36.753764 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:36.753553 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8hpf" podUID="321c627e-8b07-4734-8de1-561625eb34fd" Jul 20 16:29:36.756359 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.756342 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4qcp" Jul 20 16:29:36.757043 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.757027 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 20 16:29:36.758673 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.758655 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-etc-kubernetes\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.758757 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.758680 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7377db3f-fd05-4a8f-9ac0-35a3245062da-hosts-file\") pod \"node-resolver-kh6zc\" (UID: \"7377db3f-fd05-4a8f-9ac0-35a3245062da\") " pod="openshift-dns/node-resolver-kh6zc" Jul 20 16:29:36.758757 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.758698 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-multus-socket-dir-parent\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.758757 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.758713 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-host-var-lib-cni-bin\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.758757 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.758742 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whmnn\" (UniqueName: \"kubernetes.io/projected/9012df24-f877-4d10-8de5-feb1070f5421-kube-api-access-whmnn\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.758927 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.758761 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/846c8111-559c-4131-a066-2c2338f37da7-konnectivity-ca\") pod \"konnectivity-agent-r7vpx\" (UID: \"846c8111-559c-4131-a066-2c2338f37da7\") " pod="kube-system/konnectivity-agent-r7vpx" Jul 20 16:29:36.758927 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.758775 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-multus-cni-dir\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.758927 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.758789 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-host-run-netns\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.758927 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.758811 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t24dw\" (UniqueName: \"kubernetes.io/projected/e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d-kube-api-access-t24dw\") pod \"network-metrics-daemon-wnqv5\" (UID: \"e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d\") " pod="openshift-multus/network-metrics-daemon-wnqv5" Jul 20 16:29:36.758927 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.758852 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-system-cni-dir\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.758927 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.758875 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-host-var-lib-kubelet\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.758927 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.758894 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e60cf0cf-f42e-4d8c-a1be-977d5eab29ef-kubelet-config\") pod \"global-pull-secret-syncer-bpbjs\" (UID: \"e60cf0cf-f42e-4d8c-a1be-977d5eab29ef\") " pod="kube-system/global-pull-secret-syncer-bpbjs" Jul 20 16:29:36.758927 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.758919 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e60cf0cf-f42e-4d8c-a1be-977d5eab29ef-dbus\") pod \"global-pull-secret-syncer-bpbjs\" (UID: \"e60cf0cf-f42e-4d8c-a1be-977d5eab29ef\") " pod="kube-system/global-pull-secret-syncer-bpbjs" Jul 20 16:29:36.759318 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.758936 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.759318 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.758952 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgz8g\" (UniqueName: \"kubernetes.io/projected/4f85b138-a3e7-4242-be3e-1a237173570a-kube-api-access-rgz8g\") pod \"node-ca-m275f\" (UID: \"4f85b138-a3e7-4242-be3e-1a237173570a\") " pod="openshift-image-registry/node-ca-m275f" Jul 20 16:29:36.759318 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.758987 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-cnibin\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.759318 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.759009 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9012df24-f877-4d10-8de5-feb1070f5421-cni-binary-copy\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.759318 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.759031 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-host-run-k8s-cni-cncf-io\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.759318 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.759053 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-host-var-lib-cni-multus\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.759318 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.759074 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmkvm\" (UniqueName: \"kubernetes.io/projected/7377db3f-fd05-4a8f-9ac0-35a3245062da-kube-api-access-wmkvm\") pod \"node-resolver-kh6zc\" (UID: \"7377db3f-fd05-4a8f-9ac0-35a3245062da\") " pod="openshift-dns/node-resolver-kh6zc" Jul 20 16:29:36.759318 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.759113 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e60cf0cf-f42e-4d8c-a1be-977d5eab29ef-original-pull-secret\") pod \"global-pull-secret-syncer-bpbjs\" (UID: \"e60cf0cf-f42e-4d8c-a1be-977d5eab29ef\") " pod="kube-system/global-pull-secret-syncer-bpbjs" Jul 20 16:29:36.759318 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.759148 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4f85b138-a3e7-4242-be3e-1a237173570a-serviceca\") pod \"node-ca-m275f\" (UID: \"4f85b138-a3e7-4242-be3e-1a237173570a\") " pod="openshift-image-registry/node-ca-m275f" Jul 20 16:29:36.759318 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.759183 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-os-release\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.759318 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.759210 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-multus-conf-dir\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.759318 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.759231 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7377db3f-fd05-4a8f-9ac0-35a3245062da-tmp-dir\") pod \"node-resolver-kh6zc\" (UID: \"7377db3f-fd05-4a8f-9ac0-35a3245062da\") " pod="openshift-dns/node-resolver-kh6zc" Jul 20 16:29:36.759318 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.759255 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-hostroot\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.759318 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.759277 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9012df24-f877-4d10-8de5-feb1070f5421-multus-daemon-config\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.759318 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.759299 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d-metrics-certs\") pod \"network-metrics-daemon-wnqv5\" (UID: \"e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d\") " pod="openshift-multus/network-metrics-daemon-wnqv5" Jul 20 16:29:36.759318 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.759322 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4f85b138-a3e7-4242-be3e-1a237173570a-host\") pod \"node-ca-m275f\" (UID: \"4f85b138-a3e7-4242-be3e-1a237173570a\") " pod="openshift-image-registry/node-ca-m275f" Jul 20 16:29:36.759800 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.759355 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-host-run-multus-certs\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.759800 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.759373 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/846c8111-559c-4131-a066-2c2338f37da7-agent-certs\") pod \"konnectivity-agent-r7vpx\" (UID: \"846c8111-559c-4131-a066-2c2338f37da7\") " pod="kube-system/konnectivity-agent-r7vpx" Jul 20 16:29:36.759800 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.759375 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 20 16:29:36.760196 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.760174 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 20 16:29:36.760288 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.760205 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6xlqj\"" Jul 20 16:29:36.760288 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.760218 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 20 16:29:36.761197 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.761182 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5wqdx" Jul 20 16:29:36.761355 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.761341 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 20 16:29:36.761949 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.761933 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 20 16:29:36.762055 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.762040 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-922wt\"" Jul 20 16:29:36.763078 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.763062 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 20 16:29:36.763617 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.763601 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 20 16:29:36.763787 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.763772 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-27h4q\"" Jul 20 16:29:36.763833 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.763775 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 20 16:29:36.780929 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.780911 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wmtlt" Jul 20 16:29:36.788556 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.788540 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wmtlt" Jul 20 16:29:36.845997 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.845961 2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 20 16:29:36.851026 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.850981 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-157.ec2.internal" event={"ID":"8b50f7e977174ad9e7171a45678a56bb","Type":"ContainerStarted","Data":"69ddc20234cfa297c340c3fced14f70b0f7b6e3cac37cc8b6d69c784ad8c8a95"} Jul 20 16:29:36.851980 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.851957 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-157.ec2.internal" event={"ID":"712c64cf1d9c1af507f39dac3e30cbe7","Type":"ContainerStarted","Data":"4b1af1e2155d5eaece891a8889c47240c97d8f4625fbe5dd2426a00a50591cec"} Jul 20 16:29:36.859940 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.859923 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-host-run-netns\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.860005 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.859951 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d6d9a721-1745-4dcd-be6c-0698d368f5a9-sys-fs\") pod \"aws-ebs-csi-driver-node-h4qcp\" (UID: \"d6d9a721-1745-4dcd-be6c-0698d368f5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4qcp" Jul 20 16:29:36.860005 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.859966 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-host-cni-bin\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.860005 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860000 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/70dd6078-d12c-4b47-aa03-fb96213c188b-var-lib-kubelet\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.860111 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860027 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-host-run-netns\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.860111 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860079 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-host-var-lib-kubelet\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.860177 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860118 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-host-var-lib-kubelet\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.860177 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860145 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e60cf0cf-f42e-4d8c-a1be-977d5eab29ef-dbus\") pod \"global-pull-secret-syncer-bpbjs\" (UID: \"e60cf0cf-f42e-4d8c-a1be-977d5eab29ef\") " pod="kube-system/global-pull-secret-syncer-bpbjs" Jul 20 16:29:36.860250 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860175 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgz8g\" (UniqueName: \"kubernetes.io/projected/4f85b138-a3e7-4242-be3e-1a237173570a-kube-api-access-rgz8g\") pod \"node-ca-m275f\" (UID: \"4f85b138-a3e7-4242-be3e-1a237173570a\") " pod="openshift-image-registry/node-ca-m275f" Jul 20 16:29:36.860250 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860220 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d6d9a721-1745-4dcd-be6c-0698d368f5a9-device-dir\") pod \"aws-ebs-csi-driver-node-h4qcp\" (UID: \"d6d9a721-1745-4dcd-be6c-0698d368f5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4qcp" Jul 20 16:29:36.860341 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860298 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e60cf0cf-f42e-4d8c-a1be-977d5eab29ef-dbus\") pod \"global-pull-secret-syncer-bpbjs\" (UID: \"e60cf0cf-f42e-4d8c-a1be-977d5eab29ef\") " pod="kube-system/global-pull-secret-syncer-bpbjs" Jul 20 16:29:36.860341 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860322 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a28546f7-4091-4291-aeaa-12fee18311ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-htg96\" (UID: \"a28546f7-4091-4291-aeaa-12fee18311ca\") " pod="openshift-multus/multus-additional-cni-plugins-htg96" Jul 20 16:29:36.860432 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860341 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-cnibin\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.860432 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860356 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-host-var-lib-cni-multus\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.860432 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860373 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmkvm\" (UniqueName: \"kubernetes.io/projected/7377db3f-fd05-4a8f-9ac0-35a3245062da-kube-api-access-wmkvm\") pod \"node-resolver-kh6zc\" (UID: \"7377db3f-fd05-4a8f-9ac0-35a3245062da\") " pod="openshift-dns/node-resolver-kh6zc" Jul 20 16:29:36.860432 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860389 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70dd6078-d12c-4b47-aa03-fb96213c188b-etc-kubernetes\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.860432 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860399 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-cnibin\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.860432 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860422 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-host-var-lib-cni-multus\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.860432 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860410 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-run-openvswitch\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.860714 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860457 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-host-cni-netd\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.860714 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860479 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.860714 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860511 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-ovn-node-metrics-cert\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.860714 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860540 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/70dd6078-d12c-4b47-aa03-fb96213c188b-etc-tuned\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.860714 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860574 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-os-release\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.860714 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860589 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-multus-conf-dir\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.860714 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860627 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7377db3f-fd05-4a8f-9ac0-35a3245062da-tmp-dir\") pod \"node-resolver-kh6zc\" (UID: \"7377db3f-fd05-4a8f-9ac0-35a3245062da\") " pod="openshift-dns/node-resolver-kh6zc" Jul 20 16:29:36.860714 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860644 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/70dd6078-d12c-4b47-aa03-fb96213c188b-etc-sysconfig\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.860714 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860665 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-host-slash\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.860714 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860681 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-node-log\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.860714 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860706 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-host-run-ovn-kubernetes\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.861266 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860729 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-hostroot\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.861266 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860770 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9012df24-f877-4d10-8de5-feb1070f5421-multus-daemon-config\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.861266 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860793 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d6d9a721-1745-4dcd-be6c-0698d368f5a9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h4qcp\" (UID: \"d6d9a721-1745-4dcd-be6c-0698d368f5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4qcp" Jul 20 16:29:36.861266 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860806 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-os-release\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.861266 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860817 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a28546f7-4091-4291-aeaa-12fee18311ca-cnibin\") pod \"multus-additional-cni-plugins-htg96\" (UID: \"a28546f7-4091-4291-aeaa-12fee18311ca\") " pod="openshift-multus/multus-additional-cni-plugins-htg96" Jul 20 16:29:36.861266 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860858 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-hostroot\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.861266 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860880 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-host-run-multus-certs\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.861266 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860925 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/70dd6078-d12c-4b47-aa03-fb96213c188b-etc-modprobe-d\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.861266 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860978 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/70dd6078-d12c-4b47-aa03-fb96213c188b-etc-sysctl-d\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.861266 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860983 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7377db3f-fd05-4a8f-9ac0-35a3245062da-tmp-dir\") pod \"node-resolver-kh6zc\" (UID: \"7377db3f-fd05-4a8f-9ac0-35a3245062da\") " pod="openshift-dns/node-resolver-kh6zc" Jul 20 16:29:36.861266 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.861031 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a28546f7-4091-4291-aeaa-12fee18311ca-system-cni-dir\") pod \"multus-additional-cni-plugins-htg96\" (UID: \"a28546f7-4091-4291-aeaa-12fee18311ca\") " pod="openshift-multus/multus-additional-cni-plugins-htg96" Jul 20 16:29:36.861266 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.861056 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a28546f7-4091-4291-aeaa-12fee18311ca-os-release\") pod \"multus-additional-cni-plugins-htg96\" (UID: \"a28546f7-4091-4291-aeaa-12fee18311ca\") " pod="openshift-multus/multus-additional-cni-plugins-htg96" Jul 20 16:29:36.861266 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.861095 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/70dd6078-d12c-4b47-aa03-fb96213c188b-etc-systemd\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.861266 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.860674 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-multus-conf-dir\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.861266 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.861158 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-host-run-multus-certs\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.861692 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.861607 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9012df24-f877-4d10-8de5-feb1070f5421-multus-daemon-config\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.861692 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.861609 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-host-run-netns\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.861692 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.861665 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a28546f7-4091-4291-aeaa-12fee18311ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-htg96\" (UID: \"a28546f7-4091-4291-aeaa-12fee18311ca\") " pod="openshift-multus/multus-additional-cni-plugins-htg96" Jul 20 16:29:36.861692 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.861686 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-multus-socket-dir-parent\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.861806 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.861709 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-host-var-lib-cni-bin\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.861806 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.861746 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whmnn\" (UniqueName: \"kubernetes.io/projected/9012df24-f877-4d10-8de5-feb1070f5421-kube-api-access-whmnn\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.861806 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.861757 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-multus-socket-dir-parent\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.861806 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.861783 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-host-var-lib-cni-bin\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.861938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.861810 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp42p\" (UniqueName: \"kubernetes.io/projected/d6d9a721-1745-4dcd-be6c-0698d368f5a9-kube-api-access-cp42p\") pod \"aws-ebs-csi-driver-node-h4qcp\" (UID: \"d6d9a721-1745-4dcd-be6c-0698d368f5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4qcp" Jul 20 16:29:36.861938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.861857 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-multus-cni-dir\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.861938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.861905 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d6d9a721-1745-4dcd-be6c-0698d368f5a9-socket-dir\") pod \"aws-ebs-csi-driver-node-h4qcp\" (UID: \"d6d9a721-1745-4dcd-be6c-0698d368f5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4qcp" Jul 20 16:29:36.861938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.861907 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-multus-cni-dir\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.861938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.861926 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t24dw\" (UniqueName: \"kubernetes.io/projected/e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d-kube-api-access-t24dw\") pod \"network-metrics-daemon-wnqv5\" (UID: \"e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d\") " pod="openshift-multus/network-metrics-daemon-wnqv5" Jul 20 16:29:36.862177 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.861947 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-system-cni-dir\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.862177 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.861967 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e60cf0cf-f42e-4d8c-a1be-977d5eab29ef-kubelet-config\") pod \"global-pull-secret-syncer-bpbjs\" (UID: \"e60cf0cf-f42e-4d8c-a1be-977d5eab29ef\") " pod="kube-system/global-pull-secret-syncer-bpbjs" Jul 20 16:29:36.862177 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.861991 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-env-overrides\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.862177 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.862006 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-system-cni-dir\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.862177 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.862014 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9012df24-f877-4d10-8de5-feb1070f5421-cni-binary-copy\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.862177 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.862051 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-host-run-k8s-cni-cncf-io\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.862177 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.862056 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e60cf0cf-f42e-4d8c-a1be-977d5eab29ef-kubelet-config\") pod \"global-pull-secret-syncer-bpbjs\" (UID: \"e60cf0cf-f42e-4d8c-a1be-977d5eab29ef\") " pod="kube-system/global-pull-secret-syncer-bpbjs" Jul 20 16:29:36.862177 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.862079 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e60cf0cf-f42e-4d8c-a1be-977d5eab29ef-original-pull-secret\") pod \"global-pull-secret-syncer-bpbjs\" (UID: \"e60cf0cf-f42e-4d8c-a1be-977d5eab29ef\") " pod="kube-system/global-pull-secret-syncer-bpbjs" Jul 20 16:29:36.862177 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.862121 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4f85b138-a3e7-4242-be3e-1a237173570a-serviceca\") pod \"node-ca-m275f\" (UID: \"4f85b138-a3e7-4242-be3e-1a237173570a\") " pod="openshift-image-registry/node-ca-m275f" Jul 20 16:29:36.862177 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.862127 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-host-run-k8s-cni-cncf-io\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.862177 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.862147 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/70dd6078-d12c-4b47-aa03-fb96213c188b-run\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.862177 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.862176 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70dd6078-d12c-4b47-aa03-fb96213c188b-host\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.862681 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:36.862176 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 16:29:36.862681 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.862200 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-systemd-units\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.862681 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.862223 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84tv7\" (UniqueName: \"kubernetes.io/projected/70dd6078-d12c-4b47-aa03-fb96213c188b-kube-api-access-84tv7\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.862681 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:36.862260 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e60cf0cf-f42e-4d8c-a1be-977d5eab29ef-original-pull-secret podName:e60cf0cf-f42e-4d8c-a1be-977d5eab29ef nodeName:}" failed. No retries permitted until 2026-07-20 16:29:37.362240759 +0000 UTC m=+3.013123258 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e60cf0cf-f42e-4d8c-a1be-977d5eab29ef-original-pull-secret") pod "global-pull-secret-syncer-bpbjs" (UID: "e60cf0cf-f42e-4d8c-a1be-977d5eab29ef") : object "kube-system"/"original-pull-secret" not registered Jul 20 16:29:36.862681 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.862296 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/70dd6078-d12c-4b47-aa03-fb96213c188b-lib-modules\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.862681 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.862325 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nmbt\" (UniqueName: \"kubernetes.io/projected/e8c92c04-1924-4079-a43f-93c6af8451f0-kube-api-access-5nmbt\") pod \"iptables-alerter-5wqdx\" (UID: \"e8c92c04-1924-4079-a43f-93c6af8451f0\") " pod="openshift-network-operator/iptables-alerter-5wqdx" Jul 20 16:29:36.862681 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.862355 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-etc-openvswitch\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.862681 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.862388 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d-metrics-certs\") pod \"network-metrics-daemon-wnqv5\" (UID: \"e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d\") " pod="openshift-multus/network-metrics-daemon-wnqv5" Jul 20 16:29:36.862681 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.862416 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4f85b138-a3e7-4242-be3e-1a237173570a-host\") pod \"node-ca-m275f\" (UID: \"4f85b138-a3e7-4242-be3e-1a237173570a\") " pod="openshift-image-registry/node-ca-m275f" Jul 20 16:29:36.862681 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.862440 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d6d9a721-1745-4dcd-be6c-0698d368f5a9-registration-dir\") pod \"aws-ebs-csi-driver-node-h4qcp\" (UID: \"d6d9a721-1745-4dcd-be6c-0698d368f5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4qcp" Jul 20 16:29:36.862681 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:36.862446 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:29:36.862681 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.862462 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/70dd6078-d12c-4b47-aa03-fb96213c188b-etc-sysctl-conf\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.862681 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:36.862482 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d-metrics-certs podName:e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d nodeName:}" failed. No retries permitted until 2026-07-20 16:29:37.362470942 +0000 UTC m=+3.013353418 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d-metrics-certs") pod "network-metrics-daemon-wnqv5" (UID: "e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:29:36.862681 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.862513 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-run-ovn\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.862681 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.862524 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4f85b138-a3e7-4242-be3e-1a237173570a-serviceca\") pod \"node-ca-m275f\" (UID: \"4f85b138-a3e7-4242-be3e-1a237173570a\") " pod="openshift-image-registry/node-ca-m275f" Jul 20 16:29:36.862681 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.862529 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9012df24-f877-4d10-8de5-feb1070f5421-cni-binary-copy\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.863419 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.862536 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/846c8111-559c-4131-a066-2c2338f37da7-agent-certs\") pod \"konnectivity-agent-r7vpx\" (UID: \"846c8111-559c-4131-a066-2c2338f37da7\") " pod="kube-system/konnectivity-agent-r7vpx" Jul 20 16:29:36.863419 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.862524 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4f85b138-a3e7-4242-be3e-1a237173570a-host\") pod \"node-ca-m275f\" (UID: \"4f85b138-a3e7-4242-be3e-1a237173570a\") " pod="openshift-image-registry/node-ca-m275f" Jul 20 16:29:36.863419 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.863256 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 20 16:29:36.863558 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.863515 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e8c92c04-1924-4079-a43f-93c6af8451f0-host-slash\") pod \"iptables-alerter-5wqdx\" (UID: \"e8c92c04-1924-4079-a43f-93c6af8451f0\") " pod="openshift-network-operator/iptables-alerter-5wqdx" Jul 20 16:29:36.863623 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.863576 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-host-kubelet\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.863623 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.863603 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-run-systemd\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.863715 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.863649 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-var-lib-openvswitch\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.863715 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.863678 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-log-socket\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.863805 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.863719 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfdbr\" (UniqueName: \"kubernetes.io/projected/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-kube-api-access-jfdbr\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.863805 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.863750 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a28546f7-4091-4291-aeaa-12fee18311ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-htg96\" (UID: \"a28546f7-4091-4291-aeaa-12fee18311ca\") " pod="openshift-multus/multus-additional-cni-plugins-htg96" Jul 20 16:29:36.863909 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.863893 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-etc-kubernetes\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.863986 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.863971 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7377db3f-fd05-4a8f-9ac0-35a3245062da-hosts-file\") pod \"node-resolver-kh6zc\" (UID: \"7377db3f-fd05-4a8f-9ac0-35a3245062da\") " pod="openshift-dns/node-resolver-kh6zc" Jul 20 16:29:36.864029 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.864002 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d6d9a721-1745-4dcd-be6c-0698d368f5a9-etc-selinux\") pod \"aws-ebs-csi-driver-node-h4qcp\" (UID: \"d6d9a721-1745-4dcd-be6c-0698d368f5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4qcp" Jul 20 16:29:36.864111 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.864079 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9012df24-f877-4d10-8de5-feb1070f5421-etc-kubernetes\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.864197 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.864182 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7377db3f-fd05-4a8f-9ac0-35a3245062da-hosts-file\") pod \"node-resolver-kh6zc\" (UID: \"7377db3f-fd05-4a8f-9ac0-35a3245062da\") " pod="openshift-dns/node-resolver-kh6zc" Jul 20 16:29:36.864278 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.864229 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e8c92c04-1924-4079-a43f-93c6af8451f0-iptables-alerter-script\") pod \"iptables-alerter-5wqdx\" (UID: \"e8c92c04-1924-4079-a43f-93c6af8451f0\") " pod="openshift-network-operator/iptables-alerter-5wqdx" Jul 20 16:29:36.864349 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.864316 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-ovnkube-script-lib\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.864396 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.864370 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a28546f7-4091-4291-aeaa-12fee18311ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-htg96\" (UID: \"a28546f7-4091-4291-aeaa-12fee18311ca\") " pod="openshift-multus/multus-additional-cni-plugins-htg96" Jul 20 16:29:36.864458 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.864400 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htnhl\" (UniqueName: \"kubernetes.io/projected/321c627e-8b07-4734-8de1-561625eb34fd-kube-api-access-htnhl\") pod \"network-check-target-z8hpf\" (UID: \"321c627e-8b07-4734-8de1-561625eb34fd\") " pod="openshift-network-diagnostics/network-check-target-z8hpf" Jul 20 16:29:36.865267 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.865248 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/846c8111-559c-4131-a066-2c2338f37da7-konnectivity-ca\") pod \"konnectivity-agent-r7vpx\" (UID: \"846c8111-559c-4131-a066-2c2338f37da7\") " pod="kube-system/konnectivity-agent-r7vpx" Jul 20 16:29:36.865365 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.865277 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70dd6078-d12c-4b47-aa03-fb96213c188b-sys\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.865365 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.865308 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70dd6078-d12c-4b47-aa03-fb96213c188b-tmp\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.865365 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.865337 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-ovnkube-config\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.865496 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.865363 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flp48\" (UniqueName: \"kubernetes.io/projected/a28546f7-4091-4291-aeaa-12fee18311ca-kube-api-access-flp48\") pod \"multus-additional-cni-plugins-htg96\" (UID: \"a28546f7-4091-4291-aeaa-12fee18311ca\") " pod="openshift-multus/multus-additional-cni-plugins-htg96" Jul 20 16:29:36.866001 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.865865 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/846c8111-559c-4131-a066-2c2338f37da7-konnectivity-ca\") pod \"konnectivity-agent-r7vpx\" (UID: \"846c8111-559c-4131-a066-2c2338f37da7\") " pod="kube-system/konnectivity-agent-r7vpx" Jul 20 16:29:36.867216 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.867196 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/846c8111-559c-4131-a066-2c2338f37da7-agent-certs\") pod \"konnectivity-agent-r7vpx\" (UID: \"846c8111-559c-4131-a066-2c2338f37da7\") " pod="kube-system/konnectivity-agent-r7vpx" Jul 20 16:29:36.868286 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.868260 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgz8g\" (UniqueName: \"kubernetes.io/projected/4f85b138-a3e7-4242-be3e-1a237173570a-kube-api-access-rgz8g\") pod \"node-ca-m275f\" (UID: \"4f85b138-a3e7-4242-be3e-1a237173570a\") " pod="openshift-image-registry/node-ca-m275f" Jul 20 16:29:36.868286 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.868270 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmkvm\" (UniqueName: \"kubernetes.io/projected/7377db3f-fd05-4a8f-9ac0-35a3245062da-kube-api-access-wmkvm\") pod \"node-resolver-kh6zc\" (UID: \"7377db3f-fd05-4a8f-9ac0-35a3245062da\") " pod="openshift-dns/node-resolver-kh6zc" Jul 20 16:29:36.868885 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.868866 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whmnn\" (UniqueName: \"kubernetes.io/projected/9012df24-f877-4d10-8de5-feb1070f5421-kube-api-access-whmnn\") pod \"multus-845hr\" (UID: \"9012df24-f877-4d10-8de5-feb1070f5421\") " pod="openshift-multus/multus-845hr" Jul 20 16:29:36.870271 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.870253 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t24dw\" (UniqueName: \"kubernetes.io/projected/e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d-kube-api-access-t24dw\") pod \"network-metrics-daemon-wnqv5\" (UID: \"e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d\") " pod="openshift-multus/network-metrics-daemon-wnqv5" Jul 20 16:29:36.966381 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966290 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d6d9a721-1745-4dcd-be6c-0698d368f5a9-device-dir\") pod \"aws-ebs-csi-driver-node-h4qcp\" (UID: \"d6d9a721-1745-4dcd-be6c-0698d368f5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4qcp" Jul 20 16:29:36.966381 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966329 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a28546f7-4091-4291-aeaa-12fee18311ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-htg96\" (UID: \"a28546f7-4091-4291-aeaa-12fee18311ca\") " pod="openshift-multus/multus-additional-cni-plugins-htg96" Jul 20 16:29:36.966381 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966357 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70dd6078-d12c-4b47-aa03-fb96213c188b-etc-kubernetes\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.966647 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966413 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70dd6078-d12c-4b47-aa03-fb96213c188b-etc-kubernetes\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.966647 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966413 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d6d9a721-1745-4dcd-be6c-0698d368f5a9-device-dir\") pod \"aws-ebs-csi-driver-node-h4qcp\" (UID: \"d6d9a721-1745-4dcd-be6c-0698d368f5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4qcp" Jul 20 16:29:36.966647 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966450 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-run-openvswitch\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.966647 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966467 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-host-cni-netd\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.966647 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966492 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.966647 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966509 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-ovn-node-metrics-cert\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.966647 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966518 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-run-openvswitch\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.966647 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966524 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/70dd6078-d12c-4b47-aa03-fb96213c188b-etc-tuned\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.966647 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966547 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a28546f7-4091-4291-aeaa-12fee18311ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-htg96\" (UID: \"a28546f7-4091-4291-aeaa-12fee18311ca\") " pod="openshift-multus/multus-additional-cni-plugins-htg96" Jul 20 16:29:36.966647 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966580 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/70dd6078-d12c-4b47-aa03-fb96213c188b-etc-sysconfig\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.966647 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966591 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-host-cni-netd\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.966647 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966607 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-host-slash\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.966647 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966630 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-node-log\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.966647 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966641 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/70dd6078-d12c-4b47-aa03-fb96213c188b-etc-sysconfig\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.966647 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966655 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-host-run-ovn-kubernetes\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.967363 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966680 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-node-log\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.967363 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966692 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-host-slash\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.967363 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966715 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d6d9a721-1745-4dcd-be6c-0698d368f5a9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h4qcp\" (UID: \"d6d9a721-1745-4dcd-be6c-0698d368f5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4qcp" Jul 20 16:29:36.967363 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966699 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-host-run-ovn-kubernetes\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.967363 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966716 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.967363 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966748 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a28546f7-4091-4291-aeaa-12fee18311ca-cnibin\") pod \"multus-additional-cni-plugins-htg96\" (UID: \"a28546f7-4091-4291-aeaa-12fee18311ca\") " pod="openshift-multus/multus-additional-cni-plugins-htg96" Jul 20 16:29:36.967363 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966766 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d6d9a721-1745-4dcd-be6c-0698d368f5a9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h4qcp\" (UID: \"d6d9a721-1745-4dcd-be6c-0698d368f5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4qcp" Jul 20 16:29:36.967363 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966780 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/70dd6078-d12c-4b47-aa03-fb96213c188b-etc-modprobe-d\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.967363 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966804 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/70dd6078-d12c-4b47-aa03-fb96213c188b-etc-sysctl-d\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.967363 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966803 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a28546f7-4091-4291-aeaa-12fee18311ca-cnibin\") pod \"multus-additional-cni-plugins-htg96\" (UID: \"a28546f7-4091-4291-aeaa-12fee18311ca\") " pod="openshift-multus/multus-additional-cni-plugins-htg96" Jul 20 16:29:36.967363 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966828 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a28546f7-4091-4291-aeaa-12fee18311ca-system-cni-dir\") pod \"multus-additional-cni-plugins-htg96\" (UID: \"a28546f7-4091-4291-aeaa-12fee18311ca\") " pod="openshift-multus/multus-additional-cni-plugins-htg96" Jul 20 16:29:36.967363 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966864 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a28546f7-4091-4291-aeaa-12fee18311ca-os-release\") pod \"multus-additional-cni-plugins-htg96\" (UID: \"a28546f7-4091-4291-aeaa-12fee18311ca\") " pod="openshift-multus/multus-additional-cni-plugins-htg96" Jul 20 16:29:36.967363 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966883 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/70dd6078-d12c-4b47-aa03-fb96213c188b-etc-systemd\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.967363 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966904 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-host-run-netns\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.967363 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966917 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/70dd6078-d12c-4b47-aa03-fb96213c188b-etc-sysctl-d\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.967363 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966926 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/70dd6078-d12c-4b47-aa03-fb96213c188b-etc-modprobe-d\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.967363 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966930 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a28546f7-4091-4291-aeaa-12fee18311ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-htg96\" (UID: \"a28546f7-4091-4291-aeaa-12fee18311ca\") " pod="openshift-multus/multus-additional-cni-plugins-htg96" Jul 20 16:29:36.968221 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966944 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a28546f7-4091-4291-aeaa-12fee18311ca-system-cni-dir\") pod \"multus-additional-cni-plugins-htg96\" (UID: \"a28546f7-4091-4291-aeaa-12fee18311ca\") " pod="openshift-multus/multus-additional-cni-plugins-htg96" Jul 20 16:29:36.968221 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966960 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/70dd6078-d12c-4b47-aa03-fb96213c188b-etc-systemd\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.968221 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966975 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp42p\" (UniqueName: \"kubernetes.io/projected/d6d9a721-1745-4dcd-be6c-0698d368f5a9-kube-api-access-cp42p\") pod \"aws-ebs-csi-driver-node-h4qcp\" (UID: \"d6d9a721-1745-4dcd-be6c-0698d368f5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4qcp" Jul 20 16:29:36.968221 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967001 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d6d9a721-1745-4dcd-be6c-0698d368f5a9-socket-dir\") pod \"aws-ebs-csi-driver-node-h4qcp\" (UID: \"d6d9a721-1745-4dcd-be6c-0698d368f5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4qcp" Jul 20 16:29:36.968221 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967020 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a28546f7-4091-4291-aeaa-12fee18311ca-os-release\") pod \"multus-additional-cni-plugins-htg96\" (UID: \"a28546f7-4091-4291-aeaa-12fee18311ca\") " pod="openshift-multus/multus-additional-cni-plugins-htg96" Jul 20 16:29:36.968221 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967024 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-env-overrides\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.968221 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967077 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/70dd6078-d12c-4b47-aa03-fb96213c188b-run\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.968221 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967132 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70dd6078-d12c-4b47-aa03-fb96213c188b-host\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.968221 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967157 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-systemd-units\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.968221 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967182 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84tv7\" (UniqueName: \"kubernetes.io/projected/70dd6078-d12c-4b47-aa03-fb96213c188b-kube-api-access-84tv7\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.968221 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967206 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/70dd6078-d12c-4b47-aa03-fb96213c188b-lib-modules\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.968221 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967211 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d6d9a721-1745-4dcd-be6c-0698d368f5a9-socket-dir\") pod \"aws-ebs-csi-driver-node-h4qcp\" (UID: \"d6d9a721-1745-4dcd-be6c-0698d368f5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4qcp" Jul 20 16:29:36.968221 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967230 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nmbt\" (UniqueName: \"kubernetes.io/projected/e8c92c04-1924-4079-a43f-93c6af8451f0-kube-api-access-5nmbt\") pod \"iptables-alerter-5wqdx\" (UID: \"e8c92c04-1924-4079-a43f-93c6af8451f0\") " pod="openshift-network-operator/iptables-alerter-5wqdx" Jul 20 16:29:36.968221 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967255 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-etc-openvswitch\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.968221 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967269 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70dd6078-d12c-4b47-aa03-fb96213c188b-host\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.968221 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.966956 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-host-run-netns\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.968221 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967292 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d6d9a721-1745-4dcd-be6c-0698d368f5a9-registration-dir\") pod \"aws-ebs-csi-driver-node-h4qcp\" (UID: \"d6d9a721-1745-4dcd-be6c-0698d368f5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4qcp" Jul 20 16:29:36.969000 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967299 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/70dd6078-d12c-4b47-aa03-fb96213c188b-run\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.969000 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967315 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/70dd6078-d12c-4b47-aa03-fb96213c188b-etc-sysctl-conf\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.969000 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967346 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-run-ovn\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.969000 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967377 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/70dd6078-d12c-4b47-aa03-fb96213c188b-lib-modules\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.969000 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967384 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e8c92c04-1924-4079-a43f-93c6af8451f0-host-slash\") pod \"iptables-alerter-5wqdx\" (UID: \"e8c92c04-1924-4079-a43f-93c6af8451f0\") " pod="openshift-network-operator/iptables-alerter-5wqdx" Jul 20 16:29:36.969000 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967410 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-host-kubelet\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.969000 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967434 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-run-systemd\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.969000 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967442 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/70dd6078-d12c-4b47-aa03-fb96213c188b-etc-sysctl-conf\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.969000 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967458 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-var-lib-openvswitch\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.969000 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967483 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-log-socket\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.969000 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967515 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-env-overrides\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.969000 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967521 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-etc-openvswitch\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.969000 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967508 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfdbr\" (UniqueName: \"kubernetes.io/projected/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-kube-api-access-jfdbr\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.969000 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967554 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a28546f7-4091-4291-aeaa-12fee18311ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-htg96\" (UID: \"a28546f7-4091-4291-aeaa-12fee18311ca\") " pod="openshift-multus/multus-additional-cni-plugins-htg96" Jul 20 16:29:36.969000 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967575 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d6d9a721-1745-4dcd-be6c-0698d368f5a9-registration-dir\") pod \"aws-ebs-csi-driver-node-h4qcp\" (UID: \"d6d9a721-1745-4dcd-be6c-0698d368f5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4qcp" Jul 20 16:29:36.969000 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967586 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-log-socket\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.969000 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967483 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-systemd-units\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.969538 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967575 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-run-systemd\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.969538 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967615 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e8c92c04-1924-4079-a43f-93c6af8451f0-host-slash\") pod \"iptables-alerter-5wqdx\" (UID: \"e8c92c04-1924-4079-a43f-93c6af8451f0\") " pod="openshift-network-operator/iptables-alerter-5wqdx" Jul 20 16:29:36.969538 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967615 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a28546f7-4091-4291-aeaa-12fee18311ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-htg96\" (UID: \"a28546f7-4091-4291-aeaa-12fee18311ca\") " pod="openshift-multus/multus-additional-cni-plugins-htg96" Jul 20 16:29:36.969538 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967637 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-var-lib-openvswitch\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.969538 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967654 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d6d9a721-1745-4dcd-be6c-0698d368f5a9-etc-selinux\") pod \"aws-ebs-csi-driver-node-h4qcp\" (UID: \"d6d9a721-1745-4dcd-be6c-0698d368f5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4qcp" Jul 20 16:29:36.969538 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967658 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-run-ovn\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.969538 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967691 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e8c92c04-1924-4079-a43f-93c6af8451f0-iptables-alerter-script\") pod \"iptables-alerter-5wqdx\" (UID: \"e8c92c04-1924-4079-a43f-93c6af8451f0\") " pod="openshift-network-operator/iptables-alerter-5wqdx" Jul 20 16:29:36.969538 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967724 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-ovnkube-script-lib\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.969538 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967731 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d6d9a721-1745-4dcd-be6c-0698d368f5a9-etc-selinux\") pod \"aws-ebs-csi-driver-node-h4qcp\" (UID: \"d6d9a721-1745-4dcd-be6c-0698d368f5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4qcp" Jul 20 16:29:36.969538 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967747 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a28546f7-4091-4291-aeaa-12fee18311ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-htg96\" (UID: \"a28546f7-4091-4291-aeaa-12fee18311ca\") " pod="openshift-multus/multus-additional-cni-plugins-htg96" Jul 20 16:29:36.969538 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967776 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htnhl\" (UniqueName: \"kubernetes.io/projected/321c627e-8b07-4734-8de1-561625eb34fd-kube-api-access-htnhl\") pod \"network-check-target-z8hpf\" (UID: \"321c627e-8b07-4734-8de1-561625eb34fd\") " pod="openshift-network-diagnostics/network-check-target-z8hpf" Jul 20 16:29:36.969538 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967799 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70dd6078-d12c-4b47-aa03-fb96213c188b-sys\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.969538 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967816 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-host-kubelet\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.969538 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967822 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70dd6078-d12c-4b47-aa03-fb96213c188b-tmp\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.969538 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967859 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-ovnkube-config\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.969538 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967894 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flp48\" (UniqueName: \"kubernetes.io/projected/a28546f7-4091-4291-aeaa-12fee18311ca-kube-api-access-flp48\") pod \"multus-additional-cni-plugins-htg96\" (UID: \"a28546f7-4091-4291-aeaa-12fee18311ca\") " pod="openshift-multus/multus-additional-cni-plugins-htg96" Jul 20 16:29:36.969538 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967934 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d6d9a721-1745-4dcd-be6c-0698d368f5a9-sys-fs\") pod \"aws-ebs-csi-driver-node-h4qcp\" (UID: \"d6d9a721-1745-4dcd-be6c-0698d368f5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4qcp" Jul 20 16:29:36.970180 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967956 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-host-cni-bin\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.970180 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.967978 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/70dd6078-d12c-4b47-aa03-fb96213c188b-var-lib-kubelet\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.970180 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.968099 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/70dd6078-d12c-4b47-aa03-fb96213c188b-var-lib-kubelet\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.970180 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.968099 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a28546f7-4091-4291-aeaa-12fee18311ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-htg96\" (UID: \"a28546f7-4091-4291-aeaa-12fee18311ca\") " pod="openshift-multus/multus-additional-cni-plugins-htg96" Jul 20 16:29:36.970180 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.968170 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d6d9a721-1745-4dcd-be6c-0698d368f5a9-sys-fs\") pod \"aws-ebs-csi-driver-node-h4qcp\" (UID: \"d6d9a721-1745-4dcd-be6c-0698d368f5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4qcp" Jul 20 16:29:36.970180 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.968221 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-host-cni-bin\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.970180 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.968299 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e8c92c04-1924-4079-a43f-93c6af8451f0-iptables-alerter-script\") pod \"iptables-alerter-5wqdx\" (UID: \"e8c92c04-1924-4079-a43f-93c6af8451f0\") " pod="openshift-network-operator/iptables-alerter-5wqdx" Jul 20 16:29:36.970180 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.968399 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70dd6078-d12c-4b47-aa03-fb96213c188b-sys\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.970180 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.968722 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-ovnkube-script-lib\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.970180 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.968832 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-ovnkube-config\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.970180 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.968893 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a28546f7-4091-4291-aeaa-12fee18311ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-htg96\" (UID: \"a28546f7-4091-4291-aeaa-12fee18311ca\") " pod="openshift-multus/multus-additional-cni-plugins-htg96" Jul 20 16:29:36.970180 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.969061 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/70dd6078-d12c-4b47-aa03-fb96213c188b-etc-tuned\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.970180 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.969473 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-ovn-node-metrics-cert\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:36.970180 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.969828 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70dd6078-d12c-4b47-aa03-fb96213c188b-tmp\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.973993 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:36.973968 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 16:29:36.973993 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:36.973995 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 16:29:36.974760 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:36.974009 2575 projected.go:196] Error preparing data for projected volume kube-api-access-htnhl for pod openshift-network-diagnostics/network-check-target-z8hpf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:29:36.974760 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:36.974101 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/321c627e-8b07-4734-8de1-561625eb34fd-kube-api-access-htnhl podName:321c627e-8b07-4734-8de1-561625eb34fd nodeName:}" failed. No retries permitted until 2026-07-20 16:29:37.474068213 +0000 UTC m=+3.124950703 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-htnhl" (UniqueName: "kubernetes.io/projected/321c627e-8b07-4734-8de1-561625eb34fd-kube-api-access-htnhl") pod "network-check-target-z8hpf" (UID: "321c627e-8b07-4734-8de1-561625eb34fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:29:36.976232 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.976198 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84tv7\" (UniqueName: \"kubernetes.io/projected/70dd6078-d12c-4b47-aa03-fb96213c188b-kube-api-access-84tv7\") pod \"tuned-ckf7n\" (UID: \"70dd6078-d12c-4b47-aa03-fb96213c188b\") " pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:36.976232 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.976205 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp42p\" (UniqueName: \"kubernetes.io/projected/d6d9a721-1745-4dcd-be6c-0698d368f5a9-kube-api-access-cp42p\") pod \"aws-ebs-csi-driver-node-h4qcp\" (UID: \"d6d9a721-1745-4dcd-be6c-0698d368f5a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4qcp" Jul 20 16:29:36.976381 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.976364 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flp48\" (UniqueName: \"kubernetes.io/projected/a28546f7-4091-4291-aeaa-12fee18311ca-kube-api-access-flp48\") pod \"multus-additional-cni-plugins-htg96\" (UID: \"a28546f7-4091-4291-aeaa-12fee18311ca\") " pod="openshift-multus/multus-additional-cni-plugins-htg96" Jul 20 16:29:36.976781 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.976763 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nmbt\" (UniqueName: \"kubernetes.io/projected/e8c92c04-1924-4079-a43f-93c6af8451f0-kube-api-access-5nmbt\") pod \"iptables-alerter-5wqdx\" (UID: \"e8c92c04-1924-4079-a43f-93c6af8451f0\") " pod="openshift-network-operator/iptables-alerter-5wqdx" Jul 20 16:29:36.976879 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:36.976852 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfdbr\" (UniqueName: \"kubernetes.io/projected/2f2fedc7-bf3b-4223-87a6-abcfff925fa0-kube-api-access-jfdbr\") pod \"ovnkube-node-s5dt7\" (UID: \"2f2fedc7-bf3b-4223-87a6-abcfff925fa0\") " pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:37.044738 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:37.044639 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-845hr" Jul 20 16:29:37.051047 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:37.050979 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kh6zc" Jul 20 16:29:37.056216 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:37.056186 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9012df24_f877_4d10_8de5_feb1070f5421.slice/crio-a558d024e1ae31d375a193cd69beae08d2b4ec4d13f8d622963b771494763b05 WatchSource:0}: Error finding container a558d024e1ae31d375a193cd69beae08d2b4ec4d13f8d622963b771494763b05: Status 404 returned error can't find the container with id a558d024e1ae31d375a193cd69beae08d2b4ec4d13f8d622963b771494763b05 Jul 20 16:29:37.059375 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:37.059352 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r7vpx" Jul 20 16:29:37.062174 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:37.062150 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7377db3f_fd05_4a8f_9ac0_35a3245062da.slice/crio-f45b8fd69ffb4704e502acde1c48992d19f65f68e120436e2dfcb13b5e35ce7d WatchSource:0}: Error finding container f45b8fd69ffb4704e502acde1c48992d19f65f68e120436e2dfcb13b5e35ce7d: Status 404 returned error can't find the container with id f45b8fd69ffb4704e502acde1c48992d19f65f68e120436e2dfcb13b5e35ce7d Jul 20 16:29:37.063677 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:37.063363 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m275f" Jul 20 16:29:37.068929 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:37.068273 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:29:37.074311 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:37.074293 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-htg96" Jul 20 16:29:37.076885 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:37.076857 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod846c8111_559c_4131_a066_2c2338f37da7.slice/crio-f0e31c3aeef86a38d8b19fb0cd0c03b6721b27dc0209afd8d20f6187827672d8 WatchSource:0}: Error finding container f0e31c3aeef86a38d8b19fb0cd0c03b6721b27dc0209afd8d20f6187827672d8: Status 404 returned error can't find the container with id f0e31c3aeef86a38d8b19fb0cd0c03b6721b27dc0209afd8d20f6187827672d8 Jul 20 16:29:37.079111 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:37.078921 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4qcp" Jul 20 16:29:37.085120 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:37.085101 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" Jul 20 16:29:37.091242 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:37.091012 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5wqdx" Jul 20 16:29:37.103062 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:37.102996 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6d9a721_1745_4dcd_be6c_0698d368f5a9.slice/crio-15b5decf9caf8326a31ba51322a00e1ef41e186827a36d8085f34a6657939417 WatchSource:0}: Error finding container 15b5decf9caf8326a31ba51322a00e1ef41e186827a36d8085f34a6657939417: Status 404 returned error can't find the container with id 15b5decf9caf8326a31ba51322a00e1ef41e186827a36d8085f34a6657939417 Jul 20 16:29:37.105431 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:37.105393 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda28546f7_4091_4291_aeaa_12fee18311ca.slice/crio-97bf012e43c478b3fab44446e3484112fdb4f7b470dbf09405a55800e6bc2285 WatchSource:0}: Error finding container 97bf012e43c478b3fab44446e3484112fdb4f7b470dbf09405a55800e6bc2285: Status 404 returned error can't find the container with id 97bf012e43c478b3fab44446e3484112fdb4f7b470dbf09405a55800e6bc2285 Jul 20 16:29:37.120614 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:29:37.120590 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8c92c04_1924_4079_a43f_93c6af8451f0.slice/crio-6678691c4b20a5133ccefa1408518f7138bb000bd7fd67a5d98ad70d054dfab7 WatchSource:0}: Error finding container 6678691c4b20a5133ccefa1408518f7138bb000bd7fd67a5d98ad70d054dfab7: Status 404 returned error can't find the container with id 6678691c4b20a5133ccefa1408518f7138bb000bd7fd67a5d98ad70d054dfab7 Jul 20 16:29:37.371774 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:37.371683 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e60cf0cf-f42e-4d8c-a1be-977d5eab29ef-original-pull-secret\") pod \"global-pull-secret-syncer-bpbjs\" (UID: \"e60cf0cf-f42e-4d8c-a1be-977d5eab29ef\") " pod="kube-system/global-pull-secret-syncer-bpbjs" Jul 20 16:29:37.371774 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:37.371758 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d-metrics-certs\") pod \"network-metrics-daemon-wnqv5\" (UID: \"e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d\") " pod="openshift-multus/network-metrics-daemon-wnqv5" Jul 20 16:29:37.371987 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:37.371911 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:29:37.372043 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:37.371998 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d-metrics-certs podName:e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d nodeName:}" failed. No retries permitted until 2026-07-20 16:29:38.371977795 +0000 UTC m=+4.022860286 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d-metrics-certs") pod "network-metrics-daemon-wnqv5" (UID: "e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:29:37.372122 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:37.372059 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 16:29:37.372184 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:37.372140 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e60cf0cf-f42e-4d8c-a1be-977d5eab29ef-original-pull-secret podName:e60cf0cf-f42e-4d8c-a1be-977d5eab29ef nodeName:}" failed. No retries permitted until 2026-07-20 16:29:38.372122607 +0000 UTC m=+4.023005104 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e60cf0cf-f42e-4d8c-a1be-977d5eab29ef-original-pull-secret") pod "global-pull-secret-syncer-bpbjs" (UID: "e60cf0cf-f42e-4d8c-a1be-977d5eab29ef") : object "kube-system"/"original-pull-secret" not registered Jul 20 16:29:37.573047 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:37.573007 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htnhl\" (UniqueName: \"kubernetes.io/projected/321c627e-8b07-4734-8de1-561625eb34fd-kube-api-access-htnhl\") pod \"network-check-target-z8hpf\" (UID: \"321c627e-8b07-4734-8de1-561625eb34fd\") " pod="openshift-network-diagnostics/network-check-target-z8hpf" Jul 20 16:29:37.573247 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:37.573196 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 16:29:37.573247 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:37.573223 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 16:29:37.573247 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:37.573237 2575 projected.go:196] Error preparing data for projected volume kube-api-access-htnhl for pod openshift-network-diagnostics/network-check-target-z8hpf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:29:37.573377 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:37.573304 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/321c627e-8b07-4734-8de1-561625eb34fd-kube-api-access-htnhl podName:321c627e-8b07-4734-8de1-561625eb34fd nodeName:}" failed. No retries permitted until 2026-07-20 16:29:38.573284823 +0000 UTC m=+4.224167322 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-htnhl" (UniqueName: "kubernetes.io/projected/321c627e-8b07-4734-8de1-561625eb34fd-kube-api-access-htnhl") pod "network-check-target-z8hpf" (UID: "321c627e-8b07-4734-8de1-561625eb34fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:29:37.791590 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:37.791478 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 16:24:36 +0000 UTC" deadline="2027-12-19 13:47:51.042074067 +0000 UTC" Jul 20 16:29:37.791590 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:37.791547 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12405h18m13.250537598s" Jul 20 16:29:37.854632 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:37.854587 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" event={"ID":"70dd6078-d12c-4b47-aa03-fb96213c188b","Type":"ContainerStarted","Data":"c861cdd659849b7bd9e2ff05849361b88bed5921bbcf1e1037d3f4d804b18a97"} Jul 20 16:29:37.856221 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:37.856058 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m275f" event={"ID":"4f85b138-a3e7-4242-be3e-1a237173570a","Type":"ContainerStarted","Data":"f8de2900b837bf644c418b9f11b2c75f93ff9481d51fcb753ce96ba019a06703"} Jul 20 16:29:37.857971 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:37.857937 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kh6zc" event={"ID":"7377db3f-fd05-4a8f-9ac0-35a3245062da","Type":"ContainerStarted","Data":"f45b8fd69ffb4704e502acde1c48992d19f65f68e120436e2dfcb13b5e35ce7d"} Jul 20 16:29:37.859685 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:37.859642 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5wqdx" event={"ID":"e8c92c04-1924-4079-a43f-93c6af8451f0","Type":"ContainerStarted","Data":"6678691c4b20a5133ccefa1408518f7138bb000bd7fd67a5d98ad70d054dfab7"} Jul 20 16:29:37.861606 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:37.861581 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htg96" event={"ID":"a28546f7-4091-4291-aeaa-12fee18311ca","Type":"ContainerStarted","Data":"97bf012e43c478b3fab44446e3484112fdb4f7b470dbf09405a55800e6bc2285"} Jul 20 16:29:37.864384 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:37.864316 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4qcp" event={"ID":"d6d9a721-1745-4dcd-be6c-0698d368f5a9","Type":"ContainerStarted","Data":"15b5decf9caf8326a31ba51322a00e1ef41e186827a36d8085f34a6657939417"} Jul 20 16:29:37.865896 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:37.865811 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" event={"ID":"2f2fedc7-bf3b-4223-87a6-abcfff925fa0","Type":"ContainerStarted","Data":"91dafc8f373c82cea25f5ee40b95f8dcc9944a62d5427d4e0f134d2cbaa7e83a"} Jul 20 16:29:37.871751 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:37.867931 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r7vpx" event={"ID":"846c8111-559c-4131-a066-2c2338f37da7","Type":"ContainerStarted","Data":"f0e31c3aeef86a38d8b19fb0cd0c03b6721b27dc0209afd8d20f6187827672d8"} Jul 20 16:29:37.871751 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:37.870121 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-845hr" event={"ID":"9012df24-f877-4d10-8de5-feb1070f5421","Type":"ContainerStarted","Data":"a558d024e1ae31d375a193cd69beae08d2b4ec4d13f8d622963b771494763b05"} Jul 20 16:29:38.378970 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:38.378931 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e60cf0cf-f42e-4d8c-a1be-977d5eab29ef-original-pull-secret\") pod \"global-pull-secret-syncer-bpbjs\" (UID: \"e60cf0cf-f42e-4d8c-a1be-977d5eab29ef\") " pod="kube-system/global-pull-secret-syncer-bpbjs" Jul 20 16:29:38.379170 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:38.378984 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d-metrics-certs\") pod \"network-metrics-daemon-wnqv5\" (UID: \"e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d\") " pod="openshift-multus/network-metrics-daemon-wnqv5" Jul 20 16:29:38.379170 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:38.379143 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:29:38.379295 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:38.379211 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d-metrics-certs podName:e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d nodeName:}" failed. No retries permitted until 2026-07-20 16:29:40.379192358 +0000 UTC m=+6.030074837 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d-metrics-certs") pod "network-metrics-daemon-wnqv5" (UID: "e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:29:38.379295 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:38.379208 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 16:29:38.379295 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:38.379249 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e60cf0cf-f42e-4d8c-a1be-977d5eab29ef-original-pull-secret podName:e60cf0cf-f42e-4d8c-a1be-977d5eab29ef nodeName:}" failed. No retries permitted until 2026-07-20 16:29:40.379239551 +0000 UTC m=+6.030122030 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e60cf0cf-f42e-4d8c-a1be-977d5eab29ef-original-pull-secret") pod "global-pull-secret-syncer-bpbjs" (UID: "e60cf0cf-f42e-4d8c-a1be-977d5eab29ef") : object "kube-system"/"original-pull-secret" not registered Jul 20 16:29:38.580855 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:38.580801 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htnhl\" (UniqueName: \"kubernetes.io/projected/321c627e-8b07-4734-8de1-561625eb34fd-kube-api-access-htnhl\") pod \"network-check-target-z8hpf\" (UID: \"321c627e-8b07-4734-8de1-561625eb34fd\") " pod="openshift-network-diagnostics/network-check-target-z8hpf" Jul 20 16:29:38.581046 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:38.581004 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 16:29:38.581046 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:38.581025 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 16:29:38.581046 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:38.581040 2575 projected.go:196] Error preparing data for projected volume kube-api-access-htnhl for pod openshift-network-diagnostics/network-check-target-z8hpf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:29:38.581279 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:38.581127 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/321c627e-8b07-4734-8de1-561625eb34fd-kube-api-access-htnhl podName:321c627e-8b07-4734-8de1-561625eb34fd nodeName:}" failed. No retries permitted until 2026-07-20 16:29:40.581106659 +0000 UTC m=+6.231989138 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-htnhl" (UniqueName: "kubernetes.io/projected/321c627e-8b07-4734-8de1-561625eb34fd-kube-api-access-htnhl") pod "network-check-target-z8hpf" (UID: "321c627e-8b07-4734-8de1-561625eb34fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:29:38.792416 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:38.792294 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 16:24:36 +0000 UTC" deadline="2027-12-18 15:30:06.696111974 +0000 UTC" Jul 20 16:29:38.792416 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:38.792363 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12383h0m27.90375294s" Jul 20 16:29:38.848926 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:38.848223 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8hpf" Jul 20 16:29:38.848926 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:38.848352 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8hpf" podUID="321c627e-8b07-4734-8de1-561625eb34fd" Jul 20 16:29:38.848926 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:38.848438 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnqv5" Jul 20 16:29:38.848926 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:38.848561 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnqv5" podUID="e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d" Jul 20 16:29:38.848926 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:38.848617 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpbjs" Jul 20 16:29:38.848926 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:38.848683 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bpbjs" podUID="e60cf0cf-f42e-4d8c-a1be-977d5eab29ef" Jul 20 16:29:39.890742 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:39.890617 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-157.ec2.internal" event={"ID":"8b50f7e977174ad9e7171a45678a56bb","Type":"ContainerStarted","Data":"e218b2a947bb623eb3e75bf96ceafe2d2fa7113401264d3e2267b89e43dbc251"} Jul 20 16:29:39.906390 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:39.906335 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-157.ec2.internal" podStartSLOduration=3.906315521 podStartE2EDuration="3.906315521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:29:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:29:39.905981929 +0000 UTC m=+5.556864428" watchObservedRunningTime="2026-07-20 16:29:39.906315521 +0000 UTC m=+5.557198020" Jul 20 16:29:40.395193 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:40.394394 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e60cf0cf-f42e-4d8c-a1be-977d5eab29ef-original-pull-secret\") pod \"global-pull-secret-syncer-bpbjs\" (UID: \"e60cf0cf-f42e-4d8c-a1be-977d5eab29ef\") " pod="kube-system/global-pull-secret-syncer-bpbjs" Jul 20 16:29:40.395193 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:40.394453 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d-metrics-certs\") pod \"network-metrics-daemon-wnqv5\" (UID: \"e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d\") " pod="openshift-multus/network-metrics-daemon-wnqv5" Jul 20 16:29:40.395193 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:40.394631 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:29:40.395193 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:40.394692 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d-metrics-certs podName:e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d nodeName:}" failed. No retries permitted until 2026-07-20 16:29:44.394672476 +0000 UTC m=+10.045554953 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d-metrics-certs") pod "network-metrics-daemon-wnqv5" (UID: "e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:29:40.395193 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:40.395079 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 16:29:40.395193 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:40.395151 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e60cf0cf-f42e-4d8c-a1be-977d5eab29ef-original-pull-secret podName:e60cf0cf-f42e-4d8c-a1be-977d5eab29ef nodeName:}" failed. No retries permitted until 2026-07-20 16:29:44.395135321 +0000 UTC m=+10.046017799 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e60cf0cf-f42e-4d8c-a1be-977d5eab29ef-original-pull-secret") pod "global-pull-secret-syncer-bpbjs" (UID: "e60cf0cf-f42e-4d8c-a1be-977d5eab29ef") : object "kube-system"/"original-pull-secret" not registered Jul 20 16:29:40.596590 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:40.595980 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htnhl\" (UniqueName: \"kubernetes.io/projected/321c627e-8b07-4734-8de1-561625eb34fd-kube-api-access-htnhl\") pod \"network-check-target-z8hpf\" (UID: \"321c627e-8b07-4734-8de1-561625eb34fd\") " pod="openshift-network-diagnostics/network-check-target-z8hpf" Jul 20 16:29:40.596590 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:40.596167 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 16:29:40.596590 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:40.596187 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 16:29:40.596590 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:40.596199 2575 projected.go:196] Error preparing data for projected volume kube-api-access-htnhl for pod openshift-network-diagnostics/network-check-target-z8hpf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:29:40.596590 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:40.596257 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/321c627e-8b07-4734-8de1-561625eb34fd-kube-api-access-htnhl podName:321c627e-8b07-4734-8de1-561625eb34fd nodeName:}" failed. No retries permitted until 2026-07-20 16:29:44.596239777 +0000 UTC m=+10.247122256 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-htnhl" (UniqueName: "kubernetes.io/projected/321c627e-8b07-4734-8de1-561625eb34fd-kube-api-access-htnhl") pod "network-check-target-z8hpf" (UID: "321c627e-8b07-4734-8de1-561625eb34fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:29:40.848632 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:40.848072 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8hpf" Jul 20 16:29:40.848632 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:40.848107 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpbjs" Jul 20 16:29:40.848632 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:40.848229 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8hpf" podUID="321c627e-8b07-4734-8de1-561625eb34fd" Jul 20 16:29:40.848632 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:40.848277 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnqv5" Jul 20 16:29:40.848632 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:40.848413 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bpbjs" podUID="e60cf0cf-f42e-4d8c-a1be-977d5eab29ef" Jul 20 16:29:40.848632 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:40.848548 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnqv5" podUID="e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d" Jul 20 16:29:40.897896 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:40.897806 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-157.ec2.internal" event={"ID":"712c64cf1d9c1af507f39dac3e30cbe7","Type":"ContainerStarted","Data":"12b7ba7000495ac907d6ee103dfedc68b41077db200473e18a9992ae878fb05a"} Jul 20 16:29:42.848308 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:42.848272 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpbjs" Jul 20 16:29:42.848764 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:42.848279 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnqv5" Jul 20 16:29:42.848764 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:42.848419 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bpbjs" podUID="e60cf0cf-f42e-4d8c-a1be-977d5eab29ef" Jul 20 16:29:42.848764 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:42.848282 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8hpf" Jul 20 16:29:42.848764 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:42.848501 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnqv5" podUID="e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d" Jul 20 16:29:42.848764 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:42.848594 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8hpf" podUID="321c627e-8b07-4734-8de1-561625eb34fd" Jul 20 16:29:43.906401 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:43.906359 2575 generic.go:356] "Generic (PLEG): container finished" podID="712c64cf1d9c1af507f39dac3e30cbe7" containerID="12b7ba7000495ac907d6ee103dfedc68b41077db200473e18a9992ae878fb05a" exitCode=0 Jul 20 16:29:43.906893 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:43.906428 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-157.ec2.internal" event={"ID":"712c64cf1d9c1af507f39dac3e30cbe7","Type":"ContainerDied","Data":"12b7ba7000495ac907d6ee103dfedc68b41077db200473e18a9992ae878fb05a"} Jul 20 16:29:44.427551 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:44.427516 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e60cf0cf-f42e-4d8c-a1be-977d5eab29ef-original-pull-secret\") pod \"global-pull-secret-syncer-bpbjs\" (UID: \"e60cf0cf-f42e-4d8c-a1be-977d5eab29ef\") " pod="kube-system/global-pull-secret-syncer-bpbjs" Jul 20 16:29:44.427749 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:44.427560 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d-metrics-certs\") pod \"network-metrics-daemon-wnqv5\" (UID: \"e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d\") " pod="openshift-multus/network-metrics-daemon-wnqv5" Jul 20 16:29:44.427749 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:44.427673 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 16:29:44.427863 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:44.427751 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e60cf0cf-f42e-4d8c-a1be-977d5eab29ef-original-pull-secret podName:e60cf0cf-f42e-4d8c-a1be-977d5eab29ef nodeName:}" failed. No retries permitted until 2026-07-20 16:29:52.427730979 +0000 UTC m=+18.078613479 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e60cf0cf-f42e-4d8c-a1be-977d5eab29ef-original-pull-secret") pod "global-pull-secret-syncer-bpbjs" (UID: "e60cf0cf-f42e-4d8c-a1be-977d5eab29ef") : object "kube-system"/"original-pull-secret" not registered Jul 20 16:29:44.427863 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:44.427673 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:29:44.427863 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:44.427844 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d-metrics-certs podName:e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d nodeName:}" failed. No retries permitted until 2026-07-20 16:29:52.427808159 +0000 UTC m=+18.078690680 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d-metrics-certs") pod "network-metrics-daemon-wnqv5" (UID: "e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:29:44.629351 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:44.629232 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htnhl\" (UniqueName: \"kubernetes.io/projected/321c627e-8b07-4734-8de1-561625eb34fd-kube-api-access-htnhl\") pod \"network-check-target-z8hpf\" (UID: \"321c627e-8b07-4734-8de1-561625eb34fd\") " pod="openshift-network-diagnostics/network-check-target-z8hpf" Jul 20 16:29:44.629535 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:44.629410 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 16:29:44.629535 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:44.629430 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 16:29:44.629535 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:44.629441 2575 projected.go:196] Error preparing data for projected volume kube-api-access-htnhl for pod openshift-network-diagnostics/network-check-target-z8hpf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:29:44.629535 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:44.629500 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/321c627e-8b07-4734-8de1-561625eb34fd-kube-api-access-htnhl podName:321c627e-8b07-4734-8de1-561625eb34fd nodeName:}" failed. No retries permitted until 2026-07-20 16:29:52.62948189 +0000 UTC m=+18.280364369 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-htnhl" (UniqueName: "kubernetes.io/projected/321c627e-8b07-4734-8de1-561625eb34fd-kube-api-access-htnhl") pod "network-check-target-z8hpf" (UID: "321c627e-8b07-4734-8de1-561625eb34fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:29:44.848632 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:44.848550 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpbjs" Jul 20 16:29:44.848787 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:44.848689 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bpbjs" podUID="e60cf0cf-f42e-4d8c-a1be-977d5eab29ef" Jul 20 16:29:44.849218 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:44.849048 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnqv5" Jul 20 16:29:44.849218 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:44.849177 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnqv5" podUID="e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d" Jul 20 16:29:44.849406 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:44.849317 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8hpf" Jul 20 16:29:44.849469 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:44.849408 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8hpf" podUID="321c627e-8b07-4734-8de1-561625eb34fd" Jul 20 16:29:46.847928 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:46.847784 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8hpf" Jul 20 16:29:46.847928 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:46.847815 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpbjs" Jul 20 16:29:46.847928 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:46.847916 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8hpf" podUID="321c627e-8b07-4734-8de1-561625eb34fd" Jul 20 16:29:46.848582 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:46.848363 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bpbjs" podUID="e60cf0cf-f42e-4d8c-a1be-977d5eab29ef" Jul 20 16:29:46.848582 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:46.848427 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnqv5" Jul 20 16:29:46.848582 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:46.848509 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnqv5" podUID="e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d" Jul 20 16:29:47.918307 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:47.918221 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-157.ec2.internal" event={"ID":"712c64cf1d9c1af507f39dac3e30cbe7","Type":"ContainerStarted","Data":"3f98bcb02ea8b2aefffe4635e85c5d3385b6c37426237b081fb22303860c7074"} Jul 20 16:29:47.931843 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:47.931789 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-157.ec2.internal" podStartSLOduration=11.931770414 podStartE2EDuration="11.931770414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:29:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:29:47.931642984 +0000 UTC m=+13.582525483" watchObservedRunningTime="2026-07-20 16:29:47.931770414 +0000 UTC m=+13.582652913" Jul 20 16:29:48.848508 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:48.848260 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpbjs" Jul 20 16:29:48.848671 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:48.848621 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bpbjs" podUID="e60cf0cf-f42e-4d8c-a1be-977d5eab29ef" Jul 20 16:29:48.848671 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:48.848661 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnqv5" Jul 20 16:29:48.848792 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:48.848754 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnqv5" podUID="e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d" Jul 20 16:29:48.848848 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:48.848808 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8hpf" Jul 20 16:29:48.848899 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:48.848870 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8hpf" podUID="321c627e-8b07-4734-8de1-561625eb34fd" Jul 20 16:29:48.922014 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:48.921965 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" event={"ID":"70dd6078-d12c-4b47-aa03-fb96213c188b","Type":"ContainerStarted","Data":"c37628f0bac5d5f727d1558b2cd404ebc68b697567fe79ebb851da45a02ba146"} Jul 20 16:29:48.923599 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:48.923568 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m275f" event={"ID":"4f85b138-a3e7-4242-be3e-1a237173570a","Type":"ContainerStarted","Data":"dda3e532747d282de6ccc4befbb845c7ba0d784e307b0cd57572b8c965707c7b"} Jul 20 16:29:48.925264 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:48.925234 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kh6zc" event={"ID":"7377db3f-fd05-4a8f-9ac0-35a3245062da","Type":"ContainerStarted","Data":"03827af621dc00187a7b86ed3e5eb0e1456f3d7a86a3fd80a8a3e82a2e404ab9"} Jul 20 16:29:48.926903 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:48.926876 2575 generic.go:356] "Generic (PLEG): container finished" podID="a28546f7-4091-4291-aeaa-12fee18311ca" containerID="b494327ebc7cd7730951d9d36a11cb50a9a093a75f872f3a296fbedd0a9ca68c" exitCode=0 Jul 20 16:29:48.927009 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:48.926962 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htg96" event={"ID":"a28546f7-4091-4291-aeaa-12fee18311ca","Type":"ContainerDied","Data":"b494327ebc7cd7730951d9d36a11cb50a9a093a75f872f3a296fbedd0a9ca68c"} Jul 20 16:29:48.929259 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:48.929235 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4qcp" event={"ID":"d6d9a721-1745-4dcd-be6c-0698d368f5a9","Type":"ContainerStarted","Data":"502e281ef51e21cc3097ca60048457b9195ffc34299fbb7b071eb17b958eba10"} Jul 20 16:29:48.930788 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:48.930766 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r7vpx" event={"ID":"846c8111-559c-4131-a066-2c2338f37da7","Type":"ContainerStarted","Data":"1d8ee3d1860e9fec5897c4023c64f120ddf19b6b54e1c6e15643a9cda9eb867b"} Jul 20 16:29:48.938366 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:48.938327 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ckf7n" podStartSLOduration=3.0674919 podStartE2EDuration="13.93831364s" totalImagesPullingTime="10.87082174s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:29:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:29:48.938178017 +0000 UTC m=+14.589060517" watchObservedRunningTime="2026-07-20 16:29:48.93831364 +0000 UTC m=+14.589196144" Jul 20 16:29:48.951011 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:48.950972 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-m275f" podStartSLOduration=3.347186107 podStartE2EDuration="13.950954092s" totalImagesPullingTime="10.603767985s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:29:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:29:48.950760923 +0000 UTC m=+14.601643643" watchObservedRunningTime="2026-07-20 16:29:48.950954092 +0000 UTC m=+14.601836589" Jul 20 16:29:49.002099 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:49.002046 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kh6zc" podStartSLOduration=4.339991926 podStartE2EDuration="15.002025698s" totalImagesPullingTime="10.662033772s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:29:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:29:49.001312856 +0000 UTC m=+14.652195375" watchObservedRunningTime="2026-07-20 16:29:49.002025698 +0000 UTC m=+14.652908197" Jul 20 16:29:49.015371 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:49.015318 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-r7vpx" podStartSLOduration=3.368643286 podStartE2EDuration="14.015298607s" totalImagesPullingTime="10.646655321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:29:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:29:49.014948952 +0000 UTC m=+14.665831450" watchObservedRunningTime="2026-07-20 16:29:49.015298607 +0000 UTC m=+14.666181107" Jul 20 16:29:49.700746 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:49.700712 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-r7vpx" Jul 20 16:29:49.701312 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:49.701289 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-r7vpx" Jul 20 16:29:49.935138 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:49.935022 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5wqdx" event={"ID":"e8c92c04-1924-4079-a43f-93c6af8451f0","Type":"ContainerStarted","Data":"85ee7b12c6725f704f9400acc29643256af05ad10eabea8f411a28b9e3476cad"} Jul 20 16:29:49.952340 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:49.952286 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5wqdx" podStartSLOduration=4.344640051 podStartE2EDuration="14.952271464s" totalImagesPullingTime="10.607631413s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:29:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:29:49.951969601 +0000 UTC m=+15.602852101" watchObservedRunningTime="2026-07-20 16:29:49.952271464 +0000 UTC m=+15.603153961" Jul 20 16:29:50.848191 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:50.848154 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpbjs" Jul 20 16:29:50.848374 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:50.848154 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnqv5" Jul 20 16:29:50.848374 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:50.848275 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bpbjs" podUID="e60cf0cf-f42e-4d8c-a1be-977d5eab29ef" Jul 20 16:29:50.848374 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:50.848290 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8hpf" Jul 20 16:29:50.848542 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:50.848417 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnqv5" podUID="e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d" Jul 20 16:29:50.848542 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:50.848505 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8hpf" podUID="321c627e-8b07-4734-8de1-561625eb34fd" Jul 20 16:29:50.937126 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:50.937077 2575 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 20 16:29:52.487727 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:52.487686 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d-metrics-certs\") pod \"network-metrics-daemon-wnqv5\" (UID: \"e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d\") " pod="openshift-multus/network-metrics-daemon-wnqv5" Jul 20 16:29:52.488542 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:52.487838 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:29:52.488542 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:52.487879 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e60cf0cf-f42e-4d8c-a1be-977d5eab29ef-original-pull-secret\") pod \"global-pull-secret-syncer-bpbjs\" (UID: \"e60cf0cf-f42e-4d8c-a1be-977d5eab29ef\") " pod="kube-system/global-pull-secret-syncer-bpbjs" Jul 20 16:29:52.488542 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:52.487920 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d-metrics-certs podName:e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d nodeName:}" failed. No retries permitted until 2026-07-20 16:30:08.487896816 +0000 UTC m=+34.138779315 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d-metrics-certs") pod "network-metrics-daemon-wnqv5" (UID: "e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:29:52.488542 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:52.487991 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 16:29:52.488542 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:52.488075 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e60cf0cf-f42e-4d8c-a1be-977d5eab29ef-original-pull-secret podName:e60cf0cf-f42e-4d8c-a1be-977d5eab29ef nodeName:}" failed. No retries permitted until 2026-07-20 16:30:08.488035122 +0000 UTC m=+34.138917616 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e60cf0cf-f42e-4d8c-a1be-977d5eab29ef-original-pull-secret") pod "global-pull-secret-syncer-bpbjs" (UID: "e60cf0cf-f42e-4d8c-a1be-977d5eab29ef") : object "kube-system"/"original-pull-secret" not registered Jul 20 16:29:52.690154 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:52.690062 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htnhl\" (UniqueName: \"kubernetes.io/projected/321c627e-8b07-4734-8de1-561625eb34fd-kube-api-access-htnhl\") pod \"network-check-target-z8hpf\" (UID: \"321c627e-8b07-4734-8de1-561625eb34fd\") " pod="openshift-network-diagnostics/network-check-target-z8hpf" Jul 20 16:29:52.690345 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:52.690236 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 16:29:52.690345 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:52.690264 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 16:29:52.690345 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:52.690274 2575 projected.go:196] Error preparing data for projected volume kube-api-access-htnhl for pod openshift-network-diagnostics/network-check-target-z8hpf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:29:52.690345 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:52.690338 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/321c627e-8b07-4734-8de1-561625eb34fd-kube-api-access-htnhl podName:321c627e-8b07-4734-8de1-561625eb34fd nodeName:}" failed. No retries permitted until 2026-07-20 16:30:08.690319185 +0000 UTC m=+34.341201685 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-htnhl" (UniqueName: "kubernetes.io/projected/321c627e-8b07-4734-8de1-561625eb34fd-kube-api-access-htnhl") pod "network-check-target-z8hpf" (UID: "321c627e-8b07-4734-8de1-561625eb34fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:29:52.847484 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:52.847451 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpbjs" Jul 20 16:29:52.847484 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:52.847478 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnqv5" Jul 20 16:29:52.847723 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:52.847587 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bpbjs" podUID="e60cf0cf-f42e-4d8c-a1be-977d5eab29ef" Jul 20 16:29:52.847723 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:52.847671 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnqv5" podUID="e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d" Jul 20 16:29:52.847723 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:52.847695 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8hpf" Jul 20 16:29:52.847866 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:52.847760 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8hpf" podUID="321c627e-8b07-4734-8de1-561625eb34fd" Jul 20 16:29:54.848283 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:54.848253 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpbjs" Jul 20 16:29:54.848857 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:54.848360 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8hpf" Jul 20 16:29:54.848857 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:54.848401 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bpbjs" podUID="e60cf0cf-f42e-4d8c-a1be-977d5eab29ef" Jul 20 16:29:54.848857 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:54.848441 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8hpf" podUID="321c627e-8b07-4734-8de1-561625eb34fd" Jul 20 16:29:54.848857 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:54.848497 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnqv5" Jul 20 16:29:54.848857 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:54.848581 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnqv5" podUID="e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d" Jul 20 16:29:56.847482 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:56.847422 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnqv5" Jul 20 16:29:56.847482 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:56.847474 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8hpf" Jul 20 16:29:56.848000 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:56.847423 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpbjs" Jul 20 16:29:56.848000 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:56.847587 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnqv5" podUID="e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d" Jul 20 16:29:56.848000 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:56.847673 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bpbjs" podUID="e60cf0cf-f42e-4d8c-a1be-977d5eab29ef" Jul 20 16:29:56.848000 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:56.847748 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8hpf" podUID="321c627e-8b07-4734-8de1-561625eb34fd" Jul 20 16:29:57.293756 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:57.293527 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 20 16:29:57.834126 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:57.833796 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T16:29:57.293754671Z","UUID":"4a2071df-c01f-4280-9234-aa7f8de5ba1a","Handler":null,"Name":"","Endpoint":""} Jul 20 16:29:57.835619 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:57.835587 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 20 16:29:57.835791 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:57.835636 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 20 16:29:57.952037 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:57.951948 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-845hr" event={"ID":"9012df24-f877-4d10-8de5-feb1070f5421","Type":"ContainerStarted","Data":"ede18a7d446c77eeae0d980e9b2ae294871c55771254c81181b62af2adde303f"} Jul 20 16:29:57.953785 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:57.953762 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4qcp" event={"ID":"d6d9a721-1745-4dcd-be6c-0698d368f5a9","Type":"ContainerStarted","Data":"c840516fce1c4edbb824173f8415573521bfe79171f4178631e015f9fed4cde2"} Jul 20 16:29:57.957027 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:57.957005 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" event={"ID":"2f2fedc7-bf3b-4223-87a6-abcfff925fa0","Type":"ContainerStarted","Data":"d262171510d167f28fbed35436b16705b384daf2fbfba9e2f6845b58ba28169f"} Jul 20 16:29:57.957159 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:57.957057 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" event={"ID":"2f2fedc7-bf3b-4223-87a6-abcfff925fa0","Type":"ContainerStarted","Data":"2bcfccbe20e536111c269ab1dfd1be9d14cb760ab07b0dfad7271960b57558c1"} Jul 20 16:29:57.957159 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:57.957108 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" event={"ID":"2f2fedc7-bf3b-4223-87a6-abcfff925fa0","Type":"ContainerStarted","Data":"b1144e559bfe354b662d857a1affea17061d6a34dff2e84c7c3671f4f6537901"} Jul 20 16:29:57.957159 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:57.957147 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" event={"ID":"2f2fedc7-bf3b-4223-87a6-abcfff925fa0","Type":"ContainerStarted","Data":"1176ae68276c339ec72ec671d4d6ca05935a03bfe6ee316812ed615299d1cfa2"} Jul 20 16:29:57.957315 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:57.957177 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" event={"ID":"2f2fedc7-bf3b-4223-87a6-abcfff925fa0","Type":"ContainerStarted","Data":"1628e0a995f1dbcbbd098bd3fbfef112118d3e7b221c5179d336c75554ba500d"} Jul 20 16:29:57.957315 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:57.957204 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" event={"ID":"2f2fedc7-bf3b-4223-87a6-abcfff925fa0","Type":"ContainerStarted","Data":"e75ded3f9809672499b799c8cb52fe35622c5fdd489d1a403847e15dfdde3719"} Jul 20 16:29:57.970917 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:57.970870 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-845hr" podStartSLOduration=3.8590137970000002 podStartE2EDuration="23.970853144s" totalImagesPullingTime="20.111839347s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:29:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:29:57.970409831 +0000 UTC m=+23.621292330" watchObservedRunningTime="2026-07-20 16:29:57.970853144 +0000 UTC m=+23.621735642" Jul 20 16:29:58.848043 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:58.847961 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpbjs" Jul 20 16:29:58.848224 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:58.847968 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnqv5" Jul 20 16:29:58.848224 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:58.848077 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bpbjs" podUID="e60cf0cf-f42e-4d8c-a1be-977d5eab29ef" Jul 20 16:29:58.848224 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:58.848107 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8hpf" Jul 20 16:29:58.848380 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:58.848220 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnqv5" podUID="e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d" Jul 20 16:29:58.848380 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:29:58.848277 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8hpf" podUID="321c627e-8b07-4734-8de1-561625eb34fd" Jul 20 16:29:58.961344 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:58.961304 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4qcp" event={"ID":"d6d9a721-1745-4dcd-be6c-0698d368f5a9","Type":"ContainerStarted","Data":"142df6731f139667f10d617f8015b47943f9f734fcfdc6ca68b27685a17a23d1"} Jul 20 16:29:58.980547 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:29:58.980503 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4qcp" podStartSLOduration=3.075301979 podStartE2EDuration="23.980488916s" totalImagesPullingTime="20.905186937s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:29:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:29:58.980423885 +0000 UTC m=+24.631306404" watchObservedRunningTime="2026-07-20 16:29:58.980488916 +0000 UTC m=+24.631371413" Jul 20 16:30:00.847450 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:00.847409 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8hpf" Jul 20 16:30:00.848009 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:00.847409 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpbjs" Jul 20 16:30:00.848009 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:00.847544 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8hpf" podUID="321c627e-8b07-4734-8de1-561625eb34fd" Jul 20 16:30:00.848009 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:00.847415 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnqv5" Jul 20 16:30:00.848009 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:00.847632 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bpbjs" podUID="e60cf0cf-f42e-4d8c-a1be-977d5eab29ef" Jul 20 16:30:00.848009 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:00.847738 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnqv5" podUID="e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d" Jul 20 16:30:00.969202 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:00.969164 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" event={"ID":"2f2fedc7-bf3b-4223-87a6-abcfff925fa0","Type":"ContainerStarted","Data":"d010b8cfb8a6f280e774f7c52b09f2dc1f75c769bebb103b2acaf9ed74a4662c"} Jul 20 16:30:02.723265 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:02.723046 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-r7vpx" Jul 20 16:30:02.723932 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:02.723370 2575 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 20 16:30:02.723932 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:02.723644 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-r7vpx" Jul 20 16:30:02.848001 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:02.847927 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnqv5" Jul 20 16:30:02.848168 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:02.847930 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpbjs" Jul 20 16:30:02.848168 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:02.848048 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnqv5" podUID="e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d" Jul 20 16:30:02.848168 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:02.847930 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8hpf" Jul 20 16:30:02.848168 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:02.848131 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bpbjs" podUID="e60cf0cf-f42e-4d8c-a1be-977d5eab29ef" Jul 20 16:30:02.848318 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:02.848190 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8hpf" podUID="321c627e-8b07-4734-8de1-561625eb34fd" Jul 20 16:30:02.974613 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:02.974575 2575 generic.go:356] "Generic (PLEG): container finished" podID="a28546f7-4091-4291-aeaa-12fee18311ca" containerID="3185ecd0ac375487de0f891f8e222aea0e10d3bcca6334d10f634cd076ff80c4" exitCode=0 Jul 20 16:30:02.974809 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:02.974625 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htg96" event={"ID":"a28546f7-4091-4291-aeaa-12fee18311ca","Type":"ContainerDied","Data":"3185ecd0ac375487de0f891f8e222aea0e10d3bcca6334d10f634cd076ff80c4"} Jul 20 16:30:02.978365 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:02.978330 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" event={"ID":"2f2fedc7-bf3b-4223-87a6-abcfff925fa0","Type":"ContainerStarted","Data":"52688dd0e93886dbc472714d720ac8087f79a777fd90f3337b53aff8c66be227"} Jul 20 16:30:02.978620 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:02.978600 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:30:02.978713 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:02.978688 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:30:02.978770 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:02.978741 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:30:02.994703 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:02.994675 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:30:02.994869 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:02.994854 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:30:03.027545 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:03.027486 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" podStartSLOduration=7.902483897 podStartE2EDuration="28.027471342s" totalImagesPullingTime="20.124987445s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:29:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:03.026012181 +0000 UTC m=+28.676894678" watchObservedRunningTime="2026-07-20 16:30:03.027471342 +0000 UTC m=+28.678353839" Jul 20 16:30:04.231304 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:04.231215 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bpbjs"] Jul 20 16:30:04.231817 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:04.231343 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpbjs" Jul 20 16:30:04.231817 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:04.231462 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bpbjs" podUID="e60cf0cf-f42e-4d8c-a1be-977d5eab29ef" Jul 20 16:30:04.235229 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:04.235201 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wnqv5"] Jul 20 16:30:04.235392 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:04.235330 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnqv5" Jul 20 16:30:04.235472 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:04.235448 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnqv5" podUID="e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d" Jul 20 16:30:04.235959 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:04.235927 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z8hpf"] Jul 20 16:30:04.236069 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:04.236029 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8hpf" Jul 20 16:30:04.236153 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:04.236132 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8hpf" podUID="321c627e-8b07-4734-8de1-561625eb34fd" Jul 20 16:30:04.984997 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:04.984908 2575 generic.go:356] "Generic (PLEG): container finished" podID="a28546f7-4091-4291-aeaa-12fee18311ca" containerID="8f9d55dd9945f3a8d0b727171e9b5b902a841f1a41f9dd442169b32cc86528ae" exitCode=0 Jul 20 16:30:04.985160 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:04.985001 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htg96" event={"ID":"a28546f7-4091-4291-aeaa-12fee18311ca","Type":"ContainerDied","Data":"8f9d55dd9945f3a8d0b727171e9b5b902a841f1a41f9dd442169b32cc86528ae"} Jul 20 16:30:05.847345 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:05.847295 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8hpf" Jul 20 16:30:05.847345 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:05.847337 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpbjs" Jul 20 16:30:05.847345 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:05.847344 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnqv5" Jul 20 16:30:05.847919 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:05.847426 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8hpf" podUID="321c627e-8b07-4734-8de1-561625eb34fd" Jul 20 16:30:05.847919 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:05.847584 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bpbjs" podUID="e60cf0cf-f42e-4d8c-a1be-977d5eab29ef" Jul 20 16:30:05.847919 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:05.847659 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnqv5" podUID="e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d" Jul 20 16:30:06.991728 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:06.991488 2575 generic.go:356] "Generic (PLEG): container finished" podID="a28546f7-4091-4291-aeaa-12fee18311ca" containerID="6e6bc03779e57311e43cc7c7fc891d6330e798fdddf988aaffd64b496b589abe" exitCode=0 Jul 20 16:30:06.991728 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:06.991568 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htg96" event={"ID":"a28546f7-4091-4291-aeaa-12fee18311ca","Type":"ContainerDied","Data":"6e6bc03779e57311e43cc7c7fc891d6330e798fdddf988aaffd64b496b589abe"} Jul 20 16:30:07.848033 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:07.847990 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnqv5" Jul 20 16:30:07.848230 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:07.848132 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8hpf" Jul 20 16:30:07.848230 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:07.848140 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnqv5" podUID="e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d" Jul 20 16:30:07.848230 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:07.848173 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpbjs" Jul 20 16:30:07.848387 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:07.848271 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8hpf" podUID="321c627e-8b07-4734-8de1-561625eb34fd" Jul 20 16:30:07.848387 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:07.848365 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bpbjs" podUID="e60cf0cf-f42e-4d8c-a1be-977d5eab29ef" Jul 20 16:30:08.511167 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:08.511119 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e60cf0cf-f42e-4d8c-a1be-977d5eab29ef-original-pull-secret\") pod \"global-pull-secret-syncer-bpbjs\" (UID: \"e60cf0cf-f42e-4d8c-a1be-977d5eab29ef\") " pod="kube-system/global-pull-secret-syncer-bpbjs" Jul 20 16:30:08.511571 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:08.511180 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d-metrics-certs\") pod \"network-metrics-daemon-wnqv5\" (UID: \"e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d\") " pod="openshift-multus/network-metrics-daemon-wnqv5" Jul 20 16:30:08.511571 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:08.511273 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 16:30:08.511571 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:08.511327 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:30:08.511571 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:08.511353 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e60cf0cf-f42e-4d8c-a1be-977d5eab29ef-original-pull-secret podName:e60cf0cf-f42e-4d8c-a1be-977d5eab29ef nodeName:}" failed. No retries permitted until 2026-07-20 16:30:40.511328869 +0000 UTC m=+66.162211351 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e60cf0cf-f42e-4d8c-a1be-977d5eab29ef-original-pull-secret") pod "global-pull-secret-syncer-bpbjs" (UID: "e60cf0cf-f42e-4d8c-a1be-977d5eab29ef") : object "kube-system"/"original-pull-secret" not registered Jul 20 16:30:08.511571 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:08.511378 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d-metrics-certs podName:e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d nodeName:}" failed. No retries permitted until 2026-07-20 16:30:40.511361262 +0000 UTC m=+66.162243747 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d-metrics-certs") pod "network-metrics-daemon-wnqv5" (UID: "e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:30:08.712701 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:08.712620 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htnhl\" (UniqueName: \"kubernetes.io/projected/321c627e-8b07-4734-8de1-561625eb34fd-kube-api-access-htnhl\") pod \"network-check-target-z8hpf\" (UID: \"321c627e-8b07-4734-8de1-561625eb34fd\") " pod="openshift-network-diagnostics/network-check-target-z8hpf" Jul 20 16:30:08.712938 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:08.712793 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 16:30:08.712938 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:08.712818 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 16:30:08.712938 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:08.712833 2575 projected.go:196] Error preparing data for projected volume kube-api-access-htnhl for pod openshift-network-diagnostics/network-check-target-z8hpf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:30:08.712938 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:08.712891 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/321c627e-8b07-4734-8de1-561625eb34fd-kube-api-access-htnhl podName:321c627e-8b07-4734-8de1-561625eb34fd nodeName:}" failed. No retries permitted until 2026-07-20 16:30:40.71287783 +0000 UTC m=+66.363760307 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-htnhl" (UniqueName: "kubernetes.io/projected/321c627e-8b07-4734-8de1-561625eb34fd-kube-api-access-htnhl") pod "network-check-target-z8hpf" (UID: "321c627e-8b07-4734-8de1-561625eb34fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:30:09.847849 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:09.847800 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8hpf" Jul 20 16:30:09.848567 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:09.847914 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpbjs" Jul 20 16:30:09.848567 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:09.847927 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8hpf" podUID="321c627e-8b07-4734-8de1-561625eb34fd" Jul 20 16:30:09.848567 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:09.847952 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnqv5" Jul 20 16:30:09.848567 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:09.848051 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bpbjs" podUID="e60cf0cf-f42e-4d8c-a1be-977d5eab29ef" Jul 20 16:30:09.848567 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:09.848160 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnqv5" podUID="e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d" Jul 20 16:30:10.194390 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.194364 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-157.ec2.internal" event="NodeReady" Jul 20 16:30:10.194554 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.194487 2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 20 16:30:10.232475 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.232425 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-99wqw"] Jul 20 16:30:10.237263 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.237236 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j2v4n"] Jul 20 16:30:10.237491 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.237474 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-99wqw" Jul 20 16:30:10.240147 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.240115 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-55fc7b89f-fs62b"] Jul 20 16:30:10.240298 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.240206 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j2v4n" Jul 20 16:30:10.244282 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.243616 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 20 16:30:10.244282 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.243626 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vkl82\"" Jul 20 16:30:10.244282 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.243912 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 20 16:30:10.244282 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.244031 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 20 16:30:10.244282 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.244208 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-458jc\"" Jul 20 16:30:10.244654 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.244621 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-fzrfs"] Jul 20 16:30:10.244825 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.244805 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" Jul 20 16:30:10.245477 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.244918 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 20 16:30:10.246008 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.245704 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 20 16:30:10.246008 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.245719 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 20 16:30:10.247797 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.247778 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8dqnv"] Jul 20 16:30:10.248051 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.248032 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-fzrfs" Jul 20 16:30:10.248797 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.248766 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 20 16:30:10.248957 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.248939 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 20 16:30:10.249046 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.248968 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 20 16:30:10.249497 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.249288 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lntkl\"" Jul 20 16:30:10.249497 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.249294 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 20 16:30:10.251551 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.251528 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 20 16:30:10.252070 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.252050 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cqhg8"] Jul 20 16:30:10.252182 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.252128 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 20 16:30:10.252327 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.252313 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8dqnv" Jul 20 16:30:10.253672 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.253635 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-th62g\"" Jul 20 16:30:10.255227 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.255205 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-tw742"] Jul 20 16:30:10.255418 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.255397 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cqhg8" Jul 20 16:30:10.258431 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.258412 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 20 16:30:10.259235 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.259218 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 20 16:30:10.260068 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.260047 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 20 16:30:10.262339 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.261404 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fhr2l\"" Jul 20 16:30:10.262339 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.261788 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-lq9dg\"" Jul 20 16:30:10.262588 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.262571 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8dqnv"] Jul 20 16:30:10.263125 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.263108 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-tw742" Jul 20 16:30:10.263703 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.263678 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-fzrfs"] Jul 20 16:30:10.264367 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.264345 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 20 16:30:10.264506 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.264484 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 20 16:30:10.264610 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.264527 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 20 16:30:10.264610 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.264593 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j2v4n"] Jul 20 16:30:10.264777 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.264761 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 20 16:30:10.264908 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.264889 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 20 16:30:10.265010 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.264864 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 20 16:30:10.265166 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.264817 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 20 16:30:10.265511 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.265339 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 20 16:30:10.265511 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.265413 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 20 16:30:10.266013 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.265995 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-99wqw"] Jul 20 16:30:10.268869 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.268853 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-tw742"] Jul 20 16:30:10.269051 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.269038 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cqhg8"] Jul 20 16:30:10.269228 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.269216 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9vvcp"] Jul 20 16:30:10.270342 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.270324 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-vl7dm\"" Jul 20 16:30:10.270465 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.270419 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 20 16:30:10.272124 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.270418 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 20 16:30:10.275406 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.275383 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mfsjt"] Jul 20 16:30:10.277060 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.277038 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9vvcp" Jul 20 16:30:10.278458 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.278438 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 20 16:30:10.281046 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.280007 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-5659v"] Jul 20 16:30:10.281341 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.280428 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mfsjt" Jul 20 16:30:10.281699 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.280802 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 20 16:30:10.281858 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.280906 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 20 16:30:10.281974 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.280930 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 20 16:30:10.282141 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.280950 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 20 16:30:10.282494 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.282396 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-h96v9\"" Jul 20 16:30:10.285520 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.285227 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 20 16:30:10.285520 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.285496 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 20 16:30:10.285785 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.285766 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lwj5v\"" Jul 20 16:30:10.286664 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.286643 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-w24p9"] Jul 20 16:30:10.286946 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.286931 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5659v" Jul 20 16:30:10.289565 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.289546 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 20 16:30:10.289920 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.289756 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-zs9hx\"" Jul 20 16:30:10.289920 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.289885 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 20 16:30:10.293393 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.293374 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-642qq"] Jul 20 16:30:10.293595 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.293568 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-w24p9" Jul 20 16:30:10.296481 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.296464 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 20 16:30:10.296694 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.296474 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-bz87s\"" Jul 20 16:30:10.296815 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.296797 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-9c5c4477b-t6gf6"] Jul 20 16:30:10.296904 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.296890 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-642qq" Jul 20 16:30:10.297188 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.297168 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 20 16:30:10.299286 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.299265 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-djkfh\"" Jul 20 16:30:10.299380 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.299364 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 20 16:30:10.299520 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.299503 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 20 16:30:10.299709 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.299522 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 20 16:30:10.300887 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.300866 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55fc7b89f-fs62b"] Jul 20 16:30:10.300984 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.300906 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mfsjt"] Jul 20 16:30:10.300984 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.300932 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-5659v"] Jul 20 16:30:10.300984 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.300949 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-w24p9"] Jul 20 16:30:10.300984 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.300967 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9vvcp"] Jul 20 16:30:10.300984 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.300985 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-642qq"] Jul 20 16:30:10.301239 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.301016 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-9c5c4477b-t6gf6"] Jul 20 16:30:10.301239 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.301114 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-9c5c4477b-t6gf6" Jul 20 16:30:10.303320 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.303301 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 20 16:30:10.303832 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.303790 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 20 16:30:10.303954 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.303935 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 20 16:30:10.304050 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.303957 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-tfxqx\"" Jul 20 16:30:10.304050 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.303840 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 20 16:30:10.304378 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.304359 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 20 16:30:10.304467 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.304361 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 20 16:30:10.424215 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.424180 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/70abe44f-c09a-4818-b892-7b725bc197ae-default-certificate\") pod \"router-default-9c5c4477b-t6gf6\" (UID: \"70abe44f-c09a-4818-b892-7b725bc197ae\") " pod="openshift-ingress/router-default-9c5c4477b-t6gf6" Jul 20 16:30:10.424215 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.424228 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbwdb\" (UniqueName: \"kubernetes.io/projected/c8a0179d-26cb-47cc-97ae-364a22d796fe-kube-api-access-pbwdb\") pod \"image-registry-55fc7b89f-fs62b\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" Jul 20 16:30:10.424462 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.424257 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3bc894d1-53f4-415a-820c-30d02901904f-config\") pod \"service-ca-operator-5bcbc94c78-cqhg8\" (UID: \"3bc894d1-53f4-415a-820c-30d02901904f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cqhg8" Jul 20 16:30:10.424462 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.424283 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0ec4c40f-7638-4fe3-8bff-edb2579a3b3b-serving-cert\") pod \"console-operator-565b7b569d-99wqw\" (UID: \"0ec4c40f-7638-4fe3-8bff-edb2579a3b3b\") " pod="openshift-console-operator/console-operator-565b7b569d-99wqw" Jul 20 16:30:10.424462 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.424308 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c8a0179d-26cb-47cc-97ae-364a22d796fe-registry-certificates\") pod \"image-registry-55fc7b89f-fs62b\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" Jul 20 16:30:10.424462 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.424371 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfhk8\" (UniqueName: \"kubernetes.io/projected/bbfb6c85-631b-4639-8b95-5342f1f06c3a-kube-api-access-qfhk8\") pod \"volume-data-source-validator-78cf4c6f6-tw742\" (UID: \"bbfb6c85-631b-4639-8b95-5342f1f06c3a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-tw742" Jul 20 16:30:10.424462 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.424411 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd433e6a-a361-4daf-bbbe-053e843cca00-tmp-dir\") pod \"dns-default-mfsjt\" (UID: \"bd433e6a-a361-4daf-bbbe-053e843cca00\") " pod="openshift-dns/dns-default-mfsjt" Jul 20 16:30:10.424462 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.424445 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mfzw\" (UniqueName: \"kubernetes.io/projected/be235707-ca7f-4d7f-98f7-454db0d5b23b-kube-api-access-5mfzw\") pod \"network-check-source-7bc5b6bf85-w24p9\" (UID: \"be235707-ca7f-4d7f-98f7-454db0d5b23b\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-w24p9" Jul 20 16:30:10.424730 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.424470 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd433e6a-a361-4daf-bbbe-053e843cca00-metrics-tls\") pod \"dns-default-mfsjt\" (UID: \"bd433e6a-a361-4daf-bbbe-053e843cca00\") " pod="openshift-dns/dns-default-mfsjt" Jul 20 16:30:10.424730 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.424569 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-879rk\" (UniqueName: \"kubernetes.io/projected/8759baf3-9e6d-4cd5-817b-c55aa90e7518-kube-api-access-879rk\") pod \"kube-storage-version-migrator-operator-7658d9b749-9vvcp\" (UID: \"8759baf3-9e6d-4cd5-817b-c55aa90e7518\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9vvcp" Jul 20 16:30:10.424730 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.424612 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k92p5\" (UniqueName: \"kubernetes.io/projected/bd433e6a-a361-4daf-bbbe-053e843cca00-kube-api-access-k92p5\") pod \"dns-default-mfsjt\" (UID: \"bd433e6a-a361-4daf-bbbe-053e843cca00\") " pod="openshift-dns/dns-default-mfsjt" Jul 20 16:30:10.424730 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.424642 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8ee47b7a-0762-47f2-9d04-d564e41fb936-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-5659v\" (UID: \"8ee47b7a-0762-47f2-9d04-d564e41fb936\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5659v" Jul 20 16:30:10.424730 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.424671 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c8a0179d-26cb-47cc-97ae-364a22d796fe-image-registry-private-configuration\") pod \"image-registry-55fc7b89f-fs62b\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" Jul 20 16:30:10.424730 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.424694 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfzkb\" (UniqueName: \"kubernetes.io/projected/70abe44f-c09a-4818-b892-7b725bc197ae-kube-api-access-sfzkb\") pod \"router-default-9c5c4477b-t6gf6\" (UID: \"70abe44f-c09a-4818-b892-7b725bc197ae\") " pod="openshift-ingress/router-default-9c5c4477b-t6gf6" Jul 20 16:30:10.424730 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.424723 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c8a0179d-26cb-47cc-97ae-364a22d796fe-installation-pull-secrets\") pod \"image-registry-55fc7b89f-fs62b\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" Jul 20 16:30:10.425023 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.424757 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/36b61e21-6ab6-46aa-853b-299dcee26854-serving-cert\") pod \"insights-operator-555d9d7885-fzrfs\" (UID: \"36b61e21-6ab6-46aa-853b-299dcee26854\") " pod="openshift-insights/insights-operator-555d9d7885-fzrfs" Jul 20 16:30:10.425023 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.424795 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pwbx\" (UniqueName: \"kubernetes.io/projected/3bc894d1-53f4-415a-820c-30d02901904f-kube-api-access-2pwbx\") pod \"service-ca-operator-5bcbc94c78-cqhg8\" (UID: \"3bc894d1-53f4-415a-820c-30d02901904f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cqhg8" Jul 20 16:30:10.425023 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.424819 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bd433e6a-a361-4daf-bbbe-053e843cca00-config-volume\") pod \"dns-default-mfsjt\" (UID: \"bd433e6a-a361-4daf-bbbe-053e843cca00\") " pod="openshift-dns/dns-default-mfsjt" Jul 20 16:30:10.425023 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.424842 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/36b61e21-6ab6-46aa-853b-299dcee26854-snapshots\") pod \"insights-operator-555d9d7885-fzrfs\" (UID: \"36b61e21-6ab6-46aa-853b-299dcee26854\") " pod="openshift-insights/insights-operator-555d9d7885-fzrfs" Jul 20 16:30:10.425023 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.424890 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70abe44f-c09a-4818-b892-7b725bc197ae-metrics-certs\") pod \"router-default-9c5c4477b-t6gf6\" (UID: \"70abe44f-c09a-4818-b892-7b725bc197ae\") " pod="openshift-ingress/router-default-9c5c4477b-t6gf6" Jul 20 16:30:10.425023 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.424914 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c8a0179d-26cb-47cc-97ae-364a22d796fe-ca-trust-extracted\") pod \"image-registry-55fc7b89f-fs62b\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" Jul 20 16:30:10.425023 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.424939 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c8a0179d-26cb-47cc-97ae-364a22d796fe-trusted-ca\") pod \"image-registry-55fc7b89f-fs62b\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" Jul 20 16:30:10.425023 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.424962 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fd5f02ab-a975-44c8-af0d-5a82dcb219af-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-j2v4n\" (UID: \"fd5f02ab-a975-44c8-af0d-5a82dcb219af\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j2v4n" Jul 20 16:30:10.425023 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.424994 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8a0179d-26cb-47cc-97ae-364a22d796fe-bound-sa-token\") pod \"image-registry-55fc7b89f-fs62b\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" Jul 20 16:30:10.425402 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.425044 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6n9k\" (UniqueName: \"kubernetes.io/projected/f3ca3fdc-9728-4d63-8847-448196cf79ab-kube-api-access-g6n9k\") pod \"ingress-canary-642qq\" (UID: \"f3ca3fdc-9728-4d63-8847-448196cf79ab\") " pod="openshift-ingress-canary/ingress-canary-642qq" Jul 20 16:30:10.425402 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.425071 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8759baf3-9e6d-4cd5-817b-c55aa90e7518-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-9vvcp\" (UID: \"8759baf3-9e6d-4cd5-817b-c55aa90e7518\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9vvcp" Jul 20 16:30:10.425402 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.425125 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skn8j\" (UniqueName: \"kubernetes.io/projected/fd5f02ab-a975-44c8-af0d-5a82dcb219af-kube-api-access-skn8j\") pod \"cluster-samples-operator-79b7c55f87-j2v4n\" (UID: \"fd5f02ab-a975-44c8-af0d-5a82dcb219af\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j2v4n" Jul 20 16:30:10.425402 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.425156 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-8dqnv\" (UID: \"53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8dqnv" Jul 20 16:30:10.425402 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.425180 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3ca3fdc-9728-4d63-8847-448196cf79ab-cert\") pod \"ingress-canary-642qq\" (UID: \"f3ca3fdc-9728-4d63-8847-448196cf79ab\") " pod="openshift-ingress-canary/ingress-canary-642qq" Jul 20 16:30:10.425402 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.425225 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36b61e21-6ab6-46aa-853b-299dcee26854-tmp\") pod \"insights-operator-555d9d7885-fzrfs\" (UID: \"36b61e21-6ab6-46aa-853b-299dcee26854\") " pod="openshift-insights/insights-operator-555d9d7885-fzrfs" Jul 20 16:30:10.425402 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.425293 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8ee47b7a-0762-47f2-9d04-d564e41fb936-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-5659v\" (UID: \"8ee47b7a-0762-47f2-9d04-d564e41fb936\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5659v" Jul 20 16:30:10.425402 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.425317 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36b61e21-6ab6-46aa-853b-299dcee26854-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-fzrfs\" (UID: \"36b61e21-6ab6-46aa-853b-299dcee26854\") " pod="openshift-insights/insights-operator-555d9d7885-fzrfs" Jul 20 16:30:10.425402 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.425340 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rhjh\" (UniqueName: \"kubernetes.io/projected/36b61e21-6ab6-46aa-853b-299dcee26854-kube-api-access-5rhjh\") pod \"insights-operator-555d9d7885-fzrfs\" (UID: \"36b61e21-6ab6-46aa-853b-299dcee26854\") " pod="openshift-insights/insights-operator-555d9d7885-fzrfs" Jul 20 16:30:10.425402 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.425362 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-8dqnv\" (UID: \"53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8dqnv" Jul 20 16:30:10.425402 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.425399 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3bc894d1-53f4-415a-820c-30d02901904f-serving-cert\") pod \"service-ca-operator-5bcbc94c78-cqhg8\" (UID: \"3bc894d1-53f4-415a-820c-30d02901904f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cqhg8" Jul 20 16:30:10.425826 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.425434 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36b61e21-6ab6-46aa-853b-299dcee26854-service-ca-bundle\") pod \"insights-operator-555d9d7885-fzrfs\" (UID: \"36b61e21-6ab6-46aa-853b-299dcee26854\") " pod="openshift-insights/insights-operator-555d9d7885-fzrfs" Jul 20 16:30:10.425826 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.425464 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8759baf3-9e6d-4cd5-817b-c55aa90e7518-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-9vvcp\" (UID: \"8759baf3-9e6d-4cd5-817b-c55aa90e7518\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9vvcp" Jul 20 16:30:10.425826 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.425485 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0ec4c40f-7638-4fe3-8bff-edb2579a3b3b-config\") pod \"console-operator-565b7b569d-99wqw\" (UID: \"0ec4c40f-7638-4fe3-8bff-edb2579a3b3b\") " pod="openshift-console-operator/console-operator-565b7b569d-99wqw" Jul 20 16:30:10.425826 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.425509 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70abe44f-c09a-4818-b892-7b725bc197ae-service-ca-bundle\") pod \"router-default-9c5c4477b-t6gf6\" (UID: \"70abe44f-c09a-4818-b892-7b725bc197ae\") " pod="openshift-ingress/router-default-9c5c4477b-t6gf6" Jul 20 16:30:10.425826 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.425533 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bdr5\" (UniqueName: \"kubernetes.io/projected/53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3-kube-api-access-7bdr5\") pod \"cluster-monitoring-operator-76cf8966f8-8dqnv\" (UID: \"53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8dqnv" Jul 20 16:30:10.425826 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.425559 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/70abe44f-c09a-4818-b892-7b725bc197ae-stats-auth\") pod \"router-default-9c5c4477b-t6gf6\" (UID: \"70abe44f-c09a-4818-b892-7b725bc197ae\") " pod="openshift-ingress/router-default-9c5c4477b-t6gf6" Jul 20 16:30:10.425826 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.425583 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8a0179d-26cb-47cc-97ae-364a22d796fe-registry-tls\") pod \"image-registry-55fc7b89f-fs62b\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" Jul 20 16:30:10.425826 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.425623 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0ec4c40f-7638-4fe3-8bff-edb2579a3b3b-trusted-ca\") pod \"console-operator-565b7b569d-99wqw\" (UID: \"0ec4c40f-7638-4fe3-8bff-edb2579a3b3b\") " pod="openshift-console-operator/console-operator-565b7b569d-99wqw" Jul 20 16:30:10.425826 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.425648 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf8p7\" (UniqueName: \"kubernetes.io/projected/0ec4c40f-7638-4fe3-8bff-edb2579a3b3b-kube-api-access-zf8p7\") pod \"console-operator-565b7b569d-99wqw\" (UID: \"0ec4c40f-7638-4fe3-8bff-edb2579a3b3b\") " pod="openshift-console-operator/console-operator-565b7b569d-99wqw" Jul 20 16:30:10.527123 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.527016 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c8a0179d-26cb-47cc-97ae-364a22d796fe-registry-certificates\") pod \"image-registry-55fc7b89f-fs62b\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" Jul 20 16:30:10.527123 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.527052 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfhk8\" (UniqueName: \"kubernetes.io/projected/bbfb6c85-631b-4639-8b95-5342f1f06c3a-kube-api-access-qfhk8\") pod \"volume-data-source-validator-78cf4c6f6-tw742\" (UID: \"bbfb6c85-631b-4639-8b95-5342f1f06c3a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-tw742" Jul 20 16:30:10.527123 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.527069 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd433e6a-a361-4daf-bbbe-053e843cca00-tmp-dir\") pod \"dns-default-mfsjt\" (UID: \"bd433e6a-a361-4daf-bbbe-053e843cca00\") " pod="openshift-dns/dns-default-mfsjt" Jul 20 16:30:10.527123 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.527115 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mfzw\" (UniqueName: \"kubernetes.io/projected/be235707-ca7f-4d7f-98f7-454db0d5b23b-kube-api-access-5mfzw\") pod \"network-check-source-7bc5b6bf85-w24p9\" (UID: \"be235707-ca7f-4d7f-98f7-454db0d5b23b\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-w24p9" Jul 20 16:30:10.527448 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.527132 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd433e6a-a361-4daf-bbbe-053e843cca00-metrics-tls\") pod \"dns-default-mfsjt\" (UID: \"bd433e6a-a361-4daf-bbbe-053e843cca00\") " pod="openshift-dns/dns-default-mfsjt" Jul 20 16:30:10.527448 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.527150 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-879rk\" (UniqueName: \"kubernetes.io/projected/8759baf3-9e6d-4cd5-817b-c55aa90e7518-kube-api-access-879rk\") pod \"kube-storage-version-migrator-operator-7658d9b749-9vvcp\" (UID: \"8759baf3-9e6d-4cd5-817b-c55aa90e7518\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9vvcp" Jul 20 16:30:10.527448 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.527167 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k92p5\" (UniqueName: \"kubernetes.io/projected/bd433e6a-a361-4daf-bbbe-053e843cca00-kube-api-access-k92p5\") pod \"dns-default-mfsjt\" (UID: \"bd433e6a-a361-4daf-bbbe-053e843cca00\") " pod="openshift-dns/dns-default-mfsjt" Jul 20 16:30:10.527448 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.527186 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8ee47b7a-0762-47f2-9d04-d564e41fb936-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-5659v\" (UID: \"8ee47b7a-0762-47f2-9d04-d564e41fb936\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5659v" Jul 20 16:30:10.527448 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.527203 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c8a0179d-26cb-47cc-97ae-364a22d796fe-image-registry-private-configuration\") pod \"image-registry-55fc7b89f-fs62b\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" Jul 20 16:30:10.527448 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.527226 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfzkb\" (UniqueName: \"kubernetes.io/projected/70abe44f-c09a-4818-b892-7b725bc197ae-kube-api-access-sfzkb\") pod \"router-default-9c5c4477b-t6gf6\" (UID: \"70abe44f-c09a-4818-b892-7b725bc197ae\") " pod="openshift-ingress/router-default-9c5c4477b-t6gf6" Jul 20 16:30:10.527448 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:10.527320 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 16:30:10.527448 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:10.527334 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 20 16:30:10.527448 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:10.527392 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd433e6a-a361-4daf-bbbe-053e843cca00-metrics-tls podName:bd433e6a-a361-4daf-bbbe-053e843cca00 nodeName:}" failed. No retries permitted until 2026-07-20 16:30:11.027371761 +0000 UTC m=+36.678254242 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd433e6a-a361-4daf-bbbe-053e843cca00-metrics-tls") pod "dns-default-mfsjt" (UID: "bd433e6a-a361-4daf-bbbe-053e843cca00") : secret "dns-default-metrics-tls" not found Jul 20 16:30:10.527448 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.527416 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c8a0179d-26cb-47cc-97ae-364a22d796fe-installation-pull-secrets\") pod \"image-registry-55fc7b89f-fs62b\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" Jul 20 16:30:10.527448 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.527448 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/36b61e21-6ab6-46aa-853b-299dcee26854-serving-cert\") pod \"insights-operator-555d9d7885-fzrfs\" (UID: \"36b61e21-6ab6-46aa-853b-299dcee26854\") " pod="openshift-insights/insights-operator-555d9d7885-fzrfs" Jul 20 16:30:10.528026 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.527480 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pwbx\" (UniqueName: \"kubernetes.io/projected/3bc894d1-53f4-415a-820c-30d02901904f-kube-api-access-2pwbx\") pod \"service-ca-operator-5bcbc94c78-cqhg8\" (UID: \"3bc894d1-53f4-415a-820c-30d02901904f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cqhg8" Jul 20 16:30:10.528026 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.527505 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bd433e6a-a361-4daf-bbbe-053e843cca00-config-volume\") pod \"dns-default-mfsjt\" (UID: \"bd433e6a-a361-4daf-bbbe-053e843cca00\") " pod="openshift-dns/dns-default-mfsjt" Jul 20 16:30:10.528026 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.527521 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd433e6a-a361-4daf-bbbe-053e843cca00-tmp-dir\") pod \"dns-default-mfsjt\" (UID: \"bd433e6a-a361-4daf-bbbe-053e843cca00\") " pod="openshift-dns/dns-default-mfsjt" Jul 20 16:30:10.528026 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:10.527536 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ee47b7a-0762-47f2-9d04-d564e41fb936-networking-console-plugin-cert podName:8ee47b7a-0762-47f2-9d04-d564e41fb936 nodeName:}" failed. No retries permitted until 2026-07-20 16:30:11.027520869 +0000 UTC m=+36.678403351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8ee47b7a-0762-47f2-9d04-d564e41fb936-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-5659v" (UID: "8ee47b7a-0762-47f2-9d04-d564e41fb936") : secret "networking-console-plugin-cert" not found Jul 20 16:30:10.528026 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.527610 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/36b61e21-6ab6-46aa-853b-299dcee26854-snapshots\") pod \"insights-operator-555d9d7885-fzrfs\" (UID: \"36b61e21-6ab6-46aa-853b-299dcee26854\") " pod="openshift-insights/insights-operator-555d9d7885-fzrfs" Jul 20 16:30:10.528026 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.527761 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70abe44f-c09a-4818-b892-7b725bc197ae-metrics-certs\") pod \"router-default-9c5c4477b-t6gf6\" (UID: \"70abe44f-c09a-4818-b892-7b725bc197ae\") " pod="openshift-ingress/router-default-9c5c4477b-t6gf6" Jul 20 16:30:10.528026 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.527773 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c8a0179d-26cb-47cc-97ae-364a22d796fe-registry-certificates\") pod \"image-registry-55fc7b89f-fs62b\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" Jul 20 16:30:10.528026 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.527797 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c8a0179d-26cb-47cc-97ae-364a22d796fe-ca-trust-extracted\") pod \"image-registry-55fc7b89f-fs62b\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" Jul 20 16:30:10.528026 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.527828 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c8a0179d-26cb-47cc-97ae-364a22d796fe-trusted-ca\") pod \"image-registry-55fc7b89f-fs62b\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" Jul 20 16:30:10.528026 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:10.527846 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 16:30:10.528026 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.527850 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fd5f02ab-a975-44c8-af0d-5a82dcb219af-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-j2v4n\" (UID: \"fd5f02ab-a975-44c8-af0d-5a82dcb219af\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j2v4n" Jul 20 16:30:10.528026 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.527887 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8a0179d-26cb-47cc-97ae-364a22d796fe-bound-sa-token\") pod \"image-registry-55fc7b89f-fs62b\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" Jul 20 16:30:10.528026 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:10.527899 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70abe44f-c09a-4818-b892-7b725bc197ae-metrics-certs podName:70abe44f-c09a-4818-b892-7b725bc197ae nodeName:}" failed. No retries permitted until 2026-07-20 16:30:11.027884358 +0000 UTC m=+36.678766853 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70abe44f-c09a-4818-b892-7b725bc197ae-metrics-certs") pod "router-default-9c5c4477b-t6gf6" (UID: "70abe44f-c09a-4818-b892-7b725bc197ae") : secret "router-metrics-certs-default" not found Jul 20 16:30:10.528026 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.527926 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6n9k\" (UniqueName: \"kubernetes.io/projected/f3ca3fdc-9728-4d63-8847-448196cf79ab-kube-api-access-g6n9k\") pod \"ingress-canary-642qq\" (UID: \"f3ca3fdc-9728-4d63-8847-448196cf79ab\") " pod="openshift-ingress-canary/ingress-canary-642qq" Jul 20 16:30:10.528026 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.527952 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8759baf3-9e6d-4cd5-817b-c55aa90e7518-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-9vvcp\" (UID: \"8759baf3-9e6d-4cd5-817b-c55aa90e7518\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9vvcp" Jul 20 16:30:10.528780 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.527980 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skn8j\" (UniqueName: \"kubernetes.io/projected/fd5f02ab-a975-44c8-af0d-5a82dcb219af-kube-api-access-skn8j\") pod \"cluster-samples-operator-79b7c55f87-j2v4n\" (UID: \"fd5f02ab-a975-44c8-af0d-5a82dcb219af\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j2v4n" Jul 20 16:30:10.528780 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.528012 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-8dqnv\" (UID: \"53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8dqnv" Jul 20 16:30:10.528780 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.528036 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3ca3fdc-9728-4d63-8847-448196cf79ab-cert\") pod \"ingress-canary-642qq\" (UID: \"f3ca3fdc-9728-4d63-8847-448196cf79ab\") " pod="openshift-ingress-canary/ingress-canary-642qq" Jul 20 16:30:10.528780 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.528061 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36b61e21-6ab6-46aa-853b-299dcee26854-tmp\") pod \"insights-operator-555d9d7885-fzrfs\" (UID: \"36b61e21-6ab6-46aa-853b-299dcee26854\") " pod="openshift-insights/insights-operator-555d9d7885-fzrfs" Jul 20 16:30:10.528780 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.528126 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8ee47b7a-0762-47f2-9d04-d564e41fb936-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-5659v\" (UID: \"8ee47b7a-0762-47f2-9d04-d564e41fb936\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5659v" Jul 20 16:30:10.528780 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.528158 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c8a0179d-26cb-47cc-97ae-364a22d796fe-ca-trust-extracted\") pod \"image-registry-55fc7b89f-fs62b\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" Jul 20 16:30:10.528780 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.528177 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36b61e21-6ab6-46aa-853b-299dcee26854-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-fzrfs\" (UID: \"36b61e21-6ab6-46aa-853b-299dcee26854\") " pod="openshift-insights/insights-operator-555d9d7885-fzrfs" Jul 20 16:30:10.528780 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.528199 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rhjh\" (UniqueName: \"kubernetes.io/projected/36b61e21-6ab6-46aa-853b-299dcee26854-kube-api-access-5rhjh\") pod \"insights-operator-555d9d7885-fzrfs\" (UID: \"36b61e21-6ab6-46aa-853b-299dcee26854\") " pod="openshift-insights/insights-operator-555d9d7885-fzrfs" Jul 20 16:30:10.528780 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.528209 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bd433e6a-a361-4daf-bbbe-053e843cca00-config-volume\") pod \"dns-default-mfsjt\" (UID: \"bd433e6a-a361-4daf-bbbe-053e843cca00\") " pod="openshift-dns/dns-default-mfsjt" Jul 20 16:30:10.528780 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.528221 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-8dqnv\" (UID: \"53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8dqnv" Jul 20 16:30:10.528780 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.528258 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3bc894d1-53f4-415a-820c-30d02901904f-serving-cert\") pod \"service-ca-operator-5bcbc94c78-cqhg8\" (UID: \"3bc894d1-53f4-415a-820c-30d02901904f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cqhg8" Jul 20 16:30:10.528780 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.528281 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36b61e21-6ab6-46aa-853b-299dcee26854-service-ca-bundle\") pod \"insights-operator-555d9d7885-fzrfs\" (UID: \"36b61e21-6ab6-46aa-853b-299dcee26854\") " pod="openshift-insights/insights-operator-555d9d7885-fzrfs" Jul 20 16:30:10.528780 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.528310 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8759baf3-9e6d-4cd5-817b-c55aa90e7518-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-9vvcp\" (UID: \"8759baf3-9e6d-4cd5-817b-c55aa90e7518\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9vvcp" Jul 20 16:30:10.528780 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.528333 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0ec4c40f-7638-4fe3-8bff-edb2579a3b3b-config\") pod \"console-operator-565b7b569d-99wqw\" (UID: \"0ec4c40f-7638-4fe3-8bff-edb2579a3b3b\") " pod="openshift-console-operator/console-operator-565b7b569d-99wqw" Jul 20 16:30:10.528780 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.528355 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70abe44f-c09a-4818-b892-7b725bc197ae-service-ca-bundle\") pod \"router-default-9c5c4477b-t6gf6\" (UID: \"70abe44f-c09a-4818-b892-7b725bc197ae\") " pod="openshift-ingress/router-default-9c5c4477b-t6gf6" Jul 20 16:30:10.528780 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.528390 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bdr5\" (UniqueName: \"kubernetes.io/projected/53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3-kube-api-access-7bdr5\") pod \"cluster-monitoring-operator-76cf8966f8-8dqnv\" (UID: \"53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8dqnv" Jul 20 16:30:10.529496 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.528419 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/70abe44f-c09a-4818-b892-7b725bc197ae-stats-auth\") pod \"router-default-9c5c4477b-t6gf6\" (UID: \"70abe44f-c09a-4818-b892-7b725bc197ae\") " pod="openshift-ingress/router-default-9c5c4477b-t6gf6" Jul 20 16:30:10.529496 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.528449 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8a0179d-26cb-47cc-97ae-364a22d796fe-registry-tls\") pod \"image-registry-55fc7b89f-fs62b\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" Jul 20 16:30:10.529496 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.528484 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0ec4c40f-7638-4fe3-8bff-edb2579a3b3b-trusted-ca\") pod \"console-operator-565b7b569d-99wqw\" (UID: \"0ec4c40f-7638-4fe3-8bff-edb2579a3b3b\") " pod="openshift-console-operator/console-operator-565b7b569d-99wqw" Jul 20 16:30:10.529496 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.528510 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf8p7\" (UniqueName: \"kubernetes.io/projected/0ec4c40f-7638-4fe3-8bff-edb2579a3b3b-kube-api-access-zf8p7\") pod \"console-operator-565b7b569d-99wqw\" (UID: \"0ec4c40f-7638-4fe3-8bff-edb2579a3b3b\") " pod="openshift-console-operator/console-operator-565b7b569d-99wqw" Jul 20 16:30:10.529496 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.528558 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/70abe44f-c09a-4818-b892-7b725bc197ae-default-certificate\") pod \"router-default-9c5c4477b-t6gf6\" (UID: \"70abe44f-c09a-4818-b892-7b725bc197ae\") " pod="openshift-ingress/router-default-9c5c4477b-t6gf6" Jul 20 16:30:10.529496 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.528582 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbwdb\" (UniqueName: \"kubernetes.io/projected/c8a0179d-26cb-47cc-97ae-364a22d796fe-kube-api-access-pbwdb\") pod \"image-registry-55fc7b89f-fs62b\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" Jul 20 16:30:10.529496 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.528614 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3bc894d1-53f4-415a-820c-30d02901904f-config\") pod \"service-ca-operator-5bcbc94c78-cqhg8\" (UID: \"3bc894d1-53f4-415a-820c-30d02901904f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cqhg8" Jul 20 16:30:10.529496 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.528643 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0ec4c40f-7638-4fe3-8bff-edb2579a3b3b-serving-cert\") pod \"console-operator-565b7b569d-99wqw\" (UID: \"0ec4c40f-7638-4fe3-8bff-edb2579a3b3b\") " pod="openshift-console-operator/console-operator-565b7b569d-99wqw" Jul 20 16:30:10.529496 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.528923 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c8a0179d-26cb-47cc-97ae-364a22d796fe-trusted-ca\") pod \"image-registry-55fc7b89f-fs62b\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" Jul 20 16:30:10.529496 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.528934 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-8dqnv\" (UID: \"53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8dqnv" Jul 20 16:30:10.529993 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.529719 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/36b61e21-6ab6-46aa-853b-299dcee26854-snapshots\") pod \"insights-operator-555d9d7885-fzrfs\" (UID: \"36b61e21-6ab6-46aa-853b-299dcee26854\") " pod="openshift-insights/insights-operator-555d9d7885-fzrfs" Jul 20 16:30:10.530338 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.530308 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8759baf3-9e6d-4cd5-817b-c55aa90e7518-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-9vvcp\" (UID: \"8759baf3-9e6d-4cd5-817b-c55aa90e7518\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9vvcp" Jul 20 16:30:10.530431 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:10.528284 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 16:30:10.530431 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:10.530399 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3-cluster-monitoring-operator-tls podName:53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3 nodeName:}" failed. No retries permitted until 2026-07-20 16:30:11.030381662 +0000 UTC m=+36.681264138 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-8dqnv" (UID: "53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3") : secret "cluster-monitoring-operator-tls" not found Jul 20 16:30:10.530431 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:10.529007 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 16:30:10.530598 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:10.530445 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd5f02ab-a975-44c8-af0d-5a82dcb219af-samples-operator-tls podName:fd5f02ab-a975-44c8-af0d-5a82dcb219af nodeName:}" failed. No retries permitted until 2026-07-20 16:30:11.03043453 +0000 UTC m=+36.681317009 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fd5f02ab-a975-44c8-af0d-5a82dcb219af-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-j2v4n" (UID: "fd5f02ab-a975-44c8-af0d-5a82dcb219af") : secret "samples-operator-tls" not found Jul 20 16:30:10.530598 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.530483 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0ec4c40f-7638-4fe3-8bff-edb2579a3b3b-config\") pod \"console-operator-565b7b569d-99wqw\" (UID: \"0ec4c40f-7638-4fe3-8bff-edb2579a3b3b\") " pod="openshift-console-operator/console-operator-565b7b569d-99wqw" Jul 20 16:30:10.530598 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.530494 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8ee47b7a-0762-47f2-9d04-d564e41fb936-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-5659v\" (UID: \"8ee47b7a-0762-47f2-9d04-d564e41fb936\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5659v" Jul 20 16:30:10.530598 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:10.530534 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/70abe44f-c09a-4818-b892-7b725bc197ae-service-ca-bundle podName:70abe44f-c09a-4818-b892-7b725bc197ae nodeName:}" failed. No retries permitted until 2026-07-20 16:30:11.030522647 +0000 UTC m=+36.681405127 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/70abe44f-c09a-4818-b892-7b725bc197ae-service-ca-bundle") pod "router-default-9c5c4477b-t6gf6" (UID: "70abe44f-c09a-4818-b892-7b725bc197ae") : configmap references non-existent config key: service-ca.crt Jul 20 16:30:10.530803 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.530758 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36b61e21-6ab6-46aa-853b-299dcee26854-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-fzrfs\" (UID: \"36b61e21-6ab6-46aa-853b-299dcee26854\") " pod="openshift-insights/insights-operator-555d9d7885-fzrfs" Jul 20 16:30:10.530875 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:10.530854 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 16:30:10.530929 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:10.530880 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55fc7b89f-fs62b: secret "image-registry-tls" not found Jul 20 16:30:10.530929 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:10.530925 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8a0179d-26cb-47cc-97ae-364a22d796fe-registry-tls podName:c8a0179d-26cb-47cc-97ae-364a22d796fe nodeName:}" failed. No retries permitted until 2026-07-20 16:30:11.030909693 +0000 UTC m=+36.681792172 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c8a0179d-26cb-47cc-97ae-364a22d796fe-registry-tls") pod "image-registry-55fc7b89f-fs62b" (UID: "c8a0179d-26cb-47cc-97ae-364a22d796fe") : secret "image-registry-tls" not found Jul 20 16:30:10.531043 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.531019 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3bc894d1-53f4-415a-820c-30d02901904f-config\") pod \"service-ca-operator-5bcbc94c78-cqhg8\" (UID: \"3bc894d1-53f4-415a-820c-30d02901904f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cqhg8" Jul 20 16:30:10.531727 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.531381 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36b61e21-6ab6-46aa-853b-299dcee26854-tmp\") pod \"insights-operator-555d9d7885-fzrfs\" (UID: \"36b61e21-6ab6-46aa-853b-299dcee26854\") " pod="openshift-insights/insights-operator-555d9d7885-fzrfs" Jul 20 16:30:10.531727 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.531568 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0ec4c40f-7638-4fe3-8bff-edb2579a3b3b-trusted-ca\") pod \"console-operator-565b7b569d-99wqw\" (UID: \"0ec4c40f-7638-4fe3-8bff-edb2579a3b3b\") " pod="openshift-console-operator/console-operator-565b7b569d-99wqw" Jul 20 16:30:10.531727 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.531682 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36b61e21-6ab6-46aa-853b-299dcee26854-service-ca-bundle\") pod \"insights-operator-555d9d7885-fzrfs\" (UID: \"36b61e21-6ab6-46aa-853b-299dcee26854\") " pod="openshift-insights/insights-operator-555d9d7885-fzrfs" Jul 20 16:30:10.532861 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.532808 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0ec4c40f-7638-4fe3-8bff-edb2579a3b3b-serving-cert\") pod \"console-operator-565b7b569d-99wqw\" (UID: \"0ec4c40f-7638-4fe3-8bff-edb2579a3b3b\") " pod="openshift-console-operator/console-operator-565b7b569d-99wqw" Jul 20 16:30:10.532861 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.532808 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/36b61e21-6ab6-46aa-853b-299dcee26854-serving-cert\") pod \"insights-operator-555d9d7885-fzrfs\" (UID: \"36b61e21-6ab6-46aa-853b-299dcee26854\") " pod="openshift-insights/insights-operator-555d9d7885-fzrfs" Jul 20 16:30:10.533314 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.533290 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3ca3fdc-9728-4d63-8847-448196cf79ab-cert\") pod \"ingress-canary-642qq\" (UID: \"f3ca3fdc-9728-4d63-8847-448196cf79ab\") " pod="openshift-ingress-canary/ingress-canary-642qq" Jul 20 16:30:10.533498 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.533475 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8759baf3-9e6d-4cd5-817b-c55aa90e7518-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-9vvcp\" (UID: \"8759baf3-9e6d-4cd5-817b-c55aa90e7518\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9vvcp" Jul 20 16:30:10.533565 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.533526 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/70abe44f-c09a-4818-b892-7b725bc197ae-stats-auth\") pod \"router-default-9c5c4477b-t6gf6\" (UID: \"70abe44f-c09a-4818-b892-7b725bc197ae\") " pod="openshift-ingress/router-default-9c5c4477b-t6gf6" Jul 20 16:30:10.533981 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.533949 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c8a0179d-26cb-47cc-97ae-364a22d796fe-installation-pull-secrets\") pod \"image-registry-55fc7b89f-fs62b\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" Jul 20 16:30:10.534046 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.534027 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3bc894d1-53f4-415a-820c-30d02901904f-serving-cert\") pod \"service-ca-operator-5bcbc94c78-cqhg8\" (UID: \"3bc894d1-53f4-415a-820c-30d02901904f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cqhg8" Jul 20 16:30:10.534198 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.534179 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c8a0179d-26cb-47cc-97ae-364a22d796fe-image-registry-private-configuration\") pod \"image-registry-55fc7b89f-fs62b\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" Jul 20 16:30:10.534614 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.534599 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/70abe44f-c09a-4818-b892-7b725bc197ae-default-certificate\") pod \"router-default-9c5c4477b-t6gf6\" (UID: \"70abe44f-c09a-4818-b892-7b725bc197ae\") " pod="openshift-ingress/router-default-9c5c4477b-t6gf6" Jul 20 16:30:10.550517 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.550493 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mfzw\" (UniqueName: \"kubernetes.io/projected/be235707-ca7f-4d7f-98f7-454db0d5b23b-kube-api-access-5mfzw\") pod \"network-check-source-7bc5b6bf85-w24p9\" (UID: \"be235707-ca7f-4d7f-98f7-454db0d5b23b\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-w24p9" Jul 20 16:30:10.551856 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.551838 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbwdb\" (UniqueName: \"kubernetes.io/projected/c8a0179d-26cb-47cc-97ae-364a22d796fe-kube-api-access-pbwdb\") pod \"image-registry-55fc7b89f-fs62b\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" Jul 20 16:30:10.554489 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.554466 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6n9k\" (UniqueName: \"kubernetes.io/projected/f3ca3fdc-9728-4d63-8847-448196cf79ab-kube-api-access-g6n9k\") pod \"ingress-canary-642qq\" (UID: \"f3ca3fdc-9728-4d63-8847-448196cf79ab\") " pod="openshift-ingress-canary/ingress-canary-642qq" Jul 20 16:30:10.556535 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.556497 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfzkb\" (UniqueName: \"kubernetes.io/projected/70abe44f-c09a-4818-b892-7b725bc197ae-kube-api-access-sfzkb\") pod \"router-default-9c5c4477b-t6gf6\" (UID: \"70abe44f-c09a-4818-b892-7b725bc197ae\") " pod="openshift-ingress/router-default-9c5c4477b-t6gf6" Jul 20 16:30:10.557860 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.557834 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pwbx\" (UniqueName: \"kubernetes.io/projected/3bc894d1-53f4-415a-820c-30d02901904f-kube-api-access-2pwbx\") pod \"service-ca-operator-5bcbc94c78-cqhg8\" (UID: \"3bc894d1-53f4-415a-820c-30d02901904f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cqhg8" Jul 20 16:30:10.558121 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.558072 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8a0179d-26cb-47cc-97ae-364a22d796fe-bound-sa-token\") pod \"image-registry-55fc7b89f-fs62b\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" Jul 20 16:30:10.558663 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.558637 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bdr5\" (UniqueName: \"kubernetes.io/projected/53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3-kube-api-access-7bdr5\") pod \"cluster-monitoring-operator-76cf8966f8-8dqnv\" (UID: \"53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8dqnv" Jul 20 16:30:10.558835 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.558787 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k92p5\" (UniqueName: \"kubernetes.io/projected/bd433e6a-a361-4daf-bbbe-053e843cca00-kube-api-access-k92p5\") pod \"dns-default-mfsjt\" (UID: \"bd433e6a-a361-4daf-bbbe-053e843cca00\") " pod="openshift-dns/dns-default-mfsjt" Jul 20 16:30:10.559859 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.559816 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfhk8\" (UniqueName: \"kubernetes.io/projected/bbfb6c85-631b-4639-8b95-5342f1f06c3a-kube-api-access-qfhk8\") pod \"volume-data-source-validator-78cf4c6f6-tw742\" (UID: \"bbfb6c85-631b-4639-8b95-5342f1f06c3a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-tw742" Jul 20 16:30:10.560402 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.560384 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skn8j\" (UniqueName: \"kubernetes.io/projected/fd5f02ab-a975-44c8-af0d-5a82dcb219af-kube-api-access-skn8j\") pod \"cluster-samples-operator-79b7c55f87-j2v4n\" (UID: \"fd5f02ab-a975-44c8-af0d-5a82dcb219af\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j2v4n" Jul 20 16:30:10.560664 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.560643 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf8p7\" (UniqueName: \"kubernetes.io/projected/0ec4c40f-7638-4fe3-8bff-edb2579a3b3b-kube-api-access-zf8p7\") pod \"console-operator-565b7b569d-99wqw\" (UID: \"0ec4c40f-7638-4fe3-8bff-edb2579a3b3b\") " pod="openshift-console-operator/console-operator-565b7b569d-99wqw" Jul 20 16:30:10.561035 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.561014 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rhjh\" (UniqueName: \"kubernetes.io/projected/36b61e21-6ab6-46aa-853b-299dcee26854-kube-api-access-5rhjh\") pod \"insights-operator-555d9d7885-fzrfs\" (UID: \"36b61e21-6ab6-46aa-853b-299dcee26854\") " pod="openshift-insights/insights-operator-555d9d7885-fzrfs" Jul 20 16:30:10.563242 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.563223 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-879rk\" (UniqueName: \"kubernetes.io/projected/8759baf3-9e6d-4cd5-817b-c55aa90e7518-kube-api-access-879rk\") pod \"kube-storage-version-migrator-operator-7658d9b749-9vvcp\" (UID: \"8759baf3-9e6d-4cd5-817b-c55aa90e7518\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9vvcp" Jul 20 16:30:10.584408 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.584386 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-fzrfs" Jul 20 16:30:10.602719 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.602695 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cqhg8" Jul 20 16:30:10.609883 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.609846 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-tw742" Jul 20 16:30:10.617190 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.617163 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9vvcp" Jul 20 16:30:10.639012 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.638983 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-w24p9" Jul 20 16:30:10.647267 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.647238 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-642qq" Jul 20 16:30:10.854609 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.854178 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-99wqw" Jul 20 16:30:10.879770 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.878337 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cqhg8"] Jul 20 16:30:10.888846 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.888053 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-fzrfs"] Jul 20 16:30:10.893685 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:30:10.891162 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36b61e21_6ab6_46aa_853b_299dcee26854.slice/crio-b47b01774d2fcb797e848374edf7ecc712e41e2bdd5a0ec63c010d618d289db8 WatchSource:0}: Error finding container b47b01774d2fcb797e848374edf7ecc712e41e2bdd5a0ec63c010d618d289db8: Status 404 returned error can't find the container with id b47b01774d2fcb797e848374edf7ecc712e41e2bdd5a0ec63c010d618d289db8 Jul 20 16:30:10.893793 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.893737 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-tw742"] Jul 20 16:30:10.895524 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.895348 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9vvcp"] Jul 20 16:30:10.902759 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:30:10.902663 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8759baf3_9e6d_4cd5_817b_c55aa90e7518.slice/crio-b76969e6eb1ebab214a30140438b02d62fd87f18eddc416f01c4887c40fa1d93 WatchSource:0}: Error finding container b76969e6eb1ebab214a30140438b02d62fd87f18eddc416f01c4887c40fa1d93: Status 404 returned error can't find the container with id b76969e6eb1ebab214a30140438b02d62fd87f18eddc416f01c4887c40fa1d93 Jul 20 16:30:10.935793 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.934358 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-w24p9"] Jul 20 16:30:10.952437 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:10.952410 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-642qq"] Jul 20 16:30:10.955741 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:30:10.955711 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3ca3fdc_9728_4d63_8847_448196cf79ab.slice/crio-1c5127e0eb3c535941c675635585ba315f1cf7c83d4bb05434e3a2a1c073b3a7 WatchSource:0}: Error finding container 1c5127e0eb3c535941c675635585ba315f1cf7c83d4bb05434e3a2a1c073b3a7: Status 404 returned error can't find the container with id 1c5127e0eb3c535941c675635585ba315f1cf7c83d4bb05434e3a2a1c073b3a7 Jul 20 16:30:11.002681 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:11.002651 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-w24p9" event={"ID":"be235707-ca7f-4d7f-98f7-454db0d5b23b","Type":"ContainerStarted","Data":"1b9710dece1e284255ef63a25883a4adb3b61c6806c3fcbb12bc2ba44b72be8a"} Jul 20 16:30:11.003811 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:11.003788 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-tw742" event={"ID":"bbfb6c85-631b-4639-8b95-5342f1f06c3a","Type":"ContainerStarted","Data":"3fd6e9406595373fac877ac6ef8e7ac5feadaf048c3a7e2a5c64632a9d371189"} Jul 20 16:30:11.004944 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:11.004905 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9vvcp" event={"ID":"8759baf3-9e6d-4cd5-817b-c55aa90e7518","Type":"ContainerStarted","Data":"b76969e6eb1ebab214a30140438b02d62fd87f18eddc416f01c4887c40fa1d93"} Jul 20 16:30:11.005882 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:11.005858 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cqhg8" event={"ID":"3bc894d1-53f4-415a-820c-30d02901904f","Type":"ContainerStarted","Data":"9020496a958e9ec207d20be08ebc9ea7d405d2a9e5ebaaea2df07d06043c9b6e"} Jul 20 16:30:11.006924 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:11.006905 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-fzrfs" event={"ID":"36b61e21-6ab6-46aa-853b-299dcee26854","Type":"ContainerStarted","Data":"b47b01774d2fcb797e848374edf7ecc712e41e2bdd5a0ec63c010d618d289db8"} Jul 20 16:30:11.007916 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:11.007900 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-642qq" event={"ID":"f3ca3fdc-9728-4d63-8847-448196cf79ab","Type":"ContainerStarted","Data":"1c5127e0eb3c535941c675635585ba315f1cf7c83d4bb05434e3a2a1c073b3a7"} Jul 20 16:30:11.017725 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:11.017704 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-99wqw"] Jul 20 16:30:11.026845 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:30:11.026826 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ec4c40f_7638_4fe3_8bff_edb2579a3b3b.slice/crio-17ee771bc13996686b5385f3f35b18777f6c2621d4340a55daa6bc4ddb1842d2 WatchSource:0}: Error finding container 17ee771bc13996686b5385f3f35b18777f6c2621d4340a55daa6bc4ddb1842d2: Status 404 returned error can't find the container with id 17ee771bc13996686b5385f3f35b18777f6c2621d4340a55daa6bc4ddb1842d2 Jul 20 16:30:11.038678 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:11.038656 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70abe44f-c09a-4818-b892-7b725bc197ae-metrics-certs\") pod \"router-default-9c5c4477b-t6gf6\" (UID: \"70abe44f-c09a-4818-b892-7b725bc197ae\") " pod="openshift-ingress/router-default-9c5c4477b-t6gf6" Jul 20 16:30:11.038780 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:11.038688 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fd5f02ab-a975-44c8-af0d-5a82dcb219af-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-j2v4n\" (UID: \"fd5f02ab-a975-44c8-af0d-5a82dcb219af\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j2v4n" Jul 20 16:30:11.038780 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:11.038726 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-8dqnv\" (UID: \"53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8dqnv" Jul 20 16:30:11.038849 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:11.038799 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 16:30:11.038849 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:11.038803 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 16:30:11.038849 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:11.038824 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70abe44f-c09a-4818-b892-7b725bc197ae-service-ca-bundle\") pod \"router-default-9c5c4477b-t6gf6\" (UID: \"70abe44f-c09a-4818-b892-7b725bc197ae\") " pod="openshift-ingress/router-default-9c5c4477b-t6gf6" Jul 20 16:30:11.038849 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:11.038802 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 16:30:11.038974 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:11.038840 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3-cluster-monitoring-operator-tls podName:53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3 nodeName:}" failed. No retries permitted until 2026-07-20 16:30:12.038827296 +0000 UTC m=+37.689709772 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-8dqnv" (UID: "53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3") : secret "cluster-monitoring-operator-tls" not found Jul 20 16:30:11.038974 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:11.038881 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70abe44f-c09a-4818-b892-7b725bc197ae-metrics-certs podName:70abe44f-c09a-4818-b892-7b725bc197ae nodeName:}" failed. No retries permitted until 2026-07-20 16:30:12.038865043 +0000 UTC m=+37.689747520 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70abe44f-c09a-4818-b892-7b725bc197ae-metrics-certs") pod "router-default-9c5c4477b-t6gf6" (UID: "70abe44f-c09a-4818-b892-7b725bc197ae") : secret "router-metrics-certs-default" not found Jul 20 16:30:11.038974 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:11.038900 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd5f02ab-a975-44c8-af0d-5a82dcb219af-samples-operator-tls podName:fd5f02ab-a975-44c8-af0d-5a82dcb219af nodeName:}" failed. No retries permitted until 2026-07-20 16:30:12.038893286 +0000 UTC m=+37.689775762 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fd5f02ab-a975-44c8-af0d-5a82dcb219af-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-j2v4n" (UID: "fd5f02ab-a975-44c8-af0d-5a82dcb219af") : secret "samples-operator-tls" not found Jul 20 16:30:11.038974 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:11.038912 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/70abe44f-c09a-4818-b892-7b725bc197ae-service-ca-bundle podName:70abe44f-c09a-4818-b892-7b725bc197ae nodeName:}" failed. No retries permitted until 2026-07-20 16:30:12.038906503 +0000 UTC m=+37.689788979 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/70abe44f-c09a-4818-b892-7b725bc197ae-service-ca-bundle") pod "router-default-9c5c4477b-t6gf6" (UID: "70abe44f-c09a-4818-b892-7b725bc197ae") : configmap references non-existent config key: service-ca.crt Jul 20 16:30:11.038974 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:11.038939 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8a0179d-26cb-47cc-97ae-364a22d796fe-registry-tls\") pod \"image-registry-55fc7b89f-fs62b\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" Jul 20 16:30:11.039186 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:11.038992 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd433e6a-a361-4daf-bbbe-053e843cca00-metrics-tls\") pod \"dns-default-mfsjt\" (UID: \"bd433e6a-a361-4daf-bbbe-053e843cca00\") " pod="openshift-dns/dns-default-mfsjt" Jul 20 16:30:11.039186 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:11.039024 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8ee47b7a-0762-47f2-9d04-d564e41fb936-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-5659v\" (UID: \"8ee47b7a-0762-47f2-9d04-d564e41fb936\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5659v" Jul 20 16:30:11.039186 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:11.039070 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 16:30:11.039186 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:11.039115 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55fc7b89f-fs62b: secret "image-registry-tls" not found Jul 20 16:30:11.039186 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:11.039119 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 16:30:11.039186 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:11.039153 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 20 16:30:11.039186 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:11.039154 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd433e6a-a361-4daf-bbbe-053e843cca00-metrics-tls podName:bd433e6a-a361-4daf-bbbe-053e843cca00 nodeName:}" failed. No retries permitted until 2026-07-20 16:30:12.039145356 +0000 UTC m=+37.690027861 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd433e6a-a361-4daf-bbbe-053e843cca00-metrics-tls") pod "dns-default-mfsjt" (UID: "bd433e6a-a361-4daf-bbbe-053e843cca00") : secret "dns-default-metrics-tls" not found Jul 20 16:30:11.039186 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:11.039188 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8a0179d-26cb-47cc-97ae-364a22d796fe-registry-tls podName:c8a0179d-26cb-47cc-97ae-364a22d796fe nodeName:}" failed. No retries permitted until 2026-07-20 16:30:12.039180155 +0000 UTC m=+37.690062632 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c8a0179d-26cb-47cc-97ae-364a22d796fe-registry-tls") pod "image-registry-55fc7b89f-fs62b" (UID: "c8a0179d-26cb-47cc-97ae-364a22d796fe") : secret "image-registry-tls" not found Jul 20 16:30:11.039414 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:11.039200 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ee47b7a-0762-47f2-9d04-d564e41fb936-networking-console-plugin-cert podName:8ee47b7a-0762-47f2-9d04-d564e41fb936 nodeName:}" failed. No retries permitted until 2026-07-20 16:30:12.039192432 +0000 UTC m=+37.690074907 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8ee47b7a-0762-47f2-9d04-d564e41fb936-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-5659v" (UID: "8ee47b7a-0762-47f2-9d04-d564e41fb936") : secret "networking-console-plugin-cert" not found Jul 20 16:30:11.847248 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:11.847212 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8hpf" Jul 20 16:30:11.847432 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:11.847256 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpbjs" Jul 20 16:30:11.847432 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:11.847264 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnqv5" Jul 20 16:30:11.851058 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:11.851022 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 16:30:11.851210 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:11.851022 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f9blf\"" Jul 20 16:30:11.851210 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:11.851022 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 16:30:11.851210 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:11.851025 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k84bh\"" Jul 20 16:30:12.012145 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:12.012098 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-99wqw" event={"ID":"0ec4c40f-7638-4fe3-8bff-edb2579a3b3b","Type":"ContainerStarted","Data":"17ee771bc13996686b5385f3f35b18777f6c2621d4340a55daa6bc4ddb1842d2"} Jul 20 16:30:12.048686 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:12.048647 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd433e6a-a361-4daf-bbbe-053e843cca00-metrics-tls\") pod \"dns-default-mfsjt\" (UID: \"bd433e6a-a361-4daf-bbbe-053e843cca00\") " pod="openshift-dns/dns-default-mfsjt" Jul 20 16:30:12.048892 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:12.048709 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8ee47b7a-0762-47f2-9d04-d564e41fb936-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-5659v\" (UID: \"8ee47b7a-0762-47f2-9d04-d564e41fb936\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5659v" Jul 20 16:30:12.048892 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:12.048780 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 16:30:12.048892 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:12.048782 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70abe44f-c09a-4818-b892-7b725bc197ae-metrics-certs\") pod \"router-default-9c5c4477b-t6gf6\" (UID: \"70abe44f-c09a-4818-b892-7b725bc197ae\") " pod="openshift-ingress/router-default-9c5c4477b-t6gf6" Jul 20 16:30:12.048892 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:12.048850 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd433e6a-a361-4daf-bbbe-053e843cca00-metrics-tls podName:bd433e6a-a361-4daf-bbbe-053e843cca00 nodeName:}" failed. No retries permitted until 2026-07-20 16:30:14.048833931 +0000 UTC m=+39.699716420 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd433e6a-a361-4daf-bbbe-053e843cca00-metrics-tls") pod "dns-default-mfsjt" (UID: "bd433e6a-a361-4daf-bbbe-053e843cca00") : secret "dns-default-metrics-tls" not found Jul 20 16:30:12.048892 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:12.048872 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 16:30:12.049165 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:12.048897 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fd5f02ab-a975-44c8-af0d-5a82dcb219af-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-j2v4n\" (UID: \"fd5f02ab-a975-44c8-af0d-5a82dcb219af\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j2v4n" Jul 20 16:30:12.049165 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:12.048923 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70abe44f-c09a-4818-b892-7b725bc197ae-metrics-certs podName:70abe44f-c09a-4818-b892-7b725bc197ae nodeName:}" failed. No retries permitted until 2026-07-20 16:30:14.048906683 +0000 UTC m=+39.699789163 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70abe44f-c09a-4818-b892-7b725bc197ae-metrics-certs") pod "router-default-9c5c4477b-t6gf6" (UID: "70abe44f-c09a-4818-b892-7b725bc197ae") : secret "router-metrics-certs-default" not found Jul 20 16:30:12.049165 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:12.048929 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 20 16:30:12.049165 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:12.048964 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 16:30:12.049165 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:12.048985 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ee47b7a-0762-47f2-9d04-d564e41fb936-networking-console-plugin-cert podName:8ee47b7a-0762-47f2-9d04-d564e41fb936 nodeName:}" failed. No retries permitted until 2026-07-20 16:30:14.048971773 +0000 UTC m=+39.699854262 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8ee47b7a-0762-47f2-9d04-d564e41fb936-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-5659v" (UID: "8ee47b7a-0762-47f2-9d04-d564e41fb936") : secret "networking-console-plugin-cert" not found Jul 20 16:30:12.049165 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:12.049001 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd5f02ab-a975-44c8-af0d-5a82dcb219af-samples-operator-tls podName:fd5f02ab-a975-44c8-af0d-5a82dcb219af nodeName:}" failed. No retries permitted until 2026-07-20 16:30:14.048991021 +0000 UTC m=+39.699873500 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fd5f02ab-a975-44c8-af0d-5a82dcb219af-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-j2v4n" (UID: "fd5f02ab-a975-44c8-af0d-5a82dcb219af") : secret "samples-operator-tls" not found Jul 20 16:30:12.049165 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:12.049033 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-8dqnv\" (UID: \"53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8dqnv" Jul 20 16:30:12.049165 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:12.049069 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70abe44f-c09a-4818-b892-7b725bc197ae-service-ca-bundle\") pod \"router-default-9c5c4477b-t6gf6\" (UID: \"70abe44f-c09a-4818-b892-7b725bc197ae\") " pod="openshift-ingress/router-default-9c5c4477b-t6gf6" Jul 20 16:30:12.049165 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:12.049117 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8a0179d-26cb-47cc-97ae-364a22d796fe-registry-tls\") pod \"image-registry-55fc7b89f-fs62b\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" Jul 20 16:30:12.049165 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:12.049145 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 16:30:12.049537 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:12.049194 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3-cluster-monitoring-operator-tls podName:53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3 nodeName:}" failed. No retries permitted until 2026-07-20 16:30:14.049179398 +0000 UTC m=+39.700061874 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-8dqnv" (UID: "53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3") : secret "cluster-monitoring-operator-tls" not found Jul 20 16:30:12.049537 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:12.049221 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 16:30:12.049537 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:12.049235 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55fc7b89f-fs62b: secret "image-registry-tls" not found Jul 20 16:30:12.049537 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:12.049240 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/70abe44f-c09a-4818-b892-7b725bc197ae-service-ca-bundle podName:70abe44f-c09a-4818-b892-7b725bc197ae nodeName:}" failed. No retries permitted until 2026-07-20 16:30:14.049228542 +0000 UTC m=+39.700111032 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/70abe44f-c09a-4818-b892-7b725bc197ae-service-ca-bundle") pod "router-default-9c5c4477b-t6gf6" (UID: "70abe44f-c09a-4818-b892-7b725bc197ae") : configmap references non-existent config key: service-ca.crt Jul 20 16:30:12.049537 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:12.049271 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8a0179d-26cb-47cc-97ae-364a22d796fe-registry-tls podName:c8a0179d-26cb-47cc-97ae-364a22d796fe nodeName:}" failed. No retries permitted until 2026-07-20 16:30:14.049260176 +0000 UTC m=+39.700142670 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c8a0179d-26cb-47cc-97ae-364a22d796fe-registry-tls") pod "image-registry-55fc7b89f-fs62b" (UID: "c8a0179d-26cb-47cc-97ae-364a22d796fe") : secret "image-registry-tls" not found Jul 20 16:30:14.029060 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:14.029016 2575 generic.go:356] "Generic (PLEG): container finished" podID="a28546f7-4091-4291-aeaa-12fee18311ca" containerID="8d8790d96eb786c2bfd2dd01c11067083504d30c033e3b8f3c49a15943851234" exitCode=0 Jul 20 16:30:14.029530 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:14.029102 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htg96" event={"ID":"a28546f7-4091-4291-aeaa-12fee18311ca","Type":"ContainerDied","Data":"8d8790d96eb786c2bfd2dd01c11067083504d30c033e3b8f3c49a15943851234"} Jul 20 16:30:14.068502 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:14.068466 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-8dqnv\" (UID: \"53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8dqnv" Jul 20 16:30:14.068650 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:14.068523 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70abe44f-c09a-4818-b892-7b725bc197ae-service-ca-bundle\") pod \"router-default-9c5c4477b-t6gf6\" (UID: \"70abe44f-c09a-4818-b892-7b725bc197ae\") " pod="openshift-ingress/router-default-9c5c4477b-t6gf6" Jul 20 16:30:14.068650 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:14.068558 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8a0179d-26cb-47cc-97ae-364a22d796fe-registry-tls\") pod \"image-registry-55fc7b89f-fs62b\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" Jul 20 16:30:14.068765 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:14.068662 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd433e6a-a361-4daf-bbbe-053e843cca00-metrics-tls\") pod \"dns-default-mfsjt\" (UID: \"bd433e6a-a361-4daf-bbbe-053e843cca00\") " pod="openshift-dns/dns-default-mfsjt" Jul 20 16:30:14.068765 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:14.068712 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8ee47b7a-0762-47f2-9d04-d564e41fb936-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-5659v\" (UID: \"8ee47b7a-0762-47f2-9d04-d564e41fb936\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5659v" Jul 20 16:30:14.068765 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:14.068758 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70abe44f-c09a-4818-b892-7b725bc197ae-metrics-certs\") pod \"router-default-9c5c4477b-t6gf6\" (UID: \"70abe44f-c09a-4818-b892-7b725bc197ae\") " pod="openshift-ingress/router-default-9c5c4477b-t6gf6" Jul 20 16:30:14.068927 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:14.068787 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fd5f02ab-a975-44c8-af0d-5a82dcb219af-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-j2v4n\" (UID: \"fd5f02ab-a975-44c8-af0d-5a82dcb219af\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j2v4n" Jul 20 16:30:14.068982 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:14.068928 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 16:30:14.069032 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:14.068991 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd5f02ab-a975-44c8-af0d-5a82dcb219af-samples-operator-tls podName:fd5f02ab-a975-44c8-af0d-5a82dcb219af nodeName:}" failed. No retries permitted until 2026-07-20 16:30:18.068972326 +0000 UTC m=+43.719854808 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fd5f02ab-a975-44c8-af0d-5a82dcb219af-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-j2v4n" (UID: "fd5f02ab-a975-44c8-af0d-5a82dcb219af") : secret "samples-operator-tls" not found Jul 20 16:30:14.070151 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:14.069395 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 16:30:14.070151 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:14.069454 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3-cluster-monitoring-operator-tls podName:53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3 nodeName:}" failed. No retries permitted until 2026-07-20 16:30:18.069436974 +0000 UTC m=+43.720319451 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-8dqnv" (UID: "53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3") : secret "cluster-monitoring-operator-tls" not found Jul 20 16:30:14.070151 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:14.069516 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 16:30:14.070151 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:14.069547 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd433e6a-a361-4daf-bbbe-053e843cca00-metrics-tls podName:bd433e6a-a361-4daf-bbbe-053e843cca00 nodeName:}" failed. No retries permitted until 2026-07-20 16:30:18.069536774 +0000 UTC m=+43.720419251 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd433e6a-a361-4daf-bbbe-053e843cca00-metrics-tls") pod "dns-default-mfsjt" (UID: "bd433e6a-a361-4daf-bbbe-053e843cca00") : secret "dns-default-metrics-tls" not found Jul 20 16:30:14.070151 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:14.069588 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/70abe44f-c09a-4818-b892-7b725bc197ae-service-ca-bundle podName:70abe44f-c09a-4818-b892-7b725bc197ae nodeName:}" failed. No retries permitted until 2026-07-20 16:30:18.069567359 +0000 UTC m=+43.720449850 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/70abe44f-c09a-4818-b892-7b725bc197ae-service-ca-bundle") pod "router-default-9c5c4477b-t6gf6" (UID: "70abe44f-c09a-4818-b892-7b725bc197ae") : configmap references non-existent config key: service-ca.crt Jul 20 16:30:14.070151 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:14.069674 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 16:30:14.070151 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:14.069711 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70abe44f-c09a-4818-b892-7b725bc197ae-metrics-certs podName:70abe44f-c09a-4818-b892-7b725bc197ae nodeName:}" failed. No retries permitted until 2026-07-20 16:30:18.069699295 +0000 UTC m=+43.720581785 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70abe44f-c09a-4818-b892-7b725bc197ae-metrics-certs") pod "router-default-9c5c4477b-t6gf6" (UID: "70abe44f-c09a-4818-b892-7b725bc197ae") : secret "router-metrics-certs-default" not found Jul 20 16:30:14.070151 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:14.069775 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 20 16:30:14.070151 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:14.069808 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ee47b7a-0762-47f2-9d04-d564e41fb936-networking-console-plugin-cert podName:8ee47b7a-0762-47f2-9d04-d564e41fb936 nodeName:}" failed. No retries permitted until 2026-07-20 16:30:18.069798486 +0000 UTC m=+43.720680971 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8ee47b7a-0762-47f2-9d04-d564e41fb936-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-5659v" (UID: "8ee47b7a-0762-47f2-9d04-d564e41fb936") : secret "networking-console-plugin-cert" not found Jul 20 16:30:14.070151 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:14.069841 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 16:30:14.070151 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:14.069855 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55fc7b89f-fs62b: secret "image-registry-tls" not found Jul 20 16:30:14.070151 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:14.069887 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8a0179d-26cb-47cc-97ae-364a22d796fe-registry-tls podName:c8a0179d-26cb-47cc-97ae-364a22d796fe nodeName:}" failed. No retries permitted until 2026-07-20 16:30:18.069875212 +0000 UTC m=+43.720757705 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c8a0179d-26cb-47cc-97ae-364a22d796fe-registry-tls") pod "image-registry-55fc7b89f-fs62b" (UID: "c8a0179d-26cb-47cc-97ae-364a22d796fe") : secret "image-registry-tls" not found Jul 20 16:30:15.038586 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:15.038235 2575 generic.go:356] "Generic (PLEG): container finished" podID="a28546f7-4091-4291-aeaa-12fee18311ca" containerID="f88f439395bfb3a890651575a6505056aa1202e711f99952f29b05cc41ee2c56" exitCode=0 Jul 20 16:30:15.039057 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:15.038646 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htg96" event={"ID":"a28546f7-4091-4291-aeaa-12fee18311ca","Type":"ContainerDied","Data":"f88f439395bfb3a890651575a6505056aa1202e711f99952f29b05cc41ee2c56"} Jul 20 16:30:18.116424 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:18.116382 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd433e6a-a361-4daf-bbbe-053e843cca00-metrics-tls\") pod \"dns-default-mfsjt\" (UID: \"bd433e6a-a361-4daf-bbbe-053e843cca00\") " pod="openshift-dns/dns-default-mfsjt" Jul 20 16:30:18.116886 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:18.116432 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8ee47b7a-0762-47f2-9d04-d564e41fb936-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-5659v\" (UID: \"8ee47b7a-0762-47f2-9d04-d564e41fb936\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5659v" Jul 20 16:30:18.116886 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:18.116483 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70abe44f-c09a-4818-b892-7b725bc197ae-metrics-certs\") pod \"router-default-9c5c4477b-t6gf6\" (UID: \"70abe44f-c09a-4818-b892-7b725bc197ae\") " pod="openshift-ingress/router-default-9c5c4477b-t6gf6" Jul 20 16:30:18.116886 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:18.116515 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fd5f02ab-a975-44c8-af0d-5a82dcb219af-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-j2v4n\" (UID: \"fd5f02ab-a975-44c8-af0d-5a82dcb219af\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j2v4n" Jul 20 16:30:18.116886 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:18.116538 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 16:30:18.116886 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:18.116568 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-8dqnv\" (UID: \"53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8dqnv" Jul 20 16:30:18.116886 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:18.116605 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd433e6a-a361-4daf-bbbe-053e843cca00-metrics-tls podName:bd433e6a-a361-4daf-bbbe-053e843cca00 nodeName:}" failed. No retries permitted until 2026-07-20 16:30:26.11658655 +0000 UTC m=+51.767469047 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd433e6a-a361-4daf-bbbe-053e843cca00-metrics-tls") pod "dns-default-mfsjt" (UID: "bd433e6a-a361-4daf-bbbe-053e843cca00") : secret "dns-default-metrics-tls" not found Jul 20 16:30:18.116886 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:18.116626 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70abe44f-c09a-4818-b892-7b725bc197ae-service-ca-bundle\") pod \"router-default-9c5c4477b-t6gf6\" (UID: \"70abe44f-c09a-4818-b892-7b725bc197ae\") " pod="openshift-ingress/router-default-9c5c4477b-t6gf6" Jul 20 16:30:18.116886 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:18.116635 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 20 16:30:18.116886 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:18.116659 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 16:30:18.116886 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:18.116664 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8a0179d-26cb-47cc-97ae-364a22d796fe-registry-tls\") pod \"image-registry-55fc7b89f-fs62b\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" Jul 20 16:30:18.116886 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:18.116673 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 16:30:18.116886 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:18.116695 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd5f02ab-a975-44c8-af0d-5a82dcb219af-samples-operator-tls podName:fd5f02ab-a975-44c8-af0d-5a82dcb219af nodeName:}" failed. No retries permitted until 2026-07-20 16:30:26.116684077 +0000 UTC m=+51.767566566 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fd5f02ab-a975-44c8-af0d-5a82dcb219af-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-j2v4n" (UID: "fd5f02ab-a975-44c8-af0d-5a82dcb219af") : secret "samples-operator-tls" not found Jul 20 16:30:18.116886 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:18.116714 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ee47b7a-0762-47f2-9d04-d564e41fb936-networking-console-plugin-cert podName:8ee47b7a-0762-47f2-9d04-d564e41fb936 nodeName:}" failed. No retries permitted until 2026-07-20 16:30:26.116705283 +0000 UTC m=+51.767587773 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8ee47b7a-0762-47f2-9d04-d564e41fb936-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-5659v" (UID: "8ee47b7a-0762-47f2-9d04-d564e41fb936") : secret "networking-console-plugin-cert" not found Jul 20 16:30:18.116886 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:18.116730 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70abe44f-c09a-4818-b892-7b725bc197ae-metrics-certs podName:70abe44f-c09a-4818-b892-7b725bc197ae nodeName:}" failed. No retries permitted until 2026-07-20 16:30:26.116721814 +0000 UTC m=+51.767604302 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70abe44f-c09a-4818-b892-7b725bc197ae-metrics-certs") pod "router-default-9c5c4477b-t6gf6" (UID: "70abe44f-c09a-4818-b892-7b725bc197ae") : secret "router-metrics-certs-default" not found Jul 20 16:30:18.116886 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:18.116741 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 16:30:18.116886 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:18.116758 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 16:30:18.116886 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:18.116768 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55fc7b89f-fs62b: secret "image-registry-tls" not found Jul 20 16:30:18.117502 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:18.116769 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3-cluster-monitoring-operator-tls podName:53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3 nodeName:}" failed. No retries permitted until 2026-07-20 16:30:26.116756253 +0000 UTC m=+51.767638729 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-8dqnv" (UID: "53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3") : secret "cluster-monitoring-operator-tls" not found Jul 20 16:30:18.117502 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:18.116812 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8a0179d-26cb-47cc-97ae-364a22d796fe-registry-tls podName:c8a0179d-26cb-47cc-97ae-364a22d796fe nodeName:}" failed. No retries permitted until 2026-07-20 16:30:26.116801151 +0000 UTC m=+51.767683629 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c8a0179d-26cb-47cc-97ae-364a22d796fe-registry-tls") pod "image-registry-55fc7b89f-fs62b" (UID: "c8a0179d-26cb-47cc-97ae-364a22d796fe") : secret "image-registry-tls" not found Jul 20 16:30:18.117502 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:18.116826 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/70abe44f-c09a-4818-b892-7b725bc197ae-service-ca-bundle podName:70abe44f-c09a-4818-b892-7b725bc197ae nodeName:}" failed. No retries permitted until 2026-07-20 16:30:26.11681729 +0000 UTC m=+51.767699785 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/70abe44f-c09a-4818-b892-7b725bc197ae-service-ca-bundle") pod "router-default-9c5c4477b-t6gf6" (UID: "70abe44f-c09a-4818-b892-7b725bc197ae") : configmap references non-existent config key: service-ca.crt Jul 20 16:30:21.056699 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:21.056479 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-w24p9" event={"ID":"be235707-ca7f-4d7f-98f7-454db0d5b23b","Type":"ContainerStarted","Data":"b19472ce29c17ceebe0b928f8c0e92ede228d43e743ec3b5bd6585226f835e8f"} Jul 20 16:30:21.058878 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:21.058532 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-tw742" event={"ID":"bbfb6c85-631b-4639-8b95-5342f1f06c3a","Type":"ContainerStarted","Data":"2420e5b696614044616d18b46522ee10749f997bfeb2b96c842bcaaa226f15f4"} Jul 20 16:30:21.060380 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:21.060360 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9vvcp" event={"ID":"8759baf3-9e6d-4cd5-817b-c55aa90e7518","Type":"ContainerStarted","Data":"180c8d70af339c640d4386a3a6a05a2efb8c4ca72e677bd0d2b705a9eeff0bd6"} Jul 20 16:30:21.061949 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:21.061930 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-99wqw_0ec4c40f-7638-4fe3-8bff-edb2579a3b3b/console-operator/0.log" Jul 20 16:30:21.062056 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:21.061962 2575 generic.go:356] "Generic (PLEG): container finished" podID="0ec4c40f-7638-4fe3-8bff-edb2579a3b3b" containerID="fb5dd9088c42dc73de870e61e61990d2a7f151e1f09cb679bc27789b15f6b486" exitCode=255 Jul 20 16:30:21.062056 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:21.062032 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-99wqw" event={"ID":"0ec4c40f-7638-4fe3-8bff-edb2579a3b3b","Type":"ContainerDied","Data":"fb5dd9088c42dc73de870e61e61990d2a7f151e1f09cb679bc27789b15f6b486"} Jul 20 16:30:21.062244 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:21.062224 2575 scope.go:117] "RemoveContainer" containerID="fb5dd9088c42dc73de870e61e61990d2a7f151e1f09cb679bc27789b15f6b486" Jul 20 16:30:21.066133 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:21.066070 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htg96" event={"ID":"a28546f7-4091-4291-aeaa-12fee18311ca","Type":"ContainerStarted","Data":"674bdc5f92e48b6dfff27dab9a519d5487c9c10e3bdb3e698f017704f3e4c8ac"} Jul 20 16:30:21.067840 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:21.067818 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cqhg8" event={"ID":"3bc894d1-53f4-415a-820c-30d02901904f","Type":"ContainerStarted","Data":"2b091dc4a45cf23c808e6e41bca2787565a72ce9797a95441500fc5895114e00"} Jul 20 16:30:21.078520 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:21.077543 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-w24p9" podStartSLOduration=32.842844219 podStartE2EDuration="42.077524406s" totalImagesPullingTime="9.234680187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:21.075637865 +0000 UTC m=+46.726520364" watchObservedRunningTime="2026-07-20 16:30:21.077524406 +0000 UTC m=+46.728406905" Jul 20 16:30:21.079238 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:21.079059 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-fzrfs" event={"ID":"36b61e21-6ab6-46aa-853b-299dcee26854","Type":"ContainerStarted","Data":"53d6063575cc6f42509499cf2fa1caea1150d717af4fe93a387871409155be14"} Jul 20 16:30:21.081441 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:21.081369 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-642qq" event={"ID":"f3ca3fdc-9728-4d63-8847-448196cf79ab","Type":"ContainerStarted","Data":"d1e879d95a71884ceb2c354e7fc3f53443b5e5beeb15299a204c1d61bb4e059d"} Jul 20 16:30:21.096847 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:21.096793 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9vvcp" podStartSLOduration=32.841291889 podStartE2EDuration="42.096772763s" totalImagesPullingTime="9.255480874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:21.095445179 +0000 UTC m=+46.746327676" watchObservedRunningTime="2026-07-20 16:30:21.096772763 +0000 UTC m=+46.747655240" Jul 20 16:30:21.113017 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:21.112963 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-fzrfs" podStartSLOduration=32.850746823 podStartE2EDuration="42.112935472s" totalImagesPullingTime="9.262188649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:21.112674429 +0000 UTC m=+46.763556927" watchObservedRunningTime="2026-07-20 16:30:21.112935472 +0000 UTC m=+46.763817985" Jul 20 16:30:21.133072 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:21.132994 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cqhg8" podStartSLOduration=32.863113681 podStartE2EDuration="42.132959194s" totalImagesPullingTime="9.269845513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:21.131939456 +0000 UTC m=+46.782821975" watchObservedRunningTime="2026-07-20 16:30:21.132959194 +0000 UTC m=+46.783841691" Jul 20 16:30:21.153151 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:21.153065 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-htg96" podStartSLOduration=13.005100436 podStartE2EDuration="46.153045218s" totalImagesPullingTime="33.147944782s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:29:35 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:21.151779537 +0000 UTC m=+46.802662040" watchObservedRunningTime="2026-07-20 16:30:21.153045218 +0000 UTC m=+46.803927719" Jul 20 16:30:21.202277 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:21.202218 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-tw742" podStartSLOduration=32.944278417 podStartE2EDuration="42.202193731s" totalImagesPullingTime="9.257915314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:21.185041773 +0000 UTC m=+46.835924273" watchObservedRunningTime="2026-07-20 16:30:21.202193731 +0000 UTC m=+46.853076230" Jul 20 16:30:21.203123 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:21.203047 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-642qq" podStartSLOduration=1.9973731030000001 podStartE2EDuration="11.203036052s" totalImagesPullingTime="9.205662949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:21.202166158 +0000 UTC m=+46.853048681" watchObservedRunningTime="2026-07-20 16:30:21.203036052 +0000 UTC m=+46.853918551" Jul 20 16:30:22.086801 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:22.086764 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hg27p"] Jul 20 16:30:22.087779 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:22.087749 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-99wqw_0ec4c40f-7638-4fe3-8bff-edb2579a3b3b/console-operator/1.log" Jul 20 16:30:22.088559 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:22.088283 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-99wqw_0ec4c40f-7638-4fe3-8bff-edb2579a3b3b/console-operator/0.log" Jul 20 16:30:22.088559 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:22.088319 2575 generic.go:356] "Generic (PLEG): container finished" podID="0ec4c40f-7638-4fe3-8bff-edb2579a3b3b" containerID="13bfbda7cf5290d9ea97ceb9db36800894b4129a2e8fa29983d0f5480901386c" exitCode=255 Jul 20 16:30:22.089207 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:22.089185 2575 scope.go:117] "RemoveContainer" containerID="13bfbda7cf5290d9ea97ceb9db36800894b4129a2e8fa29983d0f5480901386c" Jul 20 16:30:22.090845 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:22.089356 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-99wqw_openshift-console-operator(0ec4c40f-7638-4fe3-8bff-edb2579a3b3b)\"" pod="openshift-console-operator/console-operator-565b7b569d-99wqw" podUID="0ec4c40f-7638-4fe3-8bff-edb2579a3b3b" Jul 20 16:30:22.090845 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:22.090193 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-99wqw" event={"ID":"0ec4c40f-7638-4fe3-8bff-edb2579a3b3b","Type":"ContainerDied","Data":"13bfbda7cf5290d9ea97ceb9db36800894b4129a2e8fa29983d0f5480901386c"} Jul 20 16:30:22.090845 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:22.090236 2575 scope.go:117] "RemoveContainer" containerID="fb5dd9088c42dc73de870e61e61990d2a7f151e1f09cb679bc27789b15f6b486" Jul 20 16:30:22.090845 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:22.090400 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hg27p" Jul 20 16:30:22.096115 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:22.093049 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 20 16:30:22.096115 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:22.093208 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w4qdt\"" Jul 20 16:30:22.096115 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:22.094250 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 20 16:30:22.102562 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:22.102538 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hg27p"] Jul 20 16:30:22.157241 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:22.157198 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47e9b2bf-923f-4e16-b106-a2f7be0575ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hg27p\" (UID: \"47e9b2bf-923f-4e16-b106-a2f7be0575ae\") " pod="openshift-insights/insights-runtime-extractor-hg27p" Jul 20 16:30:22.157415 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:22.157305 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28mcv\" (UniqueName: \"kubernetes.io/projected/47e9b2bf-923f-4e16-b106-a2f7be0575ae-kube-api-access-28mcv\") pod \"insights-runtime-extractor-hg27p\" (UID: \"47e9b2bf-923f-4e16-b106-a2f7be0575ae\") " pod="openshift-insights/insights-runtime-extractor-hg27p" Jul 20 16:30:22.157415 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:22.157371 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/47e9b2bf-923f-4e16-b106-a2f7be0575ae-data-volume\") pod \"insights-runtime-extractor-hg27p\" (UID: \"47e9b2bf-923f-4e16-b106-a2f7be0575ae\") " pod="openshift-insights/insights-runtime-extractor-hg27p" Jul 20 16:30:22.157534 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:22.157410 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/47e9b2bf-923f-4e16-b106-a2f7be0575ae-crio-socket\") pod \"insights-runtime-extractor-hg27p\" (UID: \"47e9b2bf-923f-4e16-b106-a2f7be0575ae\") " pod="openshift-insights/insights-runtime-extractor-hg27p" Jul 20 16:30:22.157534 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:22.157457 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47e9b2bf-923f-4e16-b106-a2f7be0575ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hg27p\" (UID: \"47e9b2bf-923f-4e16-b106-a2f7be0575ae\") " pod="openshift-insights/insights-runtime-extractor-hg27p" Jul 20 16:30:22.259366 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:22.259315 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/47e9b2bf-923f-4e16-b106-a2f7be0575ae-data-volume\") pod \"insights-runtime-extractor-hg27p\" (UID: \"47e9b2bf-923f-4e16-b106-a2f7be0575ae\") " pod="openshift-insights/insights-runtime-extractor-hg27p" Jul 20 16:30:22.259525 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:22.259379 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/47e9b2bf-923f-4e16-b106-a2f7be0575ae-crio-socket\") pod \"insights-runtime-extractor-hg27p\" (UID: \"47e9b2bf-923f-4e16-b106-a2f7be0575ae\") " pod="openshift-insights/insights-runtime-extractor-hg27p" Jul 20 16:30:22.259525 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:22.259409 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47e9b2bf-923f-4e16-b106-a2f7be0575ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hg27p\" (UID: \"47e9b2bf-923f-4e16-b106-a2f7be0575ae\") " pod="openshift-insights/insights-runtime-extractor-hg27p" Jul 20 16:30:22.259525 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:22.259505 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/47e9b2bf-923f-4e16-b106-a2f7be0575ae-crio-socket\") pod \"insights-runtime-extractor-hg27p\" (UID: \"47e9b2bf-923f-4e16-b106-a2f7be0575ae\") " pod="openshift-insights/insights-runtime-extractor-hg27p" Jul 20 16:30:22.259715 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:22.259541 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 16:30:22.259715 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:22.259599 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47e9b2bf-923f-4e16-b106-a2f7be0575ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hg27p\" (UID: \"47e9b2bf-923f-4e16-b106-a2f7be0575ae\") " pod="openshift-insights/insights-runtime-extractor-hg27p" Jul 20 16:30:22.259715 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:22.259619 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47e9b2bf-923f-4e16-b106-a2f7be0575ae-kube-rbac-proxy-cm podName:47e9b2bf-923f-4e16-b106-a2f7be0575ae nodeName:}" failed. No retries permitted until 2026-07-20 16:30:22.759599816 +0000 UTC m=+48.410482306 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47e9b2bf-923f-4e16-b106-a2f7be0575ae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hg27p" (UID: "47e9b2bf-923f-4e16-b106-a2f7be0575ae") : configmap "kube-rbac-proxy" not found Jul 20 16:30:22.259715 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:22.259648 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/47e9b2bf-923f-4e16-b106-a2f7be0575ae-data-volume\") pod \"insights-runtime-extractor-hg27p\" (UID: \"47e9b2bf-923f-4e16-b106-a2f7be0575ae\") " pod="openshift-insights/insights-runtime-extractor-hg27p" Jul 20 16:30:22.259715 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:22.259681 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 16:30:22.259715 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:22.259695 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28mcv\" (UniqueName: \"kubernetes.io/projected/47e9b2bf-923f-4e16-b106-a2f7be0575ae-kube-api-access-28mcv\") pod \"insights-runtime-extractor-hg27p\" (UID: \"47e9b2bf-923f-4e16-b106-a2f7be0575ae\") " pod="openshift-insights/insights-runtime-extractor-hg27p" Jul 20 16:30:22.259715 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:22.259717 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47e9b2bf-923f-4e16-b106-a2f7be0575ae-insights-runtime-extractor-tls podName:47e9b2bf-923f-4e16-b106-a2f7be0575ae nodeName:}" failed. No retries permitted until 2026-07-20 16:30:22.759707046 +0000 UTC m=+48.410589522 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47e9b2bf-923f-4e16-b106-a2f7be0575ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hg27p" (UID: "47e9b2bf-923f-4e16-b106-a2f7be0575ae") : secret "insights-runtime-extractor-tls" not found Jul 20 16:30:22.270393 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:22.270371 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28mcv\" (UniqueName: \"kubernetes.io/projected/47e9b2bf-923f-4e16-b106-a2f7be0575ae-kube-api-access-28mcv\") pod \"insights-runtime-extractor-hg27p\" (UID: \"47e9b2bf-923f-4e16-b106-a2f7be0575ae\") " pod="openshift-insights/insights-runtime-extractor-hg27p" Jul 20 16:30:22.765130 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:22.765071 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47e9b2bf-923f-4e16-b106-a2f7be0575ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hg27p\" (UID: \"47e9b2bf-923f-4e16-b106-a2f7be0575ae\") " pod="openshift-insights/insights-runtime-extractor-hg27p" Jul 20 16:30:22.765313 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:22.765218 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 16:30:22.765313 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:22.765237 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47e9b2bf-923f-4e16-b106-a2f7be0575ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hg27p\" (UID: \"47e9b2bf-923f-4e16-b106-a2f7be0575ae\") " pod="openshift-insights/insights-runtime-extractor-hg27p" Jul 20 16:30:22.765313 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:22.765278 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47e9b2bf-923f-4e16-b106-a2f7be0575ae-insights-runtime-extractor-tls podName:47e9b2bf-923f-4e16-b106-a2f7be0575ae nodeName:}" failed. No retries permitted until 2026-07-20 16:30:23.765263817 +0000 UTC m=+49.416146293 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47e9b2bf-923f-4e16-b106-a2f7be0575ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hg27p" (UID: "47e9b2bf-923f-4e16-b106-a2f7be0575ae") : secret "insights-runtime-extractor-tls" not found Jul 20 16:30:22.765313 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:22.765303 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 16:30:22.765465 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:22.765346 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47e9b2bf-923f-4e16-b106-a2f7be0575ae-kube-rbac-proxy-cm podName:47e9b2bf-923f-4e16-b106-a2f7be0575ae nodeName:}" failed. No retries permitted until 2026-07-20 16:30:23.765331351 +0000 UTC m=+49.416213828 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47e9b2bf-923f-4e16-b106-a2f7be0575ae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hg27p" (UID: "47e9b2bf-923f-4e16-b106-a2f7be0575ae") : configmap "kube-rbac-proxy" not found Jul 20 16:30:23.093812 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:23.093783 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-99wqw_0ec4c40f-7638-4fe3-8bff-edb2579a3b3b/console-operator/1.log" Jul 20 16:30:23.094317 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:23.094216 2575 scope.go:117] "RemoveContainer" containerID="13bfbda7cf5290d9ea97ceb9db36800894b4129a2e8fa29983d0f5480901386c" Jul 20 16:30:23.094430 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:23.094406 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-99wqw_openshift-console-operator(0ec4c40f-7638-4fe3-8bff-edb2579a3b3b)\"" pod="openshift-console-operator/console-operator-565b7b569d-99wqw" podUID="0ec4c40f-7638-4fe3-8bff-edb2579a3b3b" Jul 20 16:30:23.774243 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:23.774205 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47e9b2bf-923f-4e16-b106-a2f7be0575ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hg27p\" (UID: \"47e9b2bf-923f-4e16-b106-a2f7be0575ae\") " pod="openshift-insights/insights-runtime-extractor-hg27p" Jul 20 16:30:23.774448 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:23.774346 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 16:30:23.774448 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:23.774396 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47e9b2bf-923f-4e16-b106-a2f7be0575ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hg27p\" (UID: \"47e9b2bf-923f-4e16-b106-a2f7be0575ae\") " pod="openshift-insights/insights-runtime-extractor-hg27p" Jul 20 16:30:23.774448 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:23.774417 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47e9b2bf-923f-4e16-b106-a2f7be0575ae-kube-rbac-proxy-cm podName:47e9b2bf-923f-4e16-b106-a2f7be0575ae nodeName:}" failed. No retries permitted until 2026-07-20 16:30:25.774397026 +0000 UTC m=+51.425279501 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47e9b2bf-923f-4e16-b106-a2f7be0575ae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hg27p" (UID: "47e9b2bf-923f-4e16-b106-a2f7be0575ae") : configmap "kube-rbac-proxy" not found Jul 20 16:30:23.774583 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:23.774467 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 16:30:23.774583 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:23.774508 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47e9b2bf-923f-4e16-b106-a2f7be0575ae-insights-runtime-extractor-tls podName:47e9b2bf-923f-4e16-b106-a2f7be0575ae nodeName:}" failed. No retries permitted until 2026-07-20 16:30:25.774496529 +0000 UTC m=+51.425379005 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47e9b2bf-923f-4e16-b106-a2f7be0575ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hg27p" (UID: "47e9b2bf-923f-4e16-b106-a2f7be0575ae") : secret "insights-runtime-extractor-tls" not found Jul 20 16:30:24.887887 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:24.887860 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kh6zc_7377db3f-fd05-4a8f-9ac0-35a3245062da/dns-node-resolver/0.log" Jul 20 16:30:25.688857 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:25.688828 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m275f_4f85b138-a3e7-4242-be3e-1a237173570a/node-ca/0.log" Jul 20 16:30:25.793396 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:25.793359 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47e9b2bf-923f-4e16-b106-a2f7be0575ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hg27p\" (UID: \"47e9b2bf-923f-4e16-b106-a2f7be0575ae\") " pod="openshift-insights/insights-runtime-extractor-hg27p" Jul 20 16:30:25.793579 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:25.793431 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47e9b2bf-923f-4e16-b106-a2f7be0575ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hg27p\" (UID: \"47e9b2bf-923f-4e16-b106-a2f7be0575ae\") " pod="openshift-insights/insights-runtime-extractor-hg27p" Jul 20 16:30:25.793579 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:25.793515 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 16:30:25.793579 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:25.793540 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 16:30:25.793579 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:25.793581 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47e9b2bf-923f-4e16-b106-a2f7be0575ae-insights-runtime-extractor-tls podName:47e9b2bf-923f-4e16-b106-a2f7be0575ae nodeName:}" failed. No retries permitted until 2026-07-20 16:30:29.79356457 +0000 UTC m=+55.444447045 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47e9b2bf-923f-4e16-b106-a2f7be0575ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hg27p" (UID: "47e9b2bf-923f-4e16-b106-a2f7be0575ae") : secret "insights-runtime-extractor-tls" not found Jul 20 16:30:25.793739 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:25.793596 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47e9b2bf-923f-4e16-b106-a2f7be0575ae-kube-rbac-proxy-cm podName:47e9b2bf-923f-4e16-b106-a2f7be0575ae nodeName:}" failed. No retries permitted until 2026-07-20 16:30:29.793589596 +0000 UTC m=+55.444472072 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47e9b2bf-923f-4e16-b106-a2f7be0575ae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hg27p" (UID: "47e9b2bf-923f-4e16-b106-a2f7be0575ae") : configmap "kube-rbac-proxy" not found Jul 20 16:30:26.196756 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:26.196714 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-8dqnv\" (UID: \"53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8dqnv" Jul 20 16:30:26.197267 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:26.196765 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70abe44f-c09a-4818-b892-7b725bc197ae-service-ca-bundle\") pod \"router-default-9c5c4477b-t6gf6\" (UID: \"70abe44f-c09a-4818-b892-7b725bc197ae\") " pod="openshift-ingress/router-default-9c5c4477b-t6gf6" Jul 20 16:30:26.197267 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:26.196863 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/70abe44f-c09a-4818-b892-7b725bc197ae-service-ca-bundle podName:70abe44f-c09a-4818-b892-7b725bc197ae nodeName:}" failed. No retries permitted until 2026-07-20 16:30:42.196850543 +0000 UTC m=+67.847733020 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/70abe44f-c09a-4818-b892-7b725bc197ae-service-ca-bundle") pod "router-default-9c5c4477b-t6gf6" (UID: "70abe44f-c09a-4818-b892-7b725bc197ae") : configmap references non-existent config key: service-ca.crt Jul 20 16:30:26.197267 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:26.196864 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 16:30:26.197267 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:26.196891 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8a0179d-26cb-47cc-97ae-364a22d796fe-registry-tls\") pod \"image-registry-55fc7b89f-fs62b\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" Jul 20 16:30:26.197267 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:26.196942 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd433e6a-a361-4daf-bbbe-053e843cca00-metrics-tls\") pod \"dns-default-mfsjt\" (UID: \"bd433e6a-a361-4daf-bbbe-053e843cca00\") " pod="openshift-dns/dns-default-mfsjt" Jul 20 16:30:26.197267 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:26.196948 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 16:30:26.197267 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:26.196957 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55fc7b89f-fs62b: secret "image-registry-tls" not found Jul 20 16:30:26.197267 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:26.196962 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8ee47b7a-0762-47f2-9d04-d564e41fb936-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-5659v\" (UID: \"8ee47b7a-0762-47f2-9d04-d564e41fb936\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5659v" Jul 20 16:30:26.197267 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:26.196985 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8a0179d-26cb-47cc-97ae-364a22d796fe-registry-tls podName:c8a0179d-26cb-47cc-97ae-364a22d796fe nodeName:}" failed. No retries permitted until 2026-07-20 16:30:42.196972758 +0000 UTC m=+67.847855250 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c8a0179d-26cb-47cc-97ae-364a22d796fe-registry-tls") pod "image-registry-55fc7b89f-fs62b" (UID: "c8a0179d-26cb-47cc-97ae-364a22d796fe") : secret "image-registry-tls" not found Jul 20 16:30:26.197267 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:26.197017 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3-cluster-monitoring-operator-tls podName:53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3 nodeName:}" failed. No retries permitted until 2026-07-20 16:30:42.196995342 +0000 UTC m=+67.847877824 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-8dqnv" (UID: "53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3") : secret "cluster-monitoring-operator-tls" not found Jul 20 16:30:26.197267 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:26.197027 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 16:30:26.197267 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:26.197021 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 20 16:30:26.197267 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:26.197049 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd433e6a-a361-4daf-bbbe-053e843cca00-metrics-tls podName:bd433e6a-a361-4daf-bbbe-053e843cca00 nodeName:}" failed. No retries permitted until 2026-07-20 16:30:42.197042136 +0000 UTC m=+67.847924612 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd433e6a-a361-4daf-bbbe-053e843cca00-metrics-tls") pod "dns-default-mfsjt" (UID: "bd433e6a-a361-4daf-bbbe-053e843cca00") : secret "dns-default-metrics-tls" not found Jul 20 16:30:26.197267 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:26.197109 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ee47b7a-0762-47f2-9d04-d564e41fb936-networking-console-plugin-cert podName:8ee47b7a-0762-47f2-9d04-d564e41fb936 nodeName:}" failed. No retries permitted until 2026-07-20 16:30:42.197075672 +0000 UTC m=+67.847958148 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8ee47b7a-0762-47f2-9d04-d564e41fb936-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-5659v" (UID: "8ee47b7a-0762-47f2-9d04-d564e41fb936") : secret "networking-console-plugin-cert" not found Jul 20 16:30:26.197267 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:26.197079 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70abe44f-c09a-4818-b892-7b725bc197ae-metrics-certs\") pod \"router-default-9c5c4477b-t6gf6\" (UID: \"70abe44f-c09a-4818-b892-7b725bc197ae\") " pod="openshift-ingress/router-default-9c5c4477b-t6gf6" Jul 20 16:30:26.197755 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:26.197168 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fd5f02ab-a975-44c8-af0d-5a82dcb219af-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-j2v4n\" (UID: \"fd5f02ab-a975-44c8-af0d-5a82dcb219af\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j2v4n" Jul 20 16:30:26.197755 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:26.197235 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 16:30:26.197755 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:26.197245 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 16:30:26.197755 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:26.197268 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70abe44f-c09a-4818-b892-7b725bc197ae-metrics-certs podName:70abe44f-c09a-4818-b892-7b725bc197ae nodeName:}" failed. No retries permitted until 2026-07-20 16:30:42.19725794 +0000 UTC m=+67.848140417 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70abe44f-c09a-4818-b892-7b725bc197ae-metrics-certs") pod "router-default-9c5c4477b-t6gf6" (UID: "70abe44f-c09a-4818-b892-7b725bc197ae") : secret "router-metrics-certs-default" not found Jul 20 16:30:26.197755 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:26.197280 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd5f02ab-a975-44c8-af0d-5a82dcb219af-samples-operator-tls podName:fd5f02ab-a975-44c8-af0d-5a82dcb219af nodeName:}" failed. No retries permitted until 2026-07-20 16:30:42.197275015 +0000 UTC m=+67.848157490 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fd5f02ab-a975-44c8-af0d-5a82dcb219af-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-j2v4n" (UID: "fd5f02ab-a975-44c8-af0d-5a82dcb219af") : secret "samples-operator-tls" not found Jul 20 16:30:26.487443 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:26.487368 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-642qq_f3ca3fdc-9728-4d63-8847-448196cf79ab/serve-healthcheck-canary/0.log" Jul 20 16:30:27.489260 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:27.489231 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-9vvcp_8759baf3-9e6d-4cd5-817b-c55aa90e7518/kube-storage-version-migrator-operator/0.log" Jul 20 16:30:29.831078 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:29.831040 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47e9b2bf-923f-4e16-b106-a2f7be0575ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hg27p\" (UID: \"47e9b2bf-923f-4e16-b106-a2f7be0575ae\") " pod="openshift-insights/insights-runtime-extractor-hg27p" Jul 20 16:30:29.831606 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:29.831156 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47e9b2bf-923f-4e16-b106-a2f7be0575ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hg27p\" (UID: \"47e9b2bf-923f-4e16-b106-a2f7be0575ae\") " pod="openshift-insights/insights-runtime-extractor-hg27p" Jul 20 16:30:29.831606 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:29.831201 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 16:30:29.831606 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:29.831268 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47e9b2bf-923f-4e16-b106-a2f7be0575ae-insights-runtime-extractor-tls podName:47e9b2bf-923f-4e16-b106-a2f7be0575ae nodeName:}" failed. No retries permitted until 2026-07-20 16:30:37.831255491 +0000 UTC m=+63.482137972 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47e9b2bf-923f-4e16-b106-a2f7be0575ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hg27p" (UID: "47e9b2bf-923f-4e16-b106-a2f7be0575ae") : secret "insights-runtime-extractor-tls" not found Jul 20 16:30:29.831606 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:29.831293 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 16:30:29.831606 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:29.831358 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47e9b2bf-923f-4e16-b106-a2f7be0575ae-kube-rbac-proxy-cm podName:47e9b2bf-923f-4e16-b106-a2f7be0575ae nodeName:}" failed. No retries permitted until 2026-07-20 16:30:37.831340348 +0000 UTC m=+63.482222827 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47e9b2bf-923f-4e16-b106-a2f7be0575ae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hg27p" (UID: "47e9b2bf-923f-4e16-b106-a2f7be0575ae") : configmap "kube-rbac-proxy" not found Jul 20 16:30:30.855016 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:30.854989 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-99wqw" Jul 20 16:30:30.855389 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:30.855034 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-99wqw" Jul 20 16:30:30.855389 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:30.855357 2575 scope.go:117] "RemoveContainer" containerID="13bfbda7cf5290d9ea97ceb9db36800894b4129a2e8fa29983d0f5480901386c" Jul 20 16:30:30.855517 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:30.855497 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-99wqw_openshift-console-operator(0ec4c40f-7638-4fe3-8bff-edb2579a3b3b)\"" pod="openshift-console-operator/console-operator-565b7b569d-99wqw" podUID="0ec4c40f-7638-4fe3-8bff-edb2579a3b3b" Jul 20 16:30:35.000710 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:35.000681 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s5dt7" Jul 20 16:30:37.910403 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:37.910365 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47e9b2bf-923f-4e16-b106-a2f7be0575ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hg27p\" (UID: \"47e9b2bf-923f-4e16-b106-a2f7be0575ae\") " pod="openshift-insights/insights-runtime-extractor-hg27p" Jul 20 16:30:37.910867 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:37.910425 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47e9b2bf-923f-4e16-b106-a2f7be0575ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hg27p\" (UID: \"47e9b2bf-923f-4e16-b106-a2f7be0575ae\") " pod="openshift-insights/insights-runtime-extractor-hg27p" Jul 20 16:30:37.910867 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:37.910516 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 16:30:37.910867 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:30:37.910597 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47e9b2bf-923f-4e16-b106-a2f7be0575ae-insights-runtime-extractor-tls podName:47e9b2bf-923f-4e16-b106-a2f7be0575ae nodeName:}" failed. No retries permitted until 2026-07-20 16:30:53.910580039 +0000 UTC m=+79.561462534 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47e9b2bf-923f-4e16-b106-a2f7be0575ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hg27p" (UID: "47e9b2bf-923f-4e16-b106-a2f7be0575ae") : secret "insights-runtime-extractor-tls" not found Jul 20 16:30:37.910989 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:37.910915 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47e9b2bf-923f-4e16-b106-a2f7be0575ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hg27p\" (UID: \"47e9b2bf-923f-4e16-b106-a2f7be0575ae\") " pod="openshift-insights/insights-runtime-extractor-hg27p" Jul 20 16:30:40.536729 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:40.536689 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d-metrics-certs\") pod \"network-metrics-daemon-wnqv5\" (UID: \"e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d\") " pod="openshift-multus/network-metrics-daemon-wnqv5" Jul 20 16:30:40.537190 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:40.536774 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e60cf0cf-f42e-4d8c-a1be-977d5eab29ef-original-pull-secret\") pod \"global-pull-secret-syncer-bpbjs\" (UID: \"e60cf0cf-f42e-4d8c-a1be-977d5eab29ef\") " pod="kube-system/global-pull-secret-syncer-bpbjs" Jul 20 16:30:40.539419 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:40.539401 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 16:30:40.540177 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:40.540162 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 16:30:40.550076 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:40.550055 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d-metrics-certs\") pod \"network-metrics-daemon-wnqv5\" (UID: \"e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d\") " pod="openshift-multus/network-metrics-daemon-wnqv5" Jul 20 16:30:40.550210 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:40.550193 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e60cf0cf-f42e-4d8c-a1be-977d5eab29ef-original-pull-secret\") pod \"global-pull-secret-syncer-bpbjs\" (UID: \"e60cf0cf-f42e-4d8c-a1be-977d5eab29ef\") " pod="kube-system/global-pull-secret-syncer-bpbjs" Jul 20 16:30:40.667359 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:40.667313 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpbjs" Jul 20 16:30:40.675121 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:40.675105 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k84bh\"" Jul 20 16:30:40.683213 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:40.683191 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnqv5" Jul 20 16:30:40.739149 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:40.738543 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htnhl\" (UniqueName: \"kubernetes.io/projected/321c627e-8b07-4734-8de1-561625eb34fd-kube-api-access-htnhl\") pod \"network-check-target-z8hpf\" (UID: \"321c627e-8b07-4734-8de1-561625eb34fd\") " pod="openshift-network-diagnostics/network-check-target-z8hpf" Jul 20 16:30:40.742166 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:40.742106 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htnhl\" (UniqueName: \"kubernetes.io/projected/321c627e-8b07-4734-8de1-561625eb34fd-kube-api-access-htnhl\") pod \"network-check-target-z8hpf\" (UID: \"321c627e-8b07-4734-8de1-561625eb34fd\") " pod="openshift-network-diagnostics/network-check-target-z8hpf" Jul 20 16:30:40.801307 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:40.801277 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bpbjs"] Jul 20 16:30:40.803739 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:30:40.803705 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode60cf0cf_f42e_4d8c_a1be_977d5eab29ef.slice/crio-36efb4e5efdc416399703c71816f97429a3a581f268c2958a4748ba42da3451c WatchSource:0}: Error finding container 36efb4e5efdc416399703c71816f97429a3a581f268c2958a4748ba42da3451c: Status 404 returned error can't find the container with id 36efb4e5efdc416399703c71816f97429a3a581f268c2958a4748ba42da3451c Jul 20 16:30:40.815285 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:40.815197 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wnqv5"] Jul 20 16:30:40.817473 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:30:40.817452 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode100d3fe_3d49_47e3_b7e7_eb5ad31fbe0d.slice/crio-177371327a4dec9e92b1f96efae709130acdcd1c41d7075cad27c6d0353aa4ff WatchSource:0}: Error finding container 177371327a4dec9e92b1f96efae709130acdcd1c41d7075cad27c6d0353aa4ff: Status 404 returned error can't find the container with id 177371327a4dec9e92b1f96efae709130acdcd1c41d7075cad27c6d0353aa4ff Jul 20 16:30:40.962145 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:40.962112 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f9blf\"" Jul 20 16:30:40.970536 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:40.970512 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8hpf" Jul 20 16:30:41.097620 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:41.097542 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z8hpf"] Jul 20 16:30:41.100039 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:30:41.100016 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod321c627e_8b07_4734_8de1_561625eb34fd.slice/crio-7a05ea10cc936aad214e22ad03b8b6e44fe3daed54fc8ef3910c6b5ccb1dd7fe WatchSource:0}: Error finding container 7a05ea10cc936aad214e22ad03b8b6e44fe3daed54fc8ef3910c6b5ccb1dd7fe: Status 404 returned error can't find the container with id 7a05ea10cc936aad214e22ad03b8b6e44fe3daed54fc8ef3910c6b5ccb1dd7fe Jul 20 16:30:41.155586 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:41.155552 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z8hpf" event={"ID":"321c627e-8b07-4734-8de1-561625eb34fd","Type":"ContainerStarted","Data":"ce90c90e67585a941e2c719a12b6d73c1cce35555ba664529b88bc02dc881c3a"} Jul 20 16:30:41.155702 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:41.155609 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-z8hpf" Jul 20 16:30:41.155702 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:41.155630 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z8hpf" event={"ID":"321c627e-8b07-4734-8de1-561625eb34fd","Type":"ContainerStarted","Data":"7a05ea10cc936aad214e22ad03b8b6e44fe3daed54fc8ef3910c6b5ccb1dd7fe"} Jul 20 16:30:41.156722 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:41.156701 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wnqv5" event={"ID":"e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d","Type":"ContainerStarted","Data":"177371327a4dec9e92b1f96efae709130acdcd1c41d7075cad27c6d0353aa4ff"} Jul 20 16:30:41.157667 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:41.157649 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bpbjs" event={"ID":"e60cf0cf-f42e-4d8c-a1be-977d5eab29ef","Type":"ContainerStarted","Data":"36efb4e5efdc416399703c71816f97429a3a581f268c2958a4748ba42da3451c"} Jul 20 16:30:41.170607 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:41.170566 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-z8hpf" podStartSLOduration=66.170554397 podStartE2EDuration="1m6.170554397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:29:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:41.169607532 +0000 UTC m=+66.820490030" watchObservedRunningTime="2026-07-20 16:30:41.170554397 +0000 UTC m=+66.821436895" Jul 20 16:30:42.250688 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:42.250646 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70abe44f-c09a-4818-b892-7b725bc197ae-metrics-certs\") pod \"router-default-9c5c4477b-t6gf6\" (UID: \"70abe44f-c09a-4818-b892-7b725bc197ae\") " pod="openshift-ingress/router-default-9c5c4477b-t6gf6" Jul 20 16:30:42.251207 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:42.250707 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fd5f02ab-a975-44c8-af0d-5a82dcb219af-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-j2v4n\" (UID: \"fd5f02ab-a975-44c8-af0d-5a82dcb219af\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j2v4n" Jul 20 16:30:42.251207 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:42.250768 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-8dqnv\" (UID: \"53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8dqnv" Jul 20 16:30:42.251207 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:42.250803 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70abe44f-c09a-4818-b892-7b725bc197ae-service-ca-bundle\") pod \"router-default-9c5c4477b-t6gf6\" (UID: \"70abe44f-c09a-4818-b892-7b725bc197ae\") " pod="openshift-ingress/router-default-9c5c4477b-t6gf6" Jul 20 16:30:42.251207 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:42.250842 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8a0179d-26cb-47cc-97ae-364a22d796fe-registry-tls\") pod \"image-registry-55fc7b89f-fs62b\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" Jul 20 16:30:42.251207 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:42.250892 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd433e6a-a361-4daf-bbbe-053e843cca00-metrics-tls\") pod \"dns-default-mfsjt\" (UID: \"bd433e6a-a361-4daf-bbbe-053e843cca00\") " pod="openshift-dns/dns-default-mfsjt" Jul 20 16:30:42.251207 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:42.250921 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8ee47b7a-0762-47f2-9d04-d564e41fb936-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-5659v\" (UID: \"8ee47b7a-0762-47f2-9d04-d564e41fb936\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5659v" Jul 20 16:30:42.251743 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:42.251715 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70abe44f-c09a-4818-b892-7b725bc197ae-service-ca-bundle\") pod \"router-default-9c5c4477b-t6gf6\" (UID: \"70abe44f-c09a-4818-b892-7b725bc197ae\") " pod="openshift-ingress/router-default-9c5c4477b-t6gf6" Jul 20 16:30:42.254454 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:42.254426 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8a0179d-26cb-47cc-97ae-364a22d796fe-registry-tls\") pod \"image-registry-55fc7b89f-fs62b\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" Jul 20 16:30:42.254571 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:42.254437 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70abe44f-c09a-4818-b892-7b725bc197ae-metrics-certs\") pod \"router-default-9c5c4477b-t6gf6\" (UID: \"70abe44f-c09a-4818-b892-7b725bc197ae\") " pod="openshift-ingress/router-default-9c5c4477b-t6gf6" Jul 20 16:30:42.254825 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:42.254786 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd433e6a-a361-4daf-bbbe-053e843cca00-metrics-tls\") pod \"dns-default-mfsjt\" (UID: \"bd433e6a-a361-4daf-bbbe-053e843cca00\") " pod="openshift-dns/dns-default-mfsjt" Jul 20 16:30:42.255337 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:42.255314 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fd5f02ab-a975-44c8-af0d-5a82dcb219af-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-j2v4n\" (UID: \"fd5f02ab-a975-44c8-af0d-5a82dcb219af\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j2v4n" Jul 20 16:30:42.255636 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:42.255613 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-8dqnv\" (UID: \"53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8dqnv" Jul 20 16:30:42.255876 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:42.255835 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8ee47b7a-0762-47f2-9d04-d564e41fb936-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-5659v\" (UID: \"8ee47b7a-0762-47f2-9d04-d564e41fb936\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5659v" Jul 20 16:30:42.365494 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:42.365460 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vkl82\"" Jul 20 16:30:42.373534 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:42.373503 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j2v4n" Jul 20 16:30:42.374618 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:42.374588 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lntkl\"" Jul 20 16:30:42.382996 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:42.382970 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" Jul 20 16:30:42.395043 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:42.395018 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fhr2l\"" Jul 20 16:30:42.403157 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:42.402940 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8dqnv" Jul 20 16:30:42.426498 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:42.426132 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lwj5v\"" Jul 20 16:30:42.437480 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:42.434668 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-zs9hx\"" Jul 20 16:30:42.437480 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:42.434922 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mfsjt" Jul 20 16:30:42.442532 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:42.442326 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5659v" Jul 20 16:30:42.457905 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:42.457684 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-tfxqx\"" Jul 20 16:30:42.464348 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:42.464027 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-9c5c4477b-t6gf6" Jul 20 16:30:42.603465 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:42.603427 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55fc7b89f-fs62b"] Jul 20 16:30:42.619288 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:42.619116 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j2v4n"] Jul 20 16:30:42.647330 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:42.647224 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8dqnv"] Jul 20 16:30:42.655421 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:30:42.654806 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53105f6d_e4c4_497b_b5a9_b0e37d4c2eb3.slice/crio-5b06bb3dfd3886384f451c3a772eb1f7c5e4a74e4086bf84a4f722b77540bd92 WatchSource:0}: Error finding container 5b06bb3dfd3886384f451c3a772eb1f7c5e4a74e4086bf84a4f722b77540bd92: Status 404 returned error can't find the container with id 5b06bb3dfd3886384f451c3a772eb1f7c5e4a74e4086bf84a4f722b77540bd92 Jul 20 16:30:42.742489 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:42.740671 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mfsjt"] Jul 20 16:30:42.744852 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:30:42.744822 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd433e6a_a361_4daf_bbbe_053e843cca00.slice/crio-be8164b6c486988794488f4272a34b62a71496010d685c56056f8d77502f0190 WatchSource:0}: Error finding container be8164b6c486988794488f4272a34b62a71496010d685c56056f8d77502f0190: Status 404 returned error can't find the container with id be8164b6c486988794488f4272a34b62a71496010d685c56056f8d77502f0190 Jul 20 16:30:42.754748 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:42.754654 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-5659v"] Jul 20 16:30:42.759184 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:30:42.759146 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ee47b7a_0762_47f2_9d04_d564e41fb936.slice/crio-36d5520f896f39cdb5e028e476ead5d2d145d38372ac65be4fefe36eff6327f1 WatchSource:0}: Error finding container 36d5520f896f39cdb5e028e476ead5d2d145d38372ac65be4fefe36eff6327f1: Status 404 returned error can't find the container with id 36d5520f896f39cdb5e028e476ead5d2d145d38372ac65be4fefe36eff6327f1 Jul 20 16:30:42.771944 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:42.771881 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-9c5c4477b-t6gf6"] Jul 20 16:30:42.774565 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:30:42.774539 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70abe44f_c09a_4818_b892_7b725bc197ae.slice/crio-2e79b182decd618f75d84f0eebf9d56ef3160deb55415a19625f7e992d0d1ff6 WatchSource:0}: Error finding container 2e79b182decd618f75d84f0eebf9d56ef3160deb55415a19625f7e992d0d1ff6: Status 404 returned error can't find the container with id 2e79b182decd618f75d84f0eebf9d56ef3160deb55415a19625f7e992d0d1ff6 Jul 20 16:30:43.169917 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:43.169872 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wnqv5" event={"ID":"e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d","Type":"ContainerStarted","Data":"4b58566affe0c6e2839490eaeac466778690df7c24f8461a23dac3ddbd5fad4e"} Jul 20 16:30:43.170140 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:43.169979 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wnqv5" event={"ID":"e100d3fe-3d49-47e3-b7e7-eb5ad31fbe0d","Type":"ContainerStarted","Data":"baee65f069098a84c5c2c556875d73f1952c4b767d7e285394fdecb3ce438952"} Jul 20 16:30:43.171449 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:43.171421 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-9c5c4477b-t6gf6" event={"ID":"70abe44f-c09a-4818-b892-7b725bc197ae","Type":"ContainerStarted","Data":"04039e9fc4a1a4197e638d9879a6973040ff8debb1d82066c1131de25d1f8afb"} Jul 20 16:30:43.171568 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:43.171468 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-9c5c4477b-t6gf6" event={"ID":"70abe44f-c09a-4818-b892-7b725bc197ae","Type":"ContainerStarted","Data":"2e79b182decd618f75d84f0eebf9d56ef3160deb55415a19625f7e992d0d1ff6"} Jul 20 16:30:43.172493 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:43.172466 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5659v" event={"ID":"8ee47b7a-0762-47f2-9d04-d564e41fb936","Type":"ContainerStarted","Data":"36d5520f896f39cdb5e028e476ead5d2d145d38372ac65be4fefe36eff6327f1"} Jul 20 16:30:43.176494 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:43.176468 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mfsjt" event={"ID":"bd433e6a-a361-4daf-bbbe-053e843cca00","Type":"ContainerStarted","Data":"be8164b6c486988794488f4272a34b62a71496010d685c56056f8d77502f0190"} Jul 20 16:30:43.177725 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:43.177702 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8dqnv" event={"ID":"53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3","Type":"ContainerStarted","Data":"5b06bb3dfd3886384f451c3a772eb1f7c5e4a74e4086bf84a4f722b77540bd92"} Jul 20 16:30:43.179334 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:43.179308 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" event={"ID":"c8a0179d-26cb-47cc-97ae-364a22d796fe","Type":"ContainerStarted","Data":"59e994874406f9a95dbf62521bd7f234801ca0693b5ee4b29a2a516b4756c50c"} Jul 20 16:30:43.179429 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:43.179350 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" event={"ID":"c8a0179d-26cb-47cc-97ae-364a22d796fe","Type":"ContainerStarted","Data":"2f7bbc2717e74ec865a619f55961545e6ce73d0a0e99c772f0db9d6916016250"} Jul 20 16:30:43.179429 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:43.179376 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" Jul 20 16:30:43.180380 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:43.180361 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j2v4n" event={"ID":"fd5f02ab-a975-44c8-af0d-5a82dcb219af","Type":"ContainerStarted","Data":"1c128db6fd46e4aa7d52cea1870f78f9cf8843171918d64830cd1d41c3959894"} Jul 20 16:30:43.186933 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:43.186887 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wnqv5" podStartSLOduration=66.610668835 podStartE2EDuration="1m8.186873476s" totalImagesPullingTime="1.576204641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:29:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:43.18623026 +0000 UTC m=+68.837112760" watchObservedRunningTime="2026-07-20 16:30:43.186873476 +0000 UTC m=+68.837755977" Jul 20 16:30:43.206715 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:43.206653 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" podStartSLOduration=68.206632046 podStartE2EDuration="1m8.206632046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:29:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:43.206057616 +0000 UTC m=+68.856940116" watchObservedRunningTime="2026-07-20 16:30:43.206632046 +0000 UTC m=+68.857514554" Jul 20 16:30:43.225809 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:43.225749 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-9c5c4477b-t6gf6" podStartSLOduration=64.225729854 podStartE2EDuration="1m4.225729854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:29:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:43.224078817 +0000 UTC m=+68.874961316" watchObservedRunningTime="2026-07-20 16:30:43.225729854 +0000 UTC m=+68.876612353" Jul 20 16:30:43.464810 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:43.464717 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-9c5c4477b-t6gf6" Jul 20 16:30:43.467808 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:43.467769 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-9c5c4477b-t6gf6" Jul 20 16:30:44.189316 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:44.189288 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-9c5c4477b-t6gf6" Jul 20 16:30:44.191599 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:44.191338 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-9c5c4477b-t6gf6" Jul 20 16:30:45.847497 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:45.847469 2575 scope.go:117] "RemoveContainer" containerID="13bfbda7cf5290d9ea97ceb9db36800894b4129a2e8fa29983d0f5480901386c" Jul 20 16:30:49.206715 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:49.206655 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8dqnv" event={"ID":"53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3","Type":"ContainerStarted","Data":"1deefd90e14b95ca2ff705f010ea053dcaffcab859051e1623be96a5b2715284"} Jul 20 16:30:49.208923 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:49.208891 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j2v4n" event={"ID":"fd5f02ab-a975-44c8-af0d-5a82dcb219af","Type":"ContainerStarted","Data":"042005b3b8e9d84f1fff88f5f0dd972752628afd33b49578d4eab02673565437"} Jul 20 16:30:49.209062 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:49.208936 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j2v4n" event={"ID":"fd5f02ab-a975-44c8-af0d-5a82dcb219af","Type":"ContainerStarted","Data":"63ece216fe0e35525d63b3523da5dc94479133c39199fed89979e72c615654a4"} Jul 20 16:30:49.210696 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:49.210668 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-99wqw_0ec4c40f-7638-4fe3-8bff-edb2579a3b3b/console-operator/1.log" Jul 20 16:30:49.210846 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:49.210761 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-99wqw" event={"ID":"0ec4c40f-7638-4fe3-8bff-edb2579a3b3b","Type":"ContainerStarted","Data":"b1214b2c7f6f49ba46d91bc2351f4dbf9d2a50e02bf371f6bdce89214528c5f0"} Jul 20 16:30:49.211056 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:49.211039 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-99wqw" Jul 20 16:30:49.212556 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:49.212524 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bpbjs" event={"ID":"e60cf0cf-f42e-4d8c-a1be-977d5eab29ef","Type":"ContainerStarted","Data":"14969a1c34cf6af9516cf8dd94286698a1be27b543c178c56d49585ce969e719"} Jul 20 16:30:49.214141 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:49.214117 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5659v" event={"ID":"8ee47b7a-0762-47f2-9d04-d564e41fb936","Type":"ContainerStarted","Data":"39790a0457279bc0e04a5fcbfb4e514502ae179932e286745d337e1b1592a03c"} Jul 20 16:30:49.215801 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:49.215779 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mfsjt" event={"ID":"bd433e6a-a361-4daf-bbbe-053e843cca00","Type":"ContainerStarted","Data":"e3bfa1663ed13cef16e77e30f830eab60a43c246949e5d9e2e2c66d1b98c32ee"} Jul 20 16:30:49.215902 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:49.215822 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mfsjt" event={"ID":"bd433e6a-a361-4daf-bbbe-053e843cca00","Type":"ContainerStarted","Data":"a09a3ef05bd1ad211bc622fbe89bb91936389b60c1390ef8631b3cf7994a693e"} Jul 20 16:30:49.215902 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:49.215857 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mfsjt" Jul 20 16:30:49.216249 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:49.216233 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-99wqw" Jul 20 16:30:49.219264 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:49.219236 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-dcggk"] Jul 20 16:30:49.224143 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:49.224105 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8dqnv" podStartSLOduration=64.583312313 podStartE2EDuration="1m10.22407114s" totalImagesPullingTime="5.640758827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:49.223480733 +0000 UTC m=+74.874363234" watchObservedRunningTime="2026-07-20 16:30:49.22407114 +0000 UTC m=+74.874953637" Jul 20 16:30:49.241852 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:49.241816 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5659v" podStartSLOduration=45.702788303 podStartE2EDuration="51.241804126s" totalImagesPullingTime="5.539015823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:29:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:49.241096884 +0000 UTC m=+74.891979377" watchObservedRunningTime="2026-07-20 16:30:49.241804126 +0000 UTC m=+74.892686650" Jul 20 16:30:49.244843 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:49.244823 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-dcggk"] Jul 20 16:30:49.244951 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:49.244907 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-dcggk" Jul 20 16:30:49.246898 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:49.246877 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 20 16:30:49.247055 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:49.247039 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-2fzjd\"" Jul 20 16:30:49.247182 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:49.247164 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 20 16:30:49.258345 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:49.258276 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mfsjt" podStartSLOduration=33.706312153 podStartE2EDuration="39.25825978s" totalImagesPullingTime="5.551947627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:49.257212154 +0000 UTC m=+74.908094665" watchObservedRunningTime="2026-07-20 16:30:49.25825978 +0000 UTC m=+74.909142277" Jul 20 16:30:49.271065 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:49.271015 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bpbjs" podStartSLOduration=66.765017421 podStartE2EDuration="1m14.271002395s" totalImagesPullingTime="7.505984974s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:29:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:49.27019154 +0000 UTC m=+74.921074039" watchObservedRunningTime="2026-07-20 16:30:49.271002395 +0000 UTC m=+74.921884894" Jul 20 16:30:49.288303 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:49.288264 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-99wqw" podStartSLOduration=61.156135823 podStartE2EDuration="1m10.288249638s" totalImagesPullingTime="9.132113815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:49.287323906 +0000 UTC m=+74.938206405" watchObservedRunningTime="2026-07-20 16:30:49.288249638 +0000 UTC m=+74.939132135" Jul 20 16:30:49.313334 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:49.310852 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j2v4n" podStartSLOduration=64.752568052 podStartE2EDuration="1m10.310831891s" totalImagesPullingTime="5.558263839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:49.30697983 +0000 UTC m=+74.957862351" watchObservedRunningTime="2026-07-20 16:30:49.310831891 +0000 UTC m=+74.961714391" Jul 20 16:30:49.324494 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:49.324057 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbt9b\" (UniqueName: \"kubernetes.io/projected/dec857bc-bb8a-4a89-8ece-24125904bfde-kube-api-access-tbt9b\") pod \"downloads-5bc67dcd46-dcggk\" (UID: \"dec857bc-bb8a-4a89-8ece-24125904bfde\") " pod="openshift-console/downloads-5bc67dcd46-dcggk" Jul 20 16:30:49.425357 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:49.425317 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbt9b\" (UniqueName: \"kubernetes.io/projected/dec857bc-bb8a-4a89-8ece-24125904bfde-kube-api-access-tbt9b\") pod \"downloads-5bc67dcd46-dcggk\" (UID: \"dec857bc-bb8a-4a89-8ece-24125904bfde\") " pod="openshift-console/downloads-5bc67dcd46-dcggk" Jul 20 16:30:49.433805 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:49.433773 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbt9b\" (UniqueName: \"kubernetes.io/projected/dec857bc-bb8a-4a89-8ece-24125904bfde-kube-api-access-tbt9b\") pod \"downloads-5bc67dcd46-dcggk\" (UID: \"dec857bc-bb8a-4a89-8ece-24125904bfde\") " pod="openshift-console/downloads-5bc67dcd46-dcggk" Jul 20 16:30:49.554664 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:49.554633 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-dcggk" Jul 20 16:30:49.702884 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:49.702855 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-dcggk"] Jul 20 16:30:49.706218 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:30:49.706192 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddec857bc_bb8a_4a89_8ece_24125904bfde.slice/crio-7019b17f378a2600324ed8931aaddb0bb67cfe89ddfb91347992912afc5f6273 WatchSource:0}: Error finding container 7019b17f378a2600324ed8931aaddb0bb67cfe89ddfb91347992912afc5f6273: Status 404 returned error can't find the container with id 7019b17f378a2600324ed8931aaddb0bb67cfe89ddfb91347992912afc5f6273 Jul 20 16:30:50.221363 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:50.221319 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-dcggk" event={"ID":"dec857bc-bb8a-4a89-8ece-24125904bfde","Type":"ContainerStarted","Data":"7019b17f378a2600324ed8931aaddb0bb67cfe89ddfb91347992912afc5f6273"} Jul 20 16:30:53.965569 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:53.965524 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47e9b2bf-923f-4e16-b106-a2f7be0575ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hg27p\" (UID: \"47e9b2bf-923f-4e16-b106-a2f7be0575ae\") " pod="openshift-insights/insights-runtime-extractor-hg27p" Jul 20 16:30:53.968126 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:53.968077 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47e9b2bf-923f-4e16-b106-a2f7be0575ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hg27p\" (UID: \"47e9b2bf-923f-4e16-b106-a2f7be0575ae\") " pod="openshift-insights/insights-runtime-extractor-hg27p" Jul 20 16:30:54.208987 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:54.208954 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w4qdt\"" Jul 20 16:30:54.216992 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:54.216923 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hg27p" Jul 20 16:30:54.386594 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:54.386477 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hg27p"] Jul 20 16:30:54.391489 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:30:54.391449 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47e9b2bf_923f_4e16_b106_a2f7be0575ae.slice/crio-eab927e18f588dcf45b63958ed1ce3e320763c96d58dc5ea391269094b919cd1 WatchSource:0}: Error finding container eab927e18f588dcf45b63958ed1ce3e320763c96d58dc5ea391269094b919cd1: Status 404 returned error can't find the container with id eab927e18f588dcf45b63958ed1ce3e320763c96d58dc5ea391269094b919cd1 Jul 20 16:30:55.250308 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:55.250272 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hg27p" event={"ID":"47e9b2bf-923f-4e16-b106-a2f7be0575ae","Type":"ContainerStarted","Data":"eab927e18f588dcf45b63958ed1ce3e320763c96d58dc5ea391269094b919cd1"} Jul 20 16:30:59.225177 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:30:59.225030 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mfsjt" Jul 20 16:31:00.277881 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:00.277846 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hg27p" event={"ID":"47e9b2bf-923f-4e16-b106-a2f7be0575ae","Type":"ContainerStarted","Data":"c31b5e67f2b51722b17b8530eb8d1fa92a125f23d9b76c92cde4421947108e77"} Jul 20 16:31:01.338390 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.336858 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-qzbcz"] Jul 20 16:31:01.341175 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.340675 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qzbcz" Jul 20 16:31:01.344995 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.344928 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-njbzh\"" Jul 20 16:31:01.344995 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.344931 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 20 16:31:01.344995 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.344983 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 20 16:31:01.345320 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.345128 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 20 16:31:01.355972 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.355946 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-qzbcz"] Jul 20 16:31:01.369359 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.369330 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bzfp8"] Jul 20 16:31:01.373047 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.373023 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bzfp8" Jul 20 16:31:01.376353 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.376285 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 20 16:31:01.376594 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.376550 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-25shj\"" Jul 20 16:31:01.376675 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.376557 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 20 16:31:01.377168 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.376998 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 20 16:31:01.432003 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.431976 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/48ee35a2-9bda-4328-9452-ab5ee276fc6e-sys\") pod \"node-exporter-bzfp8\" (UID: \"48ee35a2-9bda-4328-9452-ab5ee276fc6e\") " pod="openshift-monitoring/node-exporter-bzfp8" Jul 20 16:31:01.432280 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.432111 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/48ee35a2-9bda-4328-9452-ab5ee276fc6e-node-exporter-wtmp\") pod \"node-exporter-bzfp8\" (UID: \"48ee35a2-9bda-4328-9452-ab5ee276fc6e\") " pod="openshift-monitoring/node-exporter-bzfp8" Jul 20 16:31:01.432280 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.432160 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/efee9b27-14b5-4e57-bf01-1da41f07676b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-qzbcz\" (UID: \"efee9b27-14b5-4e57-bf01-1da41f07676b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qzbcz" Jul 20 16:31:01.432280 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.432186 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/48ee35a2-9bda-4328-9452-ab5ee276fc6e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bzfp8\" (UID: \"48ee35a2-9bda-4328-9452-ab5ee276fc6e\") " pod="openshift-monitoring/node-exporter-bzfp8" Jul 20 16:31:01.432280 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.432213 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/efee9b27-14b5-4e57-bf01-1da41f07676b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-qzbcz\" (UID: \"efee9b27-14b5-4e57-bf01-1da41f07676b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qzbcz" Jul 20 16:31:01.432502 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.432284 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efee9b27-14b5-4e57-bf01-1da41f07676b-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-qzbcz\" (UID: \"efee9b27-14b5-4e57-bf01-1da41f07676b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qzbcz" Jul 20 16:31:01.432502 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.432339 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48ee35a2-9bda-4328-9452-ab5ee276fc6e-metrics-client-ca\") pod \"node-exporter-bzfp8\" (UID: \"48ee35a2-9bda-4328-9452-ab5ee276fc6e\") " pod="openshift-monitoring/node-exporter-bzfp8" Jul 20 16:31:01.432502 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.432369 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx2jr\" (UniqueName: \"kubernetes.io/projected/48ee35a2-9bda-4328-9452-ab5ee276fc6e-kube-api-access-wx2jr\") pod \"node-exporter-bzfp8\" (UID: \"48ee35a2-9bda-4328-9452-ab5ee276fc6e\") " pod="openshift-monitoring/node-exporter-bzfp8" Jul 20 16:31:01.432502 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.432414 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/48ee35a2-9bda-4328-9452-ab5ee276fc6e-node-exporter-textfile\") pod \"node-exporter-bzfp8\" (UID: \"48ee35a2-9bda-4328-9452-ab5ee276fc6e\") " pod="openshift-monitoring/node-exporter-bzfp8" Jul 20 16:31:01.432502 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.432438 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/48ee35a2-9bda-4328-9452-ab5ee276fc6e-node-exporter-tls\") pod \"node-exporter-bzfp8\" (UID: \"48ee35a2-9bda-4328-9452-ab5ee276fc6e\") " pod="openshift-monitoring/node-exporter-bzfp8" Jul 20 16:31:01.432502 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.432487 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/48ee35a2-9bda-4328-9452-ab5ee276fc6e-node-exporter-accelerators-collector-config\") pod \"node-exporter-bzfp8\" (UID: \"48ee35a2-9bda-4328-9452-ab5ee276fc6e\") " pod="openshift-monitoring/node-exporter-bzfp8" Jul 20 16:31:01.432779 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.432513 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgm2z\" (UniqueName: \"kubernetes.io/projected/efee9b27-14b5-4e57-bf01-1da41f07676b-kube-api-access-jgm2z\") pod \"openshift-state-metrics-79f6958cdf-qzbcz\" (UID: \"efee9b27-14b5-4e57-bf01-1da41f07676b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qzbcz" Jul 20 16:31:01.432779 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.432562 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/48ee35a2-9bda-4328-9452-ab5ee276fc6e-root\") pod \"node-exporter-bzfp8\" (UID: \"48ee35a2-9bda-4328-9452-ab5ee276fc6e\") " pod="openshift-monitoring/node-exporter-bzfp8" Jul 20 16:31:01.533658 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.533628 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/48ee35a2-9bda-4328-9452-ab5ee276fc6e-sys\") pod \"node-exporter-bzfp8\" (UID: \"48ee35a2-9bda-4328-9452-ab5ee276fc6e\") " pod="openshift-monitoring/node-exporter-bzfp8" Jul 20 16:31:01.533658 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.533667 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/48ee35a2-9bda-4328-9452-ab5ee276fc6e-node-exporter-wtmp\") pod \"node-exporter-bzfp8\" (UID: \"48ee35a2-9bda-4328-9452-ab5ee276fc6e\") " pod="openshift-monitoring/node-exporter-bzfp8" Jul 20 16:31:01.533905 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.533701 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/efee9b27-14b5-4e57-bf01-1da41f07676b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-qzbcz\" (UID: \"efee9b27-14b5-4e57-bf01-1da41f07676b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qzbcz" Jul 20 16:31:01.533905 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.533734 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/48ee35a2-9bda-4328-9452-ab5ee276fc6e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bzfp8\" (UID: \"48ee35a2-9bda-4328-9452-ab5ee276fc6e\") " pod="openshift-monitoring/node-exporter-bzfp8" Jul 20 16:31:01.533905 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.533762 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/48ee35a2-9bda-4328-9452-ab5ee276fc6e-sys\") pod \"node-exporter-bzfp8\" (UID: \"48ee35a2-9bda-4328-9452-ab5ee276fc6e\") " pod="openshift-monitoring/node-exporter-bzfp8" Jul 20 16:31:01.533905 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.533830 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/48ee35a2-9bda-4328-9452-ab5ee276fc6e-node-exporter-wtmp\") pod \"node-exporter-bzfp8\" (UID: \"48ee35a2-9bda-4328-9452-ab5ee276fc6e\") " pod="openshift-monitoring/node-exporter-bzfp8" Jul 20 16:31:01.534167 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.533767 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/efee9b27-14b5-4e57-bf01-1da41f07676b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-qzbcz\" (UID: \"efee9b27-14b5-4e57-bf01-1da41f07676b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qzbcz" Jul 20 16:31:01.534264 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.534213 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efee9b27-14b5-4e57-bf01-1da41f07676b-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-qzbcz\" (UID: \"efee9b27-14b5-4e57-bf01-1da41f07676b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qzbcz" Jul 20 16:31:01.534264 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.534259 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48ee35a2-9bda-4328-9452-ab5ee276fc6e-metrics-client-ca\") pod \"node-exporter-bzfp8\" (UID: \"48ee35a2-9bda-4328-9452-ab5ee276fc6e\") " pod="openshift-monitoring/node-exporter-bzfp8" Jul 20 16:31:01.534378 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.534286 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx2jr\" (UniqueName: \"kubernetes.io/projected/48ee35a2-9bda-4328-9452-ab5ee276fc6e-kube-api-access-wx2jr\") pod \"node-exporter-bzfp8\" (UID: \"48ee35a2-9bda-4328-9452-ab5ee276fc6e\") " pod="openshift-monitoring/node-exporter-bzfp8" Jul 20 16:31:01.534378 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.534317 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/48ee35a2-9bda-4328-9452-ab5ee276fc6e-node-exporter-textfile\") pod \"node-exporter-bzfp8\" (UID: \"48ee35a2-9bda-4328-9452-ab5ee276fc6e\") " pod="openshift-monitoring/node-exporter-bzfp8" Jul 20 16:31:01.534378 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.534350 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/48ee35a2-9bda-4328-9452-ab5ee276fc6e-node-exporter-tls\") pod \"node-exporter-bzfp8\" (UID: \"48ee35a2-9bda-4328-9452-ab5ee276fc6e\") " pod="openshift-monitoring/node-exporter-bzfp8" Jul 20 16:31:01.534528 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.534381 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/48ee35a2-9bda-4328-9452-ab5ee276fc6e-node-exporter-accelerators-collector-config\") pod \"node-exporter-bzfp8\" (UID: \"48ee35a2-9bda-4328-9452-ab5ee276fc6e\") " pod="openshift-monitoring/node-exporter-bzfp8" Jul 20 16:31:01.534528 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.534410 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgm2z\" (UniqueName: \"kubernetes.io/projected/efee9b27-14b5-4e57-bf01-1da41f07676b-kube-api-access-jgm2z\") pod \"openshift-state-metrics-79f6958cdf-qzbcz\" (UID: \"efee9b27-14b5-4e57-bf01-1da41f07676b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qzbcz" Jul 20 16:31:01.534528 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.534470 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/48ee35a2-9bda-4328-9452-ab5ee276fc6e-root\") pod \"node-exporter-bzfp8\" (UID: \"48ee35a2-9bda-4328-9452-ab5ee276fc6e\") " pod="openshift-monitoring/node-exporter-bzfp8" Jul 20 16:31:01.534674 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.534553 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/48ee35a2-9bda-4328-9452-ab5ee276fc6e-root\") pod \"node-exporter-bzfp8\" (UID: \"48ee35a2-9bda-4328-9452-ab5ee276fc6e\") " pod="openshift-monitoring/node-exporter-bzfp8" Jul 20 16:31:01.534783 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.534757 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/48ee35a2-9bda-4328-9452-ab5ee276fc6e-node-exporter-textfile\") pod \"node-exporter-bzfp8\" (UID: \"48ee35a2-9bda-4328-9452-ab5ee276fc6e\") " pod="openshift-monitoring/node-exporter-bzfp8" Jul 20 16:31:01.535737 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.535192 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efee9b27-14b5-4e57-bf01-1da41f07676b-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-qzbcz\" (UID: \"efee9b27-14b5-4e57-bf01-1da41f07676b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qzbcz" Jul 20 16:31:01.535737 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.535274 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48ee35a2-9bda-4328-9452-ab5ee276fc6e-metrics-client-ca\") pod \"node-exporter-bzfp8\" (UID: \"48ee35a2-9bda-4328-9452-ab5ee276fc6e\") " pod="openshift-monitoring/node-exporter-bzfp8" Jul 20 16:31:01.535737 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.535670 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/48ee35a2-9bda-4328-9452-ab5ee276fc6e-node-exporter-accelerators-collector-config\") pod \"node-exporter-bzfp8\" (UID: \"48ee35a2-9bda-4328-9452-ab5ee276fc6e\") " pod="openshift-monitoring/node-exporter-bzfp8" Jul 20 16:31:01.537106 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.536973 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/efee9b27-14b5-4e57-bf01-1da41f07676b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-qzbcz\" (UID: \"efee9b27-14b5-4e57-bf01-1da41f07676b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qzbcz" Jul 20 16:31:01.537821 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.537796 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/efee9b27-14b5-4e57-bf01-1da41f07676b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-qzbcz\" (UID: \"efee9b27-14b5-4e57-bf01-1da41f07676b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qzbcz" Jul 20 16:31:01.538114 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.538066 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/48ee35a2-9bda-4328-9452-ab5ee276fc6e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bzfp8\" (UID: \"48ee35a2-9bda-4328-9452-ab5ee276fc6e\") " pod="openshift-monitoring/node-exporter-bzfp8" Jul 20 16:31:01.538812 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.538718 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/48ee35a2-9bda-4328-9452-ab5ee276fc6e-node-exporter-tls\") pod \"node-exporter-bzfp8\" (UID: \"48ee35a2-9bda-4328-9452-ab5ee276fc6e\") " pod="openshift-monitoring/node-exporter-bzfp8" Jul 20 16:31:01.544680 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.544660 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx2jr\" (UniqueName: \"kubernetes.io/projected/48ee35a2-9bda-4328-9452-ab5ee276fc6e-kube-api-access-wx2jr\") pod \"node-exporter-bzfp8\" (UID: \"48ee35a2-9bda-4328-9452-ab5ee276fc6e\") " pod="openshift-monitoring/node-exporter-bzfp8" Jul 20 16:31:01.547874 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.547851 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgm2z\" (UniqueName: \"kubernetes.io/projected/efee9b27-14b5-4e57-bf01-1da41f07676b-kube-api-access-jgm2z\") pod \"openshift-state-metrics-79f6958cdf-qzbcz\" (UID: \"efee9b27-14b5-4e57-bf01-1da41f07676b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qzbcz" Jul 20 16:31:01.655633 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.655548 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qzbcz" Jul 20 16:31:01.684877 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.684659 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bzfp8" Jul 20 16:31:01.816149 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:01.815907 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-qzbcz"] Jul 20 16:31:02.289116 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.289049 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bzfp8" event={"ID":"48ee35a2-9bda-4328-9452-ab5ee276fc6e","Type":"ContainerStarted","Data":"623b69f39fd8b853a84c4445177717ec902991ea6182fe7c662022067ca410ea"} Jul 20 16:31:02.439068 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.439025 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 16:31:02.443184 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.443160 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.446476 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.446453 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 20 16:31:02.446592 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.446451 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 20 16:31:02.446716 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.446699 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 20 16:31:02.446781 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.446760 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 20 16:31:02.446832 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.446802 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 20 16:31:02.446832 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.446814 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 20 16:31:02.446935 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.446835 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 20 16:31:02.446935 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.446802 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4vqvf\"" Jul 20 16:31:02.447034 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.446955 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 20 16:31:02.447387 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.447265 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 20 16:31:02.467782 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.467751 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 16:31:02.544391 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.544310 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3d80185e-3632-46ee-9287-915f34db810c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.544391 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.544366 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d80185e-3632-46ee-9287-915f34db810c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.544600 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.544428 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d80185e-3632-46ee-9287-915f34db810c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.544600 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.544466 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-config-volume\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.544600 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.544490 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3d80185e-3632-46ee-9287-915f34db810c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.544600 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.544589 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.544802 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.544618 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-web-config\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.544802 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.544636 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.544802 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.544686 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.544802 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.544703 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.544802 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.544760 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.545016 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.544806 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhsjv\" (UniqueName: \"kubernetes.io/projected/3d80185e-3632-46ee-9287-915f34db810c-kube-api-access-lhsjv\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.545016 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.544863 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3d80185e-3632-46ee-9287-915f34db810c-config-out\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.645700 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.645662 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d80185e-3632-46ee-9287-915f34db810c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.645883 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.645732 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d80185e-3632-46ee-9287-915f34db810c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.645883 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.645767 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-config-volume\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.645883 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.645786 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3d80185e-3632-46ee-9287-915f34db810c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.645883 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.645826 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.645883 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.645853 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-web-config\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.645883 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.645878 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.646229 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.645912 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.646229 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.645934 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.646229 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.645976 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.646229 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.645997 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhsjv\" (UniqueName: \"kubernetes.io/projected/3d80185e-3632-46ee-9287-915f34db810c-kube-api-access-lhsjv\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.646229 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.646016 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3d80185e-3632-46ee-9287-915f34db810c-config-out\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.646229 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.646050 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3d80185e-3632-46ee-9287-915f34db810c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.646523 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.646306 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3d80185e-3632-46ee-9287-915f34db810c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.646584 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.646558 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d80185e-3632-46ee-9287-915f34db810c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.647752 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.647721 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d80185e-3632-46ee-9287-915f34db810c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.649005 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.648962 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-web-config\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.649384 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.649363 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.650105 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.649788 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-config-volume\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.650211 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.650142 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3d80185e-3632-46ee-9287-915f34db810c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.650278 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.650229 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3d80185e-3632-46ee-9287-915f34db810c-config-out\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.650351 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.650333 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.650748 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.650724 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.651410 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.651387 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.652774 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.652751 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.657251 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.657230 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhsjv\" (UniqueName: \"kubernetes.io/projected/3d80185e-3632-46ee-9287-915f34db810c-kube-api-access-lhsjv\") pod \"alertmanager-main-0\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:02.759264 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:02.759221 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:31:04.194197 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:04.194167 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" Jul 20 16:31:04.332791 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:04.332751 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-866c9b644b-k4wdq"] Jul 20 16:31:04.336858 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:04.336831 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-866c9b644b-k4wdq" Jul 20 16:31:04.339626 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:04.339602 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fi1g65f7hs9tv\"" Jul 20 16:31:04.339755 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:04.339623 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 20 16:31:04.339755 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:04.339636 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 20 16:31:04.339755 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:04.339602 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 20 16:31:04.339755 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:04.339677 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 20 16:31:04.339755 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:04.339638 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-qxg5d\"" Jul 20 16:31:04.340020 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:04.340004 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 20 16:31:04.349734 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:04.349706 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-866c9b644b-k4wdq"] Jul 20 16:31:04.464506 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:04.464422 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a-secret-thanos-querier-tls\") pod \"thanos-querier-866c9b644b-k4wdq\" (UID: \"e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a\") " pod="openshift-monitoring/thanos-querier-866c9b644b-k4wdq" Jul 20 16:31:04.464506 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:04.464473 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-866c9b644b-k4wdq\" (UID: \"e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a\") " pod="openshift-monitoring/thanos-querier-866c9b644b-k4wdq" Jul 20 16:31:04.464506 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:04.464504 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftv57\" (UniqueName: \"kubernetes.io/projected/e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a-kube-api-access-ftv57\") pod \"thanos-querier-866c9b644b-k4wdq\" (UID: \"e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a\") " pod="openshift-monitoring/thanos-querier-866c9b644b-k4wdq" Jul 20 16:31:04.464764 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:04.464524 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-866c9b644b-k4wdq\" (UID: \"e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a\") " pod="openshift-monitoring/thanos-querier-866c9b644b-k4wdq" Jul 20 16:31:04.464764 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:04.464549 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a-metrics-client-ca\") pod \"thanos-querier-866c9b644b-k4wdq\" (UID: \"e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a\") " pod="openshift-monitoring/thanos-querier-866c9b644b-k4wdq" Jul 20 16:31:04.464764 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:04.464596 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-866c9b644b-k4wdq\" (UID: \"e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a\") " pod="openshift-monitoring/thanos-querier-866c9b644b-k4wdq" Jul 20 16:31:04.464764 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:04.464670 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-866c9b644b-k4wdq\" (UID: \"e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a\") " pod="openshift-monitoring/thanos-querier-866c9b644b-k4wdq" Jul 20 16:31:04.464941 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:04.464768 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a-secret-grpc-tls\") pod \"thanos-querier-866c9b644b-k4wdq\" (UID: \"e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a\") " pod="openshift-monitoring/thanos-querier-866c9b644b-k4wdq" Jul 20 16:31:04.565909 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:04.565869 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a-secret-grpc-tls\") pod \"thanos-querier-866c9b644b-k4wdq\" (UID: \"e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a\") " pod="openshift-monitoring/thanos-querier-866c9b644b-k4wdq" Jul 20 16:31:04.566123 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:04.565935 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a-secret-thanos-querier-tls\") pod \"thanos-querier-866c9b644b-k4wdq\" (UID: \"e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a\") " pod="openshift-monitoring/thanos-querier-866c9b644b-k4wdq" Jul 20 16:31:04.566123 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:04.565970 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-866c9b644b-k4wdq\" (UID: \"e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a\") " pod="openshift-monitoring/thanos-querier-866c9b644b-k4wdq" Jul 20 16:31:04.566123 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:04.565995 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftv57\" (UniqueName: \"kubernetes.io/projected/e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a-kube-api-access-ftv57\") pod \"thanos-querier-866c9b644b-k4wdq\" (UID: \"e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a\") " pod="openshift-monitoring/thanos-querier-866c9b644b-k4wdq" Jul 20 16:31:04.566123 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:04.566019 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-866c9b644b-k4wdq\" (UID: \"e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a\") " pod="openshift-monitoring/thanos-querier-866c9b644b-k4wdq" Jul 20 16:31:04.566123 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:04.566042 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a-metrics-client-ca\") pod \"thanos-querier-866c9b644b-k4wdq\" (UID: \"e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a\") " pod="openshift-monitoring/thanos-querier-866c9b644b-k4wdq" Jul 20 16:31:04.566123 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:04.566109 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-866c9b644b-k4wdq\" (UID: \"e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a\") " pod="openshift-monitoring/thanos-querier-866c9b644b-k4wdq" Jul 20 16:31:04.566424 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:04.566147 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-866c9b644b-k4wdq\" (UID: \"e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a\") " pod="openshift-monitoring/thanos-querier-866c9b644b-k4wdq" Jul 20 16:31:04.567196 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:04.567134 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a-metrics-client-ca\") pod \"thanos-querier-866c9b644b-k4wdq\" (UID: \"e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a\") " pod="openshift-monitoring/thanos-querier-866c9b644b-k4wdq" Jul 20 16:31:04.569260 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:04.569233 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a-secret-thanos-querier-tls\") pod \"thanos-querier-866c9b644b-k4wdq\" (UID: \"e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a\") " pod="openshift-monitoring/thanos-querier-866c9b644b-k4wdq" Jul 20 16:31:04.569362 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:04.569235 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-866c9b644b-k4wdq\" (UID: \"e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a\") " pod="openshift-monitoring/thanos-querier-866c9b644b-k4wdq" Jul 20 16:31:04.569431 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:04.569397 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-866c9b644b-k4wdq\" (UID: \"e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a\") " pod="openshift-monitoring/thanos-querier-866c9b644b-k4wdq" Jul 20 16:31:04.569564 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:04.569540 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-866c9b644b-k4wdq\" (UID: \"e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a\") " pod="openshift-monitoring/thanos-querier-866c9b644b-k4wdq" Jul 20 16:31:04.569639 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:04.569626 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a-secret-grpc-tls\") pod \"thanos-querier-866c9b644b-k4wdq\" (UID: \"e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a\") " pod="openshift-monitoring/thanos-querier-866c9b644b-k4wdq" Jul 20 16:31:04.569803 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:04.569782 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-866c9b644b-k4wdq\" (UID: \"e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a\") " pod="openshift-monitoring/thanos-querier-866c9b644b-k4wdq" Jul 20 16:31:04.574773 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:04.574747 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftv57\" (UniqueName: \"kubernetes.io/projected/e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a-kube-api-access-ftv57\") pod \"thanos-querier-866c9b644b-k4wdq\" (UID: \"e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a\") " pod="openshift-monitoring/thanos-querier-866c9b644b-k4wdq" Jul 20 16:31:04.648708 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:04.648658 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-866c9b644b-k4wdq" Jul 20 16:31:05.660957 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:05.660919 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-967997db4-64vzd"] Jul 20 16:31:05.664455 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:05.664434 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-967997db4-64vzd" Jul 20 16:31:05.667179 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:05.667155 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 20 16:31:05.667290 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:05.667263 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 20 16:31:05.668400 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:05.668377 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8o7ugvv5vtg90\"" Jul 20 16:31:05.668518 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:05.668426 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 20 16:31:05.668518 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:05.668453 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-75ts6\"" Jul 20 16:31:05.668518 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:05.668376 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 20 16:31:05.674527 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:05.674467 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-967997db4-64vzd"] Jul 20 16:31:05.777964 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:05.777925 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4f8759ae-541e-45f6-972f-87742e533649-secret-metrics-server-client-certs\") pod \"metrics-server-967997db4-64vzd\" (UID: \"4f8759ae-541e-45f6-972f-87742e533649\") " pod="openshift-monitoring/metrics-server-967997db4-64vzd" Jul 20 16:31:05.778162 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:05.777989 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4f8759ae-541e-45f6-972f-87742e533649-audit-log\") pod \"metrics-server-967997db4-64vzd\" (UID: \"4f8759ae-541e-45f6-972f-87742e533649\") " pod="openshift-monitoring/metrics-server-967997db4-64vzd" Jul 20 16:31:05.778162 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:05.778034 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcm9q\" (UniqueName: \"kubernetes.io/projected/4f8759ae-541e-45f6-972f-87742e533649-kube-api-access-wcm9q\") pod \"metrics-server-967997db4-64vzd\" (UID: \"4f8759ae-541e-45f6-972f-87742e533649\") " pod="openshift-monitoring/metrics-server-967997db4-64vzd" Jul 20 16:31:05.778162 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:05.778132 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4f8759ae-541e-45f6-972f-87742e533649-metrics-server-audit-profiles\") pod \"metrics-server-967997db4-64vzd\" (UID: \"4f8759ae-541e-45f6-972f-87742e533649\") " pod="openshift-monitoring/metrics-server-967997db4-64vzd" Jul 20 16:31:05.778300 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:05.778203 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4f8759ae-541e-45f6-972f-87742e533649-secret-metrics-server-tls\") pod \"metrics-server-967997db4-64vzd\" (UID: \"4f8759ae-541e-45f6-972f-87742e533649\") " pod="openshift-monitoring/metrics-server-967997db4-64vzd" Jul 20 16:31:05.778300 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:05.778240 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f8759ae-541e-45f6-972f-87742e533649-client-ca-bundle\") pod \"metrics-server-967997db4-64vzd\" (UID: \"4f8759ae-541e-45f6-972f-87742e533649\") " pod="openshift-monitoring/metrics-server-967997db4-64vzd" Jul 20 16:31:05.778376 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:05.778292 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f8759ae-541e-45f6-972f-87742e533649-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-967997db4-64vzd\" (UID: \"4f8759ae-541e-45f6-972f-87742e533649\") " pod="openshift-monitoring/metrics-server-967997db4-64vzd" Jul 20 16:31:05.879387 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:05.879348 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4f8759ae-541e-45f6-972f-87742e533649-secret-metrics-server-client-certs\") pod \"metrics-server-967997db4-64vzd\" (UID: \"4f8759ae-541e-45f6-972f-87742e533649\") " pod="openshift-monitoring/metrics-server-967997db4-64vzd" Jul 20 16:31:05.879574 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:05.879405 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4f8759ae-541e-45f6-972f-87742e533649-audit-log\") pod \"metrics-server-967997db4-64vzd\" (UID: \"4f8759ae-541e-45f6-972f-87742e533649\") " pod="openshift-monitoring/metrics-server-967997db4-64vzd" Jul 20 16:31:05.879574 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:05.879433 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcm9q\" (UniqueName: \"kubernetes.io/projected/4f8759ae-541e-45f6-972f-87742e533649-kube-api-access-wcm9q\") pod \"metrics-server-967997db4-64vzd\" (UID: \"4f8759ae-541e-45f6-972f-87742e533649\") " pod="openshift-monitoring/metrics-server-967997db4-64vzd" Jul 20 16:31:05.879574 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:05.879461 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4f8759ae-541e-45f6-972f-87742e533649-metrics-server-audit-profiles\") pod \"metrics-server-967997db4-64vzd\" (UID: \"4f8759ae-541e-45f6-972f-87742e533649\") " pod="openshift-monitoring/metrics-server-967997db4-64vzd" Jul 20 16:31:05.879574 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:05.879492 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4f8759ae-541e-45f6-972f-87742e533649-secret-metrics-server-tls\") pod \"metrics-server-967997db4-64vzd\" (UID: \"4f8759ae-541e-45f6-972f-87742e533649\") " pod="openshift-monitoring/metrics-server-967997db4-64vzd" Jul 20 16:31:05.879574 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:05.879520 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f8759ae-541e-45f6-972f-87742e533649-client-ca-bundle\") pod \"metrics-server-967997db4-64vzd\" (UID: \"4f8759ae-541e-45f6-972f-87742e533649\") " pod="openshift-monitoring/metrics-server-967997db4-64vzd" Jul 20 16:31:05.879574 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:05.879569 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f8759ae-541e-45f6-972f-87742e533649-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-967997db4-64vzd\" (UID: \"4f8759ae-541e-45f6-972f-87742e533649\") " pod="openshift-monitoring/metrics-server-967997db4-64vzd" Jul 20 16:31:05.880235 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:05.879929 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4f8759ae-541e-45f6-972f-87742e533649-audit-log\") pod \"metrics-server-967997db4-64vzd\" (UID: \"4f8759ae-541e-45f6-972f-87742e533649\") " pod="openshift-monitoring/metrics-server-967997db4-64vzd" Jul 20 16:31:05.880235 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:05.880228 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f8759ae-541e-45f6-972f-87742e533649-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-967997db4-64vzd\" (UID: \"4f8759ae-541e-45f6-972f-87742e533649\") " pod="openshift-monitoring/metrics-server-967997db4-64vzd" Jul 20 16:31:05.880828 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:05.880798 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4f8759ae-541e-45f6-972f-87742e533649-metrics-server-audit-profiles\") pod \"metrics-server-967997db4-64vzd\" (UID: \"4f8759ae-541e-45f6-972f-87742e533649\") " pod="openshift-monitoring/metrics-server-967997db4-64vzd" Jul 20 16:31:05.882326 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:05.882302 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4f8759ae-541e-45f6-972f-87742e533649-secret-metrics-server-client-certs\") pod \"metrics-server-967997db4-64vzd\" (UID: \"4f8759ae-541e-45f6-972f-87742e533649\") " pod="openshift-monitoring/metrics-server-967997db4-64vzd" Jul 20 16:31:05.882558 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:05.882535 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f8759ae-541e-45f6-972f-87742e533649-client-ca-bundle\") pod \"metrics-server-967997db4-64vzd\" (UID: \"4f8759ae-541e-45f6-972f-87742e533649\") " pod="openshift-monitoring/metrics-server-967997db4-64vzd" Jul 20 16:31:05.883154 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:05.883133 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4f8759ae-541e-45f6-972f-87742e533649-secret-metrics-server-tls\") pod \"metrics-server-967997db4-64vzd\" (UID: \"4f8759ae-541e-45f6-972f-87742e533649\") " pod="openshift-monitoring/metrics-server-967997db4-64vzd" Jul 20 16:31:05.887929 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:05.887911 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcm9q\" (UniqueName: \"kubernetes.io/projected/4f8759ae-541e-45f6-972f-87742e533649-kube-api-access-wcm9q\") pod \"metrics-server-967997db4-64vzd\" (UID: \"4f8759ae-541e-45f6-972f-87742e533649\") " pod="openshift-monitoring/metrics-server-967997db4-64vzd" Jul 20 16:31:05.977318 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:05.977237 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-967997db4-64vzd" Jul 20 16:31:07.747628 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:07.747596 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76db9f7764-tv42z"] Jul 20 16:31:07.757007 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:07.756978 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76db9f7764-tv42z" Jul 20 16:31:07.760601 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:07.760436 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xvhqd\"" Jul 20 16:31:07.760601 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:07.760441 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 20 16:31:07.760601 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:07.760476 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 20 16:31:07.760850 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:07.760811 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 20 16:31:07.760850 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:07.760821 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 20 16:31:07.760850 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:07.760848 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 20 16:31:07.765697 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:07.765673 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 20 16:31:07.765946 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:07.765924 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76db9f7764-tv42z"] Jul 20 16:31:07.906047 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:07.906008 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49d7932d-ac6e-45bb-a9d0-5177d097b488-trusted-ca-bundle\") pod \"console-76db9f7764-tv42z\" (UID: \"49d7932d-ac6e-45bb-a9d0-5177d097b488\") " pod="openshift-console/console-76db9f7764-tv42z" Jul 20 16:31:07.906247 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:07.906072 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49d7932d-ac6e-45bb-a9d0-5177d097b488-console-config\") pod \"console-76db9f7764-tv42z\" (UID: \"49d7932d-ac6e-45bb-a9d0-5177d097b488\") " pod="openshift-console/console-76db9f7764-tv42z" Jul 20 16:31:07.906247 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:07.906162 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49d7932d-ac6e-45bb-a9d0-5177d097b488-console-oauth-config\") pod \"console-76db9f7764-tv42z\" (UID: \"49d7932d-ac6e-45bb-a9d0-5177d097b488\") " pod="openshift-console/console-76db9f7764-tv42z" Jul 20 16:31:07.906247 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:07.906209 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49d7932d-ac6e-45bb-a9d0-5177d097b488-service-ca\") pod \"console-76db9f7764-tv42z\" (UID: \"49d7932d-ac6e-45bb-a9d0-5177d097b488\") " pod="openshift-console/console-76db9f7764-tv42z" Jul 20 16:31:07.906365 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:07.906254 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj6wl\" (UniqueName: \"kubernetes.io/projected/49d7932d-ac6e-45bb-a9d0-5177d097b488-kube-api-access-hj6wl\") pod \"console-76db9f7764-tv42z\" (UID: \"49d7932d-ac6e-45bb-a9d0-5177d097b488\") " pod="openshift-console/console-76db9f7764-tv42z" Jul 20 16:31:07.906365 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:07.906323 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49d7932d-ac6e-45bb-a9d0-5177d097b488-oauth-serving-cert\") pod \"console-76db9f7764-tv42z\" (UID: \"49d7932d-ac6e-45bb-a9d0-5177d097b488\") " pod="openshift-console/console-76db9f7764-tv42z" Jul 20 16:31:07.906365 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:07.906360 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49d7932d-ac6e-45bb-a9d0-5177d097b488-console-serving-cert\") pod \"console-76db9f7764-tv42z\" (UID: \"49d7932d-ac6e-45bb-a9d0-5177d097b488\") " pod="openshift-console/console-76db9f7764-tv42z" Jul 20 16:31:08.006984 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:08.006892 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49d7932d-ac6e-45bb-a9d0-5177d097b488-trusted-ca-bundle\") pod \"console-76db9f7764-tv42z\" (UID: \"49d7932d-ac6e-45bb-a9d0-5177d097b488\") " pod="openshift-console/console-76db9f7764-tv42z" Jul 20 16:31:08.006984 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:08.006955 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49d7932d-ac6e-45bb-a9d0-5177d097b488-console-config\") pod \"console-76db9f7764-tv42z\" (UID: \"49d7932d-ac6e-45bb-a9d0-5177d097b488\") " pod="openshift-console/console-76db9f7764-tv42z" Jul 20 16:31:08.007292 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:08.006991 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49d7932d-ac6e-45bb-a9d0-5177d097b488-console-oauth-config\") pod \"console-76db9f7764-tv42z\" (UID: \"49d7932d-ac6e-45bb-a9d0-5177d097b488\") " pod="openshift-console/console-76db9f7764-tv42z" Jul 20 16:31:08.007292 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:08.007014 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49d7932d-ac6e-45bb-a9d0-5177d097b488-service-ca\") pod \"console-76db9f7764-tv42z\" (UID: \"49d7932d-ac6e-45bb-a9d0-5177d097b488\") " pod="openshift-console/console-76db9f7764-tv42z" Jul 20 16:31:08.007292 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:08.007053 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj6wl\" (UniqueName: \"kubernetes.io/projected/49d7932d-ac6e-45bb-a9d0-5177d097b488-kube-api-access-hj6wl\") pod \"console-76db9f7764-tv42z\" (UID: \"49d7932d-ac6e-45bb-a9d0-5177d097b488\") " pod="openshift-console/console-76db9f7764-tv42z" Jul 20 16:31:08.007292 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:08.007126 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49d7932d-ac6e-45bb-a9d0-5177d097b488-oauth-serving-cert\") pod \"console-76db9f7764-tv42z\" (UID: \"49d7932d-ac6e-45bb-a9d0-5177d097b488\") " pod="openshift-console/console-76db9f7764-tv42z" Jul 20 16:31:08.007292 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:08.007149 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49d7932d-ac6e-45bb-a9d0-5177d097b488-console-serving-cert\") pod \"console-76db9f7764-tv42z\" (UID: \"49d7932d-ac6e-45bb-a9d0-5177d097b488\") " pod="openshift-console/console-76db9f7764-tv42z" Jul 20 16:31:08.007951 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:08.007899 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49d7932d-ac6e-45bb-a9d0-5177d097b488-trusted-ca-bundle\") pod \"console-76db9f7764-tv42z\" (UID: \"49d7932d-ac6e-45bb-a9d0-5177d097b488\") " pod="openshift-console/console-76db9f7764-tv42z" Jul 20 16:31:08.007951 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:08.007929 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49d7932d-ac6e-45bb-a9d0-5177d097b488-console-config\") pod \"console-76db9f7764-tv42z\" (UID: \"49d7932d-ac6e-45bb-a9d0-5177d097b488\") " pod="openshift-console/console-76db9f7764-tv42z" Jul 20 16:31:08.008131 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:08.008062 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49d7932d-ac6e-45bb-a9d0-5177d097b488-oauth-serving-cert\") pod \"console-76db9f7764-tv42z\" (UID: \"49d7932d-ac6e-45bb-a9d0-5177d097b488\") " pod="openshift-console/console-76db9f7764-tv42z" Jul 20 16:31:08.008203 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:08.008127 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49d7932d-ac6e-45bb-a9d0-5177d097b488-service-ca\") pod \"console-76db9f7764-tv42z\" (UID: \"49d7932d-ac6e-45bb-a9d0-5177d097b488\") " pod="openshift-console/console-76db9f7764-tv42z" Jul 20 16:31:08.009890 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:08.009868 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49d7932d-ac6e-45bb-a9d0-5177d097b488-console-oauth-config\") pod \"console-76db9f7764-tv42z\" (UID: \"49d7932d-ac6e-45bb-a9d0-5177d097b488\") " pod="openshift-console/console-76db9f7764-tv42z" Jul 20 16:31:08.010032 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:08.010014 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49d7932d-ac6e-45bb-a9d0-5177d097b488-console-serving-cert\") pod \"console-76db9f7764-tv42z\" (UID: \"49d7932d-ac6e-45bb-a9d0-5177d097b488\") " pod="openshift-console/console-76db9f7764-tv42z" Jul 20 16:31:08.017732 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:08.017711 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj6wl\" (UniqueName: \"kubernetes.io/projected/49d7932d-ac6e-45bb-a9d0-5177d097b488-kube-api-access-hj6wl\") pod \"console-76db9f7764-tv42z\" (UID: \"49d7932d-ac6e-45bb-a9d0-5177d097b488\") " pod="openshift-console/console-76db9f7764-tv42z" Jul 20 16:31:08.070746 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:08.070707 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76db9f7764-tv42z" Jul 20 16:31:08.865820 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:31:08.865792 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefee9b27_14b5_4e57_bf01_1da41f07676b.slice/crio-7b73e50ee00cb56d133f605957307e5a7d52ee6a0fae25b3c3119ddf8e7f7d2f WatchSource:0}: Error finding container 7b73e50ee00cb56d133f605957307e5a7d52ee6a0fae25b3c3119ddf8e7f7d2f: Status 404 returned error can't find the container with id 7b73e50ee00cb56d133f605957307e5a7d52ee6a0fae25b3c3119ddf8e7f7d2f Jul 20 16:31:09.319147 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:09.319107 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qzbcz" event={"ID":"efee9b27-14b5-4e57-bf01-1da41f07676b","Type":"ContainerStarted","Data":"7b73e50ee00cb56d133f605957307e5a7d52ee6a0fae25b3c3119ddf8e7f7d2f"} Jul 20 16:31:09.661387 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:09.661305 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-55fc7b89f-fs62b"] Jul 20 16:31:10.767860 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:10.767746 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-866c9b644b-k4wdq"] Jul 20 16:31:11.414105 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:31:11.414050 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode857eb6c_ecf2_4c09_8b7e_ed70b6025b3a.slice/crio-256796440fa2058b26d14c673961179881316fc6bb4c7557c70a0073e8a59dd0 WatchSource:0}: Error finding container 256796440fa2058b26d14c673961179881316fc6bb4c7557c70a0073e8a59dd0: Status 404 returned error can't find the container with id 256796440fa2058b26d14c673961179881316fc6bb4c7557c70a0073e8a59dd0 Jul 20 16:31:11.742047 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:11.741754 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 16:31:11.747444 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:31:11.747390 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d80185e_3632_46ee_9287_915f34db810c.slice/crio-01c585cb48af46dba2eb4df1c4d120b43ffdb3d5394e374b361473e93e54b71a WatchSource:0}: Error finding container 01c585cb48af46dba2eb4df1c4d120b43ffdb3d5394e374b361473e93e54b71a: Status 404 returned error can't find the container with id 01c585cb48af46dba2eb4df1c4d120b43ffdb3d5394e374b361473e93e54b71a Jul 20 16:31:11.757886 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:11.757586 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76db9f7764-tv42z"] Jul 20 16:31:11.760351 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:31:11.760316 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49d7932d_ac6e_45bb_a9d0_5177d097b488.slice/crio-c647463c0b69cf11ded90b79d11d9191c8c8fe51109e360c831460596e3336ae WatchSource:0}: Error finding container c647463c0b69cf11ded90b79d11d9191c8c8fe51109e360c831460596e3336ae: Status 404 returned error can't find the container with id c647463c0b69cf11ded90b79d11d9191c8c8fe51109e360c831460596e3336ae Jul 20 16:31:11.783317 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:11.783182 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-967997db4-64vzd"] Jul 20 16:31:11.786326 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:31:11.786297 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f8759ae_541e_45f6_972f_87742e533649.slice/crio-df9c02a5490ba234ca978e108dcbd51de70f7f9a87927d87e41950a487e03a5c WatchSource:0}: Error finding container df9c02a5490ba234ca978e108dcbd51de70f7f9a87927d87e41950a487e03a5c: Status 404 returned error can't find the container with id df9c02a5490ba234ca978e108dcbd51de70f7f9a87927d87e41950a487e03a5c Jul 20 16:31:12.167359 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:12.167323 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-z8hpf" Jul 20 16:31:12.337113 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:12.336977 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3d80185e-3632-46ee-9287-915f34db810c","Type":"ContainerStarted","Data":"01c585cb48af46dba2eb4df1c4d120b43ffdb3d5394e374b361473e93e54b71a"} Jul 20 16:31:12.338813 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:12.338741 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76db9f7764-tv42z" event={"ID":"49d7932d-ac6e-45bb-a9d0-5177d097b488","Type":"ContainerStarted","Data":"c647463c0b69cf11ded90b79d11d9191c8c8fe51109e360c831460596e3336ae"} Jul 20 16:31:12.340352 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:12.340280 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-866c9b644b-k4wdq" event={"ID":"e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a","Type":"ContainerStarted","Data":"256796440fa2058b26d14c673961179881316fc6bb4c7557c70a0073e8a59dd0"} Jul 20 16:31:12.343607 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:12.343540 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hg27p" event={"ID":"47e9b2bf-923f-4e16-b106-a2f7be0575ae","Type":"ContainerStarted","Data":"3cfff67cc7a330f663054033d08604c5a42c327594526cedb7a10cddec10a32c"} Jul 20 16:31:12.350134 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:12.349636 2575 generic.go:356] "Generic (PLEG): container finished" podID="48ee35a2-9bda-4328-9452-ab5ee276fc6e" containerID="bf947aa623c7b322cd7f2fbaaaa732a76ce872b151c50b83c96bbc1d0908ac6c" exitCode=0 Jul 20 16:31:12.350134 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:12.349722 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bzfp8" event={"ID":"48ee35a2-9bda-4328-9452-ab5ee276fc6e","Type":"ContainerDied","Data":"bf947aa623c7b322cd7f2fbaaaa732a76ce872b151c50b83c96bbc1d0908ac6c"} Jul 20 16:31:12.355907 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:12.355859 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-dcggk" event={"ID":"dec857bc-bb8a-4a89-8ece-24125904bfde","Type":"ContainerStarted","Data":"086d6b22aa888e43111499a7597c598c2484bfd0fcc3945bfe9c17abacbe86b1"} Jul 20 16:31:12.356232 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:12.356187 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-dcggk" Jul 20 16:31:12.360638 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:12.360540 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qzbcz" event={"ID":"efee9b27-14b5-4e57-bf01-1da41f07676b","Type":"ContainerStarted","Data":"0d0b4a1881d702fbb121eae37a127aad15fc769663429597afffc993ff5f333b"} Jul 20 16:31:12.360638 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:12.360603 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qzbcz" event={"ID":"efee9b27-14b5-4e57-bf01-1da41f07676b","Type":"ContainerStarted","Data":"ffbff2f757a42ff9018826587eff190038a465c992841a1db41c16654f93bbb4"} Jul 20 16:31:12.362220 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:12.362173 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-967997db4-64vzd" event={"ID":"4f8759ae-541e-45f6-972f-87742e533649","Type":"ContainerStarted","Data":"df9c02a5490ba234ca978e108dcbd51de70f7f9a87927d87e41950a487e03a5c"} Jul 20 16:31:12.371195 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:12.371032 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-dcggk" Jul 20 16:31:12.388633 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:12.388576 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-dcggk" podStartSLOduration=1.5526221260000002 podStartE2EDuration="23.388556921s" totalImagesPullingTime="21.835934795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:30:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:31:12.386818364 +0000 UTC m=+98.037700879" watchObservedRunningTime="2026-07-20 16:31:12.388556921 +0000 UTC m=+98.039439422" Jul 20 16:31:13.372626 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:13.372585 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bzfp8" event={"ID":"48ee35a2-9bda-4328-9452-ab5ee276fc6e","Type":"ContainerStarted","Data":"5cf802fbacb7342a0166bd4800a6c721e1dacb309e8bfc6f0fbc5ccb9e3377bb"} Jul 20 16:31:13.373149 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:13.372650 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bzfp8" event={"ID":"48ee35a2-9bda-4328-9452-ab5ee276fc6e","Type":"ContainerStarted","Data":"f5660a0ed0865be5019d4f1b6f234525d4b9591acca9dec52f030d9eb8a26893"} Jul 20 16:31:13.393134 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:13.393057 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bzfp8" podStartSLOduration=2.45292848 podStartE2EDuration="12.393038357s" totalImagesPullingTime="9.854016706s" totalInitContainerRuntime="86.093171ms" isStatefulPod=true podCreationTimestamp="2026-07-20 16:31:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:31:13.392059316 +0000 UTC m=+99.042941816" watchObservedRunningTime="2026-07-20 16:31:13.393038357 +0000 UTC m=+99.043920855" Jul 20 16:31:14.382170 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:14.381257 2575 generic.go:356] "Generic (PLEG): container finished" podID="3d80185e-3632-46ee-9287-915f34db810c" containerID="a9baff25c7c48f4dcd7e32ff39d1361645b7dd057efef2b7303575aaf11ac782" exitCode=0 Jul 20 16:31:14.382170 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:14.382149 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3d80185e-3632-46ee-9287-915f34db810c","Type":"ContainerDied","Data":"a9baff25c7c48f4dcd7e32ff39d1361645b7dd057efef2b7303575aaf11ac782"} Jul 20 16:31:22.427985 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:22.427954 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hg27p" event={"ID":"47e9b2bf-923f-4e16-b106-a2f7be0575ae","Type":"ContainerStarted","Data":"8a3ac77a78d1acb241b7425b630321647b519fd9fe6f44bc8a2c12a2fd7b9b37"} Jul 20 16:31:22.430343 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:22.430299 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qzbcz" event={"ID":"efee9b27-14b5-4e57-bf01-1da41f07676b","Type":"ContainerStarted","Data":"28ef5da4fdcd054400d9fb4bd43ab355e034cd44b41f8eddb777c3a357b3a857"} Jul 20 16:31:22.432069 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:22.432041 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-967997db4-64vzd" event={"ID":"4f8759ae-541e-45f6-972f-87742e533649","Type":"ContainerStarted","Data":"e03407b02c7d241b7cb538d9167ba2d810fbcbf1b0c3e32c57103ad76785def7"} Jul 20 16:31:22.434581 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:22.434557 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3d80185e-3632-46ee-9287-915f34db810c","Type":"ContainerStarted","Data":"e5e5edc6b4a4f846efe968c3383a2b5e98d8c592a1848b0972d2770f0b83277a"} Jul 20 16:31:22.434689 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:22.434625 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3d80185e-3632-46ee-9287-915f34db810c","Type":"ContainerStarted","Data":"815fb5f7184b4531096d9e88400f0c3b160f3a50b5a0789bfa53ee8e969e7cc3"} Jul 20 16:31:22.436055 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:22.436036 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76db9f7764-tv42z" event={"ID":"49d7932d-ac6e-45bb-a9d0-5177d097b488","Type":"ContainerStarted","Data":"25073fe334f582ed30865fdc99e138f46eda7d5fb36522c1d972256ebc283b2c"} Jul 20 16:31:22.437897 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:22.437879 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-866c9b644b-k4wdq" event={"ID":"e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a","Type":"ContainerStarted","Data":"5fc8f8147093d77c0d979ad01d2d579305ebf6d544f45818a95e2e546409733d"} Jul 20 16:31:22.437985 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:22.437924 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-866c9b644b-k4wdq" event={"ID":"e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a","Type":"ContainerStarted","Data":"d449c1002be034a6518c145eea360d59d973eebf12dfc100b2bc4c6b3002fcf0"} Jul 20 16:31:22.437985 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:22.437951 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-866c9b644b-k4wdq" event={"ID":"e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a","Type":"ContainerStarted","Data":"af76156e4d4b97cb20ce68e530a6e497dca0b2ba54eb43fa4a92046d1f1b4d1f"} Jul 20 16:31:22.446096 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:22.446044 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hg27p" podStartSLOduration=33.283353963 podStartE2EDuration="1m0.44603056s" totalImagesPullingTime="27.162676597s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:30:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:31:22.444584645 +0000 UTC m=+108.095467142" watchObservedRunningTime="2026-07-20 16:31:22.44603056 +0000 UTC m=+108.096913057" Jul 20 16:31:22.462587 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:22.462542 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-967997db4-64vzd" podStartSLOduration=7.49729544 podStartE2EDuration="17.462527921s" totalImagesPullingTime="9.965232481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:31:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:31:22.461806006 +0000 UTC m=+108.112688505" watchObservedRunningTime="2026-07-20 16:31:22.462527921 +0000 UTC m=+108.113410419" Jul 20 16:31:22.480235 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:22.480032 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76db9f7764-tv42z" podStartSLOduration=5.490566619 podStartE2EDuration="15.480018878s" totalImagesPullingTime="9.989452259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:31:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:31:22.478273751 +0000 UTC m=+108.129156241" watchObservedRunningTime="2026-07-20 16:31:22.480018878 +0000 UTC m=+108.130901375" Jul 20 16:31:22.501883 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:22.501840 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-qzbcz" podStartSLOduration=11.517458616999999 podStartE2EDuration="21.501825194s" totalImagesPullingTime="9.984366577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:31:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:31:22.500893357 +0000 UTC m=+108.151775896" watchObservedRunningTime="2026-07-20 16:31:22.501825194 +0000 UTC m=+108.152707691" Jul 20 16:31:23.447659 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:23.447621 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3d80185e-3632-46ee-9287-915f34db810c","Type":"ContainerStarted","Data":"8f401244a9817ee1941348e976c6c74f3047b036c70c423156d4cc46166fd81a"} Jul 20 16:31:23.448269 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:23.447699 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3d80185e-3632-46ee-9287-915f34db810c","Type":"ContainerStarted","Data":"ffe63ba68340fbcad6070a48f3774a72ab523e539db0b057172a26bac13e8a4e"} Jul 20 16:31:23.448269 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:23.447733 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3d80185e-3632-46ee-9287-915f34db810c","Type":"ContainerStarted","Data":"a963aedefaf54700fa4cb2b719058e495f5e675d0f17868fdb6e67377d3b4250"} Jul 20 16:31:24.455585 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:24.455559 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3d80185e-3632-46ee-9287-915f34db810c","Type":"ContainerStarted","Data":"40d33d79018ab540bcc25886b4fa1b643f750836c3e0d5fdf87d75c700881f97"} Jul 20 16:31:24.458490 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:24.458460 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-866c9b644b-k4wdq" event={"ID":"e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a","Type":"ContainerStarted","Data":"ef9b3ef56f67e4db623036b80f38ba8bbedfc46c348a6a2dc6707b26b362411a"} Jul 20 16:31:24.458602 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:24.458538 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-866c9b644b-k4wdq" event={"ID":"e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a","Type":"ContainerStarted","Data":"982820f3ec098a511c8406195002cb4b9915708080edb96d2ecf72975f827d9f"} Jul 20 16:31:24.497097 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:24.496992 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=11.386004772 podStartE2EDuration="22.496971375s" totalImagesPullingTime="11.094370152s" totalInitContainerRuntime="16.596451ms" isStatefulPod=false podCreationTimestamp="2026-07-20 16:31:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:31:24.496241556 +0000 UTC m=+110.147124055" watchObservedRunningTime="2026-07-20 16:31:24.496971375 +0000 UTC m=+110.147853876" Jul 20 16:31:25.465539 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:25.465501 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-866c9b644b-k4wdq" event={"ID":"e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a","Type":"ContainerStarted","Data":"124fb32ea0afd5abd6b4db81de9d585b128f98bfda3d3efa78b31c26393e700e"} Jul 20 16:31:25.465941 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:25.465920 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-866c9b644b-k4wdq" Jul 20 16:31:25.489074 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:25.489014 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-866c9b644b-k4wdq" podStartSLOduration=9.187876643 podStartE2EDuration="21.488995861s" totalImagesPullingTime="12.301119218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:31:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:31:25.48658795 +0000 UTC m=+111.137470449" watchObservedRunningTime="2026-07-20 16:31:25.488995861 +0000 UTC m=+111.139878371" Jul 20 16:31:25.978356 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:25.978320 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-967997db4-64vzd" Jul 20 16:31:25.978529 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:25.978406 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-967997db4-64vzd" Jul 20 16:31:28.071797 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:28.071759 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76db9f7764-tv42z" Jul 20 16:31:28.072345 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:28.071833 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76db9f7764-tv42z" Jul 20 16:31:28.076668 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:28.076645 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76db9f7764-tv42z" Jul 20 16:31:28.481501 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:28.481426 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76db9f7764-tv42z" Jul 20 16:31:31.476609 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:31.476577 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-866c9b644b-k4wdq" Jul 20 16:31:31.491363 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:31.491332 2575 generic.go:356] "Generic (PLEG): container finished" podID="3bc894d1-53f4-415a-820c-30d02901904f" containerID="2b091dc4a45cf23c808e6e41bca2787565a72ce9797a95441500fc5895114e00" exitCode=0 Jul 20 16:31:31.491507 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:31.491405 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cqhg8" event={"ID":"3bc894d1-53f4-415a-820c-30d02901904f","Type":"ContainerDied","Data":"2b091dc4a45cf23c808e6e41bca2787565a72ce9797a95441500fc5895114e00"} Jul 20 16:31:31.491764 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:31.491749 2575 scope.go:117] "RemoveContainer" containerID="2b091dc4a45cf23c808e6e41bca2787565a72ce9797a95441500fc5895114e00" Jul 20 16:31:31.492985 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:31.492965 2575 generic.go:356] "Generic (PLEG): container finished" podID="8759baf3-9e6d-4cd5-817b-c55aa90e7518" containerID="180c8d70af339c640d4386a3a6a05a2efb8c4ca72e677bd0d2b705a9eeff0bd6" exitCode=0 Jul 20 16:31:31.493072 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:31.493009 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9vvcp" event={"ID":"8759baf3-9e6d-4cd5-817b-c55aa90e7518","Type":"ContainerDied","Data":"180c8d70af339c640d4386a3a6a05a2efb8c4ca72e677bd0d2b705a9eeff0bd6"} Jul 20 16:31:31.493286 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:31.493273 2575 scope.go:117] "RemoveContainer" containerID="180c8d70af339c640d4386a3a6a05a2efb8c4ca72e677bd0d2b705a9eeff0bd6" Jul 20 16:31:32.499047 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:32.499012 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cqhg8" event={"ID":"3bc894d1-53f4-415a-820c-30d02901904f","Type":"ContainerStarted","Data":"aa687b02cec2a98d443a4ed50795a46f6c5fa0e1e0d632e5213c23c841f796a8"} Jul 20 16:31:32.500893 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:32.500867 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9vvcp" event={"ID":"8759baf3-9e6d-4cd5-817b-c55aa90e7518","Type":"ContainerStarted","Data":"c05cd72f394ca30993c76563589692da66d7566bfada6f98cdf590c116d0c316"} Jul 20 16:31:34.683490 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:34.683432 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" podUID="c8a0179d-26cb-47cc-97ae-364a22d796fe" containerName="registry" containerID="cri-o://59e994874406f9a95dbf62521bd7f234801ca0693b5ee4b29a2a516b4756c50c" gracePeriod=30 Jul 20 16:31:34.974864 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:34.974831 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" Jul 20 16:31:35.087128 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:35.087072 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8a0179d-26cb-47cc-97ae-364a22d796fe-bound-sa-token\") pod \"c8a0179d-26cb-47cc-97ae-364a22d796fe\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " Jul 20 16:31:35.087128 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:35.087136 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbwdb\" (UniqueName: \"kubernetes.io/projected/c8a0179d-26cb-47cc-97ae-364a22d796fe-kube-api-access-pbwdb\") pod \"c8a0179d-26cb-47cc-97ae-364a22d796fe\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " Jul 20 16:31:35.087372 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:35.087163 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8a0179d-26cb-47cc-97ae-364a22d796fe-registry-tls\") pod \"c8a0179d-26cb-47cc-97ae-364a22d796fe\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " Jul 20 16:31:35.087372 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:35.087185 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c8a0179d-26cb-47cc-97ae-364a22d796fe-installation-pull-secrets\") pod \"c8a0179d-26cb-47cc-97ae-364a22d796fe\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " Jul 20 16:31:35.087372 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:35.087211 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c8a0179d-26cb-47cc-97ae-364a22d796fe-registry-certificates\") pod \"c8a0179d-26cb-47cc-97ae-364a22d796fe\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " Jul 20 16:31:35.087372 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:35.087258 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c8a0179d-26cb-47cc-97ae-364a22d796fe-image-registry-private-configuration\") pod \"c8a0179d-26cb-47cc-97ae-364a22d796fe\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " Jul 20 16:31:35.087372 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:35.087291 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c8a0179d-26cb-47cc-97ae-364a22d796fe-ca-trust-extracted\") pod \"c8a0179d-26cb-47cc-97ae-364a22d796fe\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " Jul 20 16:31:35.087372 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:35.087348 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c8a0179d-26cb-47cc-97ae-364a22d796fe-trusted-ca\") pod \"c8a0179d-26cb-47cc-97ae-364a22d796fe\" (UID: \"c8a0179d-26cb-47cc-97ae-364a22d796fe\") " Jul 20 16:31:35.087836 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:35.087803 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8a0179d-26cb-47cc-97ae-364a22d796fe-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c8a0179d-26cb-47cc-97ae-364a22d796fe" (UID: "c8a0179d-26cb-47cc-97ae-364a22d796fe"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:31:35.088077 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:35.088045 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8a0179d-26cb-47cc-97ae-364a22d796fe-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c8a0179d-26cb-47cc-97ae-364a22d796fe" (UID: "c8a0179d-26cb-47cc-97ae-364a22d796fe"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:31:35.089739 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:35.089712 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8a0179d-26cb-47cc-97ae-364a22d796fe-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c8a0179d-26cb-47cc-97ae-364a22d796fe" (UID: "c8a0179d-26cb-47cc-97ae-364a22d796fe"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:31:35.089855 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:35.089834 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8a0179d-26cb-47cc-97ae-364a22d796fe-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c8a0179d-26cb-47cc-97ae-364a22d796fe" (UID: "c8a0179d-26cb-47cc-97ae-364a22d796fe"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:31:35.090048 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:35.090027 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8a0179d-26cb-47cc-97ae-364a22d796fe-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c8a0179d-26cb-47cc-97ae-364a22d796fe" (UID: "c8a0179d-26cb-47cc-97ae-364a22d796fe"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:31:35.090139 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:35.090113 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8a0179d-26cb-47cc-97ae-364a22d796fe-kube-api-access-pbwdb" (OuterVolumeSpecName: "kube-api-access-pbwdb") pod "c8a0179d-26cb-47cc-97ae-364a22d796fe" (UID: "c8a0179d-26cb-47cc-97ae-364a22d796fe"). InnerVolumeSpecName "kube-api-access-pbwdb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:31:35.090188 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:35.090133 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8a0179d-26cb-47cc-97ae-364a22d796fe-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c8a0179d-26cb-47cc-97ae-364a22d796fe" (UID: "c8a0179d-26cb-47cc-97ae-364a22d796fe"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:31:35.095836 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:35.095810 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8a0179d-26cb-47cc-97ae-364a22d796fe-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c8a0179d-26cb-47cc-97ae-364a22d796fe" (UID: "c8a0179d-26cb-47cc-97ae-364a22d796fe"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:31:35.188055 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:35.187966 2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8a0179d-26cb-47cc-97ae-364a22d796fe-bound-sa-token\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:31:35.188055 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:35.187997 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbwdb\" (UniqueName: \"kubernetes.io/projected/c8a0179d-26cb-47cc-97ae-364a22d796fe-kube-api-access-pbwdb\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:31:35.188055 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:35.188012 2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8a0179d-26cb-47cc-97ae-364a22d796fe-registry-tls\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:31:35.188055 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:35.188024 2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c8a0179d-26cb-47cc-97ae-364a22d796fe-installation-pull-secrets\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:31:35.188055 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:35.188035 2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c8a0179d-26cb-47cc-97ae-364a22d796fe-registry-certificates\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:31:35.188055 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:35.188049 2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c8a0179d-26cb-47cc-97ae-364a22d796fe-image-registry-private-configuration\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:31:35.188411 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:35.188063 2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c8a0179d-26cb-47cc-97ae-364a22d796fe-ca-trust-extracted\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:31:35.188411 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:35.188074 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c8a0179d-26cb-47cc-97ae-364a22d796fe-trusted-ca\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:31:35.514307 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:35.514217 2575 generic.go:356] "Generic (PLEG): container finished" podID="c8a0179d-26cb-47cc-97ae-364a22d796fe" containerID="59e994874406f9a95dbf62521bd7f234801ca0693b5ee4b29a2a516b4756c50c" exitCode=0 Jul 20 16:31:35.514307 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:35.514254 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" event={"ID":"c8a0179d-26cb-47cc-97ae-364a22d796fe","Type":"ContainerDied","Data":"59e994874406f9a95dbf62521bd7f234801ca0693b5ee4b29a2a516b4756c50c"} Jul 20 16:31:35.514489 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:35.514308 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" event={"ID":"c8a0179d-26cb-47cc-97ae-364a22d796fe","Type":"ContainerDied","Data":"2f7bbc2717e74ec865a619f55961545e6ce73d0a0e99c772f0db9d6916016250"} Jul 20 16:31:35.514489 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:35.514332 2575 scope.go:117] "RemoveContainer" containerID="59e994874406f9a95dbf62521bd7f234801ca0693b5ee4b29a2a516b4756c50c" Jul 20 16:31:35.514489 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:35.514260 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55fc7b89f-fs62b" Jul 20 16:31:35.523869 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:35.523852 2575 scope.go:117] "RemoveContainer" containerID="59e994874406f9a95dbf62521bd7f234801ca0693b5ee4b29a2a516b4756c50c" Jul 20 16:31:35.524153 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:31:35.524134 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59e994874406f9a95dbf62521bd7f234801ca0693b5ee4b29a2a516b4756c50c\": container with ID starting with 59e994874406f9a95dbf62521bd7f234801ca0693b5ee4b29a2a516b4756c50c not found: ID does not exist" containerID="59e994874406f9a95dbf62521bd7f234801ca0693b5ee4b29a2a516b4756c50c" Jul 20 16:31:35.524208 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:35.524163 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59e994874406f9a95dbf62521bd7f234801ca0693b5ee4b29a2a516b4756c50c"} err="failed to get container status \"59e994874406f9a95dbf62521bd7f234801ca0693b5ee4b29a2a516b4756c50c\": rpc error: code = NotFound desc = could not find container \"59e994874406f9a95dbf62521bd7f234801ca0693b5ee4b29a2a516b4756c50c\": container with ID starting with 59e994874406f9a95dbf62521bd7f234801ca0693b5ee4b29a2a516b4756c50c not found: ID does not exist" Jul 20 16:31:35.537549 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:35.537528 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-55fc7b89f-fs62b"] Jul 20 16:31:35.542684 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:35.542664 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-55fc7b89f-fs62b"] Jul 20 16:31:36.852223 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:36.852194 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8a0179d-26cb-47cc-97ae-364a22d796fe" path="/var/lib/kubelet/pods/c8a0179d-26cb-47cc-97ae-364a22d796fe/volumes" Jul 20 16:31:45.983186 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:45.983155 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-967997db4-64vzd" Jul 20 16:31:45.987006 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:45.986982 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-967997db4-64vzd" Jul 20 16:31:46.566049 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:46.565965 2575 generic.go:356] "Generic (PLEG): container finished" podID="36b61e21-6ab6-46aa-853b-299dcee26854" containerID="53d6063575cc6f42509499cf2fa1caea1150d717af4fe93a387871409155be14" exitCode=0 Jul 20 16:31:46.566049 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:46.566040 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-fzrfs" event={"ID":"36b61e21-6ab6-46aa-853b-299dcee26854","Type":"ContainerDied","Data":"53d6063575cc6f42509499cf2fa1caea1150d717af4fe93a387871409155be14"} Jul 20 16:31:46.566506 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:46.566489 2575 scope.go:117] "RemoveContainer" containerID="53d6063575cc6f42509499cf2fa1caea1150d717af4fe93a387871409155be14" Jul 20 16:31:47.573906 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:31:47.573860 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-fzrfs" event={"ID":"36b61e21-6ab6-46aa-853b-299dcee26854","Type":"ContainerStarted","Data":"1731a2d08757f79ff05f9657ca319982bd9c8a9d5bbb37a2184d8c6d8c6936b4"} Jul 20 16:32:21.602997 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:21.602953 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 16:32:21.603516 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:21.603254 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3d80185e-3632-46ee-9287-915f34db810c" containerName="alertmanager" containerID="cri-o://815fb5f7184b4531096d9e88400f0c3b160f3a50b5a0789bfa53ee8e969e7cc3" gracePeriod=120 Jul 20 16:32:21.603516 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:21.603335 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3d80185e-3632-46ee-9287-915f34db810c" containerName="kube-rbac-proxy-web" containerID="cri-o://a963aedefaf54700fa4cb2b719058e495f5e675d0f17868fdb6e67377d3b4250" gracePeriod=120 Jul 20 16:32:21.603516 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:21.603335 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3d80185e-3632-46ee-9287-915f34db810c" containerName="kube-rbac-proxy-metric" containerID="cri-o://8f401244a9817ee1941348e976c6c74f3047b036c70c423156d4cc46166fd81a" gracePeriod=120 Jul 20 16:32:21.603516 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:21.603412 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3d80185e-3632-46ee-9287-915f34db810c" containerName="kube-rbac-proxy" containerID="cri-o://ffe63ba68340fbcad6070a48f3774a72ab523e539db0b057172a26bac13e8a4e" gracePeriod=120 Jul 20 16:32:21.603516 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:21.603339 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3d80185e-3632-46ee-9287-915f34db810c" containerName="config-reloader" containerID="cri-o://e5e5edc6b4a4f846efe968c3383a2b5e98d8c592a1848b0972d2770f0b83277a" gracePeriod=120 Jul 20 16:32:21.603516 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:21.603431 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3d80185e-3632-46ee-9287-915f34db810c" containerName="prom-label-proxy" containerID="cri-o://40d33d79018ab540bcc25886b4fa1b643f750836c3e0d5fdf87d75c700881f97" gracePeriod=120 Jul 20 16:32:22.723662 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.723630 2575 generic.go:356] "Generic (PLEG): container finished" podID="3d80185e-3632-46ee-9287-915f34db810c" containerID="40d33d79018ab540bcc25886b4fa1b643f750836c3e0d5fdf87d75c700881f97" exitCode=0 Jul 20 16:32:22.723662 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.723659 2575 generic.go:356] "Generic (PLEG): container finished" podID="3d80185e-3632-46ee-9287-915f34db810c" containerID="8f401244a9817ee1941348e976c6c74f3047b036c70c423156d4cc46166fd81a" exitCode=0 Jul 20 16:32:22.723662 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.723668 2575 generic.go:356] "Generic (PLEG): container finished" podID="3d80185e-3632-46ee-9287-915f34db810c" containerID="ffe63ba68340fbcad6070a48f3774a72ab523e539db0b057172a26bac13e8a4e" exitCode=0 Jul 20 16:32:22.723662 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.723679 2575 generic.go:356] "Generic (PLEG): container finished" podID="3d80185e-3632-46ee-9287-915f34db810c" containerID="a963aedefaf54700fa4cb2b719058e495f5e675d0f17868fdb6e67377d3b4250" exitCode=0 Jul 20 16:32:22.724148 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.723687 2575 generic.go:356] "Generic (PLEG): container finished" podID="3d80185e-3632-46ee-9287-915f34db810c" containerID="e5e5edc6b4a4f846efe968c3383a2b5e98d8c592a1848b0972d2770f0b83277a" exitCode=0 Jul 20 16:32:22.724148 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.723696 2575 generic.go:356] "Generic (PLEG): container finished" podID="3d80185e-3632-46ee-9287-915f34db810c" containerID="815fb5f7184b4531096d9e88400f0c3b160f3a50b5a0789bfa53ee8e969e7cc3" exitCode=0 Jul 20 16:32:22.724148 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.723708 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3d80185e-3632-46ee-9287-915f34db810c","Type":"ContainerDied","Data":"40d33d79018ab540bcc25886b4fa1b643f750836c3e0d5fdf87d75c700881f97"} Jul 20 16:32:22.724148 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.723787 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3d80185e-3632-46ee-9287-915f34db810c","Type":"ContainerDied","Data":"8f401244a9817ee1941348e976c6c74f3047b036c70c423156d4cc46166fd81a"} Jul 20 16:32:22.724148 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.723825 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3d80185e-3632-46ee-9287-915f34db810c","Type":"ContainerDied","Data":"ffe63ba68340fbcad6070a48f3774a72ab523e539db0b057172a26bac13e8a4e"} Jul 20 16:32:22.724148 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.723850 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3d80185e-3632-46ee-9287-915f34db810c","Type":"ContainerDied","Data":"a963aedefaf54700fa4cb2b719058e495f5e675d0f17868fdb6e67377d3b4250"} Jul 20 16:32:22.724148 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.723873 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3d80185e-3632-46ee-9287-915f34db810c","Type":"ContainerDied","Data":"e5e5edc6b4a4f846efe968c3383a2b5e98d8c592a1848b0972d2770f0b83277a"} Jul 20 16:32:22.724148 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.723897 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3d80185e-3632-46ee-9287-915f34db810c","Type":"ContainerDied","Data":"815fb5f7184b4531096d9e88400f0c3b160f3a50b5a0789bfa53ee8e969e7cc3"} Jul 20 16:32:22.836235 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.836212 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:22.899352 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.899262 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-config-volume\") pod \"3d80185e-3632-46ee-9287-915f34db810c\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " Jul 20 16:32:22.899352 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.899304 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-secret-alertmanager-main-tls\") pod \"3d80185e-3632-46ee-9287-915f34db810c\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " Jul 20 16:32:22.899352 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.899350 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhsjv\" (UniqueName: \"kubernetes.io/projected/3d80185e-3632-46ee-9287-915f34db810c-kube-api-access-lhsjv\") pod \"3d80185e-3632-46ee-9287-915f34db810c\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " Jul 20 16:32:22.899625 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.899377 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d80185e-3632-46ee-9287-915f34db810c-alertmanager-trusted-ca-bundle\") pod \"3d80185e-3632-46ee-9287-915f34db810c\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " Jul 20 16:32:22.899625 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.899396 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-cluster-tls-config\") pod \"3d80185e-3632-46ee-9287-915f34db810c\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " Jul 20 16:32:22.899625 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.899449 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-web-config\") pod \"3d80185e-3632-46ee-9287-915f34db810c\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " Jul 20 16:32:22.899625 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.899473 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3d80185e-3632-46ee-9287-915f34db810c-alertmanager-main-db\") pod \"3d80185e-3632-46ee-9287-915f34db810c\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " Jul 20 16:32:22.899625 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.899499 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"3d80185e-3632-46ee-9287-915f34db810c\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " Jul 20 16:32:22.899625 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.899524 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-secret-alertmanager-kube-rbac-proxy-web\") pod \"3d80185e-3632-46ee-9287-915f34db810c\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " Jul 20 16:32:22.899625 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.899563 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d80185e-3632-46ee-9287-915f34db810c-metrics-client-ca\") pod \"3d80185e-3632-46ee-9287-915f34db810c\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " Jul 20 16:32:22.899625 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.899589 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-secret-alertmanager-kube-rbac-proxy\") pod \"3d80185e-3632-46ee-9287-915f34db810c\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " Jul 20 16:32:22.900013 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.899657 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3d80185e-3632-46ee-9287-915f34db810c-tls-assets\") pod \"3d80185e-3632-46ee-9287-915f34db810c\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " Jul 20 16:32:22.900013 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.899708 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3d80185e-3632-46ee-9287-915f34db810c-config-out\") pod \"3d80185e-3632-46ee-9287-915f34db810c\" (UID: \"3d80185e-3632-46ee-9287-915f34db810c\") " Jul 20 16:32:22.900474 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.900168 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d80185e-3632-46ee-9287-915f34db810c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "3d80185e-3632-46ee-9287-915f34db810c" (UID: "3d80185e-3632-46ee-9287-915f34db810c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:32:22.900474 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.900419 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d80185e-3632-46ee-9287-915f34db810c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "3d80185e-3632-46ee-9287-915f34db810c" (UID: "3d80185e-3632-46ee-9287-915f34db810c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:32:22.901300 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.901263 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d80185e-3632-46ee-9287-915f34db810c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "3d80185e-3632-46ee-9287-915f34db810c" (UID: "3d80185e-3632-46ee-9287-915f34db810c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:32:22.902220 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.902168 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "3d80185e-3632-46ee-9287-915f34db810c" (UID: "3d80185e-3632-46ee-9287-915f34db810c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:32:22.902220 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.902175 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d80185e-3632-46ee-9287-915f34db810c-kube-api-access-lhsjv" (OuterVolumeSpecName: "kube-api-access-lhsjv") pod "3d80185e-3632-46ee-9287-915f34db810c" (UID: "3d80185e-3632-46ee-9287-915f34db810c"). InnerVolumeSpecName "kube-api-access-lhsjv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:32:22.902429 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.902405 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-config-volume" (OuterVolumeSpecName: "config-volume") pod "3d80185e-3632-46ee-9287-915f34db810c" (UID: "3d80185e-3632-46ee-9287-915f34db810c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:32:22.902535 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.902511 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d80185e-3632-46ee-9287-915f34db810c-config-out" (OuterVolumeSpecName: "config-out") pod "3d80185e-3632-46ee-9287-915f34db810c" (UID: "3d80185e-3632-46ee-9287-915f34db810c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:32:22.902822 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.902798 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "3d80185e-3632-46ee-9287-915f34db810c" (UID: "3d80185e-3632-46ee-9287-915f34db810c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:32:22.903535 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.903508 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "3d80185e-3632-46ee-9287-915f34db810c" (UID: "3d80185e-3632-46ee-9287-915f34db810c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:32:22.904191 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.904156 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d80185e-3632-46ee-9287-915f34db810c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3d80185e-3632-46ee-9287-915f34db810c" (UID: "3d80185e-3632-46ee-9287-915f34db810c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:32:22.904754 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.904726 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "3d80185e-3632-46ee-9287-915f34db810c" (UID: "3d80185e-3632-46ee-9287-915f34db810c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:32:22.908508 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.908483 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "3d80185e-3632-46ee-9287-915f34db810c" (UID: "3d80185e-3632-46ee-9287-915f34db810c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:32:22.916333 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:22.916287 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-web-config" (OuterVolumeSpecName: "web-config") pod "3d80185e-3632-46ee-9287-915f34db810c" (UID: "3d80185e-3632-46ee-9287-915f34db810c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:32:23.000807 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.000775 2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3d80185e-3632-46ee-9287-915f34db810c-tls-assets\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:32:23.000807 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.000803 2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3d80185e-3632-46ee-9287-915f34db810c-config-out\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:32:23.000807 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.000813 2575 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-config-volume\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:32:23.001034 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.000824 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-secret-alertmanager-main-tls\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:32:23.001034 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.000834 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhsjv\" (UniqueName: \"kubernetes.io/projected/3d80185e-3632-46ee-9287-915f34db810c-kube-api-access-lhsjv\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:32:23.001034 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.000844 2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d80185e-3632-46ee-9287-915f34db810c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:32:23.001034 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.000853 2575 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-cluster-tls-config\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:32:23.001034 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.000861 2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-web-config\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:32:23.001034 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.000869 2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3d80185e-3632-46ee-9287-915f34db810c-alertmanager-main-db\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:32:23.001034 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.000878 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:32:23.001034 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.000887 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:32:23.001034 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.000896 2575 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d80185e-3632-46ee-9287-915f34db810c-metrics-client-ca\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:32:23.001034 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.000904 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3d80185e-3632-46ee-9287-915f34db810c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:32:23.731161 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.731125 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3d80185e-3632-46ee-9287-915f34db810c","Type":"ContainerDied","Data":"01c585cb48af46dba2eb4df1c4d120b43ffdb3d5394e374b361473e93e54b71a"} Jul 20 16:32:23.731537 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.731183 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:23.731537 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.731212 2575 scope.go:117] "RemoveContainer" containerID="40d33d79018ab540bcc25886b4fa1b643f750836c3e0d5fdf87d75c700881f97" Jul 20 16:32:23.739564 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.739541 2575 scope.go:117] "RemoveContainer" containerID="8f401244a9817ee1941348e976c6c74f3047b036c70c423156d4cc46166fd81a" Jul 20 16:32:23.746647 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.746628 2575 scope.go:117] "RemoveContainer" containerID="ffe63ba68340fbcad6070a48f3774a72ab523e539db0b057172a26bac13e8a4e" Jul 20 16:32:23.754786 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.754683 2575 scope.go:117] "RemoveContainer" containerID="a963aedefaf54700fa4cb2b719058e495f5e675d0f17868fdb6e67377d3b4250" Jul 20 16:32:23.755355 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.755328 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 16:32:23.762050 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.762027 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 16:32:23.762991 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.762962 2575 scope.go:117] "RemoveContainer" containerID="e5e5edc6b4a4f846efe968c3383a2b5e98d8c592a1848b0972d2770f0b83277a" Jul 20 16:32:23.769805 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.769785 2575 scope.go:117] "RemoveContainer" containerID="815fb5f7184b4531096d9e88400f0c3b160f3a50b5a0789bfa53ee8e969e7cc3" Jul 20 16:32:23.778914 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.778896 2575 scope.go:117] "RemoveContainer" containerID="a9baff25c7c48f4dcd7e32ff39d1361645b7dd057efef2b7303575aaf11ac782" Jul 20 16:32:23.784493 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.784469 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 16:32:23.784815 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.784799 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8a0179d-26cb-47cc-97ae-364a22d796fe" containerName="registry" Jul 20 16:32:23.784885 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.784818 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8a0179d-26cb-47cc-97ae-364a22d796fe" containerName="registry" Jul 20 16:32:23.784885 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.784837 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d80185e-3632-46ee-9287-915f34db810c" containerName="kube-rbac-proxy" Jul 20 16:32:23.784885 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.784846 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d80185e-3632-46ee-9287-915f34db810c" containerName="kube-rbac-proxy" Jul 20 16:32:23.784885 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.784860 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d80185e-3632-46ee-9287-915f34db810c" containerName="config-reloader" Jul 20 16:32:23.784885 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.784869 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d80185e-3632-46ee-9287-915f34db810c" containerName="config-reloader" Jul 20 16:32:23.784885 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.784881 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d80185e-3632-46ee-9287-915f34db810c" containerName="prom-label-proxy" Jul 20 16:32:23.785187 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.784890 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d80185e-3632-46ee-9287-915f34db810c" containerName="prom-label-proxy" Jul 20 16:32:23.785187 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.784902 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d80185e-3632-46ee-9287-915f34db810c" containerName="kube-rbac-proxy-web" Jul 20 16:32:23.785187 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.784911 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d80185e-3632-46ee-9287-915f34db810c" containerName="kube-rbac-proxy-web" Jul 20 16:32:23.785187 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.784923 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d80185e-3632-46ee-9287-915f34db810c" containerName="alertmanager" Jul 20 16:32:23.785187 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.784931 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d80185e-3632-46ee-9287-915f34db810c" containerName="alertmanager" Jul 20 16:32:23.785187 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.784943 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d80185e-3632-46ee-9287-915f34db810c" containerName="init-config-reloader" Jul 20 16:32:23.785187 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.784951 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d80185e-3632-46ee-9287-915f34db810c" containerName="init-config-reloader" Jul 20 16:32:23.785187 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.784965 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d80185e-3632-46ee-9287-915f34db810c" containerName="kube-rbac-proxy-metric" Jul 20 16:32:23.785187 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.784974 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d80185e-3632-46ee-9287-915f34db810c" containerName="kube-rbac-proxy-metric" Jul 20 16:32:23.785187 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.785057 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d80185e-3632-46ee-9287-915f34db810c" containerName="alertmanager" Jul 20 16:32:23.785187 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.785069 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d80185e-3632-46ee-9287-915f34db810c" containerName="kube-rbac-proxy-web" Jul 20 16:32:23.785187 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.785079 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d80185e-3632-46ee-9287-915f34db810c" containerName="config-reloader" Jul 20 16:32:23.785187 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.785107 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d80185e-3632-46ee-9287-915f34db810c" containerName="prom-label-proxy" Jul 20 16:32:23.785187 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.785119 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d80185e-3632-46ee-9287-915f34db810c" containerName="kube-rbac-proxy" Jul 20 16:32:23.785187 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.785128 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8a0179d-26cb-47cc-97ae-364a22d796fe" containerName="registry" Jul 20 16:32:23.785187 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.785137 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d80185e-3632-46ee-9287-915f34db810c" containerName="kube-rbac-proxy-metric" Jul 20 16:32:23.788841 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.788823 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:23.791414 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.791392 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 20 16:32:23.791553 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.791539 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 20 16:32:23.791604 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.791584 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 20 16:32:23.792011 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.791847 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 20 16:32:23.792011 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.791873 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 20 16:32:23.792011 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.791903 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4vqvf\"" Jul 20 16:32:23.792011 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.791876 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 20 16:32:23.792011 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.791876 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 20 16:32:23.792011 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.792015 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 20 16:32:23.796705 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.796690 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 20 16:32:23.801917 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.801898 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 16:32:23.908725 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.908632 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/79de569a-6f31-4490-a540-3f5cb67f2a16-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:23.908902 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.908879 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/79de569a-6f31-4490-a540-3f5cb67f2a16-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:23.908971 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.908921 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/79de569a-6f31-4490-a540-3f5cb67f2a16-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:23.908971 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.908956 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79de569a-6f31-4490-a540-3f5cb67f2a16-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:23.909079 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.908988 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/79de569a-6f31-4490-a540-3f5cb67f2a16-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:23.909079 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.909019 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/79de569a-6f31-4490-a540-3f5cb67f2a16-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:23.909079 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.909037 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/79de569a-6f31-4490-a540-3f5cb67f2a16-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:23.909235 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.909115 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/79de569a-6f31-4490-a540-3f5cb67f2a16-web-config\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:23.909235 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.909139 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/79de569a-6f31-4490-a540-3f5cb67f2a16-config-volume\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:23.909235 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.909158 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/79de569a-6f31-4490-a540-3f5cb67f2a16-tls-assets\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:23.909235 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.909175 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79de569a-6f31-4490-a540-3f5cb67f2a16-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:23.909424 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.909247 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw6xv\" (UniqueName: \"kubernetes.io/projected/79de569a-6f31-4490-a540-3f5cb67f2a16-kube-api-access-fw6xv\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:23.909424 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:23.909399 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/79de569a-6f31-4490-a540-3f5cb67f2a16-config-out\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:24.010780 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:24.010741 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79de569a-6f31-4490-a540-3f5cb67f2a16-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:24.010780 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:24.010783 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw6xv\" (UniqueName: \"kubernetes.io/projected/79de569a-6f31-4490-a540-3f5cb67f2a16-kube-api-access-fw6xv\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:24.010964 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:24.010811 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/79de569a-6f31-4490-a540-3f5cb67f2a16-config-out\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:24.010964 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:24.010921 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/79de569a-6f31-4490-a540-3f5cb67f2a16-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:24.011050 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:24.010978 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/79de569a-6f31-4490-a540-3f5cb67f2a16-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:24.011050 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:24.011006 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/79de569a-6f31-4490-a540-3f5cb67f2a16-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:24.011050 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:24.011038 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79de569a-6f31-4490-a540-3f5cb67f2a16-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:24.011317 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:24.011065 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/79de569a-6f31-4490-a540-3f5cb67f2a16-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:24.011317 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:24.011110 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/79de569a-6f31-4490-a540-3f5cb67f2a16-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:24.011317 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:24.011135 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/79de569a-6f31-4490-a540-3f5cb67f2a16-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:24.011317 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:24.011173 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/79de569a-6f31-4490-a540-3f5cb67f2a16-web-config\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:24.011317 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:24.011220 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/79de569a-6f31-4490-a540-3f5cb67f2a16-config-volume\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:24.011317 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:24.011252 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/79de569a-6f31-4490-a540-3f5cb67f2a16-tls-assets\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:24.011706 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:24.011655 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79de569a-6f31-4490-a540-3f5cb67f2a16-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:24.011960 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:24.011936 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/79de569a-6f31-4490-a540-3f5cb67f2a16-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:24.012391 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:24.012064 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79de569a-6f31-4490-a540-3f5cb67f2a16-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:24.014162 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:24.013827 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/79de569a-6f31-4490-a540-3f5cb67f2a16-config-out\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:24.014162 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:24.014055 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/79de569a-6f31-4490-a540-3f5cb67f2a16-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:24.014329 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:24.014165 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/79de569a-6f31-4490-a540-3f5cb67f2a16-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:24.014329 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:24.014298 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/79de569a-6f31-4490-a540-3f5cb67f2a16-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:24.014436 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:24.014327 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/79de569a-6f31-4490-a540-3f5cb67f2a16-tls-assets\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:24.014566 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:24.014535 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/79de569a-6f31-4490-a540-3f5cb67f2a16-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:24.014716 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:24.014700 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/79de569a-6f31-4490-a540-3f5cb67f2a16-web-config\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:24.015079 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:24.015058 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/79de569a-6f31-4490-a540-3f5cb67f2a16-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:24.016119 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:24.016078 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/79de569a-6f31-4490-a540-3f5cb67f2a16-config-volume\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:24.019432 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:24.019410 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw6xv\" (UniqueName: \"kubernetes.io/projected/79de569a-6f31-4490-a540-3f5cb67f2a16-kube-api-access-fw6xv\") pod \"alertmanager-main-0\" (UID: \"79de569a-6f31-4490-a540-3f5cb67f2a16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:24.099337 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:24.099282 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:32:24.235870 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:24.235841 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 16:32:24.237219 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:32:24.237176 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79de569a_6f31_4490_a540_3f5cb67f2a16.slice/crio-5bd5c1bc08297d248f4c81fbd82bf232c32784ee3c46528cf8e9ce8a9d7c912e WatchSource:0}: Error finding container 5bd5c1bc08297d248f4c81fbd82bf232c32784ee3c46528cf8e9ce8a9d7c912e: Status 404 returned error can't find the container with id 5bd5c1bc08297d248f4c81fbd82bf232c32784ee3c46528cf8e9ce8a9d7c912e Jul 20 16:32:24.737362 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:24.737325 2575 generic.go:356] "Generic (PLEG): container finished" podID="79de569a-6f31-4490-a540-3f5cb67f2a16" containerID="ab9e0d3ae4183e735135a4295faa773e5db19e9a62038251f9c637bd9dfe3ef8" exitCode=0 Jul 20 16:32:24.737800 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:24.737402 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"79de569a-6f31-4490-a540-3f5cb67f2a16","Type":"ContainerDied","Data":"ab9e0d3ae4183e735135a4295faa773e5db19e9a62038251f9c637bd9dfe3ef8"} Jul 20 16:32:24.737800 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:24.737478 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"79de569a-6f31-4490-a540-3f5cb67f2a16","Type":"ContainerStarted","Data":"5bd5c1bc08297d248f4c81fbd82bf232c32784ee3c46528cf8e9ce8a9d7c912e"} Jul 20 16:32:24.853014 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:24.852988 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d80185e-3632-46ee-9287-915f34db810c" path="/var/lib/kubelet/pods/3d80185e-3632-46ee-9287-915f34db810c/volumes" Jul 20 16:32:25.670543 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.670501 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-86dfc96c8c-ndslv"] Jul 20 16:32:25.672975 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.672953 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-86dfc96c8c-ndslv" Jul 20 16:32:25.675668 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.675641 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-n7k8p\"" Jul 20 16:32:25.675777 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.675677 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 20 16:32:25.675777 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.675656 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 20 16:32:25.675777 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.675715 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 20 16:32:25.675777 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.675683 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 20 16:32:25.675777 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.675654 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 20 16:32:25.681191 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.681171 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 20 16:32:25.686471 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.686433 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-86dfc96c8c-ndslv"] Jul 20 16:32:25.745775 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.745737 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"79de569a-6f31-4490-a540-3f5cb67f2a16","Type":"ContainerStarted","Data":"4b006d187ca09a60bcc089445063ee3b16db7d218a007dd088c52fb0b77c0dc0"} Jul 20 16:32:25.746189 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.745818 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"79de569a-6f31-4490-a540-3f5cb67f2a16","Type":"ContainerStarted","Data":"77c96674ba9f81cf70c6a6b1e3f76329b9f66c352d8f48acd90732e98d9bcac5"} Jul 20 16:32:25.746189 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.745859 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"79de569a-6f31-4490-a540-3f5cb67f2a16","Type":"ContainerStarted","Data":"dd58f9b23196538fc8abe25484b2e37b59d9820da125ca17c404182ebeef3923"} Jul 20 16:32:25.746189 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.745896 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"79de569a-6f31-4490-a540-3f5cb67f2a16","Type":"ContainerStarted","Data":"106acdeacaea0ae8486b6a7e1902ea41eafab0b138b2ffe380eb103b8257c89a"} Jul 20 16:32:25.746189 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.745932 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"79de569a-6f31-4490-a540-3f5cb67f2a16","Type":"ContainerStarted","Data":"d4c0f94fe586c32bde034de069fea2d3da44c26b79bc717e8c1eccccb720661f"} Jul 20 16:32:25.746189 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.745966 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"79de569a-6f31-4490-a540-3f5cb67f2a16","Type":"ContainerStarted","Data":"fef229900df80e0235010a6ea981bccfdf038d78737689b3c4035330ea90c85f"} Jul 20 16:32:25.774543 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.774497 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.758518139 podStartE2EDuration="2.774481034s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.962895ms" isStatefulPod=false podCreationTimestamp="2026-07-20 16:32:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:32:25.772833569 +0000 UTC m=+171.423716066" watchObservedRunningTime="2026-07-20 16:32:25.774481034 +0000 UTC m=+171.425363532" Jul 20 16:32:25.826363 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.826324 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7498d949-4441-4c92-97c4-7934451c62a7-secret-telemeter-client\") pod \"telemeter-client-86dfc96c8c-ndslv\" (UID: \"7498d949-4441-4c92-97c4-7934451c62a7\") " pod="openshift-monitoring/telemeter-client-86dfc96c8c-ndslv" Jul 20 16:32:25.826541 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.826391 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7498d949-4441-4c92-97c4-7934451c62a7-metrics-client-ca\") pod \"telemeter-client-86dfc96c8c-ndslv\" (UID: \"7498d949-4441-4c92-97c4-7934451c62a7\") " pod="openshift-monitoring/telemeter-client-86dfc96c8c-ndslv" Jul 20 16:32:25.826541 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.826492 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7498d949-4441-4c92-97c4-7934451c62a7-telemeter-client-tls\") pod \"telemeter-client-86dfc96c8c-ndslv\" (UID: \"7498d949-4441-4c92-97c4-7934451c62a7\") " pod="openshift-monitoring/telemeter-client-86dfc96c8c-ndslv" Jul 20 16:32:25.826638 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.826558 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7498d949-4441-4c92-97c4-7934451c62a7-serving-certs-ca-bundle\") pod \"telemeter-client-86dfc96c8c-ndslv\" (UID: \"7498d949-4441-4c92-97c4-7934451c62a7\") " pod="openshift-monitoring/telemeter-client-86dfc96c8c-ndslv" Jul 20 16:32:25.826671 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.826633 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7498d949-4441-4c92-97c4-7934451c62a7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86dfc96c8c-ndslv\" (UID: \"7498d949-4441-4c92-97c4-7934451c62a7\") " pod="openshift-monitoring/telemeter-client-86dfc96c8c-ndslv" Jul 20 16:32:25.826715 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.826678 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7498d949-4441-4c92-97c4-7934451c62a7-federate-client-tls\") pod \"telemeter-client-86dfc96c8c-ndslv\" (UID: \"7498d949-4441-4c92-97c4-7934451c62a7\") " pod="openshift-monitoring/telemeter-client-86dfc96c8c-ndslv" Jul 20 16:32:25.826751 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.826721 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69p4z\" (UniqueName: \"kubernetes.io/projected/7498d949-4441-4c92-97c4-7934451c62a7-kube-api-access-69p4z\") pod \"telemeter-client-86dfc96c8c-ndslv\" (UID: \"7498d949-4441-4c92-97c4-7934451c62a7\") " pod="openshift-monitoring/telemeter-client-86dfc96c8c-ndslv" Jul 20 16:32:25.826788 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.826775 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7498d949-4441-4c92-97c4-7934451c62a7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86dfc96c8c-ndslv\" (UID: \"7498d949-4441-4c92-97c4-7934451c62a7\") " pod="openshift-monitoring/telemeter-client-86dfc96c8c-ndslv" Jul 20 16:32:25.927865 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.927767 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7498d949-4441-4c92-97c4-7934451c62a7-serving-certs-ca-bundle\") pod \"telemeter-client-86dfc96c8c-ndslv\" (UID: \"7498d949-4441-4c92-97c4-7934451c62a7\") " pod="openshift-monitoring/telemeter-client-86dfc96c8c-ndslv" Jul 20 16:32:25.927865 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.927818 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7498d949-4441-4c92-97c4-7934451c62a7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86dfc96c8c-ndslv\" (UID: \"7498d949-4441-4c92-97c4-7934451c62a7\") " pod="openshift-monitoring/telemeter-client-86dfc96c8c-ndslv" Jul 20 16:32:25.927865 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.927847 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7498d949-4441-4c92-97c4-7934451c62a7-federate-client-tls\") pod \"telemeter-client-86dfc96c8c-ndslv\" (UID: \"7498d949-4441-4c92-97c4-7934451c62a7\") " pod="openshift-monitoring/telemeter-client-86dfc96c8c-ndslv" Jul 20 16:32:25.928161 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.927883 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69p4z\" (UniqueName: \"kubernetes.io/projected/7498d949-4441-4c92-97c4-7934451c62a7-kube-api-access-69p4z\") pod \"telemeter-client-86dfc96c8c-ndslv\" (UID: \"7498d949-4441-4c92-97c4-7934451c62a7\") " pod="openshift-monitoring/telemeter-client-86dfc96c8c-ndslv" Jul 20 16:32:25.928161 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.927931 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7498d949-4441-4c92-97c4-7934451c62a7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86dfc96c8c-ndslv\" (UID: \"7498d949-4441-4c92-97c4-7934451c62a7\") " pod="openshift-monitoring/telemeter-client-86dfc96c8c-ndslv" Jul 20 16:32:25.928161 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.928007 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7498d949-4441-4c92-97c4-7934451c62a7-secret-telemeter-client\") pod \"telemeter-client-86dfc96c8c-ndslv\" (UID: \"7498d949-4441-4c92-97c4-7934451c62a7\") " pod="openshift-monitoring/telemeter-client-86dfc96c8c-ndslv" Jul 20 16:32:25.928161 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.928051 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7498d949-4441-4c92-97c4-7934451c62a7-metrics-client-ca\") pod \"telemeter-client-86dfc96c8c-ndslv\" (UID: \"7498d949-4441-4c92-97c4-7934451c62a7\") " pod="openshift-monitoring/telemeter-client-86dfc96c8c-ndslv" Jul 20 16:32:25.928161 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.928080 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7498d949-4441-4c92-97c4-7934451c62a7-telemeter-client-tls\") pod \"telemeter-client-86dfc96c8c-ndslv\" (UID: \"7498d949-4441-4c92-97c4-7934451c62a7\") " pod="openshift-monitoring/telemeter-client-86dfc96c8c-ndslv" Jul 20 16:32:25.928700 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.928674 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7498d949-4441-4c92-97c4-7934451c62a7-serving-certs-ca-bundle\") pod \"telemeter-client-86dfc96c8c-ndslv\" (UID: \"7498d949-4441-4c92-97c4-7934451c62a7\") " pod="openshift-monitoring/telemeter-client-86dfc96c8c-ndslv" Jul 20 16:32:25.928817 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.928792 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7498d949-4441-4c92-97c4-7934451c62a7-metrics-client-ca\") pod \"telemeter-client-86dfc96c8c-ndslv\" (UID: \"7498d949-4441-4c92-97c4-7934451c62a7\") " pod="openshift-monitoring/telemeter-client-86dfc96c8c-ndslv" Jul 20 16:32:25.928817 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.928802 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7498d949-4441-4c92-97c4-7934451c62a7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86dfc96c8c-ndslv\" (UID: \"7498d949-4441-4c92-97c4-7934451c62a7\") " pod="openshift-monitoring/telemeter-client-86dfc96c8c-ndslv" Jul 20 16:32:25.930559 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.930525 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7498d949-4441-4c92-97c4-7934451c62a7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86dfc96c8c-ndslv\" (UID: \"7498d949-4441-4c92-97c4-7934451c62a7\") " pod="openshift-monitoring/telemeter-client-86dfc96c8c-ndslv" Jul 20 16:32:25.930559 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.930543 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7498d949-4441-4c92-97c4-7934451c62a7-telemeter-client-tls\") pod \"telemeter-client-86dfc96c8c-ndslv\" (UID: \"7498d949-4441-4c92-97c4-7934451c62a7\") " pod="openshift-monitoring/telemeter-client-86dfc96c8c-ndslv" Jul 20 16:32:25.930855 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.930838 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7498d949-4441-4c92-97c4-7934451c62a7-federate-client-tls\") pod \"telemeter-client-86dfc96c8c-ndslv\" (UID: \"7498d949-4441-4c92-97c4-7934451c62a7\") " pod="openshift-monitoring/telemeter-client-86dfc96c8c-ndslv" Jul 20 16:32:25.930909 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.930835 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7498d949-4441-4c92-97c4-7934451c62a7-secret-telemeter-client\") pod \"telemeter-client-86dfc96c8c-ndslv\" (UID: \"7498d949-4441-4c92-97c4-7934451c62a7\") " pod="openshift-monitoring/telemeter-client-86dfc96c8c-ndslv" Jul 20 16:32:25.936031 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.936011 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69p4z\" (UniqueName: \"kubernetes.io/projected/7498d949-4441-4c92-97c4-7934451c62a7-kube-api-access-69p4z\") pod \"telemeter-client-86dfc96c8c-ndslv\" (UID: \"7498d949-4441-4c92-97c4-7934451c62a7\") " pod="openshift-monitoring/telemeter-client-86dfc96c8c-ndslv" Jul 20 16:32:25.983578 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:25.983497 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-86dfc96c8c-ndslv" Jul 20 16:32:26.119706 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:26.119645 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-86dfc96c8c-ndslv"] Jul 20 16:32:26.121843 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:32:26.121810 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7498d949_4441_4c92_97c4_7934451c62a7.slice/crio-a1663a989e497f46bf626aa3cdfffee6b7099419f5977fe03f10489cbc951389 WatchSource:0}: Error finding container a1663a989e497f46bf626aa3cdfffee6b7099419f5977fe03f10489cbc951389: Status 404 returned error can't find the container with id a1663a989e497f46bf626aa3cdfffee6b7099419f5977fe03f10489cbc951389 Jul 20 16:32:26.752172 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:26.752074 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86dfc96c8c-ndslv" event={"ID":"7498d949-4441-4c92-97c4-7934451c62a7","Type":"ContainerStarted","Data":"a1663a989e497f46bf626aa3cdfffee6b7099419f5977fe03f10489cbc951389"} Jul 20 16:32:29.769595 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:29.769561 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86dfc96c8c-ndslv" event={"ID":"7498d949-4441-4c92-97c4-7934451c62a7","Type":"ContainerStarted","Data":"dc477295d4282fe5e391a59e92877057d999761123cb6070cd083533e0f92b20"} Jul 20 16:32:29.770008 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:29.769618 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86dfc96c8c-ndslv" event={"ID":"7498d949-4441-4c92-97c4-7934451c62a7","Type":"ContainerStarted","Data":"784598c00d4cfe4775d2a6aa30b7ef6908f48dcd5b06ad9011200ab0e1306cb1"} Jul 20 16:32:29.770008 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:29.769638 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86dfc96c8c-ndslv" event={"ID":"7498d949-4441-4c92-97c4-7934451c62a7","Type":"ContainerStarted","Data":"7422f92fd1a176936b201785ae341bdf235ba9bd4def4aa9ede7a73c5a0f3d09"} Jul 20 16:32:29.792175 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:29.792127 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-86dfc96c8c-ndslv" podStartSLOduration=2.151701715 podStartE2EDuration="4.7921114s" totalImagesPullingTime="2.640409685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:32:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:32:29.79011052 +0000 UTC m=+175.440993019" watchObservedRunningTime="2026-07-20 16:32:29.7921114 +0000 UTC m=+175.442993913" Jul 20 16:32:30.563276 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:30.563239 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68dfdd8fd-8s77d"] Jul 20 16:32:30.565739 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:30.565715 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68dfdd8fd-8s77d" Jul 20 16:32:30.578373 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:30.578344 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68dfdd8fd-8s77d"] Jul 20 16:32:30.672615 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:30.672580 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/731b6b83-227b-4af9-8afc-d5282e2759c3-console-serving-cert\") pod \"console-68dfdd8fd-8s77d\" (UID: \"731b6b83-227b-4af9-8afc-d5282e2759c3\") " pod="openshift-console/console-68dfdd8fd-8s77d" Jul 20 16:32:30.672615 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:30.672617 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/731b6b83-227b-4af9-8afc-d5282e2759c3-service-ca\") pod \"console-68dfdd8fd-8s77d\" (UID: \"731b6b83-227b-4af9-8afc-d5282e2759c3\") " pod="openshift-console/console-68dfdd8fd-8s77d" Jul 20 16:32:30.672828 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:30.672647 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4fsz\" (UniqueName: \"kubernetes.io/projected/731b6b83-227b-4af9-8afc-d5282e2759c3-kube-api-access-j4fsz\") pod \"console-68dfdd8fd-8s77d\" (UID: \"731b6b83-227b-4af9-8afc-d5282e2759c3\") " pod="openshift-console/console-68dfdd8fd-8s77d" Jul 20 16:32:30.672828 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:30.672711 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/731b6b83-227b-4af9-8afc-d5282e2759c3-console-oauth-config\") pod \"console-68dfdd8fd-8s77d\" (UID: \"731b6b83-227b-4af9-8afc-d5282e2759c3\") " pod="openshift-console/console-68dfdd8fd-8s77d" Jul 20 16:32:30.672828 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:30.672759 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/731b6b83-227b-4af9-8afc-d5282e2759c3-trusted-ca-bundle\") pod \"console-68dfdd8fd-8s77d\" (UID: \"731b6b83-227b-4af9-8afc-d5282e2759c3\") " pod="openshift-console/console-68dfdd8fd-8s77d" Jul 20 16:32:30.672828 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:30.672785 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/731b6b83-227b-4af9-8afc-d5282e2759c3-oauth-serving-cert\") pod \"console-68dfdd8fd-8s77d\" (UID: \"731b6b83-227b-4af9-8afc-d5282e2759c3\") " pod="openshift-console/console-68dfdd8fd-8s77d" Jul 20 16:32:30.672984 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:30.672842 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/731b6b83-227b-4af9-8afc-d5282e2759c3-console-config\") pod \"console-68dfdd8fd-8s77d\" (UID: \"731b6b83-227b-4af9-8afc-d5282e2759c3\") " pod="openshift-console/console-68dfdd8fd-8s77d" Jul 20 16:32:30.773910 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:30.773877 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/731b6b83-227b-4af9-8afc-d5282e2759c3-console-config\") pod \"console-68dfdd8fd-8s77d\" (UID: \"731b6b83-227b-4af9-8afc-d5282e2759c3\") " pod="openshift-console/console-68dfdd8fd-8s77d" Jul 20 16:32:30.774427 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:30.773929 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/731b6b83-227b-4af9-8afc-d5282e2759c3-console-serving-cert\") pod \"console-68dfdd8fd-8s77d\" (UID: \"731b6b83-227b-4af9-8afc-d5282e2759c3\") " pod="openshift-console/console-68dfdd8fd-8s77d" Jul 20 16:32:30.774427 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:30.773956 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/731b6b83-227b-4af9-8afc-d5282e2759c3-service-ca\") pod \"console-68dfdd8fd-8s77d\" (UID: \"731b6b83-227b-4af9-8afc-d5282e2759c3\") " pod="openshift-console/console-68dfdd8fd-8s77d" Jul 20 16:32:30.774427 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:30.773994 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4fsz\" (UniqueName: \"kubernetes.io/projected/731b6b83-227b-4af9-8afc-d5282e2759c3-kube-api-access-j4fsz\") pod \"console-68dfdd8fd-8s77d\" (UID: \"731b6b83-227b-4af9-8afc-d5282e2759c3\") " pod="openshift-console/console-68dfdd8fd-8s77d" Jul 20 16:32:30.774427 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:30.774142 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/731b6b83-227b-4af9-8afc-d5282e2759c3-console-oauth-config\") pod \"console-68dfdd8fd-8s77d\" (UID: \"731b6b83-227b-4af9-8afc-d5282e2759c3\") " pod="openshift-console/console-68dfdd8fd-8s77d" Jul 20 16:32:30.774427 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:30.774201 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/731b6b83-227b-4af9-8afc-d5282e2759c3-trusted-ca-bundle\") pod \"console-68dfdd8fd-8s77d\" (UID: \"731b6b83-227b-4af9-8afc-d5282e2759c3\") " pod="openshift-console/console-68dfdd8fd-8s77d" Jul 20 16:32:30.774427 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:30.774234 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/731b6b83-227b-4af9-8afc-d5282e2759c3-oauth-serving-cert\") pod \"console-68dfdd8fd-8s77d\" (UID: \"731b6b83-227b-4af9-8afc-d5282e2759c3\") " pod="openshift-console/console-68dfdd8fd-8s77d" Jul 20 16:32:30.774835 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:30.774764 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/731b6b83-227b-4af9-8afc-d5282e2759c3-service-ca\") pod \"console-68dfdd8fd-8s77d\" (UID: \"731b6b83-227b-4af9-8afc-d5282e2759c3\") " pod="openshift-console/console-68dfdd8fd-8s77d" Jul 20 16:32:30.774835 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:30.774784 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/731b6b83-227b-4af9-8afc-d5282e2759c3-console-config\") pod \"console-68dfdd8fd-8s77d\" (UID: \"731b6b83-227b-4af9-8afc-d5282e2759c3\") " pod="openshift-console/console-68dfdd8fd-8s77d" Jul 20 16:32:30.774996 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:30.774920 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/731b6b83-227b-4af9-8afc-d5282e2759c3-oauth-serving-cert\") pod \"console-68dfdd8fd-8s77d\" (UID: \"731b6b83-227b-4af9-8afc-d5282e2759c3\") " pod="openshift-console/console-68dfdd8fd-8s77d" Jul 20 16:32:30.775179 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:30.775160 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/731b6b83-227b-4af9-8afc-d5282e2759c3-trusted-ca-bundle\") pod \"console-68dfdd8fd-8s77d\" (UID: \"731b6b83-227b-4af9-8afc-d5282e2759c3\") " pod="openshift-console/console-68dfdd8fd-8s77d" Jul 20 16:32:30.776607 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:30.776588 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/731b6b83-227b-4af9-8afc-d5282e2759c3-console-serving-cert\") pod \"console-68dfdd8fd-8s77d\" (UID: \"731b6b83-227b-4af9-8afc-d5282e2759c3\") " pod="openshift-console/console-68dfdd8fd-8s77d" Jul 20 16:32:30.776919 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:30.776898 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/731b6b83-227b-4af9-8afc-d5282e2759c3-console-oauth-config\") pod \"console-68dfdd8fd-8s77d\" (UID: \"731b6b83-227b-4af9-8afc-d5282e2759c3\") " pod="openshift-console/console-68dfdd8fd-8s77d" Jul 20 16:32:30.782939 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:30.782919 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4fsz\" (UniqueName: \"kubernetes.io/projected/731b6b83-227b-4af9-8afc-d5282e2759c3-kube-api-access-j4fsz\") pod \"console-68dfdd8fd-8s77d\" (UID: \"731b6b83-227b-4af9-8afc-d5282e2759c3\") " pod="openshift-console/console-68dfdd8fd-8s77d" Jul 20 16:32:30.875804 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:30.875658 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68dfdd8fd-8s77d" Jul 20 16:32:31.008956 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:31.008917 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68dfdd8fd-8s77d"] Jul 20 16:32:31.010823 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:32:31.010792 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod731b6b83_227b_4af9_8afc_d5282e2759c3.slice/crio-17037177cad6850244d06c702e1c1cd26b59c95b8182772d79f19466ef310e38 WatchSource:0}: Error finding container 17037177cad6850244d06c702e1c1cd26b59c95b8182772d79f19466ef310e38: Status 404 returned error can't find the container with id 17037177cad6850244d06c702e1c1cd26b59c95b8182772d79f19466ef310e38 Jul 20 16:32:31.783154 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:31.783119 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68dfdd8fd-8s77d" event={"ID":"731b6b83-227b-4af9-8afc-d5282e2759c3","Type":"ContainerStarted","Data":"3a312bdeaf1770a79ddb7a7967e6154074e76da52d0c5fd3ee11ea4cd0be8bf8"} Jul 20 16:32:31.783542 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:31.783171 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68dfdd8fd-8s77d" event={"ID":"731b6b83-227b-4af9-8afc-d5282e2759c3","Type":"ContainerStarted","Data":"17037177cad6850244d06c702e1c1cd26b59c95b8182772d79f19466ef310e38"} Jul 20 16:32:31.803367 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:31.803316 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68dfdd8fd-8s77d" podStartSLOduration=1.80330118 podStartE2EDuration="1.80330118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:32:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:32:31.801288312 +0000 UTC m=+177.452170813" watchObservedRunningTime="2026-07-20 16:32:31.80330118 +0000 UTC m=+177.454183679" Jul 20 16:32:40.876662 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:40.876628 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68dfdd8fd-8s77d" Jul 20 16:32:40.877176 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:40.876770 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68dfdd8fd-8s77d" Jul 20 16:32:40.881383 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:40.881354 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68dfdd8fd-8s77d" Jul 20 16:32:41.832819 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:41.832785 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68dfdd8fd-8s77d" Jul 20 16:32:41.871249 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:32:41.871210 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76db9f7764-tv42z"] Jul 20 16:33:06.898742 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:06.898675 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-76db9f7764-tv42z" podUID="49d7932d-ac6e-45bb-a9d0-5177d097b488" containerName="console" containerID="cri-o://25073fe334f582ed30865fdc99e138f46eda7d5fb36522c1d972256ebc283b2c" gracePeriod=15 Jul 20 16:33:07.148589 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:07.148564 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76db9f7764-tv42z" Jul 20 16:33:07.299498 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:07.299470 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49d7932d-ac6e-45bb-a9d0-5177d097b488-service-ca\") pod \"49d7932d-ac6e-45bb-a9d0-5177d097b488\" (UID: \"49d7932d-ac6e-45bb-a9d0-5177d097b488\") " Jul 20 16:33:07.299662 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:07.299506 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49d7932d-ac6e-45bb-a9d0-5177d097b488-console-serving-cert\") pod \"49d7932d-ac6e-45bb-a9d0-5177d097b488\" (UID: \"49d7932d-ac6e-45bb-a9d0-5177d097b488\") " Jul 20 16:33:07.299662 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:07.299551 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49d7932d-ac6e-45bb-a9d0-5177d097b488-console-config\") pod \"49d7932d-ac6e-45bb-a9d0-5177d097b488\" (UID: \"49d7932d-ac6e-45bb-a9d0-5177d097b488\") " Jul 20 16:33:07.299662 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:07.299580 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49d7932d-ac6e-45bb-a9d0-5177d097b488-console-oauth-config\") pod \"49d7932d-ac6e-45bb-a9d0-5177d097b488\" (UID: \"49d7932d-ac6e-45bb-a9d0-5177d097b488\") " Jul 20 16:33:07.299662 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:07.299605 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49d7932d-ac6e-45bb-a9d0-5177d097b488-oauth-serving-cert\") pod \"49d7932d-ac6e-45bb-a9d0-5177d097b488\" (UID: \"49d7932d-ac6e-45bb-a9d0-5177d097b488\") " Jul 20 16:33:07.299662 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:07.299631 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49d7932d-ac6e-45bb-a9d0-5177d097b488-trusted-ca-bundle\") pod \"49d7932d-ac6e-45bb-a9d0-5177d097b488\" (UID: \"49d7932d-ac6e-45bb-a9d0-5177d097b488\") " Jul 20 16:33:07.299898 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:07.299660 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hj6wl\" (UniqueName: \"kubernetes.io/projected/49d7932d-ac6e-45bb-a9d0-5177d097b488-kube-api-access-hj6wl\") pod \"49d7932d-ac6e-45bb-a9d0-5177d097b488\" (UID: \"49d7932d-ac6e-45bb-a9d0-5177d097b488\") " Jul 20 16:33:07.299986 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:07.299959 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49d7932d-ac6e-45bb-a9d0-5177d097b488-service-ca" (OuterVolumeSpecName: "service-ca") pod "49d7932d-ac6e-45bb-a9d0-5177d097b488" (UID: "49d7932d-ac6e-45bb-a9d0-5177d097b488"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:33:07.300048 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:07.299998 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49d7932d-ac6e-45bb-a9d0-5177d097b488-console-config" (OuterVolumeSpecName: "console-config") pod "49d7932d-ac6e-45bb-a9d0-5177d097b488" (UID: "49d7932d-ac6e-45bb-a9d0-5177d097b488"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:33:07.300048 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:07.300008 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49d7932d-ac6e-45bb-a9d0-5177d097b488-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "49d7932d-ac6e-45bb-a9d0-5177d097b488" (UID: "49d7932d-ac6e-45bb-a9d0-5177d097b488"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:33:07.300276 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:07.300249 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49d7932d-ac6e-45bb-a9d0-5177d097b488-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "49d7932d-ac6e-45bb-a9d0-5177d097b488" (UID: "49d7932d-ac6e-45bb-a9d0-5177d097b488"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:33:07.302040 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:07.302010 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49d7932d-ac6e-45bb-a9d0-5177d097b488-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "49d7932d-ac6e-45bb-a9d0-5177d097b488" (UID: "49d7932d-ac6e-45bb-a9d0-5177d097b488"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:33:07.302040 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:07.302008 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49d7932d-ac6e-45bb-a9d0-5177d097b488-kube-api-access-hj6wl" (OuterVolumeSpecName: "kube-api-access-hj6wl") pod "49d7932d-ac6e-45bb-a9d0-5177d097b488" (UID: "49d7932d-ac6e-45bb-a9d0-5177d097b488"). InnerVolumeSpecName "kube-api-access-hj6wl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:33:07.302260 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:07.302058 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49d7932d-ac6e-45bb-a9d0-5177d097b488-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "49d7932d-ac6e-45bb-a9d0-5177d097b488" (UID: "49d7932d-ac6e-45bb-a9d0-5177d097b488"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:33:07.400621 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:07.400583 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49d7932d-ac6e-45bb-a9d0-5177d097b488-oauth-serving-cert\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:33:07.400621 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:07.400611 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49d7932d-ac6e-45bb-a9d0-5177d097b488-trusted-ca-bundle\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:33:07.400621 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:07.400621 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hj6wl\" (UniqueName: \"kubernetes.io/projected/49d7932d-ac6e-45bb-a9d0-5177d097b488-kube-api-access-hj6wl\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:33:07.400621 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:07.400630 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49d7932d-ac6e-45bb-a9d0-5177d097b488-service-ca\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:33:07.400883 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:07.400640 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49d7932d-ac6e-45bb-a9d0-5177d097b488-console-serving-cert\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:33:07.400883 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:07.400649 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49d7932d-ac6e-45bb-a9d0-5177d097b488-console-config\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:33:07.400883 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:07.400657 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49d7932d-ac6e-45bb-a9d0-5177d097b488-console-oauth-config\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:33:07.948019 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:07.947980 2575 generic.go:356] "Generic (PLEG): container finished" podID="49d7932d-ac6e-45bb-a9d0-5177d097b488" containerID="25073fe334f582ed30865fdc99e138f46eda7d5fb36522c1d972256ebc283b2c" exitCode=0 Jul 20 16:33:07.948427 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:07.948028 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76db9f7764-tv42z" Jul 20 16:33:07.948427 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:07.948044 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76db9f7764-tv42z" event={"ID":"49d7932d-ac6e-45bb-a9d0-5177d097b488","Type":"ContainerDied","Data":"25073fe334f582ed30865fdc99e138f46eda7d5fb36522c1d972256ebc283b2c"} Jul 20 16:33:07.948427 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:07.948122 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76db9f7764-tv42z" event={"ID":"49d7932d-ac6e-45bb-a9d0-5177d097b488","Type":"ContainerDied","Data":"c647463c0b69cf11ded90b79d11d9191c8c8fe51109e360c831460596e3336ae"} Jul 20 16:33:07.948427 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:07.948151 2575 scope.go:117] "RemoveContainer" containerID="25073fe334f582ed30865fdc99e138f46eda7d5fb36522c1d972256ebc283b2c" Jul 20 16:33:07.957036 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:07.957018 2575 scope.go:117] "RemoveContainer" containerID="25073fe334f582ed30865fdc99e138f46eda7d5fb36522c1d972256ebc283b2c" Jul 20 16:33:07.957292 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:33:07.957274 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25073fe334f582ed30865fdc99e138f46eda7d5fb36522c1d972256ebc283b2c\": container with ID starting with 25073fe334f582ed30865fdc99e138f46eda7d5fb36522c1d972256ebc283b2c not found: ID does not exist" containerID="25073fe334f582ed30865fdc99e138f46eda7d5fb36522c1d972256ebc283b2c" Jul 20 16:33:07.957355 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:07.957300 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25073fe334f582ed30865fdc99e138f46eda7d5fb36522c1d972256ebc283b2c"} err="failed to get container status \"25073fe334f582ed30865fdc99e138f46eda7d5fb36522c1d972256ebc283b2c\": rpc error: code = NotFound desc = could not find container \"25073fe334f582ed30865fdc99e138f46eda7d5fb36522c1d972256ebc283b2c\": container with ID starting with 25073fe334f582ed30865fdc99e138f46eda7d5fb36522c1d972256ebc283b2c not found: ID does not exist" Jul 20 16:33:07.967721 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:07.967698 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76db9f7764-tv42z"] Jul 20 16:33:07.971174 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:07.971156 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76db9f7764-tv42z"] Jul 20 16:33:08.852884 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:08.852847 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49d7932d-ac6e-45bb-a9d0-5177d097b488" path="/var/lib/kubelet/pods/49d7932d-ac6e-45bb-a9d0-5177d097b488/volumes" Jul 20 16:33:49.242846 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:49.242810 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bcfb6db95-fqt89"] Jul 20 16:33:49.243408 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:49.243197 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49d7932d-ac6e-45bb-a9d0-5177d097b488" containerName="console" Jul 20 16:33:49.243408 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:49.243211 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="49d7932d-ac6e-45bb-a9d0-5177d097b488" containerName="console" Jul 20 16:33:49.243408 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:49.243279 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="49d7932d-ac6e-45bb-a9d0-5177d097b488" containerName="console" Jul 20 16:33:49.247963 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:49.247940 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bcfb6db95-fqt89" Jul 20 16:33:49.264207 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:49.264174 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bcfb6db95-fqt89"] Jul 20 16:33:49.342609 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:49.342571 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-oauth-serving-cert\") pod \"console-7bcfb6db95-fqt89\" (UID: \"c9b4b52b-717f-4f29-b23c-2cd11f4647c7\") " pod="openshift-console/console-7bcfb6db95-fqt89" Jul 20 16:33:49.342609 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:49.342612 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-console-serving-cert\") pod \"console-7bcfb6db95-fqt89\" (UID: \"c9b4b52b-717f-4f29-b23c-2cd11f4647c7\") " pod="openshift-console/console-7bcfb6db95-fqt89" Jul 20 16:33:49.342819 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:49.342694 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-service-ca\") pod \"console-7bcfb6db95-fqt89\" (UID: \"c9b4b52b-717f-4f29-b23c-2cd11f4647c7\") " pod="openshift-console/console-7bcfb6db95-fqt89" Jul 20 16:33:49.342819 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:49.342715 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-trusted-ca-bundle\") pod \"console-7bcfb6db95-fqt89\" (UID: \"c9b4b52b-717f-4f29-b23c-2cd11f4647c7\") " pod="openshift-console/console-7bcfb6db95-fqt89" Jul 20 16:33:49.342819 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:49.342738 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5278h\" (UniqueName: \"kubernetes.io/projected/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-kube-api-access-5278h\") pod \"console-7bcfb6db95-fqt89\" (UID: \"c9b4b52b-717f-4f29-b23c-2cd11f4647c7\") " pod="openshift-console/console-7bcfb6db95-fqt89" Jul 20 16:33:49.342819 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:49.342768 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-console-oauth-config\") pod \"console-7bcfb6db95-fqt89\" (UID: \"c9b4b52b-717f-4f29-b23c-2cd11f4647c7\") " pod="openshift-console/console-7bcfb6db95-fqt89" Jul 20 16:33:49.342960 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:49.342837 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-console-config\") pod \"console-7bcfb6db95-fqt89\" (UID: \"c9b4b52b-717f-4f29-b23c-2cd11f4647c7\") " pod="openshift-console/console-7bcfb6db95-fqt89" Jul 20 16:33:49.443786 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:49.443752 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-console-oauth-config\") pod \"console-7bcfb6db95-fqt89\" (UID: \"c9b4b52b-717f-4f29-b23c-2cd11f4647c7\") " pod="openshift-console/console-7bcfb6db95-fqt89" Jul 20 16:33:49.443977 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:49.443797 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-console-config\") pod \"console-7bcfb6db95-fqt89\" (UID: \"c9b4b52b-717f-4f29-b23c-2cd11f4647c7\") " pod="openshift-console/console-7bcfb6db95-fqt89" Jul 20 16:33:49.443977 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:49.443821 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-oauth-serving-cert\") pod \"console-7bcfb6db95-fqt89\" (UID: \"c9b4b52b-717f-4f29-b23c-2cd11f4647c7\") " pod="openshift-console/console-7bcfb6db95-fqt89" Jul 20 16:33:49.443977 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:49.443839 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-console-serving-cert\") pod \"console-7bcfb6db95-fqt89\" (UID: \"c9b4b52b-717f-4f29-b23c-2cd11f4647c7\") " pod="openshift-console/console-7bcfb6db95-fqt89" Jul 20 16:33:49.443977 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:49.443886 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-service-ca\") pod \"console-7bcfb6db95-fqt89\" (UID: \"c9b4b52b-717f-4f29-b23c-2cd11f4647c7\") " pod="openshift-console/console-7bcfb6db95-fqt89" Jul 20 16:33:49.443977 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:49.443899 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-trusted-ca-bundle\") pod \"console-7bcfb6db95-fqt89\" (UID: \"c9b4b52b-717f-4f29-b23c-2cd11f4647c7\") " pod="openshift-console/console-7bcfb6db95-fqt89" Jul 20 16:33:49.443977 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:49.443916 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5278h\" (UniqueName: \"kubernetes.io/projected/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-kube-api-access-5278h\") pod \"console-7bcfb6db95-fqt89\" (UID: \"c9b4b52b-717f-4f29-b23c-2cd11f4647c7\") " pod="openshift-console/console-7bcfb6db95-fqt89" Jul 20 16:33:49.444741 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:49.444713 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-service-ca\") pod \"console-7bcfb6db95-fqt89\" (UID: \"c9b4b52b-717f-4f29-b23c-2cd11f4647c7\") " pod="openshift-console/console-7bcfb6db95-fqt89" Jul 20 16:33:49.444741 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:49.444729 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-oauth-serving-cert\") pod \"console-7bcfb6db95-fqt89\" (UID: \"c9b4b52b-717f-4f29-b23c-2cd11f4647c7\") " pod="openshift-console/console-7bcfb6db95-fqt89" Jul 20 16:33:49.444867 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:49.444729 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-console-config\") pod \"console-7bcfb6db95-fqt89\" (UID: \"c9b4b52b-717f-4f29-b23c-2cd11f4647c7\") " pod="openshift-console/console-7bcfb6db95-fqt89" Jul 20 16:33:49.444988 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:49.444964 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-trusted-ca-bundle\") pod \"console-7bcfb6db95-fqt89\" (UID: \"c9b4b52b-717f-4f29-b23c-2cd11f4647c7\") " pod="openshift-console/console-7bcfb6db95-fqt89" Jul 20 16:33:49.446406 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:49.446374 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-console-serving-cert\") pod \"console-7bcfb6db95-fqt89\" (UID: \"c9b4b52b-717f-4f29-b23c-2cd11f4647c7\") " pod="openshift-console/console-7bcfb6db95-fqt89" Jul 20 16:33:49.446496 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:49.446458 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-console-oauth-config\") pod \"console-7bcfb6db95-fqt89\" (UID: \"c9b4b52b-717f-4f29-b23c-2cd11f4647c7\") " pod="openshift-console/console-7bcfb6db95-fqt89" Jul 20 16:33:49.451735 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:49.451715 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5278h\" (UniqueName: \"kubernetes.io/projected/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-kube-api-access-5278h\") pod \"console-7bcfb6db95-fqt89\" (UID: \"c9b4b52b-717f-4f29-b23c-2cd11f4647c7\") " pod="openshift-console/console-7bcfb6db95-fqt89" Jul 20 16:33:49.562846 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:49.562811 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bcfb6db95-fqt89" Jul 20 16:33:49.697463 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:49.697435 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bcfb6db95-fqt89"] Jul 20 16:33:49.699424 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:33:49.699398 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9b4b52b_717f_4f29_b23c_2cd11f4647c7.slice/crio-66bc56e51bb6af95bdf29c92168331483bc8938c6b120d9146eb57b74848951b WatchSource:0}: Error finding container 66bc56e51bb6af95bdf29c92168331483bc8938c6b120d9146eb57b74848951b: Status 404 returned error can't find the container with id 66bc56e51bb6af95bdf29c92168331483bc8938c6b120d9146eb57b74848951b Jul 20 16:33:50.128423 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:50.128390 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bcfb6db95-fqt89" event={"ID":"c9b4b52b-717f-4f29-b23c-2cd11f4647c7","Type":"ContainerStarted","Data":"352e5ff48fcfebb67cb063cbe0413da7a2125cf991f80bf45a26a74325e63eff"} Jul 20 16:33:50.128423 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:50.128441 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bcfb6db95-fqt89" event={"ID":"c9b4b52b-717f-4f29-b23c-2cd11f4647c7","Type":"ContainerStarted","Data":"66bc56e51bb6af95bdf29c92168331483bc8938c6b120d9146eb57b74848951b"} Jul 20 16:33:50.145472 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:50.145417 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bcfb6db95-fqt89" podStartSLOduration=1.145399082 podStartE2EDuration="1.145399082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:33:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:33:50.143614862 +0000 UTC m=+255.794497361" watchObservedRunningTime="2026-07-20 16:33:50.145399082 +0000 UTC m=+255.796281579" Jul 20 16:33:59.563443 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:59.563358 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bcfb6db95-fqt89" Jul 20 16:33:59.563800 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:59.563449 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bcfb6db95-fqt89" Jul 20 16:33:59.568246 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:33:59.568223 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bcfb6db95-fqt89" Jul 20 16:34:00.177029 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:00.177002 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bcfb6db95-fqt89" Jul 20 16:34:00.226725 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:00.226691 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68dfdd8fd-8s77d"] Jul 20 16:34:25.250367 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:25.250322 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-68dfdd8fd-8s77d" podUID="731b6b83-227b-4af9-8afc-d5282e2759c3" containerName="console" containerID="cri-o://3a312bdeaf1770a79ddb7a7967e6154074e76da52d0c5fd3ee11ea4cd0be8bf8" gracePeriod=15 Jul 20 16:34:25.489578 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:25.489557 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68dfdd8fd-8s77d" Jul 20 16:34:25.562438 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:25.562405 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/731b6b83-227b-4af9-8afc-d5282e2759c3-console-oauth-config\") pod \"731b6b83-227b-4af9-8afc-d5282e2759c3\" (UID: \"731b6b83-227b-4af9-8afc-d5282e2759c3\") " Jul 20 16:34:25.562602 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:25.562450 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4fsz\" (UniqueName: \"kubernetes.io/projected/731b6b83-227b-4af9-8afc-d5282e2759c3-kube-api-access-j4fsz\") pod \"731b6b83-227b-4af9-8afc-d5282e2759c3\" (UID: \"731b6b83-227b-4af9-8afc-d5282e2759c3\") " Jul 20 16:34:25.562642 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:25.562619 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/731b6b83-227b-4af9-8afc-d5282e2759c3-console-serving-cert\") pod \"731b6b83-227b-4af9-8afc-d5282e2759c3\" (UID: \"731b6b83-227b-4af9-8afc-d5282e2759c3\") " Jul 20 16:34:25.562712 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:25.562695 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/731b6b83-227b-4af9-8afc-d5282e2759c3-trusted-ca-bundle\") pod \"731b6b83-227b-4af9-8afc-d5282e2759c3\" (UID: \"731b6b83-227b-4af9-8afc-d5282e2759c3\") " Jul 20 16:34:25.562755 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:25.562734 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/731b6b83-227b-4af9-8afc-d5282e2759c3-oauth-serving-cert\") pod \"731b6b83-227b-4af9-8afc-d5282e2759c3\" (UID: \"731b6b83-227b-4af9-8afc-d5282e2759c3\") " Jul 20 16:34:25.562808 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:25.562766 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/731b6b83-227b-4af9-8afc-d5282e2759c3-service-ca\") pod \"731b6b83-227b-4af9-8afc-d5282e2759c3\" (UID: \"731b6b83-227b-4af9-8afc-d5282e2759c3\") " Jul 20 16:34:25.562808 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:25.562793 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/731b6b83-227b-4af9-8afc-d5282e2759c3-console-config\") pod \"731b6b83-227b-4af9-8afc-d5282e2759c3\" (UID: \"731b6b83-227b-4af9-8afc-d5282e2759c3\") " Jul 20 16:34:25.563262 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:25.563226 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/731b6b83-227b-4af9-8afc-d5282e2759c3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "731b6b83-227b-4af9-8afc-d5282e2759c3" (UID: "731b6b83-227b-4af9-8afc-d5282e2759c3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:34:25.563386 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:25.563251 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/731b6b83-227b-4af9-8afc-d5282e2759c3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "731b6b83-227b-4af9-8afc-d5282e2759c3" (UID: "731b6b83-227b-4af9-8afc-d5282e2759c3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:34:25.563386 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:25.563279 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/731b6b83-227b-4af9-8afc-d5282e2759c3-service-ca" (OuterVolumeSpecName: "service-ca") pod "731b6b83-227b-4af9-8afc-d5282e2759c3" (UID: "731b6b83-227b-4af9-8afc-d5282e2759c3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:34:25.563386 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:25.563315 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/731b6b83-227b-4af9-8afc-d5282e2759c3-console-config" (OuterVolumeSpecName: "console-config") pod "731b6b83-227b-4af9-8afc-d5282e2759c3" (UID: "731b6b83-227b-4af9-8afc-d5282e2759c3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:34:25.564704 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:25.564679 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/731b6b83-227b-4af9-8afc-d5282e2759c3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "731b6b83-227b-4af9-8afc-d5282e2759c3" (UID: "731b6b83-227b-4af9-8afc-d5282e2759c3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:34:25.564783 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:25.564696 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/731b6b83-227b-4af9-8afc-d5282e2759c3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "731b6b83-227b-4af9-8afc-d5282e2759c3" (UID: "731b6b83-227b-4af9-8afc-d5282e2759c3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:34:25.564920 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:25.564896 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/731b6b83-227b-4af9-8afc-d5282e2759c3-kube-api-access-j4fsz" (OuterVolumeSpecName: "kube-api-access-j4fsz") pod "731b6b83-227b-4af9-8afc-d5282e2759c3" (UID: "731b6b83-227b-4af9-8afc-d5282e2759c3"). InnerVolumeSpecName "kube-api-access-j4fsz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:34:25.663578 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:25.663530 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/731b6b83-227b-4af9-8afc-d5282e2759c3-console-oauth-config\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:34:25.663578 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:25.663571 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4fsz\" (UniqueName: \"kubernetes.io/projected/731b6b83-227b-4af9-8afc-d5282e2759c3-kube-api-access-j4fsz\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:34:25.663578 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:25.663581 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/731b6b83-227b-4af9-8afc-d5282e2759c3-console-serving-cert\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:34:25.663578 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:25.663590 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/731b6b83-227b-4af9-8afc-d5282e2759c3-trusted-ca-bundle\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:34:25.663836 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:25.663599 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/731b6b83-227b-4af9-8afc-d5282e2759c3-oauth-serving-cert\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:34:25.663836 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:25.663609 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/731b6b83-227b-4af9-8afc-d5282e2759c3-service-ca\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:34:25.663836 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:25.663619 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/731b6b83-227b-4af9-8afc-d5282e2759c3-console-config\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:34:26.292657 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:26.292618 2575 generic.go:356] "Generic (PLEG): container finished" podID="731b6b83-227b-4af9-8afc-d5282e2759c3" containerID="3a312bdeaf1770a79ddb7a7967e6154074e76da52d0c5fd3ee11ea4cd0be8bf8" exitCode=0 Jul 20 16:34:26.293053 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:26.292666 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68dfdd8fd-8s77d" Jul 20 16:34:26.293053 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:26.292705 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68dfdd8fd-8s77d" event={"ID":"731b6b83-227b-4af9-8afc-d5282e2759c3","Type":"ContainerDied","Data":"3a312bdeaf1770a79ddb7a7967e6154074e76da52d0c5fd3ee11ea4cd0be8bf8"} Jul 20 16:34:26.293053 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:26.292757 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68dfdd8fd-8s77d" event={"ID":"731b6b83-227b-4af9-8afc-d5282e2759c3","Type":"ContainerDied","Data":"17037177cad6850244d06c702e1c1cd26b59c95b8182772d79f19466ef310e38"} Jul 20 16:34:26.293053 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:26.292787 2575 scope.go:117] "RemoveContainer" containerID="3a312bdeaf1770a79ddb7a7967e6154074e76da52d0c5fd3ee11ea4cd0be8bf8" Jul 20 16:34:26.301620 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:26.301605 2575 scope.go:117] "RemoveContainer" containerID="3a312bdeaf1770a79ddb7a7967e6154074e76da52d0c5fd3ee11ea4cd0be8bf8" Jul 20 16:34:26.301850 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:34:26.301833 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a312bdeaf1770a79ddb7a7967e6154074e76da52d0c5fd3ee11ea4cd0be8bf8\": container with ID starting with 3a312bdeaf1770a79ddb7a7967e6154074e76da52d0c5fd3ee11ea4cd0be8bf8 not found: ID does not exist" containerID="3a312bdeaf1770a79ddb7a7967e6154074e76da52d0c5fd3ee11ea4cd0be8bf8" Jul 20 16:34:26.301898 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:26.301857 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a312bdeaf1770a79ddb7a7967e6154074e76da52d0c5fd3ee11ea4cd0be8bf8"} err="failed to get container status \"3a312bdeaf1770a79ddb7a7967e6154074e76da52d0c5fd3ee11ea4cd0be8bf8\": rpc error: code = NotFound desc = could not find container \"3a312bdeaf1770a79ddb7a7967e6154074e76da52d0c5fd3ee11ea4cd0be8bf8\": container with ID starting with 3a312bdeaf1770a79ddb7a7967e6154074e76da52d0c5fd3ee11ea4cd0be8bf8 not found: ID does not exist" Jul 20 16:34:26.313693 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:26.313668 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68dfdd8fd-8s77d"] Jul 20 16:34:26.320301 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:26.320273 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68dfdd8fd-8s77d"] Jul 20 16:34:26.852906 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:26.852875 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="731b6b83-227b-4af9-8afc-d5282e2759c3" path="/var/lib/kubelet/pods/731b6b83-227b-4af9-8afc-d5282e2759c3/volumes" Jul 20 16:34:34.756949 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:34.756919 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-99wqw_0ec4c40f-7638-4fe3-8bff-edb2579a3b3b/console-operator/1.log" Jul 20 16:34:34.763253 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:34.763229 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-99wqw_0ec4c40f-7638-4fe3-8bff-edb2579a3b3b/console-operator/1.log" Jul 20 16:34:34.768308 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:34:34.768286 2575 kubelet.go:1648] "Image garbage collection succeeded" Jul 20 16:35:08.727101 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:08.727053 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7p844"] Jul 20 16:35:08.729504 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:08.727403 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="731b6b83-227b-4af9-8afc-d5282e2759c3" containerName="console" Jul 20 16:35:08.729504 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:08.727413 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="731b6b83-227b-4af9-8afc-d5282e2759c3" containerName="console" Jul 20 16:35:08.729504 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:08.727482 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="731b6b83-227b-4af9-8afc-d5282e2759c3" containerName="console" Jul 20 16:35:08.730365 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:08.730351 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7p844" Jul 20 16:35:08.732710 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:08.732678 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 20 16:35:08.732848 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:08.732731 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-qm7ld\"" Jul 20 16:35:08.732848 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:08.732735 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 20 16:35:08.746769 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:08.746749 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7p844"] Jul 20 16:35:08.817187 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:08.817149 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00d5deb1-c5b6-45a2-8bb9-c00671c0ca53-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-7p844\" (UID: \"00d5deb1-c5b6-45a2-8bb9-c00671c0ca53\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7p844" Jul 20 16:35:08.817531 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:08.817292 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxxx8\" (UniqueName: \"kubernetes.io/projected/00d5deb1-c5b6-45a2-8bb9-c00671c0ca53-kube-api-access-cxxx8\") pod \"cert-manager-operator-controller-manager-55c444bf86-7p844\" (UID: \"00d5deb1-c5b6-45a2-8bb9-c00671c0ca53\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7p844" Jul 20 16:35:08.917739 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:08.917689 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxxx8\" (UniqueName: \"kubernetes.io/projected/00d5deb1-c5b6-45a2-8bb9-c00671c0ca53-kube-api-access-cxxx8\") pod \"cert-manager-operator-controller-manager-55c444bf86-7p844\" (UID: \"00d5deb1-c5b6-45a2-8bb9-c00671c0ca53\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7p844" Jul 20 16:35:08.917739 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:08.917756 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00d5deb1-c5b6-45a2-8bb9-c00671c0ca53-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-7p844\" (UID: \"00d5deb1-c5b6-45a2-8bb9-c00671c0ca53\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7p844" Jul 20 16:35:08.918106 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:08.918062 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00d5deb1-c5b6-45a2-8bb9-c00671c0ca53-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-7p844\" (UID: \"00d5deb1-c5b6-45a2-8bb9-c00671c0ca53\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7p844" Jul 20 16:35:08.929096 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:08.929048 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxxx8\" (UniqueName: \"kubernetes.io/projected/00d5deb1-c5b6-45a2-8bb9-c00671c0ca53-kube-api-access-cxxx8\") pod \"cert-manager-operator-controller-manager-55c444bf86-7p844\" (UID: \"00d5deb1-c5b6-45a2-8bb9-c00671c0ca53\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7p844" Jul 20 16:35:09.038974 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:09.038937 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7p844" Jul 20 16:35:09.173372 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:09.173346 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7p844"] Jul 20 16:35:09.176002 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:35:09.175969 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00d5deb1_c5b6_45a2_8bb9_c00671c0ca53.slice/crio-563d5502cda3be814780e2c049de86e46a74f95c098d4b4956cd6ccd4c4d777a WatchSource:0}: Error finding container 563d5502cda3be814780e2c049de86e46a74f95c098d4b4956cd6ccd4c4d777a: Status 404 returned error can't find the container with id 563d5502cda3be814780e2c049de86e46a74f95c098d4b4956cd6ccd4c4d777a Jul 20 16:35:09.178741 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:09.178725 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 16:35:09.477777 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:09.477692 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7p844" event={"ID":"00d5deb1-c5b6-45a2-8bb9-c00671c0ca53","Type":"ContainerStarted","Data":"563d5502cda3be814780e2c049de86e46a74f95c098d4b4956cd6ccd4c4d777a"} Jul 20 16:35:12.496370 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:12.496279 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7p844" event={"ID":"00d5deb1-c5b6-45a2-8bb9-c00671c0ca53","Type":"ContainerStarted","Data":"77300120f70ccce473bd0ff708ab0b3fbc72d2384d7d21b3487a694e40e0bfdb"} Jul 20 16:35:12.530852 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:12.530800 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7p844" podStartSLOduration=1.6019802269999999 podStartE2EDuration="4.530784262s" totalImagesPullingTime="2.928804035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:35:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:35:12.528021569 +0000 UTC m=+338.178904064" watchObservedRunningTime="2026-07-20 16:35:12.530784262 +0000 UTC m=+338.181666759" Jul 20 16:35:13.217143 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:13.217109 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f254zx"] Jul 20 16:35:13.220910 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:13.220893 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f254zx" Jul 20 16:35:13.225692 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:13.225669 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 20 16:35:13.226198 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:13.226161 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 20 16:35:13.227009 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:13.226986 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4lfs8\"" Jul 20 16:35:13.237601 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:13.237582 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f254zx"] Jul 20 16:35:13.359272 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:13.359239 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36403de8-c91d-4fad-9078-a737065c5833-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f254zx\" (UID: \"36403de8-c91d-4fad-9078-a737065c5833\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f254zx" Jul 20 16:35:13.359445 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:13.359309 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36403de8-c91d-4fad-9078-a737065c5833-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f254zx\" (UID: \"36403de8-c91d-4fad-9078-a737065c5833\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f254zx" Jul 20 16:35:13.359445 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:13.359348 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbcv8\" (UniqueName: \"kubernetes.io/projected/36403de8-c91d-4fad-9078-a737065c5833-kube-api-access-jbcv8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f254zx\" (UID: \"36403de8-c91d-4fad-9078-a737065c5833\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f254zx" Jul 20 16:35:13.460246 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:13.460215 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36403de8-c91d-4fad-9078-a737065c5833-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f254zx\" (UID: \"36403de8-c91d-4fad-9078-a737065c5833\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f254zx" Jul 20 16:35:13.460389 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:13.460266 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbcv8\" (UniqueName: \"kubernetes.io/projected/36403de8-c91d-4fad-9078-a737065c5833-kube-api-access-jbcv8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f254zx\" (UID: \"36403de8-c91d-4fad-9078-a737065c5833\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f254zx" Jul 20 16:35:13.460389 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:13.460300 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36403de8-c91d-4fad-9078-a737065c5833-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f254zx\" (UID: \"36403de8-c91d-4fad-9078-a737065c5833\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f254zx" Jul 20 16:35:13.460657 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:13.460633 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36403de8-c91d-4fad-9078-a737065c5833-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f254zx\" (UID: \"36403de8-c91d-4fad-9078-a737065c5833\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f254zx" Jul 20 16:35:13.460694 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:13.460640 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36403de8-c91d-4fad-9078-a737065c5833-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f254zx\" (UID: \"36403de8-c91d-4fad-9078-a737065c5833\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f254zx" Jul 20 16:35:13.468255 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:13.468195 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbcv8\" (UniqueName: \"kubernetes.io/projected/36403de8-c91d-4fad-9078-a737065c5833-kube-api-access-jbcv8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f254zx\" (UID: \"36403de8-c91d-4fad-9078-a737065c5833\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f254zx" Jul 20 16:35:13.529913 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:13.529882 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f254zx" Jul 20 16:35:13.662134 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:13.662077 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f254zx"] Jul 20 16:35:13.664476 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:35:13.664449 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36403de8_c91d_4fad_9078_a737065c5833.slice/crio-ea0b74dde8ebc25b2f24446541e56b988834f3ddf6a9bbd5af0b05a12a9c58c7 WatchSource:0}: Error finding container ea0b74dde8ebc25b2f24446541e56b988834f3ddf6a9bbd5af0b05a12a9c58c7: Status 404 returned error can't find the container with id ea0b74dde8ebc25b2f24446541e56b988834f3ddf6a9bbd5af0b05a12a9c58c7 Jul 20 16:35:14.507958 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:14.507922 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f254zx" event={"ID":"36403de8-c91d-4fad-9078-a737065c5833","Type":"ContainerStarted","Data":"ea0b74dde8ebc25b2f24446541e56b988834f3ddf6a9bbd5af0b05a12a9c58c7"} Jul 20 16:35:21.542025 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:21.541990 2575 generic.go:356] "Generic (PLEG): container finished" podID="36403de8-c91d-4fad-9078-a737065c5833" containerID="fc69175f830086fe9ac7a0b058e7c6430e4b1158b46c90b7c283d37d29ca8610" exitCode=0 Jul 20 16:35:21.542433 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:21.542058 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f254zx" event={"ID":"36403de8-c91d-4fad-9078-a737065c5833","Type":"ContainerDied","Data":"fc69175f830086fe9ac7a0b058e7c6430e4b1158b46c90b7c283d37d29ca8610"} Jul 20 16:35:24.250478 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:24.250447 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-bsnn2"] Jul 20 16:35:24.253922 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:24.253904 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-bsnn2" Jul 20 16:35:24.256256 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:24.256231 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 20 16:35:24.256386 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:24.256277 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 20 16:35:24.256386 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:24.256239 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-4qt7x\"" Jul 20 16:35:24.261070 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:24.261049 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-bsnn2"] Jul 20 16:35:24.353264 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:24.353229 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6efb67cb-b6fc-471a-9a58-9e2cd5fd6063-bound-sa-token\") pod \"cert-manager-55b4d954d5-bsnn2\" (UID: \"6efb67cb-b6fc-471a-9a58-9e2cd5fd6063\") " pod="cert-manager/cert-manager-55b4d954d5-bsnn2" Jul 20 16:35:24.353451 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:24.353304 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg5vw\" (UniqueName: \"kubernetes.io/projected/6efb67cb-b6fc-471a-9a58-9e2cd5fd6063-kube-api-access-wg5vw\") pod \"cert-manager-55b4d954d5-bsnn2\" (UID: \"6efb67cb-b6fc-471a-9a58-9e2cd5fd6063\") " pod="cert-manager/cert-manager-55b4d954d5-bsnn2" Jul 20 16:35:24.454315 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:24.454281 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg5vw\" (UniqueName: \"kubernetes.io/projected/6efb67cb-b6fc-471a-9a58-9e2cd5fd6063-kube-api-access-wg5vw\") pod \"cert-manager-55b4d954d5-bsnn2\" (UID: \"6efb67cb-b6fc-471a-9a58-9e2cd5fd6063\") " pod="cert-manager/cert-manager-55b4d954d5-bsnn2" Jul 20 16:35:24.454484 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:24.454351 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6efb67cb-b6fc-471a-9a58-9e2cd5fd6063-bound-sa-token\") pod \"cert-manager-55b4d954d5-bsnn2\" (UID: \"6efb67cb-b6fc-471a-9a58-9e2cd5fd6063\") " pod="cert-manager/cert-manager-55b4d954d5-bsnn2" Jul 20 16:35:24.462253 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:24.462221 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6efb67cb-b6fc-471a-9a58-9e2cd5fd6063-bound-sa-token\") pod \"cert-manager-55b4d954d5-bsnn2\" (UID: \"6efb67cb-b6fc-471a-9a58-9e2cd5fd6063\") " pod="cert-manager/cert-manager-55b4d954d5-bsnn2" Jul 20 16:35:24.462429 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:24.462410 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg5vw\" (UniqueName: \"kubernetes.io/projected/6efb67cb-b6fc-471a-9a58-9e2cd5fd6063-kube-api-access-wg5vw\") pod \"cert-manager-55b4d954d5-bsnn2\" (UID: \"6efb67cb-b6fc-471a-9a58-9e2cd5fd6063\") " pod="cert-manager/cert-manager-55b4d954d5-bsnn2" Jul 20 16:35:24.575943 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:24.575909 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-bsnn2" Jul 20 16:35:24.708268 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:24.708222 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-bsnn2"] Jul 20 16:35:24.710690 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:35:24.710663 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6efb67cb_b6fc_471a_9a58_9e2cd5fd6063.slice/crio-3af10af0a92d7e7acf04a195ac0e1dde6e5556fa90b1e43b06ab710516259ebc WatchSource:0}: Error finding container 3af10af0a92d7e7acf04a195ac0e1dde6e5556fa90b1e43b06ab710516259ebc: Status 404 returned error can't find the container with id 3af10af0a92d7e7acf04a195ac0e1dde6e5556fa90b1e43b06ab710516259ebc Jul 20 16:35:25.561529 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:25.561495 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-bsnn2" event={"ID":"6efb67cb-b6fc-471a-9a58-9e2cd5fd6063","Type":"ContainerStarted","Data":"3af10af0a92d7e7acf04a195ac0e1dde6e5556fa90b1e43b06ab710516259ebc"} Jul 20 16:35:27.575486 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:27.575450 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-bsnn2" event={"ID":"6efb67cb-b6fc-471a-9a58-9e2cd5fd6063","Type":"ContainerStarted","Data":"8fa0d967642a5c1deb2e1f75b02b3503b803bbb00460c345c9540dd7db8b6d50"} Jul 20 16:35:27.592031 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:27.591981 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-bsnn2" podStartSLOduration=1.260687488 podStartE2EDuration="3.591966486s" totalImagesPullingTime="2.331278998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:35:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:35:27.590663689 +0000 UTC m=+353.241546188" watchObservedRunningTime="2026-07-20 16:35:27.591966486 +0000 UTC m=+353.242848983" Jul 20 16:35:30.592476 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:30.592442 2575 generic.go:356] "Generic (PLEG): container finished" podID="36403de8-c91d-4fad-9078-a737065c5833" containerID="725383fe184828af18fe132f0a7b17d84dcbf736d900c808a16bbcf40d018855" exitCode=0 Jul 20 16:35:30.592894 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:30.592526 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f254zx" event={"ID":"36403de8-c91d-4fad-9078-a737065c5833","Type":"ContainerDied","Data":"725383fe184828af18fe132f0a7b17d84dcbf736d900c808a16bbcf40d018855"} Jul 20 16:35:39.639926 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:39.639886 2575 generic.go:356] "Generic (PLEG): container finished" podID="36403de8-c91d-4fad-9078-a737065c5833" containerID="1920afa0c8f40140dce4704c7e2fe9b8d0ec587f124b21470bd6d960466957d1" exitCode=0 Jul 20 16:35:39.639926 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:39.639929 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f254zx" event={"ID":"36403de8-c91d-4fad-9078-a737065c5833","Type":"ContainerDied","Data":"1920afa0c8f40140dce4704c7e2fe9b8d0ec587f124b21470bd6d960466957d1"} Jul 20 16:35:40.788098 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:40.788055 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f254zx" Jul 20 16:35:40.905027 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:40.904936 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36403de8-c91d-4fad-9078-a737065c5833-bundle\") pod \"36403de8-c91d-4fad-9078-a737065c5833\" (UID: \"36403de8-c91d-4fad-9078-a737065c5833\") " Jul 20 16:35:40.905027 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:40.905024 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36403de8-c91d-4fad-9078-a737065c5833-util\") pod \"36403de8-c91d-4fad-9078-a737065c5833\" (UID: \"36403de8-c91d-4fad-9078-a737065c5833\") " Jul 20 16:35:40.905267 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:40.905063 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbcv8\" (UniqueName: \"kubernetes.io/projected/36403de8-c91d-4fad-9078-a737065c5833-kube-api-access-jbcv8\") pod \"36403de8-c91d-4fad-9078-a737065c5833\" (UID: \"36403de8-c91d-4fad-9078-a737065c5833\") " Jul 20 16:35:40.905506 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:40.905438 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36403de8-c91d-4fad-9078-a737065c5833-bundle" (OuterVolumeSpecName: "bundle") pod "36403de8-c91d-4fad-9078-a737065c5833" (UID: "36403de8-c91d-4fad-9078-a737065c5833"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:35:40.907515 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:40.907478 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36403de8-c91d-4fad-9078-a737065c5833-kube-api-access-jbcv8" (OuterVolumeSpecName: "kube-api-access-jbcv8") pod "36403de8-c91d-4fad-9078-a737065c5833" (UID: "36403de8-c91d-4fad-9078-a737065c5833"). InnerVolumeSpecName "kube-api-access-jbcv8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:35:40.909525 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:40.909499 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36403de8-c91d-4fad-9078-a737065c5833-util" (OuterVolumeSpecName: "util") pod "36403de8-c91d-4fad-9078-a737065c5833" (UID: "36403de8-c91d-4fad-9078-a737065c5833"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:35:41.005948 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:41.005912 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbcv8\" (UniqueName: \"kubernetes.io/projected/36403de8-c91d-4fad-9078-a737065c5833-kube-api-access-jbcv8\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:35:41.005948 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:41.005941 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36403de8-c91d-4fad-9078-a737065c5833-bundle\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:35:41.005948 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:41.005953 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36403de8-c91d-4fad-9078-a737065c5833-util\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:35:41.650996 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:41.650970 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f254zx" Jul 20 16:35:41.651195 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:41.651001 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f254zx" event={"ID":"36403de8-c91d-4fad-9078-a737065c5833","Type":"ContainerDied","Data":"ea0b74dde8ebc25b2f24446541e56b988834f3ddf6a9bbd5af0b05a12a9c58c7"} Jul 20 16:35:41.651195 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:41.651048 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea0b74dde8ebc25b2f24446541e56b988834f3ddf6a9bbd5af0b05a12a9c58c7" Jul 20 16:35:50.158962 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:50.158924 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5lscj"] Jul 20 16:35:50.159396 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:50.159354 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36403de8-c91d-4fad-9078-a737065c5833" containerName="pull" Jul 20 16:35:50.159396 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:50.159369 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="36403de8-c91d-4fad-9078-a737065c5833" containerName="pull" Jul 20 16:35:50.159396 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:50.159378 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36403de8-c91d-4fad-9078-a737065c5833" containerName="extract" Jul 20 16:35:50.159396 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:50.159384 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="36403de8-c91d-4fad-9078-a737065c5833" containerName="extract" Jul 20 16:35:50.159550 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:50.159404 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36403de8-c91d-4fad-9078-a737065c5833" containerName="util" Jul 20 16:35:50.159550 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:50.159411 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="36403de8-c91d-4fad-9078-a737065c5833" containerName="util" Jul 20 16:35:50.159550 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:50.159466 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="36403de8-c91d-4fad-9078-a737065c5833" containerName="extract" Jul 20 16:35:50.161599 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:50.161582 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5lscj" Jul 20 16:35:50.163908 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:50.163884 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 20 16:35:50.164038 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:50.163885 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 20 16:35:50.164951 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:50.164933 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4lfs8\"" Jul 20 16:35:50.171127 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:50.171104 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5lscj"] Jul 20 16:35:50.287568 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:50.287530 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25d69e66-336a-4f60-87bc-467eaf0df7ec-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5lscj\" (UID: \"25d69e66-336a-4f60-87bc-467eaf0df7ec\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5lscj" Jul 20 16:35:50.287744 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:50.287614 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm426\" (UniqueName: \"kubernetes.io/projected/25d69e66-336a-4f60-87bc-467eaf0df7ec-kube-api-access-gm426\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5lscj\" (UID: \"25d69e66-336a-4f60-87bc-467eaf0df7ec\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5lscj" Jul 20 16:35:50.287744 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:50.287722 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25d69e66-336a-4f60-87bc-467eaf0df7ec-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5lscj\" (UID: \"25d69e66-336a-4f60-87bc-467eaf0df7ec\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5lscj" Jul 20 16:35:50.389135 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:50.389072 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25d69e66-336a-4f60-87bc-467eaf0df7ec-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5lscj\" (UID: \"25d69e66-336a-4f60-87bc-467eaf0df7ec\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5lscj" Jul 20 16:35:50.389291 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:50.389157 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25d69e66-336a-4f60-87bc-467eaf0df7ec-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5lscj\" (UID: \"25d69e66-336a-4f60-87bc-467eaf0df7ec\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5lscj" Jul 20 16:35:50.389291 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:50.389188 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm426\" (UniqueName: \"kubernetes.io/projected/25d69e66-336a-4f60-87bc-467eaf0df7ec-kube-api-access-gm426\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5lscj\" (UID: \"25d69e66-336a-4f60-87bc-467eaf0df7ec\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5lscj" Jul 20 16:35:50.389474 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:50.389454 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25d69e66-336a-4f60-87bc-467eaf0df7ec-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5lscj\" (UID: \"25d69e66-336a-4f60-87bc-467eaf0df7ec\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5lscj" Jul 20 16:35:50.389512 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:50.389481 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25d69e66-336a-4f60-87bc-467eaf0df7ec-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5lscj\" (UID: \"25d69e66-336a-4f60-87bc-467eaf0df7ec\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5lscj" Jul 20 16:35:50.399429 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:50.399397 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm426\" (UniqueName: \"kubernetes.io/projected/25d69e66-336a-4f60-87bc-467eaf0df7ec-kube-api-access-gm426\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5lscj\" (UID: \"25d69e66-336a-4f60-87bc-467eaf0df7ec\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5lscj" Jul 20 16:35:50.471456 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:50.471366 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5lscj" Jul 20 16:35:50.602750 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:50.602725 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5lscj"] Jul 20 16:35:50.605412 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:35:50.605372 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25d69e66_336a_4f60_87bc_467eaf0df7ec.slice/crio-82dc30f934af2c245929d62fb87705615981c2215ffe13f853f199c58d5fb7f5 WatchSource:0}: Error finding container 82dc30f934af2c245929d62fb87705615981c2215ffe13f853f199c58d5fb7f5: Status 404 returned error can't find the container with id 82dc30f934af2c245929d62fb87705615981c2215ffe13f853f199c58d5fb7f5 Jul 20 16:35:50.700273 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:50.700212 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5lscj" event={"ID":"25d69e66-336a-4f60-87bc-467eaf0df7ec","Type":"ContainerStarted","Data":"01a5dc017406f8246c78adb1aff777c2e252665cf448dda525622253f99408fd"} Jul 20 16:35:50.700425 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:50.700306 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5lscj" event={"ID":"25d69e66-336a-4f60-87bc-467eaf0df7ec","Type":"ContainerStarted","Data":"82dc30f934af2c245929d62fb87705615981c2215ffe13f853f199c58d5fb7f5"} Jul 20 16:35:51.706945 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:51.706864 2575 generic.go:356] "Generic (PLEG): container finished" podID="25d69e66-336a-4f60-87bc-467eaf0df7ec" containerID="01a5dc017406f8246c78adb1aff777c2e252665cf448dda525622253f99408fd" exitCode=0 Jul 20 16:35:51.706945 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:51.706911 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5lscj" event={"ID":"25d69e66-336a-4f60-87bc-467eaf0df7ec","Type":"ContainerDied","Data":"01a5dc017406f8246c78adb1aff777c2e252665cf448dda525622253f99408fd"} Jul 20 16:35:52.712960 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:52.712871 2575 generic.go:356] "Generic (PLEG): container finished" podID="25d69e66-336a-4f60-87bc-467eaf0df7ec" containerID="1b7dae95a8634e47ce7396f8c4dbcd4bdad5b009e9db137a3e0bc76c3148b16b" exitCode=0 Jul 20 16:35:52.712960 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:52.712916 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5lscj" event={"ID":"25d69e66-336a-4f60-87bc-467eaf0df7ec","Type":"ContainerDied","Data":"1b7dae95a8634e47ce7396f8c4dbcd4bdad5b009e9db137a3e0bc76c3148b16b"} Jul 20 16:35:53.719184 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:53.719144 2575 generic.go:356] "Generic (PLEG): container finished" podID="25d69e66-336a-4f60-87bc-467eaf0df7ec" containerID="42378cb687c1630b9047b7236ff16e7456ea0d870eb0a8d76da69a79976e64f8" exitCode=0 Jul 20 16:35:53.719577 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:53.719225 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5lscj" event={"ID":"25d69e66-336a-4f60-87bc-467eaf0df7ec","Type":"ContainerDied","Data":"42378cb687c1630b9047b7236ff16e7456ea0d870eb0a8d76da69a79976e64f8"} Jul 20 16:35:54.855234 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:54.855209 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5lscj" Jul 20 16:35:55.039350 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.039325 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25d69e66-336a-4f60-87bc-467eaf0df7ec-bundle\") pod \"25d69e66-336a-4f60-87bc-467eaf0df7ec\" (UID: \"25d69e66-336a-4f60-87bc-467eaf0df7ec\") " Jul 20 16:35:55.039509 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.039401 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25d69e66-336a-4f60-87bc-467eaf0df7ec-util\") pod \"25d69e66-336a-4f60-87bc-467eaf0df7ec\" (UID: \"25d69e66-336a-4f60-87bc-467eaf0df7ec\") " Jul 20 16:35:55.039509 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.039458 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gm426\" (UniqueName: \"kubernetes.io/projected/25d69e66-336a-4f60-87bc-467eaf0df7ec-kube-api-access-gm426\") pod \"25d69e66-336a-4f60-87bc-467eaf0df7ec\" (UID: \"25d69e66-336a-4f60-87bc-467eaf0df7ec\") " Jul 20 16:35:55.040074 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.040046 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25d69e66-336a-4f60-87bc-467eaf0df7ec-bundle" (OuterVolumeSpecName: "bundle") pod "25d69e66-336a-4f60-87bc-467eaf0df7ec" (UID: "25d69e66-336a-4f60-87bc-467eaf0df7ec"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:35:55.041528 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.041497 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25d69e66-336a-4f60-87bc-467eaf0df7ec-kube-api-access-gm426" (OuterVolumeSpecName: "kube-api-access-gm426") pod "25d69e66-336a-4f60-87bc-467eaf0df7ec" (UID: "25d69e66-336a-4f60-87bc-467eaf0df7ec"). InnerVolumeSpecName "kube-api-access-gm426". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:35:55.045151 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.045127 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25d69e66-336a-4f60-87bc-467eaf0df7ec-util" (OuterVolumeSpecName: "util") pod "25d69e66-336a-4f60-87bc-467eaf0df7ec" (UID: "25d69e66-336a-4f60-87bc-467eaf0df7ec"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:35:55.140288 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.140254 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gm426\" (UniqueName: \"kubernetes.io/projected/25d69e66-336a-4f60-87bc-467eaf0df7ec-kube-api-access-gm426\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:35:55.140288 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.140285 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25d69e66-336a-4f60-87bc-467eaf0df7ec-bundle\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:35:55.140288 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.140294 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25d69e66-336a-4f60-87bc-467eaf0df7ec-util\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:35:55.155884 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.155855 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6775c44bcb-8k9cz"] Jul 20 16:35:55.156242 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.156230 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25d69e66-336a-4f60-87bc-467eaf0df7ec" containerName="extract" Jul 20 16:35:55.156288 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.156244 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="25d69e66-336a-4f60-87bc-467eaf0df7ec" containerName="extract" Jul 20 16:35:55.156288 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.156268 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25d69e66-336a-4f60-87bc-467eaf0df7ec" containerName="pull" Jul 20 16:35:55.156288 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.156274 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="25d69e66-336a-4f60-87bc-467eaf0df7ec" containerName="pull" Jul 20 16:35:55.156288 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.156281 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25d69e66-336a-4f60-87bc-467eaf0df7ec" containerName="util" Jul 20 16:35:55.156288 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.156286 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="25d69e66-336a-4f60-87bc-467eaf0df7ec" containerName="util" Jul 20 16:35:55.156438 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.156351 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="25d69e66-336a-4f60-87bc-467eaf0df7ec" containerName="extract" Jul 20 16:35:55.158355 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.158336 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6775c44bcb-8k9cz" Jul 20 16:35:55.161236 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.161212 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 20 16:35:55.161236 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.161226 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 20 16:35:55.161412 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.161228 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-54bn7\"" Jul 20 16:35:55.161412 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.161212 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 20 16:35:55.161412 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.161268 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 20 16:35:55.161663 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.161644 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 20 16:35:55.172096 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.172059 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6775c44bcb-8k9cz"] Jul 20 16:35:55.342967 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.342872 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw8fs\" (UniqueName: \"kubernetes.io/projected/d92e6f2f-4404-43bd-b460-6811be1b450f-kube-api-access-bw8fs\") pod \"lws-controller-manager-6775c44bcb-8k9cz\" (UID: \"d92e6f2f-4404-43bd-b460-6811be1b450f\") " pod="openshift-lws-operator/lws-controller-manager-6775c44bcb-8k9cz" Jul 20 16:35:55.342967 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.342916 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d92e6f2f-4404-43bd-b460-6811be1b450f-manager-config\") pod \"lws-controller-manager-6775c44bcb-8k9cz\" (UID: \"d92e6f2f-4404-43bd-b460-6811be1b450f\") " pod="openshift-lws-operator/lws-controller-manager-6775c44bcb-8k9cz" Jul 20 16:35:55.343243 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.343044 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d92e6f2f-4404-43bd-b460-6811be1b450f-metrics-cert\") pod \"lws-controller-manager-6775c44bcb-8k9cz\" (UID: \"d92e6f2f-4404-43bd-b460-6811be1b450f\") " pod="openshift-lws-operator/lws-controller-manager-6775c44bcb-8k9cz" Jul 20 16:35:55.343243 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.343171 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d92e6f2f-4404-43bd-b460-6811be1b450f-cert\") pod \"lws-controller-manager-6775c44bcb-8k9cz\" (UID: \"d92e6f2f-4404-43bd-b460-6811be1b450f\") " pod="openshift-lws-operator/lws-controller-manager-6775c44bcb-8k9cz" Jul 20 16:35:55.444451 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.444413 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d92e6f2f-4404-43bd-b460-6811be1b450f-cert\") pod \"lws-controller-manager-6775c44bcb-8k9cz\" (UID: \"d92e6f2f-4404-43bd-b460-6811be1b450f\") " pod="openshift-lws-operator/lws-controller-manager-6775c44bcb-8k9cz" Jul 20 16:35:55.444451 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.444452 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw8fs\" (UniqueName: \"kubernetes.io/projected/d92e6f2f-4404-43bd-b460-6811be1b450f-kube-api-access-bw8fs\") pod \"lws-controller-manager-6775c44bcb-8k9cz\" (UID: \"d92e6f2f-4404-43bd-b460-6811be1b450f\") " pod="openshift-lws-operator/lws-controller-manager-6775c44bcb-8k9cz" Jul 20 16:35:55.444741 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.444479 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d92e6f2f-4404-43bd-b460-6811be1b450f-manager-config\") pod \"lws-controller-manager-6775c44bcb-8k9cz\" (UID: \"d92e6f2f-4404-43bd-b460-6811be1b450f\") " pod="openshift-lws-operator/lws-controller-manager-6775c44bcb-8k9cz" Jul 20 16:35:55.444741 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.444522 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d92e6f2f-4404-43bd-b460-6811be1b450f-metrics-cert\") pod \"lws-controller-manager-6775c44bcb-8k9cz\" (UID: \"d92e6f2f-4404-43bd-b460-6811be1b450f\") " pod="openshift-lws-operator/lws-controller-manager-6775c44bcb-8k9cz" Jul 20 16:35:55.445281 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.445260 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d92e6f2f-4404-43bd-b460-6811be1b450f-manager-config\") pod \"lws-controller-manager-6775c44bcb-8k9cz\" (UID: \"d92e6f2f-4404-43bd-b460-6811be1b450f\") " pod="openshift-lws-operator/lws-controller-manager-6775c44bcb-8k9cz" Jul 20 16:35:55.447027 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.447001 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d92e6f2f-4404-43bd-b460-6811be1b450f-metrics-cert\") pod \"lws-controller-manager-6775c44bcb-8k9cz\" (UID: \"d92e6f2f-4404-43bd-b460-6811be1b450f\") " pod="openshift-lws-operator/lws-controller-manager-6775c44bcb-8k9cz" Jul 20 16:35:55.447153 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.447069 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d92e6f2f-4404-43bd-b460-6811be1b450f-cert\") pod \"lws-controller-manager-6775c44bcb-8k9cz\" (UID: \"d92e6f2f-4404-43bd-b460-6811be1b450f\") " pod="openshift-lws-operator/lws-controller-manager-6775c44bcb-8k9cz" Jul 20 16:35:55.452129 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.452109 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw8fs\" (UniqueName: \"kubernetes.io/projected/d92e6f2f-4404-43bd-b460-6811be1b450f-kube-api-access-bw8fs\") pod \"lws-controller-manager-6775c44bcb-8k9cz\" (UID: \"d92e6f2f-4404-43bd-b460-6811be1b450f\") " pod="openshift-lws-operator/lws-controller-manager-6775c44bcb-8k9cz" Jul 20 16:35:55.467237 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.467216 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6775c44bcb-8k9cz" Jul 20 16:35:55.600126 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.600005 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6775c44bcb-8k9cz"] Jul 20 16:35:55.602308 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:35:55.602286 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd92e6f2f_4404_43bd_b460_6811be1b450f.slice/crio-f3e27f5915942d4b2fde57a34372cba2e98d8a459e939a319a0182eabdee196c WatchSource:0}: Error finding container f3e27f5915942d4b2fde57a34372cba2e98d8a459e939a319a0182eabdee196c: Status 404 returned error can't find the container with id f3e27f5915942d4b2fde57a34372cba2e98d8a459e939a319a0182eabdee196c Jul 20 16:35:55.737508 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.737452 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5lscj" event={"ID":"25d69e66-336a-4f60-87bc-467eaf0df7ec","Type":"ContainerDied","Data":"82dc30f934af2c245929d62fb87705615981c2215ffe13f853f199c58d5fb7f5"} Jul 20 16:35:55.737692 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.737592 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="82dc30f934af2c245929d62fb87705615981c2215ffe13f853f199c58d5fb7f5" Jul 20 16:35:55.737692 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.737483 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5lscj" Jul 20 16:35:55.738695 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:55.738670 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6775c44bcb-8k9cz" event={"ID":"d92e6f2f-4404-43bd-b460-6811be1b450f","Type":"ContainerStarted","Data":"f3e27f5915942d4b2fde57a34372cba2e98d8a459e939a319a0182eabdee196c"} Jul 20 16:35:57.750674 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:57.750637 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6775c44bcb-8k9cz" event={"ID":"d92e6f2f-4404-43bd-b460-6811be1b450f","Type":"ContainerStarted","Data":"da8d302c5767031f741b276b87cc878deccf6227d573b8214242d195f899bf38"} Jul 20 16:35:57.751038 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:57.750705 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6775c44bcb-8k9cz" Jul 20 16:35:57.768351 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:35:57.768305 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6775c44bcb-8k9cz" podStartSLOduration=1.10673952 podStartE2EDuration="2.768289859s" totalImagesPullingTime="1.661550339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:35:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:35:57.767266725 +0000 UTC m=+383.418149226" watchObservedRunningTime="2026-07-20 16:35:57.768289859 +0000 UTC m=+383.419172357" Jul 20 16:36:07.514287 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:07.514252 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9d55867bb-5zffd"] Jul 20 16:36:07.553368 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:07.553337 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9d55867bb-5zffd"] Jul 20 16:36:07.553518 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:07.553448 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-5zffd" Jul 20 16:36:07.556878 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:07.556852 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 20 16:36:07.557040 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:07.556856 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 20 16:36:07.557040 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:07.556992 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 20 16:36:07.557169 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:07.557070 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gt9k8\"" Jul 20 16:36:07.557250 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:07.557220 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 20 16:36:07.634855 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:07.634820 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0-manifests\") pod \"opendatahub-operator-controller-manager-9d55867bb-5zffd\" (UID: \"e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0\") " pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-5zffd" Jul 20 16:36:07.635019 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:07.634867 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0-tmp\") pod \"opendatahub-operator-controller-manager-9d55867bb-5zffd\" (UID: \"e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0\") " pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-5zffd" Jul 20 16:36:07.635019 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:07.634949 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9d55867bb-5zffd\" (UID: \"e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0\") " pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-5zffd" Jul 20 16:36:07.635019 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:07.634978 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw6hj\" (UniqueName: \"kubernetes.io/projected/e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0-kube-api-access-mw6hj\") pod \"opendatahub-operator-controller-manager-9d55867bb-5zffd\" (UID: \"e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0\") " pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-5zffd" Jul 20 16:36:07.635019 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:07.635013 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0-webhook-cert\") pod \"opendatahub-operator-controller-manager-9d55867bb-5zffd\" (UID: \"e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0\") " pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-5zffd" Jul 20 16:36:07.735379 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:07.735344 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9d55867bb-5zffd\" (UID: \"e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0\") " pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-5zffd" Jul 20 16:36:07.735379 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:07.735378 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw6hj\" (UniqueName: \"kubernetes.io/projected/e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0-kube-api-access-mw6hj\") pod \"opendatahub-operator-controller-manager-9d55867bb-5zffd\" (UID: \"e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0\") " pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-5zffd" Jul 20 16:36:07.735587 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:07.735405 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0-webhook-cert\") pod \"opendatahub-operator-controller-manager-9d55867bb-5zffd\" (UID: \"e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0\") " pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-5zffd" Jul 20 16:36:07.735587 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:07.735437 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0-manifests\") pod \"opendatahub-operator-controller-manager-9d55867bb-5zffd\" (UID: \"e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0\") " pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-5zffd" Jul 20 16:36:07.735587 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:07.735464 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0-tmp\") pod \"opendatahub-operator-controller-manager-9d55867bb-5zffd\" (UID: \"e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0\") " pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-5zffd" Jul 20 16:36:07.735911 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:07.735889 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0-manifests\") pod \"opendatahub-operator-controller-manager-9d55867bb-5zffd\" (UID: \"e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0\") " pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-5zffd" Jul 20 16:36:07.737741 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:07.737721 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0-tmp\") pod \"opendatahub-operator-controller-manager-9d55867bb-5zffd\" (UID: \"e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0\") " pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-5zffd" Jul 20 16:36:07.737866 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:07.737848 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0-webhook-cert\") pod \"opendatahub-operator-controller-manager-9d55867bb-5zffd\" (UID: \"e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0\") " pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-5zffd" Jul 20 16:36:07.737974 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:07.737957 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9d55867bb-5zffd\" (UID: \"e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0\") " pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-5zffd" Jul 20 16:36:07.743477 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:07.743453 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw6hj\" (UniqueName: \"kubernetes.io/projected/e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0-kube-api-access-mw6hj\") pod \"opendatahub-operator-controller-manager-9d55867bb-5zffd\" (UID: \"e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0\") " pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-5zffd" Jul 20 16:36:07.864408 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:07.864377 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-5zffd" Jul 20 16:36:08.015225 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:08.015199 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9d55867bb-5zffd"] Jul 20 16:36:08.017847 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:36:08.017817 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2660ebd_e9eb_4ecb_a7f7_c09edd4798c0.slice/crio-a569cf7a6cb7b05ba0c9de4d9088aa8de6b82f025e14f3ba43df107b0135f479 WatchSource:0}: Error finding container a569cf7a6cb7b05ba0c9de4d9088aa8de6b82f025e14f3ba43df107b0135f479: Status 404 returned error can't find the container with id a569cf7a6cb7b05ba0c9de4d9088aa8de6b82f025e14f3ba43df107b0135f479 Jul 20 16:36:08.758724 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:08.758542 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6775c44bcb-8k9cz" Jul 20 16:36:08.806790 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:08.806705 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-5zffd" event={"ID":"e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0","Type":"ContainerStarted","Data":"a569cf7a6cb7b05ba0c9de4d9088aa8de6b82f025e14f3ba43df107b0135f479"} Jul 20 16:36:11.824701 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:11.824668 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-5zffd" event={"ID":"e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0","Type":"ContainerStarted","Data":"c8b4cbfd83917713873116d0cd2884d52e382ae8cc869e6d0196eccc14bb3f76"} Jul 20 16:36:12.830850 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:12.830815 2575 generic.go:356] "Generic (PLEG): container finished" podID="e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0" containerID="c8b4cbfd83917713873116d0cd2884d52e382ae8cc869e6d0196eccc14bb3f76" exitCode=0 Jul 20 16:36:12.831279 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:12.830887 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-5zffd" event={"ID":"e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0","Type":"ContainerDied","Data":"c8b4cbfd83917713873116d0cd2884d52e382ae8cc869e6d0196eccc14bb3f76"} Jul 20 16:36:13.838159 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:13.838123 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-5zffd" event={"ID":"e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0","Type":"ContainerStarted","Data":"22b0c3f12fc9807f9ed2a74be72a8d15e5681ecf3734063a042301545d1058cf"} Jul 20 16:36:13.838635 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:13.838224 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-5zffd" Jul 20 16:36:13.868643 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:13.868590 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-5zffd" podStartSLOduration=1.999828196 podStartE2EDuration="6.868574094s" totalImagesPullingTime="3.776274482s" totalInitContainerRuntime="1.092471416s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:36:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:36:13.866625297 +0000 UTC m=+399.517507812" watchObservedRunningTime="2026-07-20 16:36:13.868574094 +0000 UTC m=+399.519456592" Jul 20 16:36:24.844533 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:24.844505 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9d55867bb-5zffd" Jul 20 16:36:36.969889 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:36.969853 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-p6m8f"] Jul 20 16:36:36.975853 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:36.975828 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-p6m8f" Jul 20 16:36:36.982444 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:36.982418 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-wqq2g\"" Jul 20 16:36:36.982559 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:36.982468 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 20 16:36:36.987308 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:36.987286 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-p6m8f"] Jul 20 16:36:36.989271 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:36.989244 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-rm6gj"] Jul 20 16:36:36.993624 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:36.993606 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rm6gj" Jul 20 16:36:36.995938 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:36.995916 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 20 16:36:36.996047 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:36.995994 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-t4mwn\"" Jul 20 16:36:37.003701 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:37.003675 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-rm6gj"] Jul 20 16:36:37.105241 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:37.105209 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh7gh\" (UniqueName: \"kubernetes.io/projected/86060b94-ae8c-40c8-aabd-d1e7e2f57551-kube-api-access-dh7gh\") pod \"kserve-controller-manager-d6f4b65b8-p6m8f\" (UID: \"86060b94-ae8c-40c8-aabd-d1e7e2f57551\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-p6m8f" Jul 20 16:36:37.105241 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:37.105253 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27426379-57c1-4039-9806-d47166bc988b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rm6gj\" (UID: \"27426379-57c1-4039-9806-d47166bc988b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rm6gj" Jul 20 16:36:37.105452 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:37.105331 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86060b94-ae8c-40c8-aabd-d1e7e2f57551-cert\") pod \"kserve-controller-manager-d6f4b65b8-p6m8f\" (UID: \"86060b94-ae8c-40c8-aabd-d1e7e2f57551\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-p6m8f" Jul 20 16:36:37.105452 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:37.105384 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txw7c\" (UniqueName: \"kubernetes.io/projected/27426379-57c1-4039-9806-d47166bc988b-kube-api-access-txw7c\") pod \"llmisvc-controller-manager-777c6bd7d5-rm6gj\" (UID: \"27426379-57c1-4039-9806-d47166bc988b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rm6gj" Jul 20 16:36:37.206243 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:37.206211 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86060b94-ae8c-40c8-aabd-d1e7e2f57551-cert\") pod \"kserve-controller-manager-d6f4b65b8-p6m8f\" (UID: \"86060b94-ae8c-40c8-aabd-d1e7e2f57551\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-p6m8f" Jul 20 16:36:37.206442 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:37.206258 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txw7c\" (UniqueName: \"kubernetes.io/projected/27426379-57c1-4039-9806-d47166bc988b-kube-api-access-txw7c\") pod \"llmisvc-controller-manager-777c6bd7d5-rm6gj\" (UID: \"27426379-57c1-4039-9806-d47166bc988b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rm6gj" Jul 20 16:36:37.206442 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:37.206316 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh7gh\" (UniqueName: \"kubernetes.io/projected/86060b94-ae8c-40c8-aabd-d1e7e2f57551-kube-api-access-dh7gh\") pod \"kserve-controller-manager-d6f4b65b8-p6m8f\" (UID: \"86060b94-ae8c-40c8-aabd-d1e7e2f57551\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-p6m8f" Jul 20 16:36:37.206442 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:37.206340 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27426379-57c1-4039-9806-d47166bc988b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rm6gj\" (UID: \"27426379-57c1-4039-9806-d47166bc988b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rm6gj" Jul 20 16:36:37.208714 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:37.208689 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27426379-57c1-4039-9806-d47166bc988b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rm6gj\" (UID: \"27426379-57c1-4039-9806-d47166bc988b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rm6gj" Jul 20 16:36:37.208814 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:37.208689 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86060b94-ae8c-40c8-aabd-d1e7e2f57551-cert\") pod \"kserve-controller-manager-d6f4b65b8-p6m8f\" (UID: \"86060b94-ae8c-40c8-aabd-d1e7e2f57551\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-p6m8f" Jul 20 16:36:37.223699 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:37.223641 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh7gh\" (UniqueName: \"kubernetes.io/projected/86060b94-ae8c-40c8-aabd-d1e7e2f57551-kube-api-access-dh7gh\") pod \"kserve-controller-manager-d6f4b65b8-p6m8f\" (UID: \"86060b94-ae8c-40c8-aabd-d1e7e2f57551\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-p6m8f" Jul 20 16:36:37.223699 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:37.223677 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txw7c\" (UniqueName: \"kubernetes.io/projected/27426379-57c1-4039-9806-d47166bc988b-kube-api-access-txw7c\") pod \"llmisvc-controller-manager-777c6bd7d5-rm6gj\" (UID: \"27426379-57c1-4039-9806-d47166bc988b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rm6gj" Jul 20 16:36:37.293738 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:37.293702 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-p6m8f" Jul 20 16:36:37.303920 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:37.303891 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rm6gj" Jul 20 16:36:37.441282 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:37.441251 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-p6m8f"] Jul 20 16:36:37.443215 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:36:37.443191 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86060b94_ae8c_40c8_aabd_d1e7e2f57551.slice/crio-0e7a9f8cdef75dca2c2b0ea88c217707656eba0a279e6bdc96b3f9e6423a193d WatchSource:0}: Error finding container 0e7a9f8cdef75dca2c2b0ea88c217707656eba0a279e6bdc96b3f9e6423a193d: Status 404 returned error can't find the container with id 0e7a9f8cdef75dca2c2b0ea88c217707656eba0a279e6bdc96b3f9e6423a193d Jul 20 16:36:37.463431 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:37.463409 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-rm6gj"] Jul 20 16:36:37.465236 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:36:37.465215 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod27426379_57c1_4039_9806_d47166bc988b.slice/crio-1faeaee8f614bf93c81e46259118f19481ec48bac87650161c6a4519753f8ddc WatchSource:0}: Error finding container 1faeaee8f614bf93c81e46259118f19481ec48bac87650161c6a4519753f8ddc: Status 404 returned error can't find the container with id 1faeaee8f614bf93c81e46259118f19481ec48bac87650161c6a4519753f8ddc Jul 20 16:36:37.953266 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:37.953230 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-p6m8f" event={"ID":"86060b94-ae8c-40c8-aabd-d1e7e2f57551","Type":"ContainerStarted","Data":"0e7a9f8cdef75dca2c2b0ea88c217707656eba0a279e6bdc96b3f9e6423a193d"} Jul 20 16:36:37.954294 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:37.954268 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rm6gj" event={"ID":"27426379-57c1-4039-9806-d47166bc988b","Type":"ContainerStarted","Data":"1faeaee8f614bf93c81e46259118f19481ec48bac87650161c6a4519753f8ddc"} Jul 20 16:36:40.973843 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:40.973806 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-p6m8f" event={"ID":"86060b94-ae8c-40c8-aabd-d1e7e2f57551","Type":"ContainerStarted","Data":"595aa3fb2e18a46cf32bda17005c56e4ed6a9d0563b6c29393ad865cdedaf0bc"} Jul 20 16:36:40.974289 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:40.973970 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-p6m8f" Jul 20 16:36:40.991606 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:40.991560 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-p6m8f" podStartSLOduration=2.529404071 podStartE2EDuration="4.991543581s" totalImagesPullingTime="2.46213951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:36:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:36:40.99000337 +0000 UTC m=+426.640885877" watchObservedRunningTime="2026-07-20 16:36:40.991543581 +0000 UTC m=+426.642426079" Jul 20 16:36:41.980554 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:41.980513 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rm6gj" event={"ID":"27426379-57c1-4039-9806-d47166bc988b","Type":"ContainerStarted","Data":"152eee5584b28b6665e462b7878a9493a6e02a9c6abeb1123c551291048a2b7b"} Jul 20 16:36:42.001033 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:42.000977 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rm6gj" podStartSLOduration=2.414122815 podStartE2EDuration="6.000962567s" totalImagesPullingTime="3.586839752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:36:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:36:42.000048519 +0000 UTC m=+427.650931047" watchObservedRunningTime="2026-07-20 16:36:42.000962567 +0000 UTC m=+427.651845065" Jul 20 16:36:42.985166 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:36:42.985139 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rm6gj" Jul 20 16:37:11.985557 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:11.985474 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-p6m8f" Jul 20 16:37:13.992358 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:13.992326 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rm6gj" Jul 20 16:37:28.174805 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:28.174769 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-frlpm"] Jul 20 16:37:28.178290 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:28.178263 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-frlpm" Jul 20 16:37:28.181402 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:28.181376 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 20 16:37:28.181620 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:28.181513 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 20 16:37:28.181841 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:28.181619 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-jrbr5\"" Jul 20 16:37:28.195417 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:28.195395 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-frlpm"] Jul 20 16:37:28.348481 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:28.348446 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwqxf\" (UniqueName: \"kubernetes.io/projected/639d32f5-4904-4371-b9d7-d39e18eed5e1-kube-api-access-mwqxf\") pod \"kuadrant-operator-catalog-frlpm\" (UID: \"639d32f5-4904-4371-b9d7-d39e18eed5e1\") " pod="kuadrant-system/kuadrant-operator-catalog-frlpm" Jul 20 16:37:28.449318 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:28.449231 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwqxf\" (UniqueName: \"kubernetes.io/projected/639d32f5-4904-4371-b9d7-d39e18eed5e1-kube-api-access-mwqxf\") pod \"kuadrant-operator-catalog-frlpm\" (UID: \"639d32f5-4904-4371-b9d7-d39e18eed5e1\") " pod="kuadrant-system/kuadrant-operator-catalog-frlpm" Jul 20 16:37:28.456957 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:28.456937 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwqxf\" (UniqueName: \"kubernetes.io/projected/639d32f5-4904-4371-b9d7-d39e18eed5e1-kube-api-access-mwqxf\") pod \"kuadrant-operator-catalog-frlpm\" (UID: \"639d32f5-4904-4371-b9d7-d39e18eed5e1\") " pod="kuadrant-system/kuadrant-operator-catalog-frlpm" Jul 20 16:37:28.488730 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:28.488689 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-frlpm" Jul 20 16:37:28.496685 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:28.496654 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-frlpm"] Jul 20 16:37:28.619862 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:28.619832 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-frlpm"] Jul 20 16:37:28.622821 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:37:28.622793 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod639d32f5_4904_4371_b9d7_d39e18eed5e1.slice/crio-5768b6b6e5c5af352d4d5c6293c6e4b03b071082871a5f7210d9e717baec5cec WatchSource:0}: Error finding container 5768b6b6e5c5af352d4d5c6293c6e4b03b071082871a5f7210d9e717baec5cec: Status 404 returned error can't find the container with id 5768b6b6e5c5af352d4d5c6293c6e4b03b071082871a5f7210d9e717baec5cec Jul 20 16:37:28.706349 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:28.706262 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hvf8w"] Jul 20 16:37:28.710828 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:28.710811 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hvf8w" Jul 20 16:37:28.717890 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:28.717863 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hvf8w"] Jul 20 16:37:28.853535 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:28.853508 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nrzj\" (UniqueName: \"kubernetes.io/projected/f72bc7da-b5e2-455e-80d5-485d5b376a03-kube-api-access-8nrzj\") pod \"kuadrant-operator-catalog-hvf8w\" (UID: \"f72bc7da-b5e2-455e-80d5-485d5b376a03\") " pod="kuadrant-system/kuadrant-operator-catalog-hvf8w" Jul 20 16:37:28.954097 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:28.954049 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nrzj\" (UniqueName: \"kubernetes.io/projected/f72bc7da-b5e2-455e-80d5-485d5b376a03-kube-api-access-8nrzj\") pod \"kuadrant-operator-catalog-hvf8w\" (UID: \"f72bc7da-b5e2-455e-80d5-485d5b376a03\") " pod="kuadrant-system/kuadrant-operator-catalog-hvf8w" Jul 20 16:37:28.962752 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:28.962689 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nrzj\" (UniqueName: \"kubernetes.io/projected/f72bc7da-b5e2-455e-80d5-485d5b376a03-kube-api-access-8nrzj\") pod \"kuadrant-operator-catalog-hvf8w\" (UID: \"f72bc7da-b5e2-455e-80d5-485d5b376a03\") " pod="kuadrant-system/kuadrant-operator-catalog-hvf8w" Jul 20 16:37:29.022423 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:29.022394 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hvf8w" Jul 20 16:37:29.160850 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:29.160824 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hvf8w"] Jul 20 16:37:29.163198 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:37:29.163171 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf72bc7da_b5e2_455e_80d5_485d5b376a03.slice/crio-4c6bb50b2cb0949963b2f2362caf0ad196aae58be9acbda4340ea2828a0a2470 WatchSource:0}: Error finding container 4c6bb50b2cb0949963b2f2362caf0ad196aae58be9acbda4340ea2828a0a2470: Status 404 returned error can't find the container with id 4c6bb50b2cb0949963b2f2362caf0ad196aae58be9acbda4340ea2828a0a2470 Jul 20 16:37:29.215600 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:29.215530 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hvf8w" event={"ID":"f72bc7da-b5e2-455e-80d5-485d5b376a03","Type":"ContainerStarted","Data":"4c6bb50b2cb0949963b2f2362caf0ad196aae58be9acbda4340ea2828a0a2470"} Jul 20 16:37:29.216696 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:29.216672 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-frlpm" event={"ID":"639d32f5-4904-4371-b9d7-d39e18eed5e1","Type":"ContainerStarted","Data":"5768b6b6e5c5af352d4d5c6293c6e4b03b071082871a5f7210d9e717baec5cec"} Jul 20 16:37:31.228473 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:31.228373 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hvf8w" event={"ID":"f72bc7da-b5e2-455e-80d5-485d5b376a03","Type":"ContainerStarted","Data":"d0f14585504a0f8f4ab33566aba583576993e37ce338eef43892cb769c59a8d2"} Jul 20 16:37:31.229856 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:31.229828 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-frlpm" event={"ID":"639d32f5-4904-4371-b9d7-d39e18eed5e1","Type":"ContainerStarted","Data":"2766c93a9ec2049aa303c30f880465744d487f06310e97a3fef1db66e3e4c2a4"} Jul 20 16:37:31.229960 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:31.229873 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-frlpm" podUID="639d32f5-4904-4371-b9d7-d39e18eed5e1" containerName="registry-server" containerID="cri-o://2766c93a9ec2049aa303c30f880465744d487f06310e97a3fef1db66e3e4c2a4" gracePeriod=2 Jul 20 16:37:31.245152 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:31.245108 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-hvf8w" podStartSLOduration=1.53151368 podStartE2EDuration="3.245073711s" totalImagesPullingTime="1.713560031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:37:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:37:31.243593112 +0000 UTC m=+476.894475612" watchObservedRunningTime="2026-07-20 16:37:31.245073711 +0000 UTC m=+476.895956209" Jul 20 16:37:31.258140 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:31.258074 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-frlpm" podStartSLOduration=1.007151118 podStartE2EDuration="3.258059755s" totalImagesPullingTime="2.250908637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:37:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:37:31.257742719 +0000 UTC m=+476.908625216" watchObservedRunningTime="2026-07-20 16:37:31.258059755 +0000 UTC m=+476.908942252" Jul 20 16:37:31.488594 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:31.488540 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-frlpm" Jul 20 16:37:31.578001 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:31.577966 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwqxf\" (UniqueName: \"kubernetes.io/projected/639d32f5-4904-4371-b9d7-d39e18eed5e1-kube-api-access-mwqxf\") pod \"639d32f5-4904-4371-b9d7-d39e18eed5e1\" (UID: \"639d32f5-4904-4371-b9d7-d39e18eed5e1\") " Jul 20 16:37:31.580177 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:31.580149 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/639d32f5-4904-4371-b9d7-d39e18eed5e1-kube-api-access-mwqxf" (OuterVolumeSpecName: "kube-api-access-mwqxf") pod "639d32f5-4904-4371-b9d7-d39e18eed5e1" (UID: "639d32f5-4904-4371-b9d7-d39e18eed5e1"). InnerVolumeSpecName "kube-api-access-mwqxf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:37:31.679443 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:31.679410 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwqxf\" (UniqueName: \"kubernetes.io/projected/639d32f5-4904-4371-b9d7-d39e18eed5e1-kube-api-access-mwqxf\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:37:32.236341 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:32.236251 2575 generic.go:356] "Generic (PLEG): container finished" podID="639d32f5-4904-4371-b9d7-d39e18eed5e1" containerID="2766c93a9ec2049aa303c30f880465744d487f06310e97a3fef1db66e3e4c2a4" exitCode=0 Jul 20 16:37:32.236341 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:32.236305 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-frlpm" Jul 20 16:37:32.236341 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:32.236342 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-frlpm" event={"ID":"639d32f5-4904-4371-b9d7-d39e18eed5e1","Type":"ContainerDied","Data":"2766c93a9ec2049aa303c30f880465744d487f06310e97a3fef1db66e3e4c2a4"} Jul 20 16:37:32.236889 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:32.236395 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-frlpm" event={"ID":"639d32f5-4904-4371-b9d7-d39e18eed5e1","Type":"ContainerDied","Data":"5768b6b6e5c5af352d4d5c6293c6e4b03b071082871a5f7210d9e717baec5cec"} Jul 20 16:37:32.236889 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:32.236421 2575 scope.go:117] "RemoveContainer" containerID="2766c93a9ec2049aa303c30f880465744d487f06310e97a3fef1db66e3e4c2a4" Jul 20 16:37:32.245508 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:32.245484 2575 scope.go:117] "RemoveContainer" containerID="2766c93a9ec2049aa303c30f880465744d487f06310e97a3fef1db66e3e4c2a4" Jul 20 16:37:32.245760 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:37:32.245741 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2766c93a9ec2049aa303c30f880465744d487f06310e97a3fef1db66e3e4c2a4\": container with ID starting with 2766c93a9ec2049aa303c30f880465744d487f06310e97a3fef1db66e3e4c2a4 not found: ID does not exist" containerID="2766c93a9ec2049aa303c30f880465744d487f06310e97a3fef1db66e3e4c2a4" Jul 20 16:37:32.245829 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:32.245769 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2766c93a9ec2049aa303c30f880465744d487f06310e97a3fef1db66e3e4c2a4"} err="failed to get container status \"2766c93a9ec2049aa303c30f880465744d487f06310e97a3fef1db66e3e4c2a4\": rpc error: code = NotFound desc = could not find container \"2766c93a9ec2049aa303c30f880465744d487f06310e97a3fef1db66e3e4c2a4\": container with ID starting with 2766c93a9ec2049aa303c30f880465744d487f06310e97a3fef1db66e3e4c2a4 not found: ID does not exist" Jul 20 16:37:32.256723 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:32.256697 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-frlpm"] Jul 20 16:37:32.260371 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:32.260350 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-frlpm"] Jul 20 16:37:32.853186 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:32.853152 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="639d32f5-4904-4371-b9d7-d39e18eed5e1" path="/var/lib/kubelet/pods/639d32f5-4904-4371-b9d7-d39e18eed5e1/volumes" Jul 20 16:37:37.795465 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:37.795421 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f596f5875-z7ltl"] Jul 20 16:37:37.796070 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:37.796045 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="639d32f5-4904-4371-b9d7-d39e18eed5e1" containerName="registry-server" Jul 20 16:37:37.796159 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:37.796076 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="639d32f5-4904-4371-b9d7-d39e18eed5e1" containerName="registry-server" Jul 20 16:37:37.796251 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:37.796235 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="639d32f5-4904-4371-b9d7-d39e18eed5e1" containerName="registry-server" Jul 20 16:37:37.801412 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:37.801390 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f596f5875-z7ltl" Jul 20 16:37:37.807910 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:37.807879 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f596f5875-z7ltl"] Jul 20 16:37:37.935816 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:37.935783 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a1cf680-8a22-48c0-a19d-5e126eaf951e-console-serving-cert\") pod \"console-7f596f5875-z7ltl\" (UID: \"9a1cf680-8a22-48c0-a19d-5e126eaf951e\") " pod="openshift-console/console-7f596f5875-z7ltl" Jul 20 16:37:37.936016 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:37.935851 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a1cf680-8a22-48c0-a19d-5e126eaf951e-trusted-ca-bundle\") pod \"console-7f596f5875-z7ltl\" (UID: \"9a1cf680-8a22-48c0-a19d-5e126eaf951e\") " pod="openshift-console/console-7f596f5875-z7ltl" Jul 20 16:37:37.936016 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:37.935891 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a1cf680-8a22-48c0-a19d-5e126eaf951e-service-ca\") pod \"console-7f596f5875-z7ltl\" (UID: \"9a1cf680-8a22-48c0-a19d-5e126eaf951e\") " pod="openshift-console/console-7f596f5875-z7ltl" Jul 20 16:37:37.936016 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:37.935914 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l84qp\" (UniqueName: \"kubernetes.io/projected/9a1cf680-8a22-48c0-a19d-5e126eaf951e-kube-api-access-l84qp\") pod \"console-7f596f5875-z7ltl\" (UID: \"9a1cf680-8a22-48c0-a19d-5e126eaf951e\") " pod="openshift-console/console-7f596f5875-z7ltl" Jul 20 16:37:37.936218 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:37.936005 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a1cf680-8a22-48c0-a19d-5e126eaf951e-oauth-serving-cert\") pod \"console-7f596f5875-z7ltl\" (UID: \"9a1cf680-8a22-48c0-a19d-5e126eaf951e\") " pod="openshift-console/console-7f596f5875-z7ltl" Jul 20 16:37:37.936218 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:37.936076 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a1cf680-8a22-48c0-a19d-5e126eaf951e-console-oauth-config\") pod \"console-7f596f5875-z7ltl\" (UID: \"9a1cf680-8a22-48c0-a19d-5e126eaf951e\") " pod="openshift-console/console-7f596f5875-z7ltl" Jul 20 16:37:37.936218 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:37.936138 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a1cf680-8a22-48c0-a19d-5e126eaf951e-console-config\") pod \"console-7f596f5875-z7ltl\" (UID: \"9a1cf680-8a22-48c0-a19d-5e126eaf951e\") " pod="openshift-console/console-7f596f5875-z7ltl" Jul 20 16:37:38.037201 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:38.037161 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a1cf680-8a22-48c0-a19d-5e126eaf951e-trusted-ca-bundle\") pod \"console-7f596f5875-z7ltl\" (UID: \"9a1cf680-8a22-48c0-a19d-5e126eaf951e\") " pod="openshift-console/console-7f596f5875-z7ltl" Jul 20 16:37:38.037397 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:38.037221 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a1cf680-8a22-48c0-a19d-5e126eaf951e-service-ca\") pod \"console-7f596f5875-z7ltl\" (UID: \"9a1cf680-8a22-48c0-a19d-5e126eaf951e\") " pod="openshift-console/console-7f596f5875-z7ltl" Jul 20 16:37:38.037397 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:38.037248 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l84qp\" (UniqueName: \"kubernetes.io/projected/9a1cf680-8a22-48c0-a19d-5e126eaf951e-kube-api-access-l84qp\") pod \"console-7f596f5875-z7ltl\" (UID: \"9a1cf680-8a22-48c0-a19d-5e126eaf951e\") " pod="openshift-console/console-7f596f5875-z7ltl" Jul 20 16:37:38.037397 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:38.037277 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a1cf680-8a22-48c0-a19d-5e126eaf951e-oauth-serving-cert\") pod \"console-7f596f5875-z7ltl\" (UID: \"9a1cf680-8a22-48c0-a19d-5e126eaf951e\") " pod="openshift-console/console-7f596f5875-z7ltl" Jul 20 16:37:38.037397 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:38.037351 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a1cf680-8a22-48c0-a19d-5e126eaf951e-console-oauth-config\") pod \"console-7f596f5875-z7ltl\" (UID: \"9a1cf680-8a22-48c0-a19d-5e126eaf951e\") " pod="openshift-console/console-7f596f5875-z7ltl" Jul 20 16:37:38.037397 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:38.037380 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a1cf680-8a22-48c0-a19d-5e126eaf951e-console-config\") pod \"console-7f596f5875-z7ltl\" (UID: \"9a1cf680-8a22-48c0-a19d-5e126eaf951e\") " pod="openshift-console/console-7f596f5875-z7ltl" Jul 20 16:37:38.037645 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:38.037414 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a1cf680-8a22-48c0-a19d-5e126eaf951e-console-serving-cert\") pod \"console-7f596f5875-z7ltl\" (UID: \"9a1cf680-8a22-48c0-a19d-5e126eaf951e\") " pod="openshift-console/console-7f596f5875-z7ltl" Jul 20 16:37:38.038042 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:38.038008 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a1cf680-8a22-48c0-a19d-5e126eaf951e-service-ca\") pod \"console-7f596f5875-z7ltl\" (UID: \"9a1cf680-8a22-48c0-a19d-5e126eaf951e\") " pod="openshift-console/console-7f596f5875-z7ltl" Jul 20 16:37:38.038294 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:38.038270 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a1cf680-8a22-48c0-a19d-5e126eaf951e-trusted-ca-bundle\") pod \"console-7f596f5875-z7ltl\" (UID: \"9a1cf680-8a22-48c0-a19d-5e126eaf951e\") " pod="openshift-console/console-7f596f5875-z7ltl" Jul 20 16:37:38.038366 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:38.038284 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a1cf680-8a22-48c0-a19d-5e126eaf951e-console-config\") pod \"console-7f596f5875-z7ltl\" (UID: \"9a1cf680-8a22-48c0-a19d-5e126eaf951e\") " pod="openshift-console/console-7f596f5875-z7ltl" Jul 20 16:37:38.038404 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:38.038354 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a1cf680-8a22-48c0-a19d-5e126eaf951e-oauth-serving-cert\") pod \"console-7f596f5875-z7ltl\" (UID: \"9a1cf680-8a22-48c0-a19d-5e126eaf951e\") " pod="openshift-console/console-7f596f5875-z7ltl" Jul 20 16:37:38.039969 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:38.039947 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a1cf680-8a22-48c0-a19d-5e126eaf951e-console-oauth-config\") pod \"console-7f596f5875-z7ltl\" (UID: \"9a1cf680-8a22-48c0-a19d-5e126eaf951e\") " pod="openshift-console/console-7f596f5875-z7ltl" Jul 20 16:37:38.040095 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:38.040014 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a1cf680-8a22-48c0-a19d-5e126eaf951e-console-serving-cert\") pod \"console-7f596f5875-z7ltl\" (UID: \"9a1cf680-8a22-48c0-a19d-5e126eaf951e\") " pod="openshift-console/console-7f596f5875-z7ltl" Jul 20 16:37:38.045464 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:38.045439 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l84qp\" (UniqueName: \"kubernetes.io/projected/9a1cf680-8a22-48c0-a19d-5e126eaf951e-kube-api-access-l84qp\") pod \"console-7f596f5875-z7ltl\" (UID: \"9a1cf680-8a22-48c0-a19d-5e126eaf951e\") " pod="openshift-console/console-7f596f5875-z7ltl" Jul 20 16:37:38.115657 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:38.115562 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f596f5875-z7ltl" Jul 20 16:37:38.251127 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:38.251075 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f596f5875-z7ltl"] Jul 20 16:37:38.253143 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:37:38.253118 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a1cf680_8a22_48c0_a19d_5e126eaf951e.slice/crio-72864ca907ea2c89c9d6bc0ba2197dafabb39e24a3d26fd06364c3127efe6c53 WatchSource:0}: Error finding container 72864ca907ea2c89c9d6bc0ba2197dafabb39e24a3d26fd06364c3127efe6c53: Status 404 returned error can't find the container with id 72864ca907ea2c89c9d6bc0ba2197dafabb39e24a3d26fd06364c3127efe6c53 Jul 20 16:37:38.266854 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:38.266825 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f596f5875-z7ltl" event={"ID":"9a1cf680-8a22-48c0-a19d-5e126eaf951e","Type":"ContainerStarted","Data":"72864ca907ea2c89c9d6bc0ba2197dafabb39e24a3d26fd06364c3127efe6c53"} Jul 20 16:37:39.023148 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:39.023112 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-hvf8w" Jul 20 16:37:39.023631 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:39.023187 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-hvf8w" Jul 20 16:37:39.046141 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:39.046079 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-hvf8w" Jul 20 16:37:39.274354 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:39.274260 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f596f5875-z7ltl" event={"ID":"9a1cf680-8a22-48c0-a19d-5e126eaf951e","Type":"ContainerStarted","Data":"13396dd64e80a6ec673496f3706174c4d5a69837409fa9f8c80d1fee3193e6d4"} Jul 20 16:37:39.291839 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:39.291781 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f596f5875-z7ltl" podStartSLOduration=2.291766983 podStartE2EDuration="2.291766983s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:37:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:37:39.289687749 +0000 UTC m=+484.940570276" watchObservedRunningTime="2026-07-20 16:37:39.291766983 +0000 UTC m=+484.942649481" Jul 20 16:37:39.297764 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:39.297738 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-hvf8w" Jul 20 16:37:43.942233 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:43.942197 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq"] Jul 20 16:37:43.946201 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:43.946180 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq" Jul 20 16:37:43.948623 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:43.948604 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fgs6k\"" Jul 20 16:37:43.954332 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:43.954311 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq"] Jul 20 16:37:43.986140 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:43.986111 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d3f783b-c0c5-4339-ac41-fd774ffbf836-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq\" (UID: \"9d3f783b-c0c5-4339-ac41-fd774ffbf836\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq" Jul 20 16:37:43.986140 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:43.986142 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d3f783b-c0c5-4339-ac41-fd774ffbf836-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq\" (UID: \"9d3f783b-c0c5-4339-ac41-fd774ffbf836\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq" Jul 20 16:37:43.986320 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:43.986188 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv2hb\" (UniqueName: \"kubernetes.io/projected/9d3f783b-c0c5-4339-ac41-fd774ffbf836-kube-api-access-vv2hb\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq\" (UID: \"9d3f783b-c0c5-4339-ac41-fd774ffbf836\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq" Jul 20 16:37:44.086779 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:44.086741 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv2hb\" (UniqueName: \"kubernetes.io/projected/9d3f783b-c0c5-4339-ac41-fd774ffbf836-kube-api-access-vv2hb\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq\" (UID: \"9d3f783b-c0c5-4339-ac41-fd774ffbf836\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq" Jul 20 16:37:44.086924 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:44.086815 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d3f783b-c0c5-4339-ac41-fd774ffbf836-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq\" (UID: \"9d3f783b-c0c5-4339-ac41-fd774ffbf836\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq" Jul 20 16:37:44.086924 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:44.086833 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d3f783b-c0c5-4339-ac41-fd774ffbf836-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq\" (UID: \"9d3f783b-c0c5-4339-ac41-fd774ffbf836\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq" Jul 20 16:37:44.087185 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:44.087168 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d3f783b-c0c5-4339-ac41-fd774ffbf836-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq\" (UID: \"9d3f783b-c0c5-4339-ac41-fd774ffbf836\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq" Jul 20 16:37:44.087226 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:44.087210 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d3f783b-c0c5-4339-ac41-fd774ffbf836-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq\" (UID: \"9d3f783b-c0c5-4339-ac41-fd774ffbf836\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq" Jul 20 16:37:44.095488 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:44.095466 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv2hb\" (UniqueName: \"kubernetes.io/projected/9d3f783b-c0c5-4339-ac41-fd774ffbf836-kube-api-access-vv2hb\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq\" (UID: \"9d3f783b-c0c5-4339-ac41-fd774ffbf836\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq" Jul 20 16:37:44.256495 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:44.256413 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq" Jul 20 16:37:44.391862 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:44.391835 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq"] Jul 20 16:37:44.394619 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:37:44.394591 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d3f783b_c0c5_4339_ac41_fd774ffbf836.slice/crio-2affd39407144afe19f1a552fa9524f74d3436a274f1b95c4d20f88395355572 WatchSource:0}: Error finding container 2affd39407144afe19f1a552fa9524f74d3436a274f1b95c4d20f88395355572: Status 404 returned error can't find the container with id 2affd39407144afe19f1a552fa9524f74d3436a274f1b95c4d20f88395355572 Jul 20 16:37:44.538881 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:44.538850 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjbkp"] Jul 20 16:37:44.542505 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:44.542487 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjbkp" Jul 20 16:37:44.550205 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:44.550181 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjbkp"] Jul 20 16:37:44.590996 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:44.590961 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b45f64be-088c-4a68-b16a-1e983f00c412-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjbkp\" (UID: \"b45f64be-088c-4a68-b16a-1e983f00c412\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjbkp" Jul 20 16:37:44.591165 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:44.591013 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b45f64be-088c-4a68-b16a-1e983f00c412-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjbkp\" (UID: \"b45f64be-088c-4a68-b16a-1e983f00c412\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjbkp" Jul 20 16:37:44.591165 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:44.591114 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q7lf\" (UniqueName: \"kubernetes.io/projected/b45f64be-088c-4a68-b16a-1e983f00c412-kube-api-access-5q7lf\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjbkp\" (UID: \"b45f64be-088c-4a68-b16a-1e983f00c412\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjbkp" Jul 20 16:37:44.692408 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:44.692372 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b45f64be-088c-4a68-b16a-1e983f00c412-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjbkp\" (UID: \"b45f64be-088c-4a68-b16a-1e983f00c412\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjbkp" Jul 20 16:37:44.692591 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:44.692421 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b45f64be-088c-4a68-b16a-1e983f00c412-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjbkp\" (UID: \"b45f64be-088c-4a68-b16a-1e983f00c412\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjbkp" Jul 20 16:37:44.692591 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:44.692473 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q7lf\" (UniqueName: \"kubernetes.io/projected/b45f64be-088c-4a68-b16a-1e983f00c412-kube-api-access-5q7lf\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjbkp\" (UID: \"b45f64be-088c-4a68-b16a-1e983f00c412\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjbkp" Jul 20 16:37:44.692846 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:44.692823 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b45f64be-088c-4a68-b16a-1e983f00c412-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjbkp\" (UID: \"b45f64be-088c-4a68-b16a-1e983f00c412\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjbkp" Jul 20 16:37:44.692887 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:44.692840 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b45f64be-088c-4a68-b16a-1e983f00c412-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjbkp\" (UID: \"b45f64be-088c-4a68-b16a-1e983f00c412\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjbkp" Jul 20 16:37:44.700708 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:44.700676 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q7lf\" (UniqueName: \"kubernetes.io/projected/b45f64be-088c-4a68-b16a-1e983f00c412-kube-api-access-5q7lf\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjbkp\" (UID: \"b45f64be-088c-4a68-b16a-1e983f00c412\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjbkp" Jul 20 16:37:44.866782 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:44.866705 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjbkp" Jul 20 16:37:44.937767 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:44.937735 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b"] Jul 20 16:37:44.942599 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:44.942573 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b" Jul 20 16:37:44.951596 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:44.950472 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b"] Jul 20 16:37:44.995627 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:44.995596 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab971744-c2b6-4eb5-ab76-77819f5debbd-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b\" (UID: \"ab971744-c2b6-4eb5-ab76-77819f5debbd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b" Jul 20 16:37:44.995779 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:44.995633 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njqfw\" (UniqueName: \"kubernetes.io/projected/ab971744-c2b6-4eb5-ab76-77819f5debbd-kube-api-access-njqfw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b\" (UID: \"ab971744-c2b6-4eb5-ab76-77819f5debbd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b" Jul 20 16:37:44.995779 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:44.995655 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab971744-c2b6-4eb5-ab76-77819f5debbd-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b\" (UID: \"ab971744-c2b6-4eb5-ab76-77819f5debbd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b" Jul 20 16:37:45.007187 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:45.007160 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjbkp"] Jul 20 16:37:45.008880 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:37:45.008857 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb45f64be_088c_4a68_b16a_1e983f00c412.slice/crio-0111033b7e1acefe48b9b61ed864d2423e2a988e74e87a80ca873fce290a07bc WatchSource:0}: Error finding container 0111033b7e1acefe48b9b61ed864d2423e2a988e74e87a80ca873fce290a07bc: Status 404 returned error can't find the container with id 0111033b7e1acefe48b9b61ed864d2423e2a988e74e87a80ca873fce290a07bc Jul 20 16:37:45.096189 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:45.096147 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njqfw\" (UniqueName: \"kubernetes.io/projected/ab971744-c2b6-4eb5-ab76-77819f5debbd-kube-api-access-njqfw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b\" (UID: \"ab971744-c2b6-4eb5-ab76-77819f5debbd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b" Jul 20 16:37:45.096383 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:45.096211 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab971744-c2b6-4eb5-ab76-77819f5debbd-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b\" (UID: \"ab971744-c2b6-4eb5-ab76-77819f5debbd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b" Jul 20 16:37:45.096383 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:45.096359 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab971744-c2b6-4eb5-ab76-77819f5debbd-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b\" (UID: \"ab971744-c2b6-4eb5-ab76-77819f5debbd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b" Jul 20 16:37:45.096640 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:45.096617 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab971744-c2b6-4eb5-ab76-77819f5debbd-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b\" (UID: \"ab971744-c2b6-4eb5-ab76-77819f5debbd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b" Jul 20 16:37:45.096747 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:45.096724 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab971744-c2b6-4eb5-ab76-77819f5debbd-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b\" (UID: \"ab971744-c2b6-4eb5-ab76-77819f5debbd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b" Jul 20 16:37:45.104737 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:45.104709 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njqfw\" (UniqueName: \"kubernetes.io/projected/ab971744-c2b6-4eb5-ab76-77819f5debbd-kube-api-access-njqfw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b\" (UID: \"ab971744-c2b6-4eb5-ab76-77819f5debbd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b" Jul 20 16:37:45.257147 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:45.257112 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b" Jul 20 16:37:45.309532 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:45.309501 2575 generic.go:356] "Generic (PLEG): container finished" podID="b45f64be-088c-4a68-b16a-1e983f00c412" containerID="5b5caad71049769f4709df6f4dc04c6c42b25ea018c00abf50c7e0ae952a8438" exitCode=0 Jul 20 16:37:45.309666 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:45.309580 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjbkp" event={"ID":"b45f64be-088c-4a68-b16a-1e983f00c412","Type":"ContainerDied","Data":"5b5caad71049769f4709df6f4dc04c6c42b25ea018c00abf50c7e0ae952a8438"} Jul 20 16:37:45.309666 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:45.309642 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjbkp" event={"ID":"b45f64be-088c-4a68-b16a-1e983f00c412","Type":"ContainerStarted","Data":"0111033b7e1acefe48b9b61ed864d2423e2a988e74e87a80ca873fce290a07bc"} Jul 20 16:37:45.311839 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:45.311816 2575 generic.go:356] "Generic (PLEG): container finished" podID="9d3f783b-c0c5-4339-ac41-fd774ffbf836" containerID="eb13acd29aec1acd3a8ebb0a63936300457cb2634dc768372395782464ab1250" exitCode=0 Jul 20 16:37:45.311967 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:45.311907 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq" event={"ID":"9d3f783b-c0c5-4339-ac41-fd774ffbf836","Type":"ContainerDied","Data":"eb13acd29aec1acd3a8ebb0a63936300457cb2634dc768372395782464ab1250"} Jul 20 16:37:45.311967 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:45.311945 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq" event={"ID":"9d3f783b-c0c5-4339-ac41-fd774ffbf836","Type":"ContainerStarted","Data":"2affd39407144afe19f1a552fa9524f74d3436a274f1b95c4d20f88395355572"} Jul 20 16:37:45.338504 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:45.338474 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69"] Jul 20 16:37:45.343388 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:45.343310 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69" Jul 20 16:37:45.351479 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:45.351387 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69"] Jul 20 16:37:45.396400 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:45.396317 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b"] Jul 20 16:37:45.398955 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:45.398930 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f56dt\" (UniqueName: \"kubernetes.io/projected/71c42723-8e56-4b44-8fef-002bb28236a2-kube-api-access-f56dt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69\" (UID: \"71c42723-8e56-4b44-8fef-002bb28236a2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69" Jul 20 16:37:45.399070 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:45.398978 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71c42723-8e56-4b44-8fef-002bb28236a2-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69\" (UID: \"71c42723-8e56-4b44-8fef-002bb28236a2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69" Jul 20 16:37:45.399202 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:45.399177 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71c42723-8e56-4b44-8fef-002bb28236a2-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69\" (UID: \"71c42723-8e56-4b44-8fef-002bb28236a2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69" Jul 20 16:37:45.399565 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:37:45.399540 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab971744_c2b6_4eb5_ab76_77819f5debbd.slice/crio-976b0cdb98b589b181de39af11cd24f1706755742342a82ca4e9fc57a0082f2d WatchSource:0}: Error finding container 976b0cdb98b589b181de39af11cd24f1706755742342a82ca4e9fc57a0082f2d: Status 404 returned error can't find the container with id 976b0cdb98b589b181de39af11cd24f1706755742342a82ca4e9fc57a0082f2d Jul 20 16:37:45.499837 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:45.499811 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71c42723-8e56-4b44-8fef-002bb28236a2-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69\" (UID: \"71c42723-8e56-4b44-8fef-002bb28236a2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69" Jul 20 16:37:45.499954 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:45.499875 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f56dt\" (UniqueName: \"kubernetes.io/projected/71c42723-8e56-4b44-8fef-002bb28236a2-kube-api-access-f56dt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69\" (UID: \"71c42723-8e56-4b44-8fef-002bb28236a2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69" Jul 20 16:37:45.499954 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:45.499915 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71c42723-8e56-4b44-8fef-002bb28236a2-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69\" (UID: \"71c42723-8e56-4b44-8fef-002bb28236a2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69" Jul 20 16:37:45.500231 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:45.500215 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71c42723-8e56-4b44-8fef-002bb28236a2-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69\" (UID: \"71c42723-8e56-4b44-8fef-002bb28236a2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69" Jul 20 16:37:45.500289 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:45.500257 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71c42723-8e56-4b44-8fef-002bb28236a2-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69\" (UID: \"71c42723-8e56-4b44-8fef-002bb28236a2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69" Jul 20 16:37:45.507655 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:45.507635 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f56dt\" (UniqueName: \"kubernetes.io/projected/71c42723-8e56-4b44-8fef-002bb28236a2-kube-api-access-f56dt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69\" (UID: \"71c42723-8e56-4b44-8fef-002bb28236a2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69" Jul 20 16:37:45.656996 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:45.656894 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69" Jul 20 16:37:45.786712 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:45.786686 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69"] Jul 20 16:37:45.788286 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:37:45.788259 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71c42723_8e56_4b44_8fef_002bb28236a2.slice/crio-8e0c57fdecbd8a0d55d81c6b995645a17922c52b05e1c6ad50a9c65a2f158550 WatchSource:0}: Error finding container 8e0c57fdecbd8a0d55d81c6b995645a17922c52b05e1c6ad50a9c65a2f158550: Status 404 returned error can't find the container with id 8e0c57fdecbd8a0d55d81c6b995645a17922c52b05e1c6ad50a9c65a2f158550 Jul 20 16:37:46.318424 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:46.318391 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq" event={"ID":"9d3f783b-c0c5-4339-ac41-fd774ffbf836","Type":"ContainerStarted","Data":"aaadec52c0ac5ade8986526e8329833571cbf79c67acc85b9c56427202c3ce0d"} Jul 20 16:37:46.319888 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:46.319863 2575 generic.go:356] "Generic (PLEG): container finished" podID="ab971744-c2b6-4eb5-ab76-77819f5debbd" containerID="88b59072edb09ec6462a9c4a88f163ddff38ff05fbbdaaf96996ef76c798b6bf" exitCode=0 Jul 20 16:37:46.320003 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:46.319941 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b" event={"ID":"ab971744-c2b6-4eb5-ab76-77819f5debbd","Type":"ContainerDied","Data":"88b59072edb09ec6462a9c4a88f163ddff38ff05fbbdaaf96996ef76c798b6bf"} Jul 20 16:37:46.320003 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:46.319988 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b" event={"ID":"ab971744-c2b6-4eb5-ab76-77819f5debbd","Type":"ContainerStarted","Data":"976b0cdb98b589b181de39af11cd24f1706755742342a82ca4e9fc57a0082f2d"} Jul 20 16:37:46.322275 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:46.322259 2575 generic.go:356] "Generic (PLEG): container finished" podID="b45f64be-088c-4a68-b16a-1e983f00c412" containerID="b71816fd7891c45019052ac62854d7b4022d0ea5933f0e32b5774eb601c078fd" exitCode=0 Jul 20 16:37:46.322373 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:46.322347 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjbkp" event={"ID":"b45f64be-088c-4a68-b16a-1e983f00c412","Type":"ContainerDied","Data":"b71816fd7891c45019052ac62854d7b4022d0ea5933f0e32b5774eb601c078fd"} Jul 20 16:37:46.323969 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:46.323949 2575 generic.go:356] "Generic (PLEG): container finished" podID="71c42723-8e56-4b44-8fef-002bb28236a2" containerID="e72f66935686442bfa2946400efd5e6763dc99a949e2cc49602106b68038e0ee" exitCode=0 Jul 20 16:37:46.324052 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:46.323990 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69" event={"ID":"71c42723-8e56-4b44-8fef-002bb28236a2","Type":"ContainerDied","Data":"e72f66935686442bfa2946400efd5e6763dc99a949e2cc49602106b68038e0ee"} Jul 20 16:37:46.324052 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:46.324021 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69" event={"ID":"71c42723-8e56-4b44-8fef-002bb28236a2","Type":"ContainerStarted","Data":"8e0c57fdecbd8a0d55d81c6b995645a17922c52b05e1c6ad50a9c65a2f158550"} Jul 20 16:37:47.331412 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:47.331365 2575 generic.go:356] "Generic (PLEG): container finished" podID="b45f64be-088c-4a68-b16a-1e983f00c412" containerID="5a3bf3bff9610d545635e1f107baf86d760f1f6fa8bce0ddd72b7339d9764afb" exitCode=0 Jul 20 16:37:47.331950 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:47.331408 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjbkp" event={"ID":"b45f64be-088c-4a68-b16a-1e983f00c412","Type":"ContainerDied","Data":"5a3bf3bff9610d545635e1f107baf86d760f1f6fa8bce0ddd72b7339d9764afb"} Jul 20 16:37:47.333460 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:47.333434 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69" event={"ID":"71c42723-8e56-4b44-8fef-002bb28236a2","Type":"ContainerStarted","Data":"9d2250570093bc412c9aa15406ead9deafe455d3a00d9cdaa070a323880ebef9"} Jul 20 16:37:47.335378 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:47.335358 2575 generic.go:356] "Generic (PLEG): container finished" podID="9d3f783b-c0c5-4339-ac41-fd774ffbf836" containerID="aaadec52c0ac5ade8986526e8329833571cbf79c67acc85b9c56427202c3ce0d" exitCode=0 Jul 20 16:37:47.335500 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:47.335450 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq" event={"ID":"9d3f783b-c0c5-4339-ac41-fd774ffbf836","Type":"ContainerDied","Data":"aaadec52c0ac5ade8986526e8329833571cbf79c67acc85b9c56427202c3ce0d"} Jul 20 16:37:47.337450 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:47.337427 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b" event={"ID":"ab971744-c2b6-4eb5-ab76-77819f5debbd","Type":"ContainerStarted","Data":"a9235d3e537e2fbe64305840698aa98d43770dec3fca404734a74c1ce60e727d"} Jul 20 16:37:48.116243 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:48.116202 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f596f5875-z7ltl" Jul 20 16:37:48.116418 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:48.116266 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f596f5875-z7ltl" Jul 20 16:37:48.121140 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:48.121113 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f596f5875-z7ltl" Jul 20 16:37:48.344943 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:48.344910 2575 generic.go:356] "Generic (PLEG): container finished" podID="71c42723-8e56-4b44-8fef-002bb28236a2" containerID="9d2250570093bc412c9aa15406ead9deafe455d3a00d9cdaa070a323880ebef9" exitCode=0 Jul 20 16:37:48.345539 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:48.345005 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69" event={"ID":"71c42723-8e56-4b44-8fef-002bb28236a2","Type":"ContainerDied","Data":"9d2250570093bc412c9aa15406ead9deafe455d3a00d9cdaa070a323880ebef9"} Jul 20 16:37:48.347203 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:48.347182 2575 generic.go:356] "Generic (PLEG): container finished" podID="9d3f783b-c0c5-4339-ac41-fd774ffbf836" containerID="d430fbca502a367a5e2cc02ac993e2635f0e3e59d3e5fbe0055a57619a4e75ff" exitCode=0 Jul 20 16:37:48.347283 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:48.347265 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq" event={"ID":"9d3f783b-c0c5-4339-ac41-fd774ffbf836","Type":"ContainerDied","Data":"d430fbca502a367a5e2cc02ac993e2635f0e3e59d3e5fbe0055a57619a4e75ff"} Jul 20 16:37:48.349058 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:48.349036 2575 generic.go:356] "Generic (PLEG): container finished" podID="ab971744-c2b6-4eb5-ab76-77819f5debbd" containerID="a9235d3e537e2fbe64305840698aa98d43770dec3fca404734a74c1ce60e727d" exitCode=0 Jul 20 16:37:48.349145 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:48.349103 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b" event={"ID":"ab971744-c2b6-4eb5-ab76-77819f5debbd","Type":"ContainerDied","Data":"a9235d3e537e2fbe64305840698aa98d43770dec3fca404734a74c1ce60e727d"} Jul 20 16:37:48.354112 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:48.354073 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f596f5875-z7ltl" Jul 20 16:37:48.418973 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:48.418698 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bcfb6db95-fqt89"] Jul 20 16:37:48.528941 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:48.527586 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjbkp" Jul 20 16:37:48.632719 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:48.632633 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b45f64be-088c-4a68-b16a-1e983f00c412-util\") pod \"b45f64be-088c-4a68-b16a-1e983f00c412\" (UID: \"b45f64be-088c-4a68-b16a-1e983f00c412\") " Jul 20 16:37:48.632719 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:48.632683 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b45f64be-088c-4a68-b16a-1e983f00c412-bundle\") pod \"b45f64be-088c-4a68-b16a-1e983f00c412\" (UID: \"b45f64be-088c-4a68-b16a-1e983f00c412\") " Jul 20 16:37:48.632719 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:48.632710 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5q7lf\" (UniqueName: \"kubernetes.io/projected/b45f64be-088c-4a68-b16a-1e983f00c412-kube-api-access-5q7lf\") pod \"b45f64be-088c-4a68-b16a-1e983f00c412\" (UID: \"b45f64be-088c-4a68-b16a-1e983f00c412\") " Jul 20 16:37:48.633189 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:48.633145 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b45f64be-088c-4a68-b16a-1e983f00c412-bundle" (OuterVolumeSpecName: "bundle") pod "b45f64be-088c-4a68-b16a-1e983f00c412" (UID: "b45f64be-088c-4a68-b16a-1e983f00c412"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:37:48.634761 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:48.634739 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b45f64be-088c-4a68-b16a-1e983f00c412-kube-api-access-5q7lf" (OuterVolumeSpecName: "kube-api-access-5q7lf") pod "b45f64be-088c-4a68-b16a-1e983f00c412" (UID: "b45f64be-088c-4a68-b16a-1e983f00c412"). InnerVolumeSpecName "kube-api-access-5q7lf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:37:48.638078 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:48.638047 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b45f64be-088c-4a68-b16a-1e983f00c412-util" (OuterVolumeSpecName: "util") pod "b45f64be-088c-4a68-b16a-1e983f00c412" (UID: "b45f64be-088c-4a68-b16a-1e983f00c412"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:37:48.734394 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:48.734352 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b45f64be-088c-4a68-b16a-1e983f00c412-util\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:37:48.734394 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:48.734388 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b45f64be-088c-4a68-b16a-1e983f00c412-bundle\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:37:48.734394 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:48.734399 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5q7lf\" (UniqueName: \"kubernetes.io/projected/b45f64be-088c-4a68-b16a-1e983f00c412-kube-api-access-5q7lf\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:37:49.356551 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:49.356511 2575 generic.go:356] "Generic (PLEG): container finished" podID="ab971744-c2b6-4eb5-ab76-77819f5debbd" containerID="00c7ef665a39e7e8d493289ac1dd7f74fa0bb9b3ed9683d9e5749bfe79b70628" exitCode=0 Jul 20 16:37:49.356926 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:49.356592 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b" event={"ID":"ab971744-c2b6-4eb5-ab76-77819f5debbd","Type":"ContainerDied","Data":"00c7ef665a39e7e8d493289ac1dd7f74fa0bb9b3ed9683d9e5749bfe79b70628"} Jul 20 16:37:49.358393 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:49.358374 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjbkp" Jul 20 16:37:49.358516 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:49.358392 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjbkp" event={"ID":"b45f64be-088c-4a68-b16a-1e983f00c412","Type":"ContainerDied","Data":"0111033b7e1acefe48b9b61ed864d2423e2a988e74e87a80ca873fce290a07bc"} Jul 20 16:37:49.358516 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:49.358429 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0111033b7e1acefe48b9b61ed864d2423e2a988e74e87a80ca873fce290a07bc" Jul 20 16:37:49.360616 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:49.360593 2575 generic.go:356] "Generic (PLEG): container finished" podID="71c42723-8e56-4b44-8fef-002bb28236a2" containerID="6aef51b7f4003a4a5561bc3af7b414482b4cac4e58b90586b2759282d7deee32" exitCode=0 Jul 20 16:37:49.360813 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:49.360668 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69" event={"ID":"71c42723-8e56-4b44-8fef-002bb28236a2","Type":"ContainerDied","Data":"6aef51b7f4003a4a5561bc3af7b414482b4cac4e58b90586b2759282d7deee32"} Jul 20 16:37:49.500518 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:49.500492 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq" Jul 20 16:37:49.541374 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:49.541346 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d3f783b-c0c5-4339-ac41-fd774ffbf836-bundle\") pod \"9d3f783b-c0c5-4339-ac41-fd774ffbf836\" (UID: \"9d3f783b-c0c5-4339-ac41-fd774ffbf836\") " Jul 20 16:37:49.541534 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:49.541423 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d3f783b-c0c5-4339-ac41-fd774ffbf836-util\") pod \"9d3f783b-c0c5-4339-ac41-fd774ffbf836\" (UID: \"9d3f783b-c0c5-4339-ac41-fd774ffbf836\") " Jul 20 16:37:49.541534 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:49.541455 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vv2hb\" (UniqueName: \"kubernetes.io/projected/9d3f783b-c0c5-4339-ac41-fd774ffbf836-kube-api-access-vv2hb\") pod \"9d3f783b-c0c5-4339-ac41-fd774ffbf836\" (UID: \"9d3f783b-c0c5-4339-ac41-fd774ffbf836\") " Jul 20 16:37:49.541850 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:49.541823 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d3f783b-c0c5-4339-ac41-fd774ffbf836-bundle" (OuterVolumeSpecName: "bundle") pod "9d3f783b-c0c5-4339-ac41-fd774ffbf836" (UID: "9d3f783b-c0c5-4339-ac41-fd774ffbf836"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:37:49.543515 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:49.543491 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d3f783b-c0c5-4339-ac41-fd774ffbf836-kube-api-access-vv2hb" (OuterVolumeSpecName: "kube-api-access-vv2hb") pod "9d3f783b-c0c5-4339-ac41-fd774ffbf836" (UID: "9d3f783b-c0c5-4339-ac41-fd774ffbf836"). InnerVolumeSpecName "kube-api-access-vv2hb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:37:49.550610 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:49.550584 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d3f783b-c0c5-4339-ac41-fd774ffbf836-util" (OuterVolumeSpecName: "util") pod "9d3f783b-c0c5-4339-ac41-fd774ffbf836" (UID: "9d3f783b-c0c5-4339-ac41-fd774ffbf836"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:37:49.642761 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:49.642671 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vv2hb\" (UniqueName: \"kubernetes.io/projected/9d3f783b-c0c5-4339-ac41-fd774ffbf836-kube-api-access-vv2hb\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:37:49.642761 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:49.642705 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d3f783b-c0c5-4339-ac41-fd774ffbf836-bundle\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:37:49.642761 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:49.642716 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d3f783b-c0c5-4339-ac41-fd774ffbf836-util\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:37:50.368614 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:50.368581 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq" Jul 20 16:37:50.369032 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:50.368620 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq" event={"ID":"9d3f783b-c0c5-4339-ac41-fd774ffbf836","Type":"ContainerDied","Data":"2affd39407144afe19f1a552fa9524f74d3436a274f1b95c4d20f88395355572"} Jul 20 16:37:50.369032 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:50.368665 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2affd39407144afe19f1a552fa9524f74d3436a274f1b95c4d20f88395355572" Jul 20 16:37:50.509390 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:50.509361 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b" Jul 20 16:37:50.548024 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:50.547996 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69" Jul 20 16:37:50.549339 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:50.549316 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njqfw\" (UniqueName: \"kubernetes.io/projected/ab971744-c2b6-4eb5-ab76-77819f5debbd-kube-api-access-njqfw\") pod \"ab971744-c2b6-4eb5-ab76-77819f5debbd\" (UID: \"ab971744-c2b6-4eb5-ab76-77819f5debbd\") " Jul 20 16:37:50.549470 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:50.549362 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab971744-c2b6-4eb5-ab76-77819f5debbd-util\") pod \"ab971744-c2b6-4eb5-ab76-77819f5debbd\" (UID: \"ab971744-c2b6-4eb5-ab76-77819f5debbd\") " Jul 20 16:37:50.549470 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:50.549404 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab971744-c2b6-4eb5-ab76-77819f5debbd-bundle\") pod \"ab971744-c2b6-4eb5-ab76-77819f5debbd\" (UID: \"ab971744-c2b6-4eb5-ab76-77819f5debbd\") " Jul 20 16:37:50.549951 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:50.549918 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab971744-c2b6-4eb5-ab76-77819f5debbd-bundle" (OuterVolumeSpecName: "bundle") pod "ab971744-c2b6-4eb5-ab76-77819f5debbd" (UID: "ab971744-c2b6-4eb5-ab76-77819f5debbd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:37:50.551474 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:50.551446 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab971744-c2b6-4eb5-ab76-77819f5debbd-kube-api-access-njqfw" (OuterVolumeSpecName: "kube-api-access-njqfw") pod "ab971744-c2b6-4eb5-ab76-77819f5debbd" (UID: "ab971744-c2b6-4eb5-ab76-77819f5debbd"). InnerVolumeSpecName "kube-api-access-njqfw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:37:50.554911 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:50.554890 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab971744-c2b6-4eb5-ab76-77819f5debbd-util" (OuterVolumeSpecName: "util") pod "ab971744-c2b6-4eb5-ab76-77819f5debbd" (UID: "ab971744-c2b6-4eb5-ab76-77819f5debbd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:37:50.650007 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:50.649914 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71c42723-8e56-4b44-8fef-002bb28236a2-util\") pod \"71c42723-8e56-4b44-8fef-002bb28236a2\" (UID: \"71c42723-8e56-4b44-8fef-002bb28236a2\") " Jul 20 16:37:50.650007 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:50.649954 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f56dt\" (UniqueName: \"kubernetes.io/projected/71c42723-8e56-4b44-8fef-002bb28236a2-kube-api-access-f56dt\") pod \"71c42723-8e56-4b44-8fef-002bb28236a2\" (UID: \"71c42723-8e56-4b44-8fef-002bb28236a2\") " Jul 20 16:37:50.650007 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:50.649991 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71c42723-8e56-4b44-8fef-002bb28236a2-bundle\") pod \"71c42723-8e56-4b44-8fef-002bb28236a2\" (UID: \"71c42723-8e56-4b44-8fef-002bb28236a2\") " Jul 20 16:37:50.650306 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:50.650179 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab971744-c2b6-4eb5-ab76-77819f5debbd-bundle\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:37:50.650306 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:50.650191 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njqfw\" (UniqueName: \"kubernetes.io/projected/ab971744-c2b6-4eb5-ab76-77819f5debbd-kube-api-access-njqfw\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:37:50.650306 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:50.650200 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab971744-c2b6-4eb5-ab76-77819f5debbd-util\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:37:50.650653 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:50.650617 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71c42723-8e56-4b44-8fef-002bb28236a2-bundle" (OuterVolumeSpecName: "bundle") pod "71c42723-8e56-4b44-8fef-002bb28236a2" (UID: "71c42723-8e56-4b44-8fef-002bb28236a2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:37:50.652116 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:50.652094 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71c42723-8e56-4b44-8fef-002bb28236a2-kube-api-access-f56dt" (OuterVolumeSpecName: "kube-api-access-f56dt") pod "71c42723-8e56-4b44-8fef-002bb28236a2" (UID: "71c42723-8e56-4b44-8fef-002bb28236a2"). InnerVolumeSpecName "kube-api-access-f56dt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:37:50.655223 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:50.655201 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71c42723-8e56-4b44-8fef-002bb28236a2-util" (OuterVolumeSpecName: "util") pod "71c42723-8e56-4b44-8fef-002bb28236a2" (UID: "71c42723-8e56-4b44-8fef-002bb28236a2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:37:50.751041 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:50.750992 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71c42723-8e56-4b44-8fef-002bb28236a2-util\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:37:50.751041 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:50.751037 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f56dt\" (UniqueName: \"kubernetes.io/projected/71c42723-8e56-4b44-8fef-002bb28236a2-kube-api-access-f56dt\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:37:50.751041 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:50.751048 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71c42723-8e56-4b44-8fef-002bb28236a2-bundle\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:37:51.376247 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:51.376212 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b" Jul 20 16:37:51.376664 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:51.376239 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b" event={"ID":"ab971744-c2b6-4eb5-ab76-77819f5debbd","Type":"ContainerDied","Data":"976b0cdb98b589b181de39af11cd24f1706755742342a82ca4e9fc57a0082f2d"} Jul 20 16:37:51.376664 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:51.376335 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="976b0cdb98b589b181de39af11cd24f1706755742342a82ca4e9fc57a0082f2d" Jul 20 16:37:51.378545 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:51.378401 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69" event={"ID":"71c42723-8e56-4b44-8fef-002bb28236a2","Type":"ContainerDied","Data":"8e0c57fdecbd8a0d55d81c6b995645a17922c52b05e1c6ad50a9c65a2f158550"} Jul 20 16:37:51.378545 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:51.378437 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69" Jul 20 16:37:51.378545 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:37:51.378449 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8e0c57fdecbd8a0d55d81c6b995645a17922c52b05e1c6ad50a9c65a2f158550" Jul 20 16:38:01.978980 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:01.978943 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vp6cb"] Jul 20 16:38:01.979465 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:01.979356 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab971744-c2b6-4eb5-ab76-77819f5debbd" containerName="pull" Jul 20 16:38:01.979465 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:01.979368 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab971744-c2b6-4eb5-ab76-77819f5debbd" containerName="pull" Jul 20 16:38:01.979465 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:01.979378 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b45f64be-088c-4a68-b16a-1e983f00c412" containerName="extract" Jul 20 16:38:01.979465 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:01.979384 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b45f64be-088c-4a68-b16a-1e983f00c412" containerName="extract" Jul 20 16:38:01.979465 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:01.979395 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71c42723-8e56-4b44-8fef-002bb28236a2" containerName="pull" Jul 20 16:38:01.979465 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:01.979400 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="71c42723-8e56-4b44-8fef-002bb28236a2" containerName="pull" Jul 20 16:38:01.979465 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:01.979405 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab971744-c2b6-4eb5-ab76-77819f5debbd" containerName="extract" Jul 20 16:38:01.979465 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:01.979410 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab971744-c2b6-4eb5-ab76-77819f5debbd" containerName="extract" Jul 20 16:38:01.979465 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:01.979421 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d3f783b-c0c5-4339-ac41-fd774ffbf836" containerName="util" Jul 20 16:38:01.979465 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:01.979426 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d3f783b-c0c5-4339-ac41-fd774ffbf836" containerName="util" Jul 20 16:38:01.979465 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:01.979433 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b45f64be-088c-4a68-b16a-1e983f00c412" containerName="pull" Jul 20 16:38:01.979465 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:01.979438 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b45f64be-088c-4a68-b16a-1e983f00c412" containerName="pull" Jul 20 16:38:01.979465 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:01.979445 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71c42723-8e56-4b44-8fef-002bb28236a2" containerName="extract" Jul 20 16:38:01.979465 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:01.979450 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="71c42723-8e56-4b44-8fef-002bb28236a2" containerName="extract" Jul 20 16:38:01.979465 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:01.979457 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71c42723-8e56-4b44-8fef-002bb28236a2" containerName="util" Jul 20 16:38:01.979465 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:01.979462 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="71c42723-8e56-4b44-8fef-002bb28236a2" containerName="util" Jul 20 16:38:01.979465 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:01.979467 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d3f783b-c0c5-4339-ac41-fd774ffbf836" containerName="extract" Jul 20 16:38:01.979465 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:01.979473 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d3f783b-c0c5-4339-ac41-fd774ffbf836" containerName="extract" Jul 20 16:38:01.980005 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:01.979481 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab971744-c2b6-4eb5-ab76-77819f5debbd" containerName="util" Jul 20 16:38:01.980005 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:01.979485 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab971744-c2b6-4eb5-ab76-77819f5debbd" containerName="util" Jul 20 16:38:01.980005 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:01.979495 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d3f783b-c0c5-4339-ac41-fd774ffbf836" containerName="pull" Jul 20 16:38:01.980005 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:01.979501 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d3f783b-c0c5-4339-ac41-fd774ffbf836" containerName="pull" Jul 20 16:38:01.980005 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:01.979508 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b45f64be-088c-4a68-b16a-1e983f00c412" containerName="util" Jul 20 16:38:01.980005 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:01.979515 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b45f64be-088c-4a68-b16a-1e983f00c412" containerName="util" Jul 20 16:38:01.980005 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:01.979575 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b45f64be-088c-4a68-b16a-1e983f00c412" containerName="extract" Jul 20 16:38:01.980005 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:01.979582 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab971744-c2b6-4eb5-ab76-77819f5debbd" containerName="extract" Jul 20 16:38:01.980005 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:01.979589 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="71c42723-8e56-4b44-8fef-002bb28236a2" containerName="extract" Jul 20 16:38:01.980005 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:01.979596 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d3f783b-c0c5-4339-ac41-fd774ffbf836" containerName="extract" Jul 20 16:38:01.982400 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:01.982377 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vp6cb" Jul 20 16:38:01.985920 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:01.985898 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-whdk7\"" Jul 20 16:38:01.995480 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:01.995456 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vp6cb"] Jul 20 16:38:02.059373 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:02.059339 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd06c742-aee6-4636-8be2-dc4503f9ee5e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vp6cb\" (UID: \"cd06c742-aee6-4636-8be2-dc4503f9ee5e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vp6cb" Jul 20 16:38:02.059550 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:02.059400 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqxpc\" (UniqueName: \"kubernetes.io/projected/cd06c742-aee6-4636-8be2-dc4503f9ee5e-kube-api-access-vqxpc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vp6cb\" (UID: \"cd06c742-aee6-4636-8be2-dc4503f9ee5e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vp6cb" Jul 20 16:38:02.160266 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:02.160233 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqxpc\" (UniqueName: \"kubernetes.io/projected/cd06c742-aee6-4636-8be2-dc4503f9ee5e-kube-api-access-vqxpc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vp6cb\" (UID: \"cd06c742-aee6-4636-8be2-dc4503f9ee5e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vp6cb" Jul 20 16:38:02.160366 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:02.160320 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd06c742-aee6-4636-8be2-dc4503f9ee5e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vp6cb\" (UID: \"cd06c742-aee6-4636-8be2-dc4503f9ee5e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vp6cb" Jul 20 16:38:02.160646 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:02.160632 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd06c742-aee6-4636-8be2-dc4503f9ee5e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vp6cb\" (UID: \"cd06c742-aee6-4636-8be2-dc4503f9ee5e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vp6cb" Jul 20 16:38:02.175864 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:02.175832 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqxpc\" (UniqueName: \"kubernetes.io/projected/cd06c742-aee6-4636-8be2-dc4503f9ee5e-kube-api-access-vqxpc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vp6cb\" (UID: \"cd06c742-aee6-4636-8be2-dc4503f9ee5e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vp6cb" Jul 20 16:38:02.292995 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:02.292963 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vp6cb" Jul 20 16:38:02.434412 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:02.434385 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vp6cb"] Jul 20 16:38:02.436708 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:38:02.436679 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd06c742_aee6_4636_8be2_dc4503f9ee5e.slice/crio-e4a5d39317d4786399e1b5b6b9210d89a9822397a60334e37cb8dd245630bd75 WatchSource:0}: Error finding container e4a5d39317d4786399e1b5b6b9210d89a9822397a60334e37cb8dd245630bd75: Status 404 returned error can't find the container with id e4a5d39317d4786399e1b5b6b9210d89a9822397a60334e37cb8dd245630bd75 Jul 20 16:38:02.444514 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:02.444473 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vp6cb" event={"ID":"cd06c742-aee6-4636-8be2-dc4503f9ee5e","Type":"ContainerStarted","Data":"e4a5d39317d4786399e1b5b6b9210d89a9822397a60334e37cb8dd245630bd75"} Jul 20 16:38:09.497736 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:09.497699 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vp6cb" event={"ID":"cd06c742-aee6-4636-8be2-dc4503f9ee5e","Type":"ContainerStarted","Data":"996024d776008a02a5395c9778fc2177332ee1692fd599edf4c21243762cebd1"} Jul 20 16:38:09.498211 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:09.497858 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vp6cb" Jul 20 16:38:09.518439 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:09.518389 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vp6cb" podStartSLOduration=1.964977054 podStartE2EDuration="8.518374338s" totalImagesPullingTime="6.553397284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:38:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:38:09.516330889 +0000 UTC m=+515.167213389" watchObservedRunningTime="2026-07-20 16:38:09.518374338 +0000 UTC m=+515.169256835" Jul 20 16:38:10.520117 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:10.520071 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-tld2z"] Jul 20 16:38:10.523772 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:10.523752 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tld2z" Jul 20 16:38:10.529127 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:10.529076 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-p2xd8\"" Jul 20 16:38:10.547508 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:10.547483 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-tld2z"] Jul 20 16:38:10.642484 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:10.642438 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd5kh\" (UniqueName: \"kubernetes.io/projected/48af0a4e-80b2-4402-ab3e-52f55162918d-kube-api-access-dd5kh\") pod \"authorino-operator-75cc8d5cb7-tld2z\" (UID: \"48af0a4e-80b2-4402-ab3e-52f55162918d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-tld2z" Jul 20 16:38:10.743943 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:10.743905 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd5kh\" (UniqueName: \"kubernetes.io/projected/48af0a4e-80b2-4402-ab3e-52f55162918d-kube-api-access-dd5kh\") pod \"authorino-operator-75cc8d5cb7-tld2z\" (UID: \"48af0a4e-80b2-4402-ab3e-52f55162918d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-tld2z" Jul 20 16:38:10.754287 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:10.754260 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd5kh\" (UniqueName: \"kubernetes.io/projected/48af0a4e-80b2-4402-ab3e-52f55162918d-kube-api-access-dd5kh\") pod \"authorino-operator-75cc8d5cb7-tld2z\" (UID: \"48af0a4e-80b2-4402-ab3e-52f55162918d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-tld2z" Jul 20 16:38:10.835173 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:10.835137 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tld2z" Jul 20 16:38:10.973397 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:10.973370 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-tld2z"] Jul 20 16:38:10.975004 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:38:10.974978 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48af0a4e_80b2_4402_ab3e_52f55162918d.slice/crio-0ade47a73086fd9e94c39a2d5b3a4d21ad30a5ed86be3b3c21650cda23caf2a8 WatchSource:0}: Error finding container 0ade47a73086fd9e94c39a2d5b3a4d21ad30a5ed86be3b3c21650cda23caf2a8: Status 404 returned error can't find the container with id 0ade47a73086fd9e94c39a2d5b3a4d21ad30a5ed86be3b3c21650cda23caf2a8 Jul 20 16:38:11.511400 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:11.511340 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tld2z" event={"ID":"48af0a4e-80b2-4402-ab3e-52f55162918d","Type":"ContainerStarted","Data":"0ade47a73086fd9e94c39a2d5b3a4d21ad30a5ed86be3b3c21650cda23caf2a8"} Jul 20 16:38:13.455198 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:13.455104 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7bcfb6db95-fqt89" podUID="c9b4b52b-717f-4f29-b23c-2cd11f4647c7" containerName="console" containerID="cri-o://352e5ff48fcfebb67cb063cbe0413da7a2125cf991f80bf45a26a74325e63eff" gracePeriod=15 Jul 20 16:38:13.524871 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:13.524830 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tld2z" event={"ID":"48af0a4e-80b2-4402-ab3e-52f55162918d","Type":"ContainerStarted","Data":"ee735c47d57c828e71bdddc16215dbcd21285fc1410b38c956eac01ff7e705c7"} Jul 20 16:38:13.525035 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:13.524903 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tld2z" Jul 20 16:38:13.543172 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:13.543120 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tld2z" podStartSLOduration=1.392881752 podStartE2EDuration="3.543096368s" totalImagesPullingTime="2.150214616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:38:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:38:13.54057049 +0000 UTC m=+519.191453012" watchObservedRunningTime="2026-07-20 16:38:13.543096368 +0000 UTC m=+519.193978856" Jul 20 16:38:13.703504 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:13.703478 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bcfb6db95-fqt89" Jul 20 16:38:13.873501 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:13.873466 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5278h\" (UniqueName: \"kubernetes.io/projected/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-kube-api-access-5278h\") pod \"c9b4b52b-717f-4f29-b23c-2cd11f4647c7\" (UID: \"c9b4b52b-717f-4f29-b23c-2cd11f4647c7\") " Jul 20 16:38:13.873668 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:13.873511 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-console-serving-cert\") pod \"c9b4b52b-717f-4f29-b23c-2cd11f4647c7\" (UID: \"c9b4b52b-717f-4f29-b23c-2cd11f4647c7\") " Jul 20 16:38:13.873668 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:13.873529 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-service-ca\") pod \"c9b4b52b-717f-4f29-b23c-2cd11f4647c7\" (UID: \"c9b4b52b-717f-4f29-b23c-2cd11f4647c7\") " Jul 20 16:38:13.873668 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:13.873555 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-oauth-serving-cert\") pod \"c9b4b52b-717f-4f29-b23c-2cd11f4647c7\" (UID: \"c9b4b52b-717f-4f29-b23c-2cd11f4647c7\") " Jul 20 16:38:13.873668 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:13.873589 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-trusted-ca-bundle\") pod \"c9b4b52b-717f-4f29-b23c-2cd11f4647c7\" (UID: \"c9b4b52b-717f-4f29-b23c-2cd11f4647c7\") " Jul 20 16:38:13.873668 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:13.873609 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-console-oauth-config\") pod \"c9b4b52b-717f-4f29-b23c-2cd11f4647c7\" (UID: \"c9b4b52b-717f-4f29-b23c-2cd11f4647c7\") " Jul 20 16:38:13.873911 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:13.873694 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-console-config\") pod \"c9b4b52b-717f-4f29-b23c-2cd11f4647c7\" (UID: \"c9b4b52b-717f-4f29-b23c-2cd11f4647c7\") " Jul 20 16:38:13.873970 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:13.873932 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-service-ca" (OuterVolumeSpecName: "service-ca") pod "c9b4b52b-717f-4f29-b23c-2cd11f4647c7" (UID: "c9b4b52b-717f-4f29-b23c-2cd11f4647c7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:38:13.874221 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:13.874193 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c9b4b52b-717f-4f29-b23c-2cd11f4647c7" (UID: "c9b4b52b-717f-4f29-b23c-2cd11f4647c7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:38:13.874221 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:13.874210 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c9b4b52b-717f-4f29-b23c-2cd11f4647c7" (UID: "c9b4b52b-717f-4f29-b23c-2cd11f4647c7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:38:13.874221 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:13.874185 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-console-config" (OuterVolumeSpecName: "console-config") pod "c9b4b52b-717f-4f29-b23c-2cd11f4647c7" (UID: "c9b4b52b-717f-4f29-b23c-2cd11f4647c7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:38:13.875826 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:13.875801 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-kube-api-access-5278h" (OuterVolumeSpecName: "kube-api-access-5278h") pod "c9b4b52b-717f-4f29-b23c-2cd11f4647c7" (UID: "c9b4b52b-717f-4f29-b23c-2cd11f4647c7"). InnerVolumeSpecName "kube-api-access-5278h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:38:13.875826 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:13.875818 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c9b4b52b-717f-4f29-b23c-2cd11f4647c7" (UID: "c9b4b52b-717f-4f29-b23c-2cd11f4647c7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:38:13.875969 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:13.875853 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c9b4b52b-717f-4f29-b23c-2cd11f4647c7" (UID: "c9b4b52b-717f-4f29-b23c-2cd11f4647c7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:38:13.974573 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:13.974541 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-oauth-serving-cert\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:38:13.974573 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:13.974573 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-trusted-ca-bundle\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:38:13.974791 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:13.974590 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-console-oauth-config\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:38:13.974791 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:13.974601 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-console-config\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:38:13.974791 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:13.974613 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5278h\" (UniqueName: \"kubernetes.io/projected/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-kube-api-access-5278h\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:38:13.974791 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:13.974627 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-console-serving-cert\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:38:13.974791 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:13.974639 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9b4b52b-717f-4f29-b23c-2cd11f4647c7-service-ca\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:38:14.531744 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:14.531709 2575 generic.go:356] "Generic (PLEG): container finished" podID="c9b4b52b-717f-4f29-b23c-2cd11f4647c7" containerID="352e5ff48fcfebb67cb063cbe0413da7a2125cf991f80bf45a26a74325e63eff" exitCode=0 Jul 20 16:38:14.532242 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:14.531765 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bcfb6db95-fqt89" Jul 20 16:38:14.532242 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:14.531796 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bcfb6db95-fqt89" event={"ID":"c9b4b52b-717f-4f29-b23c-2cd11f4647c7","Type":"ContainerDied","Data":"352e5ff48fcfebb67cb063cbe0413da7a2125cf991f80bf45a26a74325e63eff"} Jul 20 16:38:14.532242 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:14.531884 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bcfb6db95-fqt89" event={"ID":"c9b4b52b-717f-4f29-b23c-2cd11f4647c7","Type":"ContainerDied","Data":"66bc56e51bb6af95bdf29c92168331483bc8938c6b120d9146eb57b74848951b"} Jul 20 16:38:14.532242 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:14.531917 2575 scope.go:117] "RemoveContainer" containerID="352e5ff48fcfebb67cb063cbe0413da7a2125cf991f80bf45a26a74325e63eff" Jul 20 16:38:14.541626 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:14.541608 2575 scope.go:117] "RemoveContainer" containerID="352e5ff48fcfebb67cb063cbe0413da7a2125cf991f80bf45a26a74325e63eff" Jul 20 16:38:14.541868 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:38:14.541848 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"352e5ff48fcfebb67cb063cbe0413da7a2125cf991f80bf45a26a74325e63eff\": container with ID starting with 352e5ff48fcfebb67cb063cbe0413da7a2125cf991f80bf45a26a74325e63eff not found: ID does not exist" containerID="352e5ff48fcfebb67cb063cbe0413da7a2125cf991f80bf45a26a74325e63eff" Jul 20 16:38:14.541916 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:14.541877 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"352e5ff48fcfebb67cb063cbe0413da7a2125cf991f80bf45a26a74325e63eff"} err="failed to get container status \"352e5ff48fcfebb67cb063cbe0413da7a2125cf991f80bf45a26a74325e63eff\": rpc error: code = NotFound desc = could not find container \"352e5ff48fcfebb67cb063cbe0413da7a2125cf991f80bf45a26a74325e63eff\": container with ID starting with 352e5ff48fcfebb67cb063cbe0413da7a2125cf991f80bf45a26a74325e63eff not found: ID does not exist" Jul 20 16:38:14.554210 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:14.554189 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bcfb6db95-fqt89"] Jul 20 16:38:14.556345 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:14.556325 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bcfb6db95-fqt89"] Jul 20 16:38:14.853717 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:14.853685 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9b4b52b-717f-4f29-b23c-2cd11f4647c7" path="/var/lib/kubelet/pods/c9b4b52b-717f-4f29-b23c-2cd11f4647c7/volumes" Jul 20 16:38:20.504945 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:20.504913 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vp6cb" Jul 20 16:38:22.239721 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.239681 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vp6cb"] Jul 20 16:38:22.240165 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.239903 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vp6cb" podUID="cd06c742-aee6-4636-8be2-dc4503f9ee5e" containerName="manager" containerID="cri-o://996024d776008a02a5395c9778fc2177332ee1692fd599edf4c21243762cebd1" gracePeriod=2 Jul 20 16:38:22.251673 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.251646 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vp6cb"] Jul 20 16:38:22.265042 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.265018 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xqrxd"] Jul 20 16:38:22.265442 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.265428 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd06c742-aee6-4636-8be2-dc4503f9ee5e" containerName="manager" Jul 20 16:38:22.265487 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.265444 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd06c742-aee6-4636-8be2-dc4503f9ee5e" containerName="manager" Jul 20 16:38:22.265487 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.265457 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9b4b52b-717f-4f29-b23c-2cd11f4647c7" containerName="console" Jul 20 16:38:22.265487 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.265462 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9b4b52b-717f-4f29-b23c-2cd11f4647c7" containerName="console" Jul 20 16:38:22.265586 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.265519 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd06c742-aee6-4636-8be2-dc4503f9ee5e" containerName="manager" Jul 20 16:38:22.265586 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.265527 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9b4b52b-717f-4f29-b23c-2cd11f4647c7" containerName="console" Jul 20 16:38:22.268757 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.268739 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xqrxd" Jul 20 16:38:22.270971 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:38:22.270936 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vp6cb\" is forbidden: User \"system:node:ip-10-0-133-157.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-157.ec2.internal' and this object" podUID="cd06c742-aee6-4636-8be2-dc4503f9ee5e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vp6cb" Jul 20 16:38:22.284917 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.284889 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xqrxd"] Jul 20 16:38:22.452436 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.452402 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26pcw\" (UniqueName: \"kubernetes.io/projected/5707b795-7801-4924-b0fb-4405a5d6f169-kube-api-access-26pcw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xqrxd\" (UID: \"5707b795-7801-4924-b0fb-4405a5d6f169\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xqrxd" Jul 20 16:38:22.452587 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.452480 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5707b795-7801-4924-b0fb-4405a5d6f169-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xqrxd\" (UID: \"5707b795-7801-4924-b0fb-4405a5d6f169\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xqrxd" Jul 20 16:38:22.482094 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.482056 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vp6cb" Jul 20 16:38:22.484860 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:38:22.484836 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vp6cb\" is forbidden: User \"system:node:ip-10-0-133-157.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-157.ec2.internal' and this object" podUID="cd06c742-aee6-4636-8be2-dc4503f9ee5e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vp6cb" Jul 20 16:38:22.552896 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.552869 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5707b795-7801-4924-b0fb-4405a5d6f169-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xqrxd\" (UID: \"5707b795-7801-4924-b0fb-4405a5d6f169\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xqrxd" Jul 20 16:38:22.553030 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.552961 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26pcw\" (UniqueName: \"kubernetes.io/projected/5707b795-7801-4924-b0fb-4405a5d6f169-kube-api-access-26pcw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xqrxd\" (UID: \"5707b795-7801-4924-b0fb-4405a5d6f169\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xqrxd" Jul 20 16:38:22.553272 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.553252 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5707b795-7801-4924-b0fb-4405a5d6f169-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xqrxd\" (UID: \"5707b795-7801-4924-b0fb-4405a5d6f169\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xqrxd" Jul 20 16:38:22.553945 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.553926 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkbjk"] Jul 20 16:38:22.557505 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.557486 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkbjk" Jul 20 16:38:22.559642 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:38:22.559618 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vp6cb\" is forbidden: User \"system:node:ip-10-0-133-157.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-157.ec2.internal' and this object" podUID="cd06c742-aee6-4636-8be2-dc4503f9ee5e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vp6cb" Jul 20 16:38:22.563237 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.563212 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26pcw\" (UniqueName: \"kubernetes.io/projected/5707b795-7801-4924-b0fb-4405a5d6f169-kube-api-access-26pcw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xqrxd\" (UID: \"5707b795-7801-4924-b0fb-4405a5d6f169\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xqrxd" Jul 20 16:38:22.578990 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.578966 2575 generic.go:356] "Generic (PLEG): container finished" podID="cd06c742-aee6-4636-8be2-dc4503f9ee5e" containerID="996024d776008a02a5395c9778fc2177332ee1692fd599edf4c21243762cebd1" exitCode=0 Jul 20 16:38:22.579076 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.579011 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vp6cb" Jul 20 16:38:22.579076 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.579037 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkbjk"] Jul 20 16:38:22.579185 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.579101 2575 scope.go:117] "RemoveContainer" containerID="996024d776008a02a5395c9778fc2177332ee1692fd599edf4c21243762cebd1" Jul 20 16:38:22.589027 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.588996 2575 scope.go:117] "RemoveContainer" containerID="996024d776008a02a5395c9778fc2177332ee1692fd599edf4c21243762cebd1" Jul 20 16:38:22.589352 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:38:22.589334 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"996024d776008a02a5395c9778fc2177332ee1692fd599edf4c21243762cebd1\": container with ID starting with 996024d776008a02a5395c9778fc2177332ee1692fd599edf4c21243762cebd1 not found: ID does not exist" containerID="996024d776008a02a5395c9778fc2177332ee1692fd599edf4c21243762cebd1" Jul 20 16:38:22.589424 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.589363 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"996024d776008a02a5395c9778fc2177332ee1692fd599edf4c21243762cebd1"} err="failed to get container status \"996024d776008a02a5395c9778fc2177332ee1692fd599edf4c21243762cebd1\": rpc error: code = NotFound desc = could not find container \"996024d776008a02a5395c9778fc2177332ee1692fd599edf4c21243762cebd1\": container with ID starting with 996024d776008a02a5395c9778fc2177332ee1692fd599edf4c21243762cebd1 not found: ID does not exist" Jul 20 16:38:22.592781 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:38:22.592748 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vp6cb\" is forbidden: User \"system:node:ip-10-0-133-157.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-157.ec2.internal' and this object" podUID="cd06c742-aee6-4636-8be2-dc4503f9ee5e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vp6cb" Jul 20 16:38:22.624960 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.624933 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xqrxd" Jul 20 16:38:22.653568 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.653542 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd06c742-aee6-4636-8be2-dc4503f9ee5e-extensions-socket-volume\") pod \"cd06c742-aee6-4636-8be2-dc4503f9ee5e\" (UID: \"cd06c742-aee6-4636-8be2-dc4503f9ee5e\") " Jul 20 16:38:22.653668 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.653638 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqxpc\" (UniqueName: \"kubernetes.io/projected/cd06c742-aee6-4636-8be2-dc4503f9ee5e-kube-api-access-vqxpc\") pod \"cd06c742-aee6-4636-8be2-dc4503f9ee5e\" (UID: \"cd06c742-aee6-4636-8be2-dc4503f9ee5e\") " Jul 20 16:38:22.653888 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.653865 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d8fa944b-ac2f-4707-8a15-e3effab87393-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nkbjk\" (UID: \"d8fa944b-ac2f-4707-8a15-e3effab87393\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkbjk" Jul 20 16:38:22.653941 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.653926 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvjqt\" (UniqueName: \"kubernetes.io/projected/d8fa944b-ac2f-4707-8a15-e3effab87393-kube-api-access-nvjqt\") pod \"kuadrant-operator-controller-manager-86878c769f-nkbjk\" (UID: \"d8fa944b-ac2f-4707-8a15-e3effab87393\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkbjk" Jul 20 16:38:22.654032 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.654005 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd06c742-aee6-4636-8be2-dc4503f9ee5e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cd06c742-aee6-4636-8be2-dc4503f9ee5e" (UID: "cd06c742-aee6-4636-8be2-dc4503f9ee5e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:38:22.654139 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.654122 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd06c742-aee6-4636-8be2-dc4503f9ee5e-extensions-socket-volume\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:38:22.655512 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.655490 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd06c742-aee6-4636-8be2-dc4503f9ee5e-kube-api-access-vqxpc" (OuterVolumeSpecName: "kube-api-access-vqxpc") pod "cd06c742-aee6-4636-8be2-dc4503f9ee5e" (UID: "cd06c742-aee6-4636-8be2-dc4503f9ee5e"). InnerVolumeSpecName "kube-api-access-vqxpc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:38:22.754805 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.754757 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d8fa944b-ac2f-4707-8a15-e3effab87393-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nkbjk\" (UID: \"d8fa944b-ac2f-4707-8a15-e3effab87393\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkbjk" Jul 20 16:38:22.754985 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.754837 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvjqt\" (UniqueName: \"kubernetes.io/projected/d8fa944b-ac2f-4707-8a15-e3effab87393-kube-api-access-nvjqt\") pod \"kuadrant-operator-controller-manager-86878c769f-nkbjk\" (UID: \"d8fa944b-ac2f-4707-8a15-e3effab87393\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkbjk" Jul 20 16:38:22.754985 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.754891 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqxpc\" (UniqueName: \"kubernetes.io/projected/cd06c742-aee6-4636-8be2-dc4503f9ee5e-kube-api-access-vqxpc\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:38:22.755238 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.755216 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d8fa944b-ac2f-4707-8a15-e3effab87393-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nkbjk\" (UID: \"d8fa944b-ac2f-4707-8a15-e3effab87393\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkbjk" Jul 20 16:38:22.766349 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.766320 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvjqt\" (UniqueName: \"kubernetes.io/projected/d8fa944b-ac2f-4707-8a15-e3effab87393-kube-api-access-nvjqt\") pod \"kuadrant-operator-controller-manager-86878c769f-nkbjk\" (UID: \"d8fa944b-ac2f-4707-8a15-e3effab87393\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkbjk" Jul 20 16:38:22.794783 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.794742 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xqrxd"] Jul 20 16:38:22.797180 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:38:22.797152 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5707b795_7801_4924_b0fb_4405a5d6f169.slice/crio-68120fa27b34e289d4bbc029e7aeb4d4a8fe2faa5e5a2466a850d88d04dd2536 WatchSource:0}: Error finding container 68120fa27b34e289d4bbc029e7aeb4d4a8fe2faa5e5a2466a850d88d04dd2536: Status 404 returned error can't find the container with id 68120fa27b34e289d4bbc029e7aeb4d4a8fe2faa5e5a2466a850d88d04dd2536 Jul 20 16:38:22.853656 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.853628 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd06c742-aee6-4636-8be2-dc4503f9ee5e" path="/var/lib/kubelet/pods/cd06c742-aee6-4636-8be2-dc4503f9ee5e/volumes" Jul 20 16:38:22.876335 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:22.876298 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkbjk" Jul 20 16:38:23.013564 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:23.013536 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkbjk"] Jul 20 16:38:23.015328 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:38:23.015300 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8fa944b_ac2f_4707_8a15_e3effab87393.slice/crio-02dfb20a67466a6d9077c1b53c7dba5d61887e4762bd4ee4d7bc2705919aee27 WatchSource:0}: Error finding container 02dfb20a67466a6d9077c1b53c7dba5d61887e4762bd4ee4d7bc2705919aee27: Status 404 returned error can't find the container with id 02dfb20a67466a6d9077c1b53c7dba5d61887e4762bd4ee4d7bc2705919aee27 Jul 20 16:38:23.585692 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:23.585652 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xqrxd" event={"ID":"5707b795-7801-4924-b0fb-4405a5d6f169","Type":"ContainerStarted","Data":"fef201a4ecb106d5edf7b8b86628fd7e70de4e6e818726205679bae54a661f82"} Jul 20 16:38:23.586131 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:23.585724 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xqrxd" Jul 20 16:38:23.586131 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:23.585752 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xqrxd" event={"ID":"5707b795-7801-4924-b0fb-4405a5d6f169","Type":"ContainerStarted","Data":"68120fa27b34e289d4bbc029e7aeb4d4a8fe2faa5e5a2466a850d88d04dd2536"} Jul 20 16:38:23.588228 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:23.588198 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkbjk" event={"ID":"d8fa944b-ac2f-4707-8a15-e3effab87393","Type":"ContainerStarted","Data":"fe457de20e318529d7adb3d789a50433a035879e2b84b57b93fb13264a1c92de"} Jul 20 16:38:23.588349 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:23.588247 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkbjk" event={"ID":"d8fa944b-ac2f-4707-8a15-e3effab87393","Type":"ContainerStarted","Data":"02dfb20a67466a6d9077c1b53c7dba5d61887e4762bd4ee4d7bc2705919aee27"} Jul 20 16:38:23.588349 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:23.588280 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkbjk" Jul 20 16:38:23.605389 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:23.605340 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xqrxd" podStartSLOduration=1.605327095 podStartE2EDuration="1.605327095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:38:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:38:23.603995972 +0000 UTC m=+529.254878470" watchObservedRunningTime="2026-07-20 16:38:23.605327095 +0000 UTC m=+529.256209592" Jul 20 16:38:23.639220 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:23.639140 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkbjk" podStartSLOduration=1.639121336 podStartE2EDuration="1.639121336s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:38:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:38:23.635360467 +0000 UTC m=+529.286242968" watchObservedRunningTime="2026-07-20 16:38:23.639121336 +0000 UTC m=+529.290003831" Jul 20 16:38:24.534370 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:24.534342 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tld2z" Jul 20 16:38:34.595522 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:34.595434 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xqrxd" Jul 20 16:38:34.596125 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:34.595840 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkbjk" Jul 20 16:38:34.675717 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:34.675685 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xqrxd"] Jul 20 16:38:34.675895 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:34.675874 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xqrxd" podUID="5707b795-7801-4924-b0fb-4405a5d6f169" containerName="manager" containerID="cri-o://fef201a4ecb106d5edf7b8b86628fd7e70de4e6e818726205679bae54a661f82" gracePeriod=10 Jul 20 16:38:34.928535 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:34.928512 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xqrxd" Jul 20 16:38:34.964879 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:34.964846 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26pcw\" (UniqueName: \"kubernetes.io/projected/5707b795-7801-4924-b0fb-4405a5d6f169-kube-api-access-26pcw\") pod \"5707b795-7801-4924-b0fb-4405a5d6f169\" (UID: \"5707b795-7801-4924-b0fb-4405a5d6f169\") " Jul 20 16:38:34.965080 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:34.964908 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5707b795-7801-4924-b0fb-4405a5d6f169-extensions-socket-volume\") pod \"5707b795-7801-4924-b0fb-4405a5d6f169\" (UID: \"5707b795-7801-4924-b0fb-4405a5d6f169\") " Jul 20 16:38:34.965401 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:34.965369 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5707b795-7801-4924-b0fb-4405a5d6f169-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5707b795-7801-4924-b0fb-4405a5d6f169" (UID: "5707b795-7801-4924-b0fb-4405a5d6f169"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:38:34.965574 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:34.965551 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5707b795-7801-4924-b0fb-4405a5d6f169-extensions-socket-volume\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:38:34.967030 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:34.967000 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5707b795-7801-4924-b0fb-4405a5d6f169-kube-api-access-26pcw" (OuterVolumeSpecName: "kube-api-access-26pcw") pod "5707b795-7801-4924-b0fb-4405a5d6f169" (UID: "5707b795-7801-4924-b0fb-4405a5d6f169"). InnerVolumeSpecName "kube-api-access-26pcw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:38:35.066437 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:35.066401 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26pcw\" (UniqueName: \"kubernetes.io/projected/5707b795-7801-4924-b0fb-4405a5d6f169-kube-api-access-26pcw\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:38:35.653602 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:35.653561 2575 generic.go:356] "Generic (PLEG): container finished" podID="5707b795-7801-4924-b0fb-4405a5d6f169" containerID="fef201a4ecb106d5edf7b8b86628fd7e70de4e6e818726205679bae54a661f82" exitCode=0 Jul 20 16:38:35.654008 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:35.653611 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xqrxd" Jul 20 16:38:35.654008 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:35.653649 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xqrxd" event={"ID":"5707b795-7801-4924-b0fb-4405a5d6f169","Type":"ContainerDied","Data":"fef201a4ecb106d5edf7b8b86628fd7e70de4e6e818726205679bae54a661f82"} Jul 20 16:38:35.654008 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:35.653704 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xqrxd" event={"ID":"5707b795-7801-4924-b0fb-4405a5d6f169","Type":"ContainerDied","Data":"68120fa27b34e289d4bbc029e7aeb4d4a8fe2faa5e5a2466a850d88d04dd2536"} Jul 20 16:38:35.654008 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:35.653727 2575 scope.go:117] "RemoveContainer" containerID="fef201a4ecb106d5edf7b8b86628fd7e70de4e6e818726205679bae54a661f82" Jul 20 16:38:35.663547 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:35.663529 2575 scope.go:117] "RemoveContainer" containerID="fef201a4ecb106d5edf7b8b86628fd7e70de4e6e818726205679bae54a661f82" Jul 20 16:38:35.663791 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:38:35.663772 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fef201a4ecb106d5edf7b8b86628fd7e70de4e6e818726205679bae54a661f82\": container with ID starting with fef201a4ecb106d5edf7b8b86628fd7e70de4e6e818726205679bae54a661f82 not found: ID does not exist" containerID="fef201a4ecb106d5edf7b8b86628fd7e70de4e6e818726205679bae54a661f82" Jul 20 16:38:35.663854 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:35.663804 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fef201a4ecb106d5edf7b8b86628fd7e70de4e6e818726205679bae54a661f82"} err="failed to get container status \"fef201a4ecb106d5edf7b8b86628fd7e70de4e6e818726205679bae54a661f82\": rpc error: code = NotFound desc = could not find container \"fef201a4ecb106d5edf7b8b86628fd7e70de4e6e818726205679bae54a661f82\": container with ID starting with fef201a4ecb106d5edf7b8b86628fd7e70de4e6e818726205679bae54a661f82 not found: ID does not exist" Jul 20 16:38:35.679887 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:35.677326 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xqrxd"] Jul 20 16:38:35.684839 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:35.684813 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xqrxd"] Jul 20 16:38:36.853209 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:36.853175 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5707b795-7801-4924-b0fb-4405a5d6f169" path="/var/lib/kubelet/pods/5707b795-7801-4924-b0fb-4405a5d6f169/volumes" Jul 20 16:38:53.899424 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:53.899385 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:38:53.899820 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:53.899811 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5707b795-7801-4924-b0fb-4405a5d6f169" containerName="manager" Jul 20 16:38:53.899862 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:53.899823 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5707b795-7801-4924-b0fb-4405a5d6f169" containerName="manager" Jul 20 16:38:53.899897 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:53.899883 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5707b795-7801-4924-b0fb-4405a5d6f169" containerName="manager" Jul 20 16:38:53.904288 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:53.904267 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-l9nlc" Jul 20 16:38:53.906822 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:53.906798 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fgs6k\"" Jul 20 16:38:53.906912 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:53.906844 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 20 16:38:53.912324 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:53.912301 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:38:53.949516 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:53.949479 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:38:54.037573 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:54.037539 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7dff765a-14af-4f25-9dae-c2af7972f17d-config-file\") pod \"limitador-limitador-54d6d988d5-l9nlc\" (UID: \"7dff765a-14af-4f25-9dae-c2af7972f17d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-l9nlc" Jul 20 16:38:54.037751 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:54.037659 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d2jt\" (UniqueName: \"kubernetes.io/projected/7dff765a-14af-4f25-9dae-c2af7972f17d-kube-api-access-2d2jt\") pod \"limitador-limitador-54d6d988d5-l9nlc\" (UID: \"7dff765a-14af-4f25-9dae-c2af7972f17d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-l9nlc" Jul 20 16:38:54.138844 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:54.138809 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7dff765a-14af-4f25-9dae-c2af7972f17d-config-file\") pod \"limitador-limitador-54d6d988d5-l9nlc\" (UID: \"7dff765a-14af-4f25-9dae-c2af7972f17d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-l9nlc" Jul 20 16:38:54.139009 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:54.138912 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d2jt\" (UniqueName: \"kubernetes.io/projected/7dff765a-14af-4f25-9dae-c2af7972f17d-kube-api-access-2d2jt\") pod \"limitador-limitador-54d6d988d5-l9nlc\" (UID: \"7dff765a-14af-4f25-9dae-c2af7972f17d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-l9nlc" Jul 20 16:38:54.139499 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:54.139479 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7dff765a-14af-4f25-9dae-c2af7972f17d-config-file\") pod \"limitador-limitador-54d6d988d5-l9nlc\" (UID: \"7dff765a-14af-4f25-9dae-c2af7972f17d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-l9nlc" Jul 20 16:38:54.146876 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:54.146845 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d2jt\" (UniqueName: \"kubernetes.io/projected/7dff765a-14af-4f25-9dae-c2af7972f17d-kube-api-access-2d2jt\") pod \"limitador-limitador-54d6d988d5-l9nlc\" (UID: \"7dff765a-14af-4f25-9dae-c2af7972f17d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-l9nlc" Jul 20 16:38:54.215961 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:54.215865 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-l9nlc" Jul 20 16:38:54.331229 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:54.331178 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-q9z5z"] Jul 20 16:38:54.335730 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:54.335703 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-q9z5z"] Jul 20 16:38:54.335854 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:54.335784 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-q9z5z" Jul 20 16:38:54.338374 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:54.338344 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dd2w2\"" Jul 20 16:38:54.359379 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:54.359353 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:38:54.361016 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:38:54.360988 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dff765a_14af_4f25_9dae_c2af7972f17d.slice/crio-f3913f3135f5001c8a23ec5b4720b62f80f261e58d255f8a4d1bb35c90bb7ce6 WatchSource:0}: Error finding container f3913f3135f5001c8a23ec5b4720b62f80f261e58d255f8a4d1bb35c90bb7ce6: Status 404 returned error can't find the container with id f3913f3135f5001c8a23ec5b4720b62f80f261e58d255f8a4d1bb35c90bb7ce6 Jul 20 16:38:54.442745 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:54.442706 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndqvj\" (UniqueName: \"kubernetes.io/projected/4f97d6c9-4c3c-4eda-9df3-db3eeb48c554-kube-api-access-ndqvj\") pod \"authorino-58cd955675-q9z5z\" (UID: \"4f97d6c9-4c3c-4eda-9df3-db3eeb48c554\") " pod="kuadrant-system/authorino-58cd955675-q9z5z" Jul 20 16:38:54.543485 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:54.543449 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndqvj\" (UniqueName: \"kubernetes.io/projected/4f97d6c9-4c3c-4eda-9df3-db3eeb48c554-kube-api-access-ndqvj\") pod \"authorino-58cd955675-q9z5z\" (UID: \"4f97d6c9-4c3c-4eda-9df3-db3eeb48c554\") " pod="kuadrant-system/authorino-58cd955675-q9z5z" Jul 20 16:38:54.551383 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:54.551355 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndqvj\" (UniqueName: \"kubernetes.io/projected/4f97d6c9-4c3c-4eda-9df3-db3eeb48c554-kube-api-access-ndqvj\") pod \"authorino-58cd955675-q9z5z\" (UID: \"4f97d6c9-4c3c-4eda-9df3-db3eeb48c554\") " pod="kuadrant-system/authorino-58cd955675-q9z5z" Jul 20 16:38:54.647889 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:54.647852 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-q9z5z" Jul 20 16:38:54.761130 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:54.761073 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-l9nlc" event={"ID":"7dff765a-14af-4f25-9dae-c2af7972f17d","Type":"ContainerStarted","Data":"f3913f3135f5001c8a23ec5b4720b62f80f261e58d255f8a4d1bb35c90bb7ce6"} Jul 20 16:38:54.782467 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:54.782443 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-q9z5z"] Jul 20 16:38:54.784452 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:38:54.784422 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f97d6c9_4c3c_4eda_9df3_db3eeb48c554.slice/crio-a6a0eff2798cd6551cedbe2111fa02ae9052eaac22f76c4cd29f1dd26deada83 WatchSource:0}: Error finding container a6a0eff2798cd6551cedbe2111fa02ae9052eaac22f76c4cd29f1dd26deada83: Status 404 returned error can't find the container with id a6a0eff2798cd6551cedbe2111fa02ae9052eaac22f76c4cd29f1dd26deada83 Jul 20 16:38:55.772598 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:55.772557 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-q9z5z" event={"ID":"4f97d6c9-4c3c-4eda-9df3-db3eeb48c554","Type":"ContainerStarted","Data":"a6a0eff2798cd6551cedbe2111fa02ae9052eaac22f76c4cd29f1dd26deada83"} Jul 20 16:38:58.552495 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:58.552423 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-q9z5z"] Jul 20 16:38:58.793598 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:58.793558 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-l9nlc" event={"ID":"7dff765a-14af-4f25-9dae-c2af7972f17d","Type":"ContainerStarted","Data":"cfeecfe1e8039867b700e8ba326165f69588bc360ad6ef1c4ae2947e87cd23e8"} Jul 20 16:38:58.793763 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:58.793750 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-l9nlc" Jul 20 16:38:58.795329 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:58.795296 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-q9z5z" event={"ID":"4f97d6c9-4c3c-4eda-9df3-db3eeb48c554","Type":"ContainerStarted","Data":"e1a9372535257b58302e5cd746222864be8a7ece2740ebbf66ae4c280c5ac55f"} Jul 20 16:38:58.795441 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:58.795359 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-q9z5z" podUID="4f97d6c9-4c3c-4eda-9df3-db3eeb48c554" containerName="authorino" containerID="cri-o://e1a9372535257b58302e5cd746222864be8a7ece2740ebbf66ae4c280c5ac55f" gracePeriod=30 Jul 20 16:38:58.809503 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:58.809460 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-l9nlc" podStartSLOduration=1.471762153 podStartE2EDuration="5.809444546s" totalImagesPullingTime="4.337682393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:38:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:38:58.807151197 +0000 UTC m=+564.458033689" watchObservedRunningTime="2026-07-20 16:38:58.809444546 +0000 UTC m=+564.460327044" Jul 20 16:38:58.822278 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:58.822216 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-q9z5z" podStartSLOduration=0.907206514 podStartE2EDuration="4.822187217s" totalImagesPullingTime="3.914980703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:38:58.819238672 +0000 UTC m=+564.470121173" watchObservedRunningTime="2026-07-20 16:38:58.822187217 +0000 UTC m=+564.473069717" Jul 20 16:38:59.053797 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:59.053772 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-q9z5z" Jul 20 16:38:59.189884 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:59.189783 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndqvj\" (UniqueName: \"kubernetes.io/projected/4f97d6c9-4c3c-4eda-9df3-db3eeb48c554-kube-api-access-ndqvj\") pod \"4f97d6c9-4c3c-4eda-9df3-db3eeb48c554\" (UID: \"4f97d6c9-4c3c-4eda-9df3-db3eeb48c554\") " Jul 20 16:38:59.192008 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:59.191976 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f97d6c9-4c3c-4eda-9df3-db3eeb48c554-kube-api-access-ndqvj" (OuterVolumeSpecName: "kube-api-access-ndqvj") pod "4f97d6c9-4c3c-4eda-9df3-db3eeb48c554" (UID: "4f97d6c9-4c3c-4eda-9df3-db3eeb48c554"). InnerVolumeSpecName "kube-api-access-ndqvj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:38:59.290775 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:59.290738 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndqvj\" (UniqueName: \"kubernetes.io/projected/4f97d6c9-4c3c-4eda-9df3-db3eeb48c554-kube-api-access-ndqvj\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:38:59.801484 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:59.801445 2575 generic.go:356] "Generic (PLEG): container finished" podID="4f97d6c9-4c3c-4eda-9df3-db3eeb48c554" containerID="e1a9372535257b58302e5cd746222864be8a7ece2740ebbf66ae4c280c5ac55f" exitCode=2 Jul 20 16:38:59.801484 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:59.801483 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-q9z5z" Jul 20 16:38:59.801975 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:59.801532 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-q9z5z" event={"ID":"4f97d6c9-4c3c-4eda-9df3-db3eeb48c554","Type":"ContainerDied","Data":"e1a9372535257b58302e5cd746222864be8a7ece2740ebbf66ae4c280c5ac55f"} Jul 20 16:38:59.801975 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:59.801574 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-q9z5z" event={"ID":"4f97d6c9-4c3c-4eda-9df3-db3eeb48c554","Type":"ContainerDied","Data":"a6a0eff2798cd6551cedbe2111fa02ae9052eaac22f76c4cd29f1dd26deada83"} Jul 20 16:38:59.801975 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:59.801596 2575 scope.go:117] "RemoveContainer" containerID="e1a9372535257b58302e5cd746222864be8a7ece2740ebbf66ae4c280c5ac55f" Jul 20 16:38:59.811447 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:59.811430 2575 scope.go:117] "RemoveContainer" containerID="e1a9372535257b58302e5cd746222864be8a7ece2740ebbf66ae4c280c5ac55f" Jul 20 16:38:59.811669 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:38:59.811652 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1a9372535257b58302e5cd746222864be8a7ece2740ebbf66ae4c280c5ac55f\": container with ID starting with e1a9372535257b58302e5cd746222864be8a7ece2740ebbf66ae4c280c5ac55f not found: ID does not exist" containerID="e1a9372535257b58302e5cd746222864be8a7ece2740ebbf66ae4c280c5ac55f" Jul 20 16:38:59.811730 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:59.811674 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1a9372535257b58302e5cd746222864be8a7ece2740ebbf66ae4c280c5ac55f"} err="failed to get container status \"e1a9372535257b58302e5cd746222864be8a7ece2740ebbf66ae4c280c5ac55f\": rpc error: code = NotFound desc = could not find container \"e1a9372535257b58302e5cd746222864be8a7ece2740ebbf66ae4c280c5ac55f\": container with ID starting with e1a9372535257b58302e5cd746222864be8a7ece2740ebbf66ae4c280c5ac55f not found: ID does not exist" Jul 20 16:38:59.822612 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:59.822589 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-q9z5z"] Jul 20 16:38:59.826377 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:38:59.826356 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-q9z5z"] Jul 20 16:39:00.853631 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:00.853596 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f97d6c9-4c3c-4eda-9df3-db3eeb48c554" path="/var/lib/kubelet/pods/4f97d6c9-4c3c-4eda-9df3-db3eeb48c554/volumes" Jul 20 16:39:09.802918 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:09.802889 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-l9nlc" Jul 20 16:39:28.181666 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.181630 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8vs52"] Jul 20 16:39:28.182099 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.182065 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f97d6c9-4c3c-4eda-9df3-db3eeb48c554" containerName="authorino" Jul 20 16:39:28.182099 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.182076 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f97d6c9-4c3c-4eda-9df3-db3eeb48c554" containerName="authorino" Jul 20 16:39:28.182189 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.182177 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f97d6c9-4c3c-4eda-9df3-db3eeb48c554" containerName="authorino" Jul 20 16:39:28.186695 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.186674 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8vs52" Jul 20 16:39:28.188989 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.188969 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dd2w2\"" Jul 20 16:39:28.191323 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.191301 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8vs52"] Jul 20 16:39:28.244049 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.244010 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq8bf\" (UniqueName: \"kubernetes.io/projected/270fbae1-afcf-4cc1-920c-51dc95c34959-kube-api-access-zq8bf\") pod \"authorino-5d4b67c446-8vs52\" (UID: \"270fbae1-afcf-4cc1-920c-51dc95c34959\") " pod="kuadrant-system/authorino-5d4b67c446-8vs52" Jul 20 16:39:28.345107 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.345045 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq8bf\" (UniqueName: \"kubernetes.io/projected/270fbae1-afcf-4cc1-920c-51dc95c34959-kube-api-access-zq8bf\") pod \"authorino-5d4b67c446-8vs52\" (UID: \"270fbae1-afcf-4cc1-920c-51dc95c34959\") " pod="kuadrant-system/authorino-5d4b67c446-8vs52" Jul 20 16:39:28.353445 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.353417 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq8bf\" (UniqueName: \"kubernetes.io/projected/270fbae1-afcf-4cc1-920c-51dc95c34959-kube-api-access-zq8bf\") pod \"authorino-5d4b67c446-8vs52\" (UID: \"270fbae1-afcf-4cc1-920c-51dc95c34959\") " pod="kuadrant-system/authorino-5d4b67c446-8vs52" Jul 20 16:39:28.358940 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.358914 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8vs52"] Jul 20 16:39:28.359246 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.359228 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8vs52" Jul 20 16:39:28.382944 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.382914 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-vv99b"] Jul 20 16:39:28.386998 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.386977 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-vv99b" Jul 20 16:39:28.389328 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.389308 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 20 16:39:28.392667 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.392634 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-vv99b"] Jul 20 16:39:28.441622 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.441537 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-vv99b"] Jul 20 16:39:28.441859 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:39:28.441840 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-8bjbh tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-76877994-vv99b" podUID="d1a6abbf-cbf9-4c11-b796-6d9ef81bc9e4" Jul 20 16:39:28.445929 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.445901 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d1a6abbf-cbf9-4c11-b796-6d9ef81bc9e4-tls-cert\") pod \"authorino-76877994-vv99b\" (UID: \"d1a6abbf-cbf9-4c11-b796-6d9ef81bc9e4\") " pod="kuadrant-system/authorino-76877994-vv99b" Jul 20 16:39:28.446056 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.445941 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bjbh\" (UniqueName: \"kubernetes.io/projected/d1a6abbf-cbf9-4c11-b796-6d9ef81bc9e4-kube-api-access-8bjbh\") pod \"authorino-76877994-vv99b\" (UID: \"d1a6abbf-cbf9-4c11-b796-6d9ef81bc9e4\") " pod="kuadrant-system/authorino-76877994-vv99b" Jul 20 16:39:28.465006 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.464972 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-79774646bc-sbfjr"] Jul 20 16:39:28.469344 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.469322 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79774646bc-sbfjr" Jul 20 16:39:28.473603 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.473579 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-79774646bc-sbfjr"] Jul 20 16:39:28.507594 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.507524 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8vs52"] Jul 20 16:39:28.508679 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:39:28.508648 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod270fbae1_afcf_4cc1_920c_51dc95c34959.slice/crio-3100f087b7e219017a1b6f2f7dfcb3987ee80adff49510e5e88c88acad8bedd2 WatchSource:0}: Error finding container 3100f087b7e219017a1b6f2f7dfcb3987ee80adff49510e5e88c88acad8bedd2: Status 404 returned error can't find the container with id 3100f087b7e219017a1b6f2f7dfcb3987ee80adff49510e5e88c88acad8bedd2 Jul 20 16:39:28.546684 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.546648 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg9lc\" (UniqueName: \"kubernetes.io/projected/81f021b2-ecd7-46fa-97c3-b731e9ab5027-kube-api-access-pg9lc\") pod \"authorino-79774646bc-sbfjr\" (UID: \"81f021b2-ecd7-46fa-97c3-b731e9ab5027\") " pod="kuadrant-system/authorino-79774646bc-sbfjr" Jul 20 16:39:28.546876 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.546710 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/81f021b2-ecd7-46fa-97c3-b731e9ab5027-tls-cert\") pod \"authorino-79774646bc-sbfjr\" (UID: \"81f021b2-ecd7-46fa-97c3-b731e9ab5027\") " pod="kuadrant-system/authorino-79774646bc-sbfjr" Jul 20 16:39:28.546876 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.546748 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d1a6abbf-cbf9-4c11-b796-6d9ef81bc9e4-tls-cert\") pod \"authorino-76877994-vv99b\" (UID: \"d1a6abbf-cbf9-4c11-b796-6d9ef81bc9e4\") " pod="kuadrant-system/authorino-76877994-vv99b" Jul 20 16:39:28.546876 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.546780 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bjbh\" (UniqueName: \"kubernetes.io/projected/d1a6abbf-cbf9-4c11-b796-6d9ef81bc9e4-kube-api-access-8bjbh\") pod \"authorino-76877994-vv99b\" (UID: \"d1a6abbf-cbf9-4c11-b796-6d9ef81bc9e4\") " pod="kuadrant-system/authorino-76877994-vv99b" Jul 20 16:39:28.549158 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.549135 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d1a6abbf-cbf9-4c11-b796-6d9ef81bc9e4-tls-cert\") pod \"authorino-76877994-vv99b\" (UID: \"d1a6abbf-cbf9-4c11-b796-6d9ef81bc9e4\") " pod="kuadrant-system/authorino-76877994-vv99b" Jul 20 16:39:28.555531 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.555508 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bjbh\" (UniqueName: \"kubernetes.io/projected/d1a6abbf-cbf9-4c11-b796-6d9ef81bc9e4-kube-api-access-8bjbh\") pod \"authorino-76877994-vv99b\" (UID: \"d1a6abbf-cbf9-4c11-b796-6d9ef81bc9e4\") " pod="kuadrant-system/authorino-76877994-vv99b" Jul 20 16:39:28.647769 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.647728 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg9lc\" (UniqueName: \"kubernetes.io/projected/81f021b2-ecd7-46fa-97c3-b731e9ab5027-kube-api-access-pg9lc\") pod \"authorino-79774646bc-sbfjr\" (UID: \"81f021b2-ecd7-46fa-97c3-b731e9ab5027\") " pod="kuadrant-system/authorino-79774646bc-sbfjr" Jul 20 16:39:28.647946 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.647778 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/81f021b2-ecd7-46fa-97c3-b731e9ab5027-tls-cert\") pod \"authorino-79774646bc-sbfjr\" (UID: \"81f021b2-ecd7-46fa-97c3-b731e9ab5027\") " pod="kuadrant-system/authorino-79774646bc-sbfjr" Jul 20 16:39:28.650291 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.650268 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/81f021b2-ecd7-46fa-97c3-b731e9ab5027-tls-cert\") pod \"authorino-79774646bc-sbfjr\" (UID: \"81f021b2-ecd7-46fa-97c3-b731e9ab5027\") " pod="kuadrant-system/authorino-79774646bc-sbfjr" Jul 20 16:39:28.654995 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.654971 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg9lc\" (UniqueName: \"kubernetes.io/projected/81f021b2-ecd7-46fa-97c3-b731e9ab5027-kube-api-access-pg9lc\") pod \"authorino-79774646bc-sbfjr\" (UID: \"81f021b2-ecd7-46fa-97c3-b731e9ab5027\") " pod="kuadrant-system/authorino-79774646bc-sbfjr" Jul 20 16:39:28.781956 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.781876 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79774646bc-sbfjr" Jul 20 16:39:28.913347 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.913285 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-79774646bc-sbfjr"] Jul 20 16:39:28.916025 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:39:28.915999 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81f021b2_ecd7_46fa_97c3_b731e9ab5027.slice/crio-f6c956d5bd4c5f0d84a2248849f26f798d07a96b83fe8c5c842e7c1d2817705a WatchSource:0}: Error finding container f6c956d5bd4c5f0d84a2248849f26f798d07a96b83fe8c5c842e7c1d2817705a: Status 404 returned error can't find the container with id f6c956d5bd4c5f0d84a2248849f26f798d07a96b83fe8c5c842e7c1d2817705a Jul 20 16:39:28.976318 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.976285 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8vs52" event={"ID":"270fbae1-afcf-4cc1-920c-51dc95c34959","Type":"ContainerStarted","Data":"3100f087b7e219017a1b6f2f7dfcb3987ee80adff49510e5e88c88acad8bedd2"} Jul 20 16:39:28.977428 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.977406 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79774646bc-sbfjr" event={"ID":"81f021b2-ecd7-46fa-97c3-b731e9ab5027","Type":"ContainerStarted","Data":"f6c956d5bd4c5f0d84a2248849f26f798d07a96b83fe8c5c842e7c1d2817705a"} Jul 20 16:39:28.977428 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.977420 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-vv99b" Jul 20 16:39:28.984476 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:28.984458 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-vv99b" Jul 20 16:39:29.050386 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:29.050364 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d1a6abbf-cbf9-4c11-b796-6d9ef81bc9e4-tls-cert\") pod \"d1a6abbf-cbf9-4c11-b796-6d9ef81bc9e4\" (UID: \"d1a6abbf-cbf9-4c11-b796-6d9ef81bc9e4\") " Jul 20 16:39:29.050491 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:29.050399 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8bjbh\" (UniqueName: \"kubernetes.io/projected/d1a6abbf-cbf9-4c11-b796-6d9ef81bc9e4-kube-api-access-8bjbh\") pod \"d1a6abbf-cbf9-4c11-b796-6d9ef81bc9e4\" (UID: \"d1a6abbf-cbf9-4c11-b796-6d9ef81bc9e4\") " Jul 20 16:39:29.052269 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:29.052245 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1a6abbf-cbf9-4c11-b796-6d9ef81bc9e4-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "d1a6abbf-cbf9-4c11-b796-6d9ef81bc9e4" (UID: "d1a6abbf-cbf9-4c11-b796-6d9ef81bc9e4"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:39:29.052397 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:29.052373 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1a6abbf-cbf9-4c11-b796-6d9ef81bc9e4-kube-api-access-8bjbh" (OuterVolumeSpecName: "kube-api-access-8bjbh") pod "d1a6abbf-cbf9-4c11-b796-6d9ef81bc9e4" (UID: "d1a6abbf-cbf9-4c11-b796-6d9ef81bc9e4"). InnerVolumeSpecName "kube-api-access-8bjbh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:39:29.151714 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:29.151674 2575 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d1a6abbf-cbf9-4c11-b796-6d9ef81bc9e4-tls-cert\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:39:29.151714 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:29.151709 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bjbh\" (UniqueName: \"kubernetes.io/projected/d1a6abbf-cbf9-4c11-b796-6d9ef81bc9e4-kube-api-access-8bjbh\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:39:29.983916 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:29.983874 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8vs52" event={"ID":"270fbae1-afcf-4cc1-920c-51dc95c34959","Type":"ContainerStarted","Data":"97b36bafdd7ff1c27e91efcca150561ab24150d3c4f4fe6584aef49b3453da0b"} Jul 20 16:39:29.983916 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:29.983900 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-8vs52" podUID="270fbae1-afcf-4cc1-920c-51dc95c34959" containerName="authorino" containerID="cri-o://97b36bafdd7ff1c27e91efcca150561ab24150d3c4f4fe6584aef49b3453da0b" gracePeriod=30 Jul 20 16:39:29.985496 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:29.985467 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79774646bc-sbfjr" event={"ID":"81f021b2-ecd7-46fa-97c3-b731e9ab5027","Type":"ContainerStarted","Data":"d51bdf868df4742d8b55f6db304cb46e0fdf49eeacf68c0dcfa28e316eca8a40"} Jul 20 16:39:29.985631 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:29.985513 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-vv99b" Jul 20 16:39:29.999335 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:29.999288 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-8vs52" podStartSLOduration=1.5252936799999999 podStartE2EDuration="1.999275151s" totalImagesPullingTime="473.981471ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:39:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:39:29.997723798 +0000 UTC m=+595.648606299" watchObservedRunningTime="2026-07-20 16:39:29.999275151 +0000 UTC m=+595.650157649" Jul 20 16:39:30.020648 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:30.020618 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-vv99b"] Jul 20 16:39:30.022808 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:30.022786 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-vv99b"] Jul 20 16:39:30.034502 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:30.034456 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-79774646bc-sbfjr" podStartSLOduration=1.648079842 podStartE2EDuration="2.034445066s" totalImagesPullingTime="386.365224ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:39:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:39:30.033908671 +0000 UTC m=+595.684791172" watchObservedRunningTime="2026-07-20 16:39:30.034445066 +0000 UTC m=+595.685327564" Jul 20 16:39:30.266903 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:30.266875 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8vs52" Jul 20 16:39:30.362815 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:30.362780 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zq8bf\" (UniqueName: \"kubernetes.io/projected/270fbae1-afcf-4cc1-920c-51dc95c34959-kube-api-access-zq8bf\") pod \"270fbae1-afcf-4cc1-920c-51dc95c34959\" (UID: \"270fbae1-afcf-4cc1-920c-51dc95c34959\") " Jul 20 16:39:30.364935 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:30.364904 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/270fbae1-afcf-4cc1-920c-51dc95c34959-kube-api-access-zq8bf" (OuterVolumeSpecName: "kube-api-access-zq8bf") pod "270fbae1-afcf-4cc1-920c-51dc95c34959" (UID: "270fbae1-afcf-4cc1-920c-51dc95c34959"). InnerVolumeSpecName "kube-api-access-zq8bf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:39:30.463587 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:30.463552 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zq8bf\" (UniqueName: \"kubernetes.io/projected/270fbae1-afcf-4cc1-920c-51dc95c34959-kube-api-access-zq8bf\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:39:30.854274 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:30.854241 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1a6abbf-cbf9-4c11-b796-6d9ef81bc9e4" path="/var/lib/kubelet/pods/d1a6abbf-cbf9-4c11-b796-6d9ef81bc9e4/volumes" Jul 20 16:39:30.992174 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:30.992138 2575 generic.go:356] "Generic (PLEG): container finished" podID="270fbae1-afcf-4cc1-920c-51dc95c34959" containerID="97b36bafdd7ff1c27e91efcca150561ab24150d3c4f4fe6584aef49b3453da0b" exitCode=0 Jul 20 16:39:30.992611 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:30.992189 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8vs52" Jul 20 16:39:30.992611 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:30.992234 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8vs52" event={"ID":"270fbae1-afcf-4cc1-920c-51dc95c34959","Type":"ContainerDied","Data":"97b36bafdd7ff1c27e91efcca150561ab24150d3c4f4fe6584aef49b3453da0b"} Jul 20 16:39:30.992611 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:30.992279 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8vs52" event={"ID":"270fbae1-afcf-4cc1-920c-51dc95c34959","Type":"ContainerDied","Data":"3100f087b7e219017a1b6f2f7dfcb3987ee80adff49510e5e88c88acad8bedd2"} Jul 20 16:39:30.992611 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:30.992301 2575 scope.go:117] "RemoveContainer" containerID="97b36bafdd7ff1c27e91efcca150561ab24150d3c4f4fe6584aef49b3453da0b" Jul 20 16:39:31.001232 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:31.001213 2575 scope.go:117] "RemoveContainer" containerID="97b36bafdd7ff1c27e91efcca150561ab24150d3c4f4fe6584aef49b3453da0b" Jul 20 16:39:31.001497 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:39:31.001478 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97b36bafdd7ff1c27e91efcca150561ab24150d3c4f4fe6584aef49b3453da0b\": container with ID starting with 97b36bafdd7ff1c27e91efcca150561ab24150d3c4f4fe6584aef49b3453da0b not found: ID does not exist" containerID="97b36bafdd7ff1c27e91efcca150561ab24150d3c4f4fe6584aef49b3453da0b" Jul 20 16:39:31.001545 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:31.001507 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97b36bafdd7ff1c27e91efcca150561ab24150d3c4f4fe6584aef49b3453da0b"} err="failed to get container status \"97b36bafdd7ff1c27e91efcca150561ab24150d3c4f4fe6584aef49b3453da0b\": rpc error: code = NotFound desc = could not find container \"97b36bafdd7ff1c27e91efcca150561ab24150d3c4f4fe6584aef49b3453da0b\": container with ID starting with 97b36bafdd7ff1c27e91efcca150561ab24150d3c4f4fe6584aef49b3453da0b not found: ID does not exist" Jul 20 16:39:31.008252 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:31.008230 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8vs52"] Jul 20 16:39:31.011569 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:31.011547 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8vs52"] Jul 20 16:39:32.854356 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:32.854319 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="270fbae1-afcf-4cc1-920c-51dc95c34959" path="/var/lib/kubelet/pods/270fbae1-afcf-4cc1-920c-51dc95c34959/volumes" Jul 20 16:39:34.796831 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:34.796799 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-99wqw_0ec4c40f-7638-4fe3-8bff-edb2579a3b3b/console-operator/1.log" Jul 20 16:39:34.800792 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:39:34.800771 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-99wqw_0ec4c40f-7638-4fe3-8bff-edb2579a3b3b/console-operator/1.log" Jul 20 16:40:11.410955 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:40:11.410913 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:40:40.600695 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:40:40.600660 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:41:10.681299 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:41:10.681262 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:41:16.689314 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:41:16.689270 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:41:24.789600 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:41:24.789559 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:41:33.684435 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:41:33.684341 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:41:43.193727 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:41:43.193690 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:42:52.096033 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:52.095998 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7fcc6c6794-jnxn7"] Jul 20 16:42:52.096634 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:52.096518 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="270fbae1-afcf-4cc1-920c-51dc95c34959" containerName="authorino" Jul 20 16:42:52.096634 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:52.096535 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="270fbae1-afcf-4cc1-920c-51dc95c34959" containerName="authorino" Jul 20 16:42:52.096634 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:52.096618 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="270fbae1-afcf-4cc1-920c-51dc95c34959" containerName="authorino" Jul 20 16:42:52.099628 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:52.099609 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fcc6c6794-jnxn7" Jul 20 16:42:52.106734 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:52.106711 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7fcc6c6794-jnxn7"] Jul 20 16:42:52.217288 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:52.217251 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c9de8109-5603-46a7-83b6-8348299b17bb-tls-cert\") pod \"authorino-7fcc6c6794-jnxn7\" (UID: \"c9de8109-5603-46a7-83b6-8348299b17bb\") " pod="kuadrant-system/authorino-7fcc6c6794-jnxn7" Jul 20 16:42:52.217472 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:52.217308 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljfgs\" (UniqueName: \"kubernetes.io/projected/c9de8109-5603-46a7-83b6-8348299b17bb-kube-api-access-ljfgs\") pod \"authorino-7fcc6c6794-jnxn7\" (UID: \"c9de8109-5603-46a7-83b6-8348299b17bb\") " pod="kuadrant-system/authorino-7fcc6c6794-jnxn7" Jul 20 16:42:52.317884 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:52.317847 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c9de8109-5603-46a7-83b6-8348299b17bb-tls-cert\") pod \"authorino-7fcc6c6794-jnxn7\" (UID: \"c9de8109-5603-46a7-83b6-8348299b17bb\") " pod="kuadrant-system/authorino-7fcc6c6794-jnxn7" Jul 20 16:42:52.318077 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:52.317914 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljfgs\" (UniqueName: \"kubernetes.io/projected/c9de8109-5603-46a7-83b6-8348299b17bb-kube-api-access-ljfgs\") pod \"authorino-7fcc6c6794-jnxn7\" (UID: \"c9de8109-5603-46a7-83b6-8348299b17bb\") " pod="kuadrant-system/authorino-7fcc6c6794-jnxn7" Jul 20 16:42:52.326560 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:52.321402 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c9de8109-5603-46a7-83b6-8348299b17bb-tls-cert\") pod \"authorino-7fcc6c6794-jnxn7\" (UID: \"c9de8109-5603-46a7-83b6-8348299b17bb\") " pod="kuadrant-system/authorino-7fcc6c6794-jnxn7" Jul 20 16:42:52.329845 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:52.329812 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljfgs\" (UniqueName: \"kubernetes.io/projected/c9de8109-5603-46a7-83b6-8348299b17bb-kube-api-access-ljfgs\") pod \"authorino-7fcc6c6794-jnxn7\" (UID: \"c9de8109-5603-46a7-83b6-8348299b17bb\") " pod="kuadrant-system/authorino-7fcc6c6794-jnxn7" Jul 20 16:42:52.410511 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:52.410435 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fcc6c6794-jnxn7" Jul 20 16:42:52.551172 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:52.551054 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7fcc6c6794-jnxn7"] Jul 20 16:42:52.552677 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:42:52.552645 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc9de8109_5603_46a7_83b6_8348299b17bb.slice/crio-0772e2753b1ae1ba8605dfb6ce8dcc81aae56dadb4dfaf48d6c505192f660781 WatchSource:0}: Error finding container 0772e2753b1ae1ba8605dfb6ce8dcc81aae56dadb4dfaf48d6c505192f660781: Status 404 returned error can't find the container with id 0772e2753b1ae1ba8605dfb6ce8dcc81aae56dadb4dfaf48d6c505192f660781 Jul 20 16:42:52.553961 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:52.553943 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 16:42:53.112293 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:53.112268 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7fcc6c6794-jnxn7" event={"ID":"c9de8109-5603-46a7-83b6-8348299b17bb","Type":"ContainerStarted","Data":"0772e2753b1ae1ba8605dfb6ce8dcc81aae56dadb4dfaf48d6c505192f660781"} Jul 20 16:42:54.120274 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:54.120230 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7fcc6c6794-jnxn7" event={"ID":"c9de8109-5603-46a7-83b6-8348299b17bb","Type":"ContainerStarted","Data":"92f2db0b780fdd0b1b64905b446d2bbceaeb044dc75a0a565c7e8e7943c4e9ae"} Jul 20 16:42:54.139850 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:54.139795 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7fcc6c6794-jnxn7" podStartSLOduration=1.645501378 podStartE2EDuration="2.139777603s" totalImagesPullingTime="494.276225ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:42:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:42:54.136352854 +0000 UTC m=+799.787235343" watchObservedRunningTime="2026-07-20 16:42:54.139777603 +0000 UTC m=+799.790660102" Jul 20 16:42:54.163971 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:54.163929 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-79774646bc-sbfjr"] Jul 20 16:42:54.164185 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:54.164154 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-79774646bc-sbfjr" podUID="81f021b2-ecd7-46fa-97c3-b731e9ab5027" containerName="authorino" containerID="cri-o://d51bdf868df4742d8b55f6db304cb46e0fdf49eeacf68c0dcfa28e316eca8a40" gracePeriod=30 Jul 20 16:42:54.435242 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:54.435212 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79774646bc-sbfjr" Jul 20 16:42:54.535596 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:54.535563 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pg9lc\" (UniqueName: \"kubernetes.io/projected/81f021b2-ecd7-46fa-97c3-b731e9ab5027-kube-api-access-pg9lc\") pod \"81f021b2-ecd7-46fa-97c3-b731e9ab5027\" (UID: \"81f021b2-ecd7-46fa-97c3-b731e9ab5027\") " Jul 20 16:42:54.535774 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:54.535635 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/81f021b2-ecd7-46fa-97c3-b731e9ab5027-tls-cert\") pod \"81f021b2-ecd7-46fa-97c3-b731e9ab5027\" (UID: \"81f021b2-ecd7-46fa-97c3-b731e9ab5027\") " Jul 20 16:42:54.537821 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:54.537772 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81f021b2-ecd7-46fa-97c3-b731e9ab5027-kube-api-access-pg9lc" (OuterVolumeSpecName: "kube-api-access-pg9lc") pod "81f021b2-ecd7-46fa-97c3-b731e9ab5027" (UID: "81f021b2-ecd7-46fa-97c3-b731e9ab5027"). InnerVolumeSpecName "kube-api-access-pg9lc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:42:54.548725 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:54.548695 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81f021b2-ecd7-46fa-97c3-b731e9ab5027-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "81f021b2-ecd7-46fa-97c3-b731e9ab5027" (UID: "81f021b2-ecd7-46fa-97c3-b731e9ab5027"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:42:54.637073 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:54.637040 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pg9lc\" (UniqueName: \"kubernetes.io/projected/81f021b2-ecd7-46fa-97c3-b731e9ab5027-kube-api-access-pg9lc\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:42:54.637073 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:54.637073 2575 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/81f021b2-ecd7-46fa-97c3-b731e9ab5027-tls-cert\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:42:55.127356 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:55.127257 2575 generic.go:356] "Generic (PLEG): container finished" podID="81f021b2-ecd7-46fa-97c3-b731e9ab5027" containerID="d51bdf868df4742d8b55f6db304cb46e0fdf49eeacf68c0dcfa28e316eca8a40" exitCode=0 Jul 20 16:42:55.127356 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:55.127308 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79774646bc-sbfjr" Jul 20 16:42:55.127865 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:55.127352 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79774646bc-sbfjr" event={"ID":"81f021b2-ecd7-46fa-97c3-b731e9ab5027","Type":"ContainerDied","Data":"d51bdf868df4742d8b55f6db304cb46e0fdf49eeacf68c0dcfa28e316eca8a40"} Jul 20 16:42:55.127865 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:55.127387 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79774646bc-sbfjr" event={"ID":"81f021b2-ecd7-46fa-97c3-b731e9ab5027","Type":"ContainerDied","Data":"f6c956d5bd4c5f0d84a2248849f26f798d07a96b83fe8c5c842e7c1d2817705a"} Jul 20 16:42:55.127865 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:55.127409 2575 scope.go:117] "RemoveContainer" containerID="d51bdf868df4742d8b55f6db304cb46e0fdf49eeacf68c0dcfa28e316eca8a40" Jul 20 16:42:55.137784 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:55.137763 2575 scope.go:117] "RemoveContainer" containerID="d51bdf868df4742d8b55f6db304cb46e0fdf49eeacf68c0dcfa28e316eca8a40" Jul 20 16:42:55.138127 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:42:55.138079 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d51bdf868df4742d8b55f6db304cb46e0fdf49eeacf68c0dcfa28e316eca8a40\": container with ID starting with d51bdf868df4742d8b55f6db304cb46e0fdf49eeacf68c0dcfa28e316eca8a40 not found: ID does not exist" containerID="d51bdf868df4742d8b55f6db304cb46e0fdf49eeacf68c0dcfa28e316eca8a40" Jul 20 16:42:55.138199 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:55.138139 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d51bdf868df4742d8b55f6db304cb46e0fdf49eeacf68c0dcfa28e316eca8a40"} err="failed to get container status \"d51bdf868df4742d8b55f6db304cb46e0fdf49eeacf68c0dcfa28e316eca8a40\": rpc error: code = NotFound desc = could not find container \"d51bdf868df4742d8b55f6db304cb46e0fdf49eeacf68c0dcfa28e316eca8a40\": container with ID starting with d51bdf868df4742d8b55f6db304cb46e0fdf49eeacf68c0dcfa28e316eca8a40 not found: ID does not exist" Jul 20 16:42:55.143621 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:55.143599 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-79774646bc-sbfjr"] Jul 20 16:42:55.147497 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:55.147474 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-79774646bc-sbfjr"] Jul 20 16:42:56.854830 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:42:56.854748 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81f021b2-ecd7-46fa-97c3-b731e9ab5027" path="/var/lib/kubelet/pods/81f021b2-ecd7-46fa-97c3-b731e9ab5027/volumes" Jul 20 16:43:21.381182 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:43:21.381141 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:43:32.488598 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:43:32.488562 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:43:43.190237 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:43:43.190202 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:44:34.838588 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:44:34.838502 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-99wqw_0ec4c40f-7638-4fe3-8bff-edb2579a3b3b/console-operator/1.log" Jul 20 16:44:34.840717 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:44:34.840688 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-99wqw_0ec4c40f-7638-4fe3-8bff-edb2579a3b3b/console-operator/1.log" Jul 20 16:45:22.379002 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:45:22.378962 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:45:34.294469 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:45:34.294433 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:46:08.585755 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:46:08.585671 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:46:17.984628 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:46:17.984593 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:46:29.284483 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:46:29.284444 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:46:40.189723 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:46:40.189687 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:46:51.894692 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:46:51.894647 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:47:04.286992 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:47:04.286953 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:47:14.781999 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:47:14.781964 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:47:24.494414 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:47:24.494370 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:47:46.802428 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:47:46.802340 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:47:57.393448 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:47:57.393408 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:48:21.700836 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:48:21.700795 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:48:34.190153 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:48:34.190114 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:48:50.598179 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:48:50.598135 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:48:59.804669 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:48:59.804585 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:49:11.388631 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:49:11.388592 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:49:20.887221 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:49:20.887175 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:49:31.195395 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:49:31.195364 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:49:34.882913 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:49:34.882874 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-99wqw_0ec4c40f-7638-4fe3-8bff-edb2579a3b3b/console-operator/1.log" Jul 20 16:49:34.883409 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:49:34.883144 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-99wqw_0ec4c40f-7638-4fe3-8bff-edb2579a3b3b/console-operator/1.log" Jul 20 16:49:55.003047 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:49:55.002999 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkbjk"] Jul 20 16:49:55.003593 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:49:55.003242 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkbjk" podUID="d8fa944b-ac2f-4707-8a15-e3effab87393" containerName="manager" containerID="cri-o://fe457de20e318529d7adb3d789a50433a035879e2b84b57b93fb13264a1c92de" gracePeriod=10 Jul 20 16:49:58.960177 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:49:58.960153 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkbjk" Jul 20 16:49:59.055663 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:49:59.055633 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d8fa944b-ac2f-4707-8a15-e3effab87393-extensions-socket-volume\") pod \"d8fa944b-ac2f-4707-8a15-e3effab87393\" (UID: \"d8fa944b-ac2f-4707-8a15-e3effab87393\") " Jul 20 16:49:59.055830 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:49:59.055671 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvjqt\" (UniqueName: \"kubernetes.io/projected/d8fa944b-ac2f-4707-8a15-e3effab87393-kube-api-access-nvjqt\") pod \"d8fa944b-ac2f-4707-8a15-e3effab87393\" (UID: \"d8fa944b-ac2f-4707-8a15-e3effab87393\") " Jul 20 16:49:59.055988 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:49:59.055963 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8fa944b-ac2f-4707-8a15-e3effab87393-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d8fa944b-ac2f-4707-8a15-e3effab87393" (UID: "d8fa944b-ac2f-4707-8a15-e3effab87393"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:49:59.057636 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:49:59.057614 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8fa944b-ac2f-4707-8a15-e3effab87393-kube-api-access-nvjqt" (OuterVolumeSpecName: "kube-api-access-nvjqt") pod "d8fa944b-ac2f-4707-8a15-e3effab87393" (UID: "d8fa944b-ac2f-4707-8a15-e3effab87393"). InnerVolumeSpecName "kube-api-access-nvjqt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:49:59.157341 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:49:59.157290 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d8fa944b-ac2f-4707-8a15-e3effab87393-extensions-socket-volume\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:49:59.157341 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:49:59.157335 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvjqt\" (UniqueName: \"kubernetes.io/projected/d8fa944b-ac2f-4707-8a15-e3effab87393-kube-api-access-nvjqt\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:49:59.515783 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:49:59.515703 2575 generic.go:356] "Generic (PLEG): container finished" podID="d8fa944b-ac2f-4707-8a15-e3effab87393" containerID="fe457de20e318529d7adb3d789a50433a035879e2b84b57b93fb13264a1c92de" exitCode=0 Jul 20 16:49:59.515783 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:49:59.515759 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkbjk" Jul 20 16:49:59.515963 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:49:59.515788 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkbjk" event={"ID":"d8fa944b-ac2f-4707-8a15-e3effab87393","Type":"ContainerDied","Data":"fe457de20e318529d7adb3d789a50433a035879e2b84b57b93fb13264a1c92de"} Jul 20 16:49:59.515963 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:49:59.515860 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkbjk" event={"ID":"d8fa944b-ac2f-4707-8a15-e3effab87393","Type":"ContainerDied","Data":"02dfb20a67466a6d9077c1b53c7dba5d61887e4762bd4ee4d7bc2705919aee27"} Jul 20 16:49:59.515963 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:49:59.515882 2575 scope.go:117] "RemoveContainer" containerID="fe457de20e318529d7adb3d789a50433a035879e2b84b57b93fb13264a1c92de" Jul 20 16:49:59.526881 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:49:59.526865 2575 scope.go:117] "RemoveContainer" containerID="fe457de20e318529d7adb3d789a50433a035879e2b84b57b93fb13264a1c92de" Jul 20 16:49:59.527143 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:49:59.527119 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe457de20e318529d7adb3d789a50433a035879e2b84b57b93fb13264a1c92de\": container with ID starting with fe457de20e318529d7adb3d789a50433a035879e2b84b57b93fb13264a1c92de not found: ID does not exist" containerID="fe457de20e318529d7adb3d789a50433a035879e2b84b57b93fb13264a1c92de" Jul 20 16:49:59.527261 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:49:59.527148 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe457de20e318529d7adb3d789a50433a035879e2b84b57b93fb13264a1c92de"} err="failed to get container status \"fe457de20e318529d7adb3d789a50433a035879e2b84b57b93fb13264a1c92de\": rpc error: code = NotFound desc = could not find container \"fe457de20e318529d7adb3d789a50433a035879e2b84b57b93fb13264a1c92de\": container with ID starting with fe457de20e318529d7adb3d789a50433a035879e2b84b57b93fb13264a1c92de not found: ID does not exist" Jul 20 16:49:59.537969 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:49:59.537946 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkbjk"] Jul 20 16:49:59.541849 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:49:59.541827 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkbjk"] Jul 20 16:50:00.853911 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:50:00.853868 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8fa944b-ac2f-4707-8a15-e3effab87393" path="/var/lib/kubelet/pods/d8fa944b-ac2f-4707-8a15-e3effab87393/volumes" Jul 20 16:50:56.149622 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:50:56.149588 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fxrlw"] Jul 20 16:50:56.150126 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:50:56.150000 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81f021b2-ecd7-46fa-97c3-b731e9ab5027" containerName="authorino" Jul 20 16:50:56.150126 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:50:56.150012 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="81f021b2-ecd7-46fa-97c3-b731e9ab5027" containerName="authorino" Jul 20 16:50:56.150126 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:50:56.150037 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8fa944b-ac2f-4707-8a15-e3effab87393" containerName="manager" Jul 20 16:50:56.150126 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:50:56.150042 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8fa944b-ac2f-4707-8a15-e3effab87393" containerName="manager" Jul 20 16:50:56.150126 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:50:56.150127 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8fa944b-ac2f-4707-8a15-e3effab87393" containerName="manager" Jul 20 16:50:56.150295 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:50:56.150140 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="81f021b2-ecd7-46fa-97c3-b731e9ab5027" containerName="authorino" Jul 20 16:50:56.154380 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:50:56.154364 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fxrlw" Jul 20 16:50:56.161758 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:50:56.161706 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kuadrant-operator-controller-manager-dockercfg-whdk7\" is forbidden: User \"system:node:ip-10-0-133-157.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-157.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-whdk7\"" type="*v1.Secret" Jul 20 16:50:56.161911 ip-10-0-133-157 kubenswrapper[2575]: E0720 16:50:56.161762 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-fxrlw\" is forbidden: User \"system:node:ip-10-0-133-157.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-157.ec2.internal' and this object" podUID="c8f6d557-e53d-4f50-ae67-dcc929ac3074" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fxrlw" Jul 20 16:50:56.180654 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:50:56.180625 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fxrlw"] Jul 20 16:50:56.281537 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:50:56.281479 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs2x9\" (UniqueName: \"kubernetes.io/projected/c8f6d557-e53d-4f50-ae67-dcc929ac3074-kube-api-access-bs2x9\") pod \"kuadrant-operator-controller-manager-86878c769f-fxrlw\" (UID: \"c8f6d557-e53d-4f50-ae67-dcc929ac3074\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fxrlw" Jul 20 16:50:56.281537 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:50:56.281551 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8f6d557-e53d-4f50-ae67-dcc929ac3074-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fxrlw\" (UID: \"c8f6d557-e53d-4f50-ae67-dcc929ac3074\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fxrlw" Jul 20 16:50:56.383034 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:50:56.382989 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs2x9\" (UniqueName: \"kubernetes.io/projected/c8f6d557-e53d-4f50-ae67-dcc929ac3074-kube-api-access-bs2x9\") pod \"kuadrant-operator-controller-manager-86878c769f-fxrlw\" (UID: \"c8f6d557-e53d-4f50-ae67-dcc929ac3074\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fxrlw" Jul 20 16:50:56.383034 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:50:56.383040 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8f6d557-e53d-4f50-ae67-dcc929ac3074-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fxrlw\" (UID: \"c8f6d557-e53d-4f50-ae67-dcc929ac3074\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fxrlw" Jul 20 16:50:56.383466 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:50:56.383442 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8f6d557-e53d-4f50-ae67-dcc929ac3074-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fxrlw\" (UID: \"c8f6d557-e53d-4f50-ae67-dcc929ac3074\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fxrlw" Jul 20 16:50:56.393090 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:50:56.393064 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs2x9\" (UniqueName: \"kubernetes.io/projected/c8f6d557-e53d-4f50-ae67-dcc929ac3074-kube-api-access-bs2x9\") pod \"kuadrant-operator-controller-manager-86878c769f-fxrlw\" (UID: \"c8f6d557-e53d-4f50-ae67-dcc929ac3074\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fxrlw" Jul 20 16:50:57.158503 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:50:57.158472 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-whdk7\"" Jul 20 16:50:57.168877 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:50:57.168853 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fxrlw" Jul 20 16:50:57.304480 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:50:57.304453 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fxrlw"] Jul 20 16:50:57.307021 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:50:57.306986 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8f6d557_e53d_4f50_ae67_dcc929ac3074.slice/crio-f0c75fd7be5b1ae017954f64d35f8c66a01190d080188cab2a4fe28aaccac772 WatchSource:0}: Error finding container f0c75fd7be5b1ae017954f64d35f8c66a01190d080188cab2a4fe28aaccac772: Status 404 returned error can't find the container with id f0c75fd7be5b1ae017954f64d35f8c66a01190d080188cab2a4fe28aaccac772 Jul 20 16:50:57.833869 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:50:57.833821 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fxrlw" event={"ID":"c8f6d557-e53d-4f50-ae67-dcc929ac3074","Type":"ContainerStarted","Data":"6feb2b9903b06047f7c1892287bf57280984f9f5859d7b9cdfadeafe58af2d18"} Jul 20 16:50:57.834060 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:50:57.833889 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fxrlw" event={"ID":"c8f6d557-e53d-4f50-ae67-dcc929ac3074","Type":"ContainerStarted","Data":"f0c75fd7be5b1ae017954f64d35f8c66a01190d080188cab2a4fe28aaccac772"} Jul 20 16:50:57.834060 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:50:57.833917 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fxrlw" Jul 20 16:50:57.857934 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:50:57.857881 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fxrlw" podStartSLOduration=1.857863822 podStartE2EDuration="1.857863822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:50:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:50:57.856353659 +0000 UTC m=+1283.507236181" watchObservedRunningTime="2026-07-20 16:50:57.857863822 +0000 UTC m=+1283.508746319" Jul 20 16:51:08.842166 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:51:08.842134 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fxrlw" Jul 20 16:51:17.582584 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:51:17.582546 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:51:28.193151 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:51:28.193108 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:51:38.993444 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:51:38.993411 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:51:51.136992 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:51:51.136958 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:52:03.386777 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:52:03.386695 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:52:12.894270 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:52:12.894228 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:52:21.889754 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:52:21.889705 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:52:33.482672 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:52:33.482629 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:52:44.393566 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:52:44.393529 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:52:52.988102 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:52:52.988046 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:53:03.810563 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:53:03.810527 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:53:24.994838 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:53:24.994797 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:53:34.392502 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:53:34.392417 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:53:45.486832 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:53:45.486794 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:54:05.580819 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:54:05.580772 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:54:26.286265 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:54:26.286227 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:54:34.924196 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:54:34.924165 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-99wqw_0ec4c40f-7638-4fe3-8bff-edb2579a3b3b/console-operator/1.log" Jul 20 16:54:34.926834 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:54:34.926807 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-99wqw_0ec4c40f-7638-4fe3-8bff-edb2579a3b3b/console-operator/1.log" Jul 20 16:54:40.784695 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:54:40.784658 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:54:47.385471 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:54:47.385432 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:55:03.092154 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:55:03.092032 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:55:14.891269 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:55:14.891234 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:55:24.987378 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:55:24.987343 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:55:33.289027 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:55:33.288992 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:55:42.887555 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:55:42.887513 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:55:52.990301 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:55:52.990263 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:56:06.385157 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:56:06.385116 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:56:21.187070 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:56:21.187029 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:56:30.704352 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:56:30.704251 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:56:37.590016 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:56:37.589980 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:56:49.887358 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:56:49.887321 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:56:57.900410 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:56:57.900368 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:57:11.187249 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:57:11.187208 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:57:23.092631 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:57:23.092594 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:57:36.588984 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:57:36.588945 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:57:49.590856 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:57:49.590819 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:58:00.197240 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:58:00.197152 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:58:10.399539 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:58:10.399502 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:58:21.886825 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:58:21.886788 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:58:51.503834 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:58:51.503797 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:59:02.292534 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:59:02.292494 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:59:24.023171 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:59:24.023128 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3e15ca90-2vc69"] Jul 20 16:59:24.026859 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:59:24.026836 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3e15ca90-2vc69" Jul 20 16:59:24.029427 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:59:24.029406 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 20 16:59:24.029513 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:59:24.029429 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d9prm\"" Jul 20 16:59:24.035243 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:59:24.035217 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3e15ca90-2vc69"] Jul 20 16:59:24.164105 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:59:24.164045 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9332312f-1f22-49d0-95f4-4d69ffcba64d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-3e15ca90-2vc69\" (UID: \"9332312f-1f22-49d0-95f4-4d69ffcba64d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3e15ca90-2vc69" Jul 20 16:59:24.265541 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:59:24.265512 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9332312f-1f22-49d0-95f4-4d69ffcba64d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-3e15ca90-2vc69\" (UID: \"9332312f-1f22-49d0-95f4-4d69ffcba64d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3e15ca90-2vc69" Jul 20 16:59:24.266156 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:59:24.266134 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9332312f-1f22-49d0-95f4-4d69ffcba64d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-3e15ca90-2vc69\" (UID: \"9332312f-1f22-49d0-95f4-4d69ffcba64d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3e15ca90-2vc69" Jul 20 16:59:24.338823 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:59:24.338785 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3e15ca90-2vc69" Jul 20 16:59:24.681985 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:59:24.681911 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3e15ca90-2vc69"] Jul 20 16:59:24.683709 ip-10-0-133-157 kubenswrapper[2575]: W0720 16:59:24.683682 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9332312f_1f22_49d0_95f4_4d69ffcba64d.slice/crio-073037b7443f3ad9879784dd6f02d847d8dbfcc0a7348303d5f2b5db4277d95d WatchSource:0}: Error finding container 073037b7443f3ad9879784dd6f02d847d8dbfcc0a7348303d5f2b5db4277d95d: Status 404 returned error can't find the container with id 073037b7443f3ad9879784dd6f02d847d8dbfcc0a7348303d5f2b5db4277d95d Jul 20 16:59:24.685626 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:59:24.685604 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 16:59:25.682004 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:59:25.681965 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3e15ca90-2vc69" event={"ID":"9332312f-1f22-49d0-95f4-4d69ffcba64d","Type":"ContainerStarted","Data":"073037b7443f3ad9879784dd6f02d847d8dbfcc0a7348303d5f2b5db4277d95d"} Jul 20 16:59:27.695252 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:59:27.695216 2575 generic.go:356] "Generic (PLEG): container finished" podID="9332312f-1f22-49d0-95f4-4d69ffcba64d" containerID="c7b65deae383832d2a4d750b6dc58f7cf77568bf252c777fa6aa7136be6420bf" exitCode=0 Jul 20 16:59:27.695632 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:59:27.695263 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3e15ca90-2vc69" event={"ID":"9332312f-1f22-49d0-95f4-4d69ffcba64d","Type":"ContainerDied","Data":"c7b65deae383832d2a4d750b6dc58f7cf77568bf252c777fa6aa7136be6420bf"} Jul 20 16:59:28.825773 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:59:28.825748 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3e15ca90-2vc69" Jul 20 16:59:28.904128 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:59:28.904075 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9332312f-1f22-49d0-95f4-4d69ffcba64d-maas-api-service-ca\") pod \"9332312f-1f22-49d0-95f4-4d69ffcba64d\" (UID: \"9332312f-1f22-49d0-95f4-4d69ffcba64d\") " Jul 20 16:59:28.904433 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:59:28.904408 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9332312f-1f22-49d0-95f4-4d69ffcba64d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9332312f-1f22-49d0-95f4-4d69ffcba64d" (UID: "9332312f-1f22-49d0-95f4-4d69ffcba64d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:59:29.005321 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:59:29.005236 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9332312f-1f22-49d0-95f4-4d69ffcba64d-maas-api-service-ca\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 16:59:29.707843 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:59:29.707814 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3e15ca90-2vc69" Jul 20 16:59:29.707843 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:59:29.707824 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3e15ca90-2vc69" event={"ID":"9332312f-1f22-49d0-95f4-4d69ffcba64d","Type":"ContainerDied","Data":"073037b7443f3ad9879784dd6f02d847d8dbfcc0a7348303d5f2b5db4277d95d"} Jul 20 16:59:29.708061 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:59:29.707876 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="073037b7443f3ad9879784dd6f02d847d8dbfcc0a7348303d5f2b5db4277d95d" Jul 20 16:59:34.968198 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:59:34.968164 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-99wqw_0ec4c40f-7638-4fe3-8bff-edb2579a3b3b/console-operator/1.log" Jul 20 16:59:34.970401 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:59:34.970380 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-99wqw_0ec4c40f-7638-4fe3-8bff-edb2579a3b3b/console-operator/1.log" Jul 20 16:59:37.388459 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:59:37.388422 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 16:59:39.106431 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:59:39.106393 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3e15ca90-2vc69"] Jul 20 16:59:39.109252 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:59:39.109222 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3e15ca90-2vc69"] Jul 20 16:59:40.854877 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:59:40.854842 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9332312f-1f22-49d0-95f4-4d69ffcba64d" path="/var/lib/kubelet/pods/9332312f-1f22-49d0-95f4-4d69ffcba64d/volumes" Jul 20 16:59:48.491334 ip-10-0-133-157 kubenswrapper[2575]: I0720 16:59:48.491294 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:00:00.132671 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:00.132637 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-4c8f9801-29742780-zdht6"] Jul 20 17:00:00.133111 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:00.133077 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9332312f-1f22-49d0-95f4-4d69ffcba64d" containerName="revoke-keys" Jul 20 17:00:00.133169 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:00.133113 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9332312f-1f22-49d0-95f4-4d69ffcba64d" containerName="revoke-keys" Jul 20 17:00:00.133211 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:00.133189 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9332312f-1f22-49d0-95f4-4d69ffcba64d" containerName="revoke-keys" Jul 20 17:00:00.140567 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:00.140532 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742780-nds7w"] Jul 20 17:00:00.140722 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:00.140697 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-4c8f9801-29742780-zdht6" Jul 20 17:00:00.143895 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:00.143867 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d9prm\"" Jul 20 17:00:00.146158 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:00.146133 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-4c8f9801-29742780-zdht6"] Jul 20 17:00:00.146278 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:00.146247 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742780-nds7w" Jul 20 17:00:00.154264 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:00.154237 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-4c8f9801-29742780-zdht6" Jul 20 17:00:00.159435 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:00.159410 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742780-nds7w"] Jul 20 17:00:00.163990 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:00.163970 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742780-nds7w" Jul 20 17:00:00.311297 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:00.311266 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-4c8f9801-29742780-zdht6"] Jul 20 17:00:00.313000 ip-10-0-133-157 kubenswrapper[2575]: W0720 17:00:00.312972 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9c3f37d_6ab8_4ee4_8434_5ca817e631f5.slice/crio-97f3d37bca79f4dbcfb94543c7894e12d4d18597a8dc12f0b9cd7d2aa914784e WatchSource:0}: Error finding container 97f3d37bca79f4dbcfb94543c7894e12d4d18597a8dc12f0b9cd7d2aa914784e: Status 404 returned error can't find the container with id 97f3d37bca79f4dbcfb94543c7894e12d4d18597a8dc12f0b9cd7d2aa914784e Jul 20 17:00:00.336805 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:00.336779 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742780-nds7w"] Jul 20 17:00:00.337294 ip-10-0-133-157 kubenswrapper[2575]: W0720 17:00:00.337270 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda20daa01_02c0_45a7_b097_6bc35f082e6d.slice/crio-50908eba039f45835ec4bd0e1415a1f1a90c9c588fb3bf97746b8c8f2d4484cd WatchSource:0}: Error finding container 50908eba039f45835ec4bd0e1415a1f1a90c9c588fb3bf97746b8c8f2d4484cd: Status 404 returned error can't find the container with id 50908eba039f45835ec4bd0e1415a1f1a90c9c588fb3bf97746b8c8f2d4484cd Jul 20 17:00:00.884907 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:00.884804 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-4c8f9801-29742780-zdht6" event={"ID":"f9c3f37d-6ab8-4ee4-8434-5ca817e631f5","Type":"ContainerStarted","Data":"a2ddd90affad55904b7bc5558dc3bba75e0ea5826b8c6ef0b96da533959621a1"} Jul 20 17:00:00.884907 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:00.884870 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-4c8f9801-29742780-zdht6" event={"ID":"f9c3f37d-6ab8-4ee4-8434-5ca817e631f5","Type":"ContainerStarted","Data":"97f3d37bca79f4dbcfb94543c7894e12d4d18597a8dc12f0b9cd7d2aa914784e"} Jul 20 17:00:00.886401 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:00.886375 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742780-nds7w" event={"ID":"a20daa01-02c0-45a7-b097-6bc35f082e6d","Type":"ContainerStarted","Data":"966463b58b4fb70bb39bb92cd142ccdbba189ca450485af13096c5ac24a4b96d"} Jul 20 17:00:00.886516 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:00.886413 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742780-nds7w" event={"ID":"a20daa01-02c0-45a7-b097-6bc35f082e6d","Type":"ContainerStarted","Data":"50908eba039f45835ec4bd0e1415a1f1a90c9c588fb3bf97746b8c8f2d4484cd"} Jul 20 17:00:00.904031 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:00.903987 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-4c8f9801-29742780-zdht6" podStartSLOduration=0.903972923 podStartE2EDuration="903.972923ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:00:00.901188094 +0000 UTC m=+1826.552070594" watchObservedRunningTime="2026-07-20 17:00:00.903972923 +0000 UTC m=+1826.554855420" Jul 20 17:00:00.917464 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:00.917423 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742780-nds7w" podStartSLOduration=0.917410208 podStartE2EDuration="917.410208ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:00:00.915808781 +0000 UTC m=+1826.566691292" watchObservedRunningTime="2026-07-20 17:00:00.917410208 +0000 UTC m=+1826.568292706" Jul 20 17:00:01.893698 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:01.893666 2575 generic.go:356] "Generic (PLEG): container finished" podID="f9c3f37d-6ab8-4ee4-8434-5ca817e631f5" containerID="a2ddd90affad55904b7bc5558dc3bba75e0ea5826b8c6ef0b96da533959621a1" exitCode=0 Jul 20 17:00:01.894169 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:01.893752 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-4c8f9801-29742780-zdht6" event={"ID":"f9c3f37d-6ab8-4ee4-8434-5ca817e631f5","Type":"ContainerDied","Data":"a2ddd90affad55904b7bc5558dc3bba75e0ea5826b8c6ef0b96da533959621a1"} Jul 20 17:00:01.895280 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:01.895258 2575 generic.go:356] "Generic (PLEG): container finished" podID="a20daa01-02c0-45a7-b097-6bc35f082e6d" containerID="966463b58b4fb70bb39bb92cd142ccdbba189ca450485af13096c5ac24a4b96d" exitCode=0 Jul 20 17:00:01.895375 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:01.895304 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742780-nds7w" event={"ID":"a20daa01-02c0-45a7-b097-6bc35f082e6d","Type":"ContainerDied","Data":"966463b58b4fb70bb39bb92cd142ccdbba189ca450485af13096c5ac24a4b96d"} Jul 20 17:00:03.036929 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:03.036906 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-4c8f9801-29742780-zdht6" Jul 20 17:00:03.056169 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:03.056136 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742780-nds7w" Jul 20 17:00:03.908236 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:03.908202 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-4c8f9801-29742780-zdht6" Jul 20 17:00:03.908429 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:03.908205 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-4c8f9801-29742780-zdht6" event={"ID":"f9c3f37d-6ab8-4ee4-8434-5ca817e631f5","Type":"ContainerDied","Data":"97f3d37bca79f4dbcfb94543c7894e12d4d18597a8dc12f0b9cd7d2aa914784e"} Jul 20 17:00:03.908429 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:03.908346 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="97f3d37bca79f4dbcfb94543c7894e12d4d18597a8dc12f0b9cd7d2aa914784e" Jul 20 17:00:03.909524 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:03.909505 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742780-nds7w" event={"ID":"a20daa01-02c0-45a7-b097-6bc35f082e6d","Type":"ContainerDied","Data":"50908eba039f45835ec4bd0e1415a1f1a90c9c588fb3bf97746b8c8f2d4484cd"} Jul 20 17:00:03.909638 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:03.909526 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742780-nds7w" Jul 20 17:00:03.909638 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:03.909537 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="50908eba039f45835ec4bd0e1415a1f1a90c9c588fb3bf97746b8c8f2d4484cd" Jul 20 17:00:07.910149 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:07.910110 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c8f9801-tkg5h"] Jul 20 17:00:07.910633 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:07.910530 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a20daa01-02c0-45a7-b097-6bc35f082e6d" containerName="cleanup" Jul 20 17:00:07.910633 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:07.910542 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a20daa01-02c0-45a7-b097-6bc35f082e6d" containerName="cleanup" Jul 20 17:00:07.910633 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:07.910550 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9c3f37d-6ab8-4ee4-8434-5ca817e631f5" containerName="cleanup" Jul 20 17:00:07.910633 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:07.910557 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9c3f37d-6ab8-4ee4-8434-5ca817e631f5" containerName="cleanup" Jul 20 17:00:07.910633 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:07.910626 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9c3f37d-6ab8-4ee4-8434-5ca817e631f5" containerName="cleanup" Jul 20 17:00:07.910633 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:07.910634 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a20daa01-02c0-45a7-b097-6bc35f082e6d" containerName="cleanup" Jul 20 17:00:07.913686 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:07.913670 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c8f9801-tkg5h" Jul 20 17:00:07.916310 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:07.916283 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 20 17:00:07.916405 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:07.916387 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d9prm\"" Jul 20 17:00:07.923862 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:07.923838 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c8f9801-tkg5h"] Jul 20 17:00:08.079764 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:08.079704 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a7ebc71-847e-480e-9987-618b292dd000-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4c8f9801-tkg5h\" (UID: \"5a7ebc71-847e-480e-9987-618b292dd000\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c8f9801-tkg5h" Jul 20 17:00:08.180446 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:08.180348 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a7ebc71-847e-480e-9987-618b292dd000-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4c8f9801-tkg5h\" (UID: \"5a7ebc71-847e-480e-9987-618b292dd000\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c8f9801-tkg5h" Jul 20 17:00:08.180994 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:08.180975 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a7ebc71-847e-480e-9987-618b292dd000-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4c8f9801-tkg5h\" (UID: \"5a7ebc71-847e-480e-9987-618b292dd000\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c8f9801-tkg5h" Jul 20 17:00:08.225193 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:08.225160 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c8f9801-tkg5h" Jul 20 17:00:08.362893 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:08.362868 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c8f9801-tkg5h"] Jul 20 17:00:08.365365 ip-10-0-133-157 kubenswrapper[2575]: W0720 17:00:08.365334 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a7ebc71_847e_480e_9987_618b292dd000.slice/crio-7896cc6cad48ff88fc786c0de35d1857ebd665f4363e88d3565ecece8ec2cfc6 WatchSource:0}: Error finding container 7896cc6cad48ff88fc786c0de35d1857ebd665f4363e88d3565ecece8ec2cfc6: Status 404 returned error can't find the container with id 7896cc6cad48ff88fc786c0de35d1857ebd665f4363e88d3565ecece8ec2cfc6 Jul 20 17:00:08.939141 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:08.939011 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c8f9801-tkg5h" event={"ID":"5a7ebc71-847e-480e-9987-618b292dd000","Type":"ContainerStarted","Data":"935a2ccef6045ac0a98a1d797b957eb7d9e135a862a27de7040b9b93018b6012"} Jul 20 17:00:08.939141 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:08.939080 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c8f9801-tkg5h" event={"ID":"5a7ebc71-847e-480e-9987-618b292dd000","Type":"ContainerStarted","Data":"7896cc6cad48ff88fc786c0de35d1857ebd665f4363e88d3565ecece8ec2cfc6"} Jul 20 17:00:08.954694 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:08.954639 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c8f9801-tkg5h" podStartSLOduration=1.9546241439999998 podStartE2EDuration="1.954624144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:00:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:00:08.953639608 +0000 UTC m=+1834.604522106" watchObservedRunningTime="2026-07-20 17:00:08.954624144 +0000 UTC m=+1834.605506658" Jul 20 17:00:09.946224 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:09.946184 2575 generic.go:356] "Generic (PLEG): container finished" podID="5a7ebc71-847e-480e-9987-618b292dd000" containerID="935a2ccef6045ac0a98a1d797b957eb7d9e135a862a27de7040b9b93018b6012" exitCode=0 Jul 20 17:00:09.946610 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:09.946236 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c8f9801-tkg5h" event={"ID":"5a7ebc71-847e-480e-9987-618b292dd000","Type":"ContainerDied","Data":"935a2ccef6045ac0a98a1d797b957eb7d9e135a862a27de7040b9b93018b6012"} Jul 20 17:00:11.087370 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:11.087336 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c8f9801-tkg5h" Jul 20 17:00:11.208675 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:11.208573 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a7ebc71-847e-480e-9987-618b292dd000-maas-api-service-ca\") pod \"5a7ebc71-847e-480e-9987-618b292dd000\" (UID: \"5a7ebc71-847e-480e-9987-618b292dd000\") " Jul 20 17:00:11.208928 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:11.208906 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a7ebc71-847e-480e-9987-618b292dd000-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5a7ebc71-847e-480e-9987-618b292dd000" (UID: "5a7ebc71-847e-480e-9987-618b292dd000"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 17:00:11.310193 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:11.310152 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a7ebc71-847e-480e-9987-618b292dd000-maas-api-service-ca\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 17:00:11.958664 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:11.958630 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c8f9801-tkg5h" Jul 20 17:00:11.958873 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:11.958673 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c8f9801-tkg5h" event={"ID":"5a7ebc71-847e-480e-9987-618b292dd000","Type":"ContainerDied","Data":"7896cc6cad48ff88fc786c0de35d1857ebd665f4363e88d3565ecece8ec2cfc6"} Jul 20 17:00:11.958873 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:11.958724 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7896cc6cad48ff88fc786c0de35d1857ebd665f4363e88d3565ecece8ec2cfc6" Jul 20 17:00:18.387470 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:18.387434 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-4c8f9801-29742780-zdht6"] Jul 20 17:00:18.390379 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:18.390349 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-4c8f9801-29742780-zdht6"] Jul 20 17:00:18.853623 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:18.853586 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9c3f37d-6ab8-4ee4-8434-5ca817e631f5" path="/var/lib/kubelet/pods/f9c3f37d-6ab8-4ee4-8434-5ca817e631f5/volumes" Jul 20 17:00:21.590286 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:21.590241 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:00:22.988619 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:22.988582 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c8f9801-tkg5h"] Jul 20 17:00:22.992537 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:22.992506 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c8f9801-tkg5h"] Jul 20 17:00:24.860707 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:24.860672 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a7ebc71-847e-480e-9987-618b292dd000" path="/var/lib/kubelet/pods/5a7ebc71-847e-480e-9987-618b292dd000/volumes" Jul 20 17:00:32.590665 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:32.590626 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:00:52.214388 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:52.214356 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c86df9a5-5ncxk"] Jul 20 17:00:52.216946 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:52.214799 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a7ebc71-847e-480e-9987-618b292dd000" containerName="revoke-keys" Jul 20 17:00:52.216946 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:52.214810 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a7ebc71-847e-480e-9987-618b292dd000" containerName="revoke-keys" Jul 20 17:00:52.216946 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:52.214882 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a7ebc71-847e-480e-9987-618b292dd000" containerName="revoke-keys" Jul 20 17:00:52.217783 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:52.217766 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c86df9a5-5ncxk" Jul 20 17:00:52.220288 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:52.220267 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d9prm\"" Jul 20 17:00:52.220395 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:52.220316 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 20 17:00:52.226430 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:52.226403 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c86df9a5-5ncxk"] Jul 20 17:00:52.394408 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:52.394369 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f604591d-0f13-474c-b374-4984420b8829-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c86df9a5-5ncxk\" (UID: \"f604591d-0f13-474c-b374-4984420b8829\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c86df9a5-5ncxk" Jul 20 17:00:52.495262 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:52.495174 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f604591d-0f13-474c-b374-4984420b8829-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c86df9a5-5ncxk\" (UID: \"f604591d-0f13-474c-b374-4984420b8829\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c86df9a5-5ncxk" Jul 20 17:00:52.495806 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:52.495785 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f604591d-0f13-474c-b374-4984420b8829-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c86df9a5-5ncxk\" (UID: \"f604591d-0f13-474c-b374-4984420b8829\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c86df9a5-5ncxk" Jul 20 17:00:52.530080 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:52.530050 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c86df9a5-5ncxk" Jul 20 17:00:52.667866 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:52.667835 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c86df9a5-5ncxk"] Jul 20 17:00:52.670126 ip-10-0-133-157 kubenswrapper[2575]: W0720 17:00:52.670098 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf604591d_0f13_474c_b374_4984420b8829.slice/crio-0ac9a1fd63812d9c0fb84e449dad2b7cad218392ff7659744e849a3311e7498e WatchSource:0}: Error finding container 0ac9a1fd63812d9c0fb84e449dad2b7cad218392ff7659744e849a3311e7498e: Status 404 returned error can't find the container with id 0ac9a1fd63812d9c0fb84e449dad2b7cad218392ff7659744e849a3311e7498e Jul 20 17:00:53.197870 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:53.197838 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c86df9a5-5ncxk" event={"ID":"f604591d-0f13-474c-b374-4984420b8829","Type":"ContainerStarted","Data":"356d275a9a86c1e52762e1209db65a7db2de1d1576f47a83d6533bbe2771958f"} Jul 20 17:00:53.198033 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:53.197889 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c86df9a5-5ncxk" event={"ID":"f604591d-0f13-474c-b374-4984420b8829","Type":"ContainerStarted","Data":"0ac9a1fd63812d9c0fb84e449dad2b7cad218392ff7659744e849a3311e7498e"} Jul 20 17:00:53.214428 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:53.214368 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c86df9a5-5ncxk" podStartSLOduration=1.214353242 podStartE2EDuration="1.214353242s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:00:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:00:53.212832676 +0000 UTC m=+1878.863715176" watchObservedRunningTime="2026-07-20 17:00:53.214353242 +0000 UTC m=+1878.865235740" Jul 20 17:00:54.205240 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:54.205201 2575 generic.go:356] "Generic (PLEG): container finished" podID="f604591d-0f13-474c-b374-4984420b8829" containerID="356d275a9a86c1e52762e1209db65a7db2de1d1576f47a83d6533bbe2771958f" exitCode=0 Jul 20 17:00:54.205496 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:54.205266 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c86df9a5-5ncxk" event={"ID":"f604591d-0f13-474c-b374-4984420b8829","Type":"ContainerDied","Data":"356d275a9a86c1e52762e1209db65a7db2de1d1576f47a83d6533bbe2771958f"} Jul 20 17:00:55.345601 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:55.345575 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c86df9a5-5ncxk" Jul 20 17:00:55.420413 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:55.420384 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f604591d-0f13-474c-b374-4984420b8829-maas-api-service-ca\") pod \"f604591d-0f13-474c-b374-4984420b8829\" (UID: \"f604591d-0f13-474c-b374-4984420b8829\") " Jul 20 17:00:55.420800 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:55.420772 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f604591d-0f13-474c-b374-4984420b8829-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f604591d-0f13-474c-b374-4984420b8829" (UID: "f604591d-0f13-474c-b374-4984420b8829"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 17:00:55.521834 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:55.521746 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f604591d-0f13-474c-b374-4984420b8829-maas-api-service-ca\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 17:00:56.217488 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:56.217452 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c86df9a5-5ncxk" Jul 20 17:00:56.217488 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:56.217471 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c86df9a5-5ncxk" event={"ID":"f604591d-0f13-474c-b374-4984420b8829","Type":"ContainerDied","Data":"0ac9a1fd63812d9c0fb84e449dad2b7cad218392ff7659744e849a3311e7498e"} Jul 20 17:00:56.217710 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:00:56.217526 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0ac9a1fd63812d9c0fb84e449dad2b7cad218392ff7659744e849a3311e7498e" Jul 20 17:01:05.685692 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:01:05.685654 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:01:07.297406 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:01:07.297371 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c86df9a5-5ncxk"] Jul 20 17:01:07.301971 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:01:07.301946 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c86df9a5-5ncxk"] Jul 20 17:01:08.853922 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:01:08.853885 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f604591d-0f13-474c-b374-4984420b8829" path="/var/lib/kubelet/pods/f604591d-0f13-474c-b374-4984420b8829/volumes" Jul 20 17:02:38.991527 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:02:38.991448 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:02:49.685893 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:02:49.685854 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:03:02.503443 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:03:02.503403 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:03:07.536782 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:03:07.536751 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0dc9df57-cwwsf"] Jul 20 17:03:07.537374 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:03:07.537353 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f604591d-0f13-474c-b374-4984420b8829" containerName="revoke-keys" Jul 20 17:03:07.537462 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:03:07.537377 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f604591d-0f13-474c-b374-4984420b8829" containerName="revoke-keys" Jul 20 17:03:07.537525 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:03:07.537492 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f604591d-0f13-474c-b374-4984420b8829" containerName="revoke-keys" Jul 20 17:03:07.549896 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:03:07.549866 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0dc9df57-cwwsf" Jul 20 17:03:07.550648 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:03:07.550616 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0dc9df57-cwwsf"] Jul 20 17:03:07.552957 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:03:07.552929 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d9prm\"" Jul 20 17:03:07.553105 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:03:07.553008 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 20 17:03:07.638923 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:03:07.638881 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f8758e9-223a-40ed-8502-d7eebfda7f6a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0dc9df57-cwwsf\" (UID: \"4f8758e9-223a-40ed-8502-d7eebfda7f6a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0dc9df57-cwwsf" Jul 20 17:03:07.739410 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:03:07.739372 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f8758e9-223a-40ed-8502-d7eebfda7f6a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0dc9df57-cwwsf\" (UID: \"4f8758e9-223a-40ed-8502-d7eebfda7f6a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0dc9df57-cwwsf" Jul 20 17:03:07.740030 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:03:07.740002 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f8758e9-223a-40ed-8502-d7eebfda7f6a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0dc9df57-cwwsf\" (UID: \"4f8758e9-223a-40ed-8502-d7eebfda7f6a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0dc9df57-cwwsf" Jul 20 17:03:07.863288 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:03:07.863197 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0dc9df57-cwwsf" Jul 20 17:03:07.999703 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:03:07.999675 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0dc9df57-cwwsf"] Jul 20 17:03:08.000961 ip-10-0-133-157 kubenswrapper[2575]: W0720 17:03:08.000932 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f8758e9_223a_40ed_8502_d7eebfda7f6a.slice/crio-09d9bbff776671d0fbbdfe7f1d1ad6d656bc1dfd610174d9bb0bc2d45b0df17c WatchSource:0}: Error finding container 09d9bbff776671d0fbbdfe7f1d1ad6d656bc1dfd610174d9bb0bc2d45b0df17c: Status 404 returned error can't find the container with id 09d9bbff776671d0fbbdfe7f1d1ad6d656bc1dfd610174d9bb0bc2d45b0df17c Jul 20 17:03:08.995576 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:03:08.995497 2575 generic.go:356] "Generic (PLEG): container finished" podID="4f8758e9-223a-40ed-8502-d7eebfda7f6a" containerID="62cd8f1102731dfc8f38e748c2f7822eb214e6d351e50761d0d0452b2a9f50fc" exitCode=0 Jul 20 17:03:08.996159 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:03:08.995574 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0dc9df57-cwwsf" event={"ID":"4f8758e9-223a-40ed-8502-d7eebfda7f6a","Type":"ContainerDied","Data":"62cd8f1102731dfc8f38e748c2f7822eb214e6d351e50761d0d0452b2a9f50fc"} Jul 20 17:03:08.996159 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:03:08.995632 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0dc9df57-cwwsf" event={"ID":"4f8758e9-223a-40ed-8502-d7eebfda7f6a","Type":"ContainerStarted","Data":"09d9bbff776671d0fbbdfe7f1d1ad6d656bc1dfd610174d9bb0bc2d45b0df17c"} Jul 20 17:03:10.138483 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:03:10.138457 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0dc9df57-cwwsf" Jul 20 17:03:10.161494 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:03:10.161465 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f8758e9-223a-40ed-8502-d7eebfda7f6a-maas-api-service-ca\") pod \"4f8758e9-223a-40ed-8502-d7eebfda7f6a\" (UID: \"4f8758e9-223a-40ed-8502-d7eebfda7f6a\") " Jul 20 17:03:10.161777 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:03:10.161757 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f8758e9-223a-40ed-8502-d7eebfda7f6a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4f8758e9-223a-40ed-8502-d7eebfda7f6a" (UID: "4f8758e9-223a-40ed-8502-d7eebfda7f6a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 17:03:10.263023 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:03:10.262920 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f8758e9-223a-40ed-8502-d7eebfda7f6a-maas-api-service-ca\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 17:03:11.008095 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:03:11.008066 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0dc9df57-cwwsf" Jul 20 17:03:11.008276 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:03:11.008108 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0dc9df57-cwwsf" event={"ID":"4f8758e9-223a-40ed-8502-d7eebfda7f6a","Type":"ContainerDied","Data":"09d9bbff776671d0fbbdfe7f1d1ad6d656bc1dfd610174d9bb0bc2d45b0df17c"} Jul 20 17:03:11.008276 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:03:11.008164 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09d9bbff776671d0fbbdfe7f1d1ad6d656bc1dfd610174d9bb0bc2d45b0df17c" Jul 20 17:03:20.086751 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:03:20.086706 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:03:22.616521 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:03:22.616480 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0dc9df57-cwwsf"] Jul 20 17:03:22.618710 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:03:22.618683 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0dc9df57-cwwsf"] Jul 20 17:03:22.855538 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:03:22.855500 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f8758e9-223a-40ed-8502-d7eebfda7f6a" path="/var/lib/kubelet/pods/4f8758e9-223a-40ed-8502-d7eebfda7f6a/volumes" Jul 20 17:03:58.700437 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:03:58.700356 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:04:13.690885 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:04:13.690850 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:04:26.291518 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:04:26.291482 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:04:29.698792 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:04:29.698755 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-06ad55ec-d552k"] Jul 20 17:04:29.699358 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:04:29.699233 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f8758e9-223a-40ed-8502-d7eebfda7f6a" containerName="revoke-keys" Jul 20 17:04:29.699358 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:04:29.699249 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f8758e9-223a-40ed-8502-d7eebfda7f6a" containerName="revoke-keys" Jul 20 17:04:29.699358 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:04:29.699330 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f8758e9-223a-40ed-8502-d7eebfda7f6a" containerName="revoke-keys" Jul 20 17:04:29.702671 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:04:29.702654 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-06ad55ec-d552k" Jul 20 17:04:29.705179 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:04:29.705157 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 20 17:04:29.705287 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:04:29.705187 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d9prm\"" Jul 20 17:04:29.705287 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:04:29.705211 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9851d95-e1ac-4219-81a2-ca4f6e5f30d7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-06ad55ec-d552k\" (UID: \"e9851d95-e1ac-4219-81a2-ca4f6e5f30d7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-06ad55ec-d552k" Jul 20 17:04:29.710138 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:04:29.710115 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-06ad55ec-d552k"] Jul 20 17:04:29.805750 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:04:29.805720 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9851d95-e1ac-4219-81a2-ca4f6e5f30d7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-06ad55ec-d552k\" (UID: \"e9851d95-e1ac-4219-81a2-ca4f6e5f30d7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-06ad55ec-d552k" Jul 20 17:04:29.806353 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:04:29.806332 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9851d95-e1ac-4219-81a2-ca4f6e5f30d7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-06ad55ec-d552k\" (UID: \"e9851d95-e1ac-4219-81a2-ca4f6e5f30d7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-06ad55ec-d552k" Jul 20 17:04:30.015265 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:04:30.015172 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-06ad55ec-d552k" Jul 20 17:04:30.148908 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:04:30.148886 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-06ad55ec-d552k"] Jul 20 17:04:30.151024 ip-10-0-133-157 kubenswrapper[2575]: W0720 17:04:30.150997 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9851d95_e1ac_4219_81a2_ca4f6e5f30d7.slice/crio-6a580de17718d81b9d3e7b03f46dda3f94e8f33c60b747aea3ef250db17717df WatchSource:0}: Error finding container 6a580de17718d81b9d3e7b03f46dda3f94e8f33c60b747aea3ef250db17717df: Status 404 returned error can't find the container with id 6a580de17718d81b9d3e7b03f46dda3f94e8f33c60b747aea3ef250db17717df Jul 20 17:04:30.474571 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:04:30.474536 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-06ad55ec-d552k" event={"ID":"e9851d95-e1ac-4219-81a2-ca4f6e5f30d7","Type":"ContainerStarted","Data":"6a580de17718d81b9d3e7b03f46dda3f94e8f33c60b747aea3ef250db17717df"} Jul 20 17:04:31.481972 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:04:31.481940 2575 generic.go:356] "Generic (PLEG): container finished" podID="e9851d95-e1ac-4219-81a2-ca4f6e5f30d7" containerID="32317851c613f6309854a3f685a133c5224c75b50f03ac284978e209b5e4dacf" exitCode=0 Jul 20 17:04:31.482375 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:04:31.482019 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-06ad55ec-d552k" event={"ID":"e9851d95-e1ac-4219-81a2-ca4f6e5f30d7","Type":"ContainerDied","Data":"32317851c613f6309854a3f685a133c5224c75b50f03ac284978e209b5e4dacf"} Jul 20 17:04:32.625625 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:04:32.625598 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-06ad55ec-d552k" Jul 20 17:04:32.731505 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:04:32.731459 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9851d95-e1ac-4219-81a2-ca4f6e5f30d7-maas-api-service-ca\") pod \"e9851d95-e1ac-4219-81a2-ca4f6e5f30d7\" (UID: \"e9851d95-e1ac-4219-81a2-ca4f6e5f30d7\") " Jul 20 17:04:32.731819 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:04:32.731794 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9851d95-e1ac-4219-81a2-ca4f6e5f30d7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e9851d95-e1ac-4219-81a2-ca4f6e5f30d7" (UID: "e9851d95-e1ac-4219-81a2-ca4f6e5f30d7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 17:04:32.833052 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:04:32.833012 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9851d95-e1ac-4219-81a2-ca4f6e5f30d7-maas-api-service-ca\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 17:04:33.494418 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:04:33.494386 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-06ad55ec-d552k" Jul 20 17:04:33.494598 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:04:33.494433 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-06ad55ec-d552k" event={"ID":"e9851d95-e1ac-4219-81a2-ca4f6e5f30d7","Type":"ContainerDied","Data":"6a580de17718d81b9d3e7b03f46dda3f94e8f33c60b747aea3ef250db17717df"} Jul 20 17:04:33.494598 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:04:33.494482 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6a580de17718d81b9d3e7b03f46dda3f94e8f33c60b747aea3ef250db17717df" Jul 20 17:04:35.009232 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:04:35.009203 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-99wqw_0ec4c40f-7638-4fe3-8bff-edb2579a3b3b/console-operator/1.log" Jul 20 17:04:35.012386 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:04:35.012364 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-99wqw_0ec4c40f-7638-4fe3-8bff-edb2579a3b3b/console-operator/1.log" Jul 20 17:04:43.799353 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:04:43.799312 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:04:49.775890 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:04:49.775847 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-06ad55ec-d552k"] Jul 20 17:04:49.779592 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:04:49.779563 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-06ad55ec-d552k"] Jul 20 17:04:50.853509 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:04:50.853471 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9851d95-e1ac-4219-81a2-ca4f6e5f30d7" path="/var/lib/kubelet/pods/e9851d95-e1ac-4219-81a2-ca4f6e5f30d7/volumes" Jul 20 17:04:52.385119 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:04:52.385066 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:05:35.076020 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:05:35.075940 2575 scope.go:117] "RemoveContainer" containerID="c7b65deae383832d2a4d750b6dc58f7cf77568bf252c777fa6aa7136be6420bf" Jul 20 17:05:44.089519 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:05:44.089478 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:05:56.629110 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:05:56.629035 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:06:35.099773 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:06:35.099732 2575 scope.go:117] "RemoveContainer" containerID="935a2ccef6045ac0a98a1d797b957eb7d9e135a862a27de7040b9b93018b6012" Jul 20 17:06:35.109260 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:06:35.109240 2575 scope.go:117] "RemoveContainer" containerID="a2ddd90affad55904b7bc5558dc3bba75e0ea5826b8c6ef0b96da533959621a1" Jul 20 17:06:44.703405 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:06:44.703367 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:06:53.497437 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:06:53.497392 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:07:16.894351 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:16.894260 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:07:35.139996 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:35.139959 2575 scope.go:117] "RemoveContainer" containerID="356d275a9a86c1e52762e1209db65a7db2de1d1576f47a83d6533bbe2771958f" Jul 20 17:07:42.097363 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:42.097323 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq"] Jul 20 17:07:42.097769 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:42.097759 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9851d95-e1ac-4219-81a2-ca4f6e5f30d7" containerName="revoke-keys" Jul 20 17:07:42.097817 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:42.097770 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9851d95-e1ac-4219-81a2-ca4f6e5f30d7" containerName="revoke-keys" Jul 20 17:07:42.097857 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:42.097841 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9851d95-e1ac-4219-81a2-ca4f6e5f30d7" containerName="revoke-keys" Jul 20 17:07:42.100394 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:42.100375 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq" Jul 20 17:07:42.103096 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:42.103057 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-ab00cf\"/\"default-dockercfg-rjfpj\"" Jul 20 17:07:42.103248 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:42.103109 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-ab00cf\"/\"openshift-service-ca.crt\"" Jul 20 17:07:42.104031 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:42.104015 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-ab00cf\"/\"kube-root-ca.crt\"" Jul 20 17:07:42.104354 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:42.104336 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-ab00cf\"/\"test-model-ab00cf-kserve-self-signed-certs\"" Jul 20 17:07:42.110095 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:42.110056 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq"] Jul 20 17:07:42.208866 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:42.208836 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db34e5af-f6c0-42a1-bd8a-515e6d577a2e-dshm\") pod \"test-model-ab00cf-kserve-76bfd4c5df-4mncq\" (UID: \"db34e5af-f6c0-42a1-bd8a-515e6d577a2e\") " pod="ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq" Jul 20 17:07:42.209062 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:42.208906 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db34e5af-f6c0-42a1-bd8a-515e6d577a2e-home\") pod \"test-model-ab00cf-kserve-76bfd4c5df-4mncq\" (UID: \"db34e5af-f6c0-42a1-bd8a-515e6d577a2e\") " pod="ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq" Jul 20 17:07:42.209062 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:42.209009 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db34e5af-f6c0-42a1-bd8a-515e6d577a2e-tls-certs\") pod \"test-model-ab00cf-kserve-76bfd4c5df-4mncq\" (UID: \"db34e5af-f6c0-42a1-bd8a-515e6d577a2e\") " pod="ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq" Jul 20 17:07:42.209173 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:42.209060 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db34e5af-f6c0-42a1-bd8a-515e6d577a2e-model-cache\") pod \"test-model-ab00cf-kserve-76bfd4c5df-4mncq\" (UID: \"db34e5af-f6c0-42a1-bd8a-515e6d577a2e\") " pod="ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq" Jul 20 17:07:42.209173 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:42.209111 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db34e5af-f6c0-42a1-bd8a-515e6d577a2e-tmp-dir\") pod \"test-model-ab00cf-kserve-76bfd4c5df-4mncq\" (UID: \"db34e5af-f6c0-42a1-bd8a-515e6d577a2e\") " pod="ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq" Jul 20 17:07:42.209173 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:42.209135 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzdqk\" (UniqueName: \"kubernetes.io/projected/db34e5af-f6c0-42a1-bd8a-515e6d577a2e-kube-api-access-tzdqk\") pod \"test-model-ab00cf-kserve-76bfd4c5df-4mncq\" (UID: \"db34e5af-f6c0-42a1-bd8a-515e6d577a2e\") " pod="ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq" Jul 20 17:07:42.310281 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:42.310245 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db34e5af-f6c0-42a1-bd8a-515e6d577a2e-dshm\") pod \"test-model-ab00cf-kserve-76bfd4c5df-4mncq\" (UID: \"db34e5af-f6c0-42a1-bd8a-515e6d577a2e\") " pod="ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq" Jul 20 17:07:42.310475 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:42.310295 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db34e5af-f6c0-42a1-bd8a-515e6d577a2e-home\") pod \"test-model-ab00cf-kserve-76bfd4c5df-4mncq\" (UID: \"db34e5af-f6c0-42a1-bd8a-515e6d577a2e\") " pod="ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq" Jul 20 17:07:42.310475 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:42.310346 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db34e5af-f6c0-42a1-bd8a-515e6d577a2e-tls-certs\") pod \"test-model-ab00cf-kserve-76bfd4c5df-4mncq\" (UID: \"db34e5af-f6c0-42a1-bd8a-515e6d577a2e\") " pod="ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq" Jul 20 17:07:42.310475 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:42.310376 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db34e5af-f6c0-42a1-bd8a-515e6d577a2e-model-cache\") pod \"test-model-ab00cf-kserve-76bfd4c5df-4mncq\" (UID: \"db34e5af-f6c0-42a1-bd8a-515e6d577a2e\") " pod="ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq" Jul 20 17:07:42.310475 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:42.310394 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db34e5af-f6c0-42a1-bd8a-515e6d577a2e-tmp-dir\") pod \"test-model-ab00cf-kserve-76bfd4c5df-4mncq\" (UID: \"db34e5af-f6c0-42a1-bd8a-515e6d577a2e\") " pod="ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq" Jul 20 17:07:42.310475 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:42.310410 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzdqk\" (UniqueName: \"kubernetes.io/projected/db34e5af-f6c0-42a1-bd8a-515e6d577a2e-kube-api-access-tzdqk\") pod \"test-model-ab00cf-kserve-76bfd4c5df-4mncq\" (UID: \"db34e5af-f6c0-42a1-bd8a-515e6d577a2e\") " pod="ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq" Jul 20 17:07:42.310785 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:42.310757 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db34e5af-f6c0-42a1-bd8a-515e6d577a2e-model-cache\") pod \"test-model-ab00cf-kserve-76bfd4c5df-4mncq\" (UID: \"db34e5af-f6c0-42a1-bd8a-515e6d577a2e\") " pod="ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq" Jul 20 17:07:42.310889 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:42.310838 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db34e5af-f6c0-42a1-bd8a-515e6d577a2e-home\") pod \"test-model-ab00cf-kserve-76bfd4c5df-4mncq\" (UID: \"db34e5af-f6c0-42a1-bd8a-515e6d577a2e\") " pod="ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq" Jul 20 17:07:42.310889 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:42.310862 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db34e5af-f6c0-42a1-bd8a-515e6d577a2e-tmp-dir\") pod \"test-model-ab00cf-kserve-76bfd4c5df-4mncq\" (UID: \"db34e5af-f6c0-42a1-bd8a-515e6d577a2e\") " pod="ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq" Jul 20 17:07:42.312603 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:42.312583 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db34e5af-f6c0-42a1-bd8a-515e6d577a2e-dshm\") pod \"test-model-ab00cf-kserve-76bfd4c5df-4mncq\" (UID: \"db34e5af-f6c0-42a1-bd8a-515e6d577a2e\") " pod="ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq" Jul 20 17:07:42.312875 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:42.312854 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db34e5af-f6c0-42a1-bd8a-515e6d577a2e-tls-certs\") pod \"test-model-ab00cf-kserve-76bfd4c5df-4mncq\" (UID: \"db34e5af-f6c0-42a1-bd8a-515e6d577a2e\") " pod="ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq" Jul 20 17:07:42.322132 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:42.322108 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzdqk\" (UniqueName: \"kubernetes.io/projected/db34e5af-f6c0-42a1-bd8a-515e6d577a2e-kube-api-access-tzdqk\") pod \"test-model-ab00cf-kserve-76bfd4c5df-4mncq\" (UID: \"db34e5af-f6c0-42a1-bd8a-515e6d577a2e\") " pod="ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq" Jul 20 17:07:42.410942 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:42.410852 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq" Jul 20 17:07:42.556180 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:42.556145 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq"] Jul 20 17:07:42.557671 ip-10-0-133-157 kubenswrapper[2575]: W0720 17:07:42.557642 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb34e5af_f6c0_42a1_bd8a_515e6d577a2e.slice/crio-d51cf5e97e3d04bc37ac38e2a1a6879e1b7f699d5e192d2827c065f3939213c3 WatchSource:0}: Error finding container d51cf5e97e3d04bc37ac38e2a1a6879e1b7f699d5e192d2827c065f3939213c3: Status 404 returned error can't find the container with id d51cf5e97e3d04bc37ac38e2a1a6879e1b7f699d5e192d2827c065f3939213c3 Jul 20 17:07:42.559773 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:42.559752 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 17:07:42.616388 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:42.616353 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq" event={"ID":"db34e5af-f6c0-42a1-bd8a-515e6d577a2e","Type":"ContainerStarted","Data":"d51cf5e97e3d04bc37ac38e2a1a6879e1b7f699d5e192d2827c065f3939213c3"} Jul 20 17:07:44.630313 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:44.630269 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq" event={"ID":"db34e5af-f6c0-42a1-bd8a-515e6d577a2e","Type":"ContainerStarted","Data":"90e535e98cdbcb03a65e74be17c3360cef0f689284e5dd1d520af09b3295ab4d"} Jul 20 17:07:44.647012 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:44.646963 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq" podStartSLOduration=1.4490512899999999 podStartE2EDuration="2.646945874s" totalImagesPullingTime="1.197894584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:07:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:07:44.646715479 +0000 UTC m=+2290.297597978" watchObservedRunningTime="2026-07-20 17:07:44.646945874 +0000 UTC m=+2290.297828372" Jul 20 17:07:46.786354 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:46.786319 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:07:52.411693 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:52.411660 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq" Jul 20 17:07:52.412316 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:52.411714 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq" Jul 20 17:07:52.423997 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:52.423971 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq" Jul 20 17:07:52.686532 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:07:52.686453 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq" Jul 20 17:08:01.097996 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:01.097955 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:08:23.128304 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:23.128262 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq"] Jul 20 17:08:23.267515 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:23.267473 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-be281d-k5gxg"] Jul 20 17:08:23.270878 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:23.270862 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-be281d-k5gxg" Jul 20 17:08:23.273420 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:23.273398 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 20 17:08:23.273546 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:23.273398 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d9prm\"" Jul 20 17:08:23.279272 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:23.279237 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-be281d-k5gxg"] Jul 20 17:08:23.388802 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:23.388720 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/187c1faf-d1ad-4f50-b84e-5df122988870-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-be281d-k5gxg\" (UID: \"187c1faf-d1ad-4f50-b84e-5df122988870\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-be281d-k5gxg" Jul 20 17:08:23.489529 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:23.489495 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/187c1faf-d1ad-4f50-b84e-5df122988870-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-be281d-k5gxg\" (UID: \"187c1faf-d1ad-4f50-b84e-5df122988870\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-be281d-k5gxg" Jul 20 17:08:23.490134 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:23.490117 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/187c1faf-d1ad-4f50-b84e-5df122988870-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-be281d-k5gxg\" (UID: \"187c1faf-d1ad-4f50-b84e-5df122988870\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-be281d-k5gxg" Jul 20 17:08:23.583156 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:23.583121 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-be281d-k5gxg" Jul 20 17:08:23.737998 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:23.737969 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-be281d-k5gxg"] Jul 20 17:08:23.739929 ip-10-0-133-157 kubenswrapper[2575]: W0720 17:08:23.739904 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod187c1faf_d1ad_4f50_b84e_5df122988870.slice/crio-d5d1519e11c39f0f91dc0b335a3c990ece8b8665e4d664e0d7b813153b37e7e1 WatchSource:0}: Error finding container d5d1519e11c39f0f91dc0b335a3c990ece8b8665e4d664e0d7b813153b37e7e1: Status 404 returned error can't find the container with id d5d1519e11c39f0f91dc0b335a3c990ece8b8665e4d664e0d7b813153b37e7e1 Jul 20 17:08:23.851039 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:23.851006 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-be281d-k5gxg" event={"ID":"187c1faf-d1ad-4f50-b84e-5df122988870","Type":"ContainerStarted","Data":"d5d1519e11c39f0f91dc0b335a3c990ece8b8665e4d664e0d7b813153b37e7e1"} Jul 20 17:08:24.857372 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:24.857339 2575 generic.go:356] "Generic (PLEG): container finished" podID="187c1faf-d1ad-4f50-b84e-5df122988870" containerID="acf9243f543bb54825dabcb46500e74e3c0932929cae0f960ca7695e641a939c" exitCode=0 Jul 20 17:08:24.857740 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:24.857389 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-be281d-k5gxg" event={"ID":"187c1faf-d1ad-4f50-b84e-5df122988870","Type":"ContainerDied","Data":"acf9243f543bb54825dabcb46500e74e3c0932929cae0f960ca7695e641a939c"} Jul 20 17:08:26.002917 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:26.002888 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-be281d-k5gxg" Jul 20 17:08:26.113847 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:26.113810 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/187c1faf-d1ad-4f50-b84e-5df122988870-maas-api-service-ca\") pod \"187c1faf-d1ad-4f50-b84e-5df122988870\" (UID: \"187c1faf-d1ad-4f50-b84e-5df122988870\") " Jul 20 17:08:26.114228 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:26.114174 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/187c1faf-d1ad-4f50-b84e-5df122988870-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "187c1faf-d1ad-4f50-b84e-5df122988870" (UID: "187c1faf-d1ad-4f50-b84e-5df122988870"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 17:08:26.214718 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:26.214673 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/187c1faf-d1ad-4f50-b84e-5df122988870-maas-api-service-ca\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 17:08:26.870746 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:26.870713 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-be281d-k5gxg" event={"ID":"187c1faf-d1ad-4f50-b84e-5df122988870","Type":"ContainerDied","Data":"d5d1519e11c39f0f91dc0b335a3c990ece8b8665e4d664e0d7b813153b37e7e1"} Jul 20 17:08:26.870746 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:26.870734 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-be281d-k5gxg" Jul 20 17:08:26.870927 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:26.870763 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5d1519e11c39f0f91dc0b335a3c990ece8b8665e4d664e0d7b813153b37e7e1" Jul 20 17:08:27.285025 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:27.284997 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:08:38.149518 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:38.149444 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq" podUID="db34e5af-f6c0-42a1-bd8a-515e6d577a2e" containerName="main" containerID="cri-o://90e535e98cdbcb03a65e74be17c3360cef0f689284e5dd1d520af09b3295ab4d" gracePeriod=45 Jul 20 17:08:38.352597 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:38.352544 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-be281d-k5gxg"] Jul 20 17:08:38.356189 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:38.356165 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-be281d-k5gxg"] Jul 20 17:08:38.406946 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:38.406894 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq" Jul 20 17:08:38.534221 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:38.534181 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db34e5af-f6c0-42a1-bd8a-515e6d577a2e-model-cache\") pod \"db34e5af-f6c0-42a1-bd8a-515e6d577a2e\" (UID: \"db34e5af-f6c0-42a1-bd8a-515e6d577a2e\") " Jul 20 17:08:38.534422 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:38.534243 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzdqk\" (UniqueName: \"kubernetes.io/projected/db34e5af-f6c0-42a1-bd8a-515e6d577a2e-kube-api-access-tzdqk\") pod \"db34e5af-f6c0-42a1-bd8a-515e6d577a2e\" (UID: \"db34e5af-f6c0-42a1-bd8a-515e6d577a2e\") " Jul 20 17:08:38.534422 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:38.534342 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db34e5af-f6c0-42a1-bd8a-515e6d577a2e-home\") pod \"db34e5af-f6c0-42a1-bd8a-515e6d577a2e\" (UID: \"db34e5af-f6c0-42a1-bd8a-515e6d577a2e\") " Jul 20 17:08:38.534422 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:38.534370 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db34e5af-f6c0-42a1-bd8a-515e6d577a2e-tls-certs\") pod \"db34e5af-f6c0-42a1-bd8a-515e6d577a2e\" (UID: \"db34e5af-f6c0-42a1-bd8a-515e6d577a2e\") " Jul 20 17:08:38.534422 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:38.534400 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db34e5af-f6c0-42a1-bd8a-515e6d577a2e-dshm\") pod \"db34e5af-f6c0-42a1-bd8a-515e6d577a2e\" (UID: \"db34e5af-f6c0-42a1-bd8a-515e6d577a2e\") " Jul 20 17:08:38.534623 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:38.534433 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db34e5af-f6c0-42a1-bd8a-515e6d577a2e-tmp-dir\") pod \"db34e5af-f6c0-42a1-bd8a-515e6d577a2e\" (UID: \"db34e5af-f6c0-42a1-bd8a-515e6d577a2e\") " Jul 20 17:08:38.534623 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:38.534546 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db34e5af-f6c0-42a1-bd8a-515e6d577a2e-model-cache" (OuterVolumeSpecName: "model-cache") pod "db34e5af-f6c0-42a1-bd8a-515e6d577a2e" (UID: "db34e5af-f6c0-42a1-bd8a-515e6d577a2e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 17:08:38.534737 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:38.534643 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db34e5af-f6c0-42a1-bd8a-515e6d577a2e-home" (OuterVolumeSpecName: "home") pod "db34e5af-f6c0-42a1-bd8a-515e6d577a2e" (UID: "db34e5af-f6c0-42a1-bd8a-515e6d577a2e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 17:08:38.534796 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:38.534736 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db34e5af-f6c0-42a1-bd8a-515e6d577a2e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "db34e5af-f6c0-42a1-bd8a-515e6d577a2e" (UID: "db34e5af-f6c0-42a1-bd8a-515e6d577a2e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 17:08:38.534796 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:38.534781 2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db34e5af-f6c0-42a1-bd8a-515e6d577a2e-home\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 17:08:38.534877 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:38.534801 2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db34e5af-f6c0-42a1-bd8a-515e6d577a2e-model-cache\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 17:08:38.536712 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:38.536688 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db34e5af-f6c0-42a1-bd8a-515e6d577a2e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "db34e5af-f6c0-42a1-bd8a-515e6d577a2e" (UID: "db34e5af-f6c0-42a1-bd8a-515e6d577a2e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 17:08:38.536993 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:38.536966 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db34e5af-f6c0-42a1-bd8a-515e6d577a2e-kube-api-access-tzdqk" (OuterVolumeSpecName: "kube-api-access-tzdqk") pod "db34e5af-f6c0-42a1-bd8a-515e6d577a2e" (UID: "db34e5af-f6c0-42a1-bd8a-515e6d577a2e"). InnerVolumeSpecName "kube-api-access-tzdqk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 17:08:38.536993 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:38.536983 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db34e5af-f6c0-42a1-bd8a-515e6d577a2e-dshm" (OuterVolumeSpecName: "dshm") pod "db34e5af-f6c0-42a1-bd8a-515e6d577a2e" (UID: "db34e5af-f6c0-42a1-bd8a-515e6d577a2e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 17:08:38.635563 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:38.635514 2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db34e5af-f6c0-42a1-bd8a-515e6d577a2e-tls-certs\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 17:08:38.635563 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:38.635556 2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db34e5af-f6c0-42a1-bd8a-515e6d577a2e-dshm\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 17:08:38.635777 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:38.635585 2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db34e5af-f6c0-42a1-bd8a-515e6d577a2e-tmp-dir\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 17:08:38.635777 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:38.635595 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzdqk\" (UniqueName: \"kubernetes.io/projected/db34e5af-f6c0-42a1-bd8a-515e6d577a2e-kube-api-access-tzdqk\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 17:08:38.853573 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:38.853537 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="187c1faf-d1ad-4f50-b84e-5df122988870" path="/var/lib/kubelet/pods/187c1faf-d1ad-4f50-b84e-5df122988870/volumes" Jul 20 17:08:38.940952 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:38.940915 2575 generic.go:356] "Generic (PLEG): container finished" podID="db34e5af-f6c0-42a1-bd8a-515e6d577a2e" containerID="90e535e98cdbcb03a65e74be17c3360cef0f689284e5dd1d520af09b3295ab4d" exitCode=0 Jul 20 17:08:38.940952 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:38.940951 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq" Jul 20 17:08:38.941202 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:38.940992 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq" event={"ID":"db34e5af-f6c0-42a1-bd8a-515e6d577a2e","Type":"ContainerDied","Data":"90e535e98cdbcb03a65e74be17c3360cef0f689284e5dd1d520af09b3295ab4d"} Jul 20 17:08:38.941202 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:38.941039 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq" event={"ID":"db34e5af-f6c0-42a1-bd8a-515e6d577a2e","Type":"ContainerDied","Data":"d51cf5e97e3d04bc37ac38e2a1a6879e1b7f699d5e192d2827c065f3939213c3"} Jul 20 17:08:38.941202 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:38.941059 2575 scope.go:117] "RemoveContainer" containerID="90e535e98cdbcb03a65e74be17c3360cef0f689284e5dd1d520af09b3295ab4d" Jul 20 17:08:38.950475 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:38.950439 2575 scope.go:117] "RemoveContainer" containerID="90e535e98cdbcb03a65e74be17c3360cef0f689284e5dd1d520af09b3295ab4d" Jul 20 17:08:38.950731 ip-10-0-133-157 kubenswrapper[2575]: E0720 17:08:38.950711 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90e535e98cdbcb03a65e74be17c3360cef0f689284e5dd1d520af09b3295ab4d\": container with ID starting with 90e535e98cdbcb03a65e74be17c3360cef0f689284e5dd1d520af09b3295ab4d not found: ID does not exist" containerID="90e535e98cdbcb03a65e74be17c3360cef0f689284e5dd1d520af09b3295ab4d" Jul 20 17:08:38.950799 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:38.950741 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90e535e98cdbcb03a65e74be17c3360cef0f689284e5dd1d520af09b3295ab4d"} err="failed to get container status \"90e535e98cdbcb03a65e74be17c3360cef0f689284e5dd1d520af09b3295ab4d\": rpc error: code = NotFound desc = could not find container \"90e535e98cdbcb03a65e74be17c3360cef0f689284e5dd1d520af09b3295ab4d\": container with ID starting with 90e535e98cdbcb03a65e74be17c3360cef0f689284e5dd1d520af09b3295ab4d not found: ID does not exist" Jul 20 17:08:38.958322 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:38.958298 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq"] Jul 20 17:08:38.962454 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:38.962433 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-ab00cf/test-model-ab00cf-kserve-76bfd4c5df-4mncq"] Jul 20 17:08:40.855094 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:40.855058 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db34e5af-f6c0-42a1-bd8a-515e6d577a2e" path="/var/lib/kubelet/pods/db34e5af-f6c0-42a1-bd8a-515e6d577a2e/volumes" Jul 20 17:08:42.389196 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:42.389156 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:08:45.252344 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:45.252311 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ab00cf-c2t5z"] Jul 20 17:08:45.252765 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:45.252751 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="187c1faf-d1ad-4f50-b84e-5df122988870" containerName="revoke-keys" Jul 20 17:08:45.252810 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:45.252766 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="187c1faf-d1ad-4f50-b84e-5df122988870" containerName="revoke-keys" Jul 20 17:08:45.252810 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:45.252791 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db34e5af-f6c0-42a1-bd8a-515e6d577a2e" containerName="main" Jul 20 17:08:45.252810 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:45.252798 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="db34e5af-f6c0-42a1-bd8a-515e6d577a2e" containerName="main" Jul 20 17:08:45.252901 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:45.252863 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="db34e5af-f6c0-42a1-bd8a-515e6d577a2e" containerName="main" Jul 20 17:08:45.252901 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:45.252874 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="187c1faf-d1ad-4f50-b84e-5df122988870" containerName="revoke-keys" Jul 20 17:08:45.255000 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:45.254984 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ab00cf-c2t5z" Jul 20 17:08:45.257540 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:45.257513 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 20 17:08:45.257663 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:45.257581 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d9prm\"" Jul 20 17:08:45.263582 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:45.263558 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ab00cf-c2t5z"] Jul 20 17:08:45.395877 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:45.395835 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c17eec7-11d0-4244-a2d8-abe659f54ce4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-ab00cf-c2t5z\" (UID: \"4c17eec7-11d0-4244-a2d8-abe659f54ce4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ab00cf-c2t5z" Jul 20 17:08:45.496829 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:45.496797 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c17eec7-11d0-4244-a2d8-abe659f54ce4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-ab00cf-c2t5z\" (UID: \"4c17eec7-11d0-4244-a2d8-abe659f54ce4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ab00cf-c2t5z" Jul 20 17:08:45.497470 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:45.497450 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c17eec7-11d0-4244-a2d8-abe659f54ce4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-ab00cf-c2t5z\" (UID: \"4c17eec7-11d0-4244-a2d8-abe659f54ce4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ab00cf-c2t5z" Jul 20 17:08:45.566818 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:45.566785 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ab00cf-c2t5z" Jul 20 17:08:45.704580 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:45.704555 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ab00cf-c2t5z"] Jul 20 17:08:45.706800 ip-10-0-133-157 kubenswrapper[2575]: W0720 17:08:45.706771 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c17eec7_11d0_4244_a2d8_abe659f54ce4.slice/crio-9f11606dbd410ed74c9b0a72805ee487ab5028d20b13fea9e750aa1e91474263 WatchSource:0}: Error finding container 9f11606dbd410ed74c9b0a72805ee487ab5028d20b13fea9e750aa1e91474263: Status 404 returned error can't find the container with id 9f11606dbd410ed74c9b0a72805ee487ab5028d20b13fea9e750aa1e91474263 Jul 20 17:08:45.981509 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:45.981422 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ab00cf-c2t5z" event={"ID":"4c17eec7-11d0-4244-a2d8-abe659f54ce4","Type":"ContainerStarted","Data":"9f11606dbd410ed74c9b0a72805ee487ab5028d20b13fea9e750aa1e91474263"} Jul 20 17:08:46.988668 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:46.988633 2575 generic.go:356] "Generic (PLEG): container finished" podID="4c17eec7-11d0-4244-a2d8-abe659f54ce4" containerID="bf069d0ebee9729ddf93f8af02fd9557f2271d4684be484ac5e3fde4be434da4" exitCode=0 Jul 20 17:08:46.989061 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:46.988691 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ab00cf-c2t5z" event={"ID":"4c17eec7-11d0-4244-a2d8-abe659f54ce4","Type":"ContainerDied","Data":"bf069d0ebee9729ddf93f8af02fd9557f2271d4684be484ac5e3fde4be434da4"} Jul 20 17:08:48.134150 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:48.134118 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ab00cf-c2t5z" Jul 20 17:08:48.327145 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:48.327077 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c17eec7-11d0-4244-a2d8-abe659f54ce4-maas-api-service-ca\") pod \"4c17eec7-11d0-4244-a2d8-abe659f54ce4\" (UID: \"4c17eec7-11d0-4244-a2d8-abe659f54ce4\") " Jul 20 17:08:48.327384 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:48.327362 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c17eec7-11d0-4244-a2d8-abe659f54ce4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4c17eec7-11d0-4244-a2d8-abe659f54ce4" (UID: "4c17eec7-11d0-4244-a2d8-abe659f54ce4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 17:08:48.428653 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:48.428616 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c17eec7-11d0-4244-a2d8-abe659f54ce4-maas-api-service-ca\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 17:08:49.000918 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:49.000887 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ab00cf-c2t5z" Jul 20 17:08:49.001124 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:49.000917 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ab00cf-c2t5z" event={"ID":"4c17eec7-11d0-4244-a2d8-abe659f54ce4","Type":"ContainerDied","Data":"9f11606dbd410ed74c9b0a72805ee487ab5028d20b13fea9e750aa1e91474263"} Jul 20 17:08:49.001124 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:49.000967 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9f11606dbd410ed74c9b0a72805ee487ab5028d20b13fea9e750aa1e91474263" Jul 20 17:08:58.786830 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:08:58.786793 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:09:00.341876 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:00.341840 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ab00cf-c2t5z"] Jul 20 17:09:00.345851 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:00.345824 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ab00cf-c2t5z"] Jul 20 17:09:00.853582 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:00.853542 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c17eec7-11d0-4244-a2d8-abe659f54ce4" path="/var/lib/kubelet/pods/4c17eec7-11d0-4244-a2d8-abe659f54ce4/volumes" Jul 20 17:09:14.090942 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:14.090902 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:09:28.143040 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:28.143003 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:09:31.900401 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:31.900364 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cdcb96-tk9n6"] Jul 20 17:09:31.900890 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:31.900768 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c17eec7-11d0-4244-a2d8-abe659f54ce4" containerName="revoke-keys" Jul 20 17:09:31.900890 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:31.900780 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c17eec7-11d0-4244-a2d8-abe659f54ce4" containerName="revoke-keys" Jul 20 17:09:31.900890 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:31.900857 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c17eec7-11d0-4244-a2d8-abe659f54ce4" containerName="revoke-keys" Jul 20 17:09:31.903989 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:31.903972 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cdcb96-tk9n6" Jul 20 17:09:31.906764 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:31.906746 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d9prm\"" Jul 20 17:09:31.907131 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:31.907111 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 20 17:09:31.916776 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:31.916748 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cdcb96-tk9n6"] Jul 20 17:09:32.011936 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:32.011904 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff31eed2-36cf-44f9-b382-ccbe8eb5e357-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-cdcb96-tk9n6\" (UID: \"ff31eed2-36cf-44f9-b382-ccbe8eb5e357\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cdcb96-tk9n6" Jul 20 17:09:32.113441 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:32.113404 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff31eed2-36cf-44f9-b382-ccbe8eb5e357-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-cdcb96-tk9n6\" (UID: \"ff31eed2-36cf-44f9-b382-ccbe8eb5e357\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cdcb96-tk9n6" Jul 20 17:09:32.114138 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:32.114067 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff31eed2-36cf-44f9-b382-ccbe8eb5e357-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-cdcb96-tk9n6\" (UID: \"ff31eed2-36cf-44f9-b382-ccbe8eb5e357\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cdcb96-tk9n6" Jul 20 17:09:32.214411 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:32.214320 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cdcb96-tk9n6" Jul 20 17:09:32.362595 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:32.362572 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cdcb96-tk9n6"] Jul 20 17:09:32.365359 ip-10-0-133-157 kubenswrapper[2575]: W0720 17:09:32.365328 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff31eed2_36cf_44f9_b382_ccbe8eb5e357.slice/crio-c9fe2124a0268b93c40d9257b46c957c9c5e10666b3fcd225c689a8d0bb02b9b WatchSource:0}: Error finding container c9fe2124a0268b93c40d9257b46c957c9c5e10666b3fcd225c689a8d0bb02b9b: Status 404 returned error can't find the container with id c9fe2124a0268b93c40d9257b46c957c9c5e10666b3fcd225c689a8d0bb02b9b Jul 20 17:09:33.271551 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:33.271512 2575 generic.go:356] "Generic (PLEG): container finished" podID="ff31eed2-36cf-44f9-b382-ccbe8eb5e357" containerID="09cd5d1fad056f97579a609b0ac77c3d6fec4aa815796dd5a392a79d9e793f2f" exitCode=0 Jul 20 17:09:33.271951 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:33.271581 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cdcb96-tk9n6" event={"ID":"ff31eed2-36cf-44f9-b382-ccbe8eb5e357","Type":"ContainerDied","Data":"09cd5d1fad056f97579a609b0ac77c3d6fec4aa815796dd5a392a79d9e793f2f"} Jul 20 17:09:33.271951 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:33.271620 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cdcb96-tk9n6" event={"ID":"ff31eed2-36cf-44f9-b382-ccbe8eb5e357","Type":"ContainerStarted","Data":"c9fe2124a0268b93c40d9257b46c957c9c5e10666b3fcd225c689a8d0bb02b9b"} Jul 20 17:09:34.418942 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:34.418916 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cdcb96-tk9n6" Jul 20 17:09:34.533761 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:34.533669 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff31eed2-36cf-44f9-b382-ccbe8eb5e357-maas-api-service-ca\") pod \"ff31eed2-36cf-44f9-b382-ccbe8eb5e357\" (UID: \"ff31eed2-36cf-44f9-b382-ccbe8eb5e357\") " Jul 20 17:09:34.534066 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:34.534045 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff31eed2-36cf-44f9-b382-ccbe8eb5e357-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ff31eed2-36cf-44f9-b382-ccbe8eb5e357" (UID: "ff31eed2-36cf-44f9-b382-ccbe8eb5e357"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 17:09:34.634931 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:34.634879 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff31eed2-36cf-44f9-b382-ccbe8eb5e357-maas-api-service-ca\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 17:09:35.059537 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:35.059508 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-99wqw_0ec4c40f-7638-4fe3-8bff-edb2579a3b3b/console-operator/1.log" Jul 20 17:09:35.061378 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:35.061356 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-99wqw_0ec4c40f-7638-4fe3-8bff-edb2579a3b3b/console-operator/1.log" Jul 20 17:09:35.171130 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:35.171023 2575 scope.go:117] "RemoveContainer" containerID="62cd8f1102731dfc8f38e748c2f7822eb214e6d351e50761d0d0452b2a9f50fc" Jul 20 17:09:35.284560 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:35.284532 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cdcb96-tk9n6" Jul 20 17:09:35.284729 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:35.284530 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cdcb96-tk9n6" event={"ID":"ff31eed2-36cf-44f9-b382-ccbe8eb5e357","Type":"ContainerDied","Data":"c9fe2124a0268b93c40d9257b46c957c9c5e10666b3fcd225c689a8d0bb02b9b"} Jul 20 17:09:35.284729 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:35.284688 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c9fe2124a0268b93c40d9257b46c957c9c5e10666b3fcd225c689a8d0bb02b9b" Jul 20 17:09:49.992843 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:49.992803 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:09:51.977056 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:51.977024 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cdcb96-tk9n6"] Jul 20 17:09:51.981247 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:51.981217 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cdcb96-tk9n6"] Jul 20 17:09:52.853621 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:52.853580 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff31eed2-36cf-44f9-b382-ccbe8eb5e357" path="/var/lib/kubelet/pods/ff31eed2-36cf-44f9-b382-ccbe8eb5e357/volumes" Jul 20 17:09:58.958527 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:58.958448 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3ee404-hgxtg"] Jul 20 17:09:58.958901 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:58.958844 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff31eed2-36cf-44f9-b382-ccbe8eb5e357" containerName="revoke-keys" Jul 20 17:09:58.958901 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:58.958855 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff31eed2-36cf-44f9-b382-ccbe8eb5e357" containerName="revoke-keys" Jul 20 17:09:58.958975 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:58.958942 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff31eed2-36cf-44f9-b382-ccbe8eb5e357" containerName="revoke-keys" Jul 20 17:09:58.962209 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:58.962191 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3ee404-hgxtg" Jul 20 17:09:58.964796 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:58.964773 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d9prm\"" Jul 20 17:09:58.964923 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:58.964844 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 20 17:09:58.969984 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:58.969954 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3ee404-hgxtg"] Jul 20 17:09:59.061800 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:59.061769 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/007d0ece-74c4-4764-b824-31af7030da8c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-3ee404-hgxtg\" (UID: \"007d0ece-74c4-4764-b824-31af7030da8c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3ee404-hgxtg" Jul 20 17:09:59.162830 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:59.162787 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/007d0ece-74c4-4764-b824-31af7030da8c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-3ee404-hgxtg\" (UID: \"007d0ece-74c4-4764-b824-31af7030da8c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3ee404-hgxtg" Jul 20 17:09:59.163500 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:59.163477 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/007d0ece-74c4-4764-b824-31af7030da8c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-3ee404-hgxtg\" (UID: \"007d0ece-74c4-4764-b824-31af7030da8c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3ee404-hgxtg" Jul 20 17:09:59.274130 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:59.273998 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3ee404-hgxtg" Jul 20 17:09:59.413224 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:59.413195 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3ee404-hgxtg"] Jul 20 17:09:59.414690 ip-10-0-133-157 kubenswrapper[2575]: W0720 17:09:59.414661 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod007d0ece_74c4_4764_b824_31af7030da8c.slice/crio-2357eee47e9d849b6cbbc804e0c53c9e35959f537aa9251d2dfc2238e082e286 WatchSource:0}: Error finding container 2357eee47e9d849b6cbbc804e0c53c9e35959f537aa9251d2dfc2238e082e286: Status 404 returned error can't find the container with id 2357eee47e9d849b6cbbc804e0c53c9e35959f537aa9251d2dfc2238e082e286 Jul 20 17:09:59.429038 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:09:59.428998 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3ee404-hgxtg" event={"ID":"007d0ece-74c4-4764-b824-31af7030da8c","Type":"ContainerStarted","Data":"2357eee47e9d849b6cbbc804e0c53c9e35959f537aa9251d2dfc2238e082e286"} Jul 20 17:10:00.437512 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:10:00.437476 2575 generic.go:356] "Generic (PLEG): container finished" podID="007d0ece-74c4-4764-b824-31af7030da8c" containerID="6446412ce6bb0b3cbefee2805057a36a3bb69d7ffe87a332e083c47464b32b4b" exitCode=0 Jul 20 17:10:00.437906 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:10:00.437564 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3ee404-hgxtg" event={"ID":"007d0ece-74c4-4764-b824-31af7030da8c","Type":"ContainerDied","Data":"6446412ce6bb0b3cbefee2805057a36a3bb69d7ffe87a332e083c47464b32b4b"} Jul 20 17:10:01.582718 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:10:01.582691 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3ee404-hgxtg" Jul 20 17:10:01.686200 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:10:01.686164 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/007d0ece-74c4-4764-b824-31af7030da8c-maas-api-service-ca\") pod \"007d0ece-74c4-4764-b824-31af7030da8c\" (UID: \"007d0ece-74c4-4764-b824-31af7030da8c\") " Jul 20 17:10:01.686591 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:10:01.686566 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/007d0ece-74c4-4764-b824-31af7030da8c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "007d0ece-74c4-4764-b824-31af7030da8c" (UID: "007d0ece-74c4-4764-b824-31af7030da8c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 17:10:01.787063 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:10:01.787028 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/007d0ece-74c4-4764-b824-31af7030da8c-maas-api-service-ca\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 17:10:02.451011 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:10:02.450983 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3ee404-hgxtg" Jul 20 17:10:02.451011 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:10:02.450982 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3ee404-hgxtg" event={"ID":"007d0ece-74c4-4764-b824-31af7030da8c","Type":"ContainerDied","Data":"2357eee47e9d849b6cbbc804e0c53c9e35959f537aa9251d2dfc2238e082e286"} Jul 20 17:10:02.451282 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:10:02.451037 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2357eee47e9d849b6cbbc804e0c53c9e35959f537aa9251d2dfc2238e082e286" Jul 20 17:10:19.053960 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:10:19.053929 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3ee404-hgxtg"] Jul 20 17:10:19.056197 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:10:19.056176 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3ee404-hgxtg"] Jul 20 17:10:19.193126 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:10:19.193077 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:10:20.854140 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:10:20.854079 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="007d0ece-74c4-4764-b824-31af7030da8c" path="/var/lib/kubelet/pods/007d0ece-74c4-4764-b824-31af7030da8c/volumes" Jul 20 17:10:33.484196 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:10:33.484161 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:10:35.197980 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:10:35.197944 2575 scope.go:117] "RemoveContainer" containerID="32317851c613f6309854a3f685a133c5224c75b50f03ac284978e209b5e4dacf" Jul 20 17:10:45.395816 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:10:45.395776 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:11:01.501651 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:11:01.501613 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:11:39.587253 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:11:39.587163 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:11:56.998114 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:11:56.998061 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:12:15.105410 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:12:15.105369 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:12:32.995940 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:12:32.995910 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:12:47.341789 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:12:47.341750 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:13:07.193670 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:13:07.193572 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:13:24.509875 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:13:24.509835 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:13:43.742459 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:13:43.742424 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:14:06.903924 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:14:06.903889 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:14:35.098316 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:14:35.098222 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-99wqw_0ec4c40f-7638-4fe3-8bff-edb2579a3b3b/console-operator/1.log" Jul 20 17:14:35.102412 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:14:35.102386 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-99wqw_0ec4c40f-7638-4fe3-8bff-edb2579a3b3b/console-operator/1.log" Jul 20 17:14:35.249203 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:14:35.249169 2575 scope.go:117] "RemoveContainer" containerID="acf9243f543bb54825dabcb46500e74e3c0932929cae0f960ca7695e641a939c" Jul 20 17:14:35.507027 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:14:35.506939 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:14:54.010232 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:14:54.010198 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:15:00.152312 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:00.152270 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742795-85krp"] Jul 20 17:15:00.152773 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:00.152756 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="007d0ece-74c4-4764-b824-31af7030da8c" containerName="revoke-keys" Jul 20 17:15:00.152773 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:00.152775 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="007d0ece-74c4-4764-b824-31af7030da8c" containerName="revoke-keys" Jul 20 17:15:00.152873 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:00.152862 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="007d0ece-74c4-4764-b824-31af7030da8c" containerName="revoke-keys" Jul 20 17:15:00.156174 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:00.156152 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a16895-29742795-twb5x"] Jul 20 17:15:00.156310 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:00.156264 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742795-85krp" Jul 20 17:15:00.159129 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:00.159105 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d9prm\"" Jul 20 17:15:00.159282 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:00.159265 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e142d5-29742795-r57ld"] Jul 20 17:15:00.159348 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:00.159331 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a16895-29742795-twb5x" Jul 20 17:15:00.162241 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:00.162223 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e142d5-29742795-r57ld" Jul 20 17:15:00.166093 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:00.166061 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742795-85krp"] Jul 20 17:15:00.169183 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:00.169163 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742795-85krp" Jul 20 17:15:00.170547 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:00.170523 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e142d5-29742795-r57ld"] Jul 20 17:15:00.174443 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:00.174192 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a16895-29742795-twb5x"] Jul 20 17:15:00.180517 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:00.180492 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a16895-29742795-twb5x" Jul 20 17:15:00.225037 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:00.224998 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e142d5-29742795-r57ld" Jul 20 17:15:00.360617 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:00.360272 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742795-85krp"] Jul 20 17:15:00.364652 ip-10-0-133-157 kubenswrapper[2575]: W0720 17:15:00.364603 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaacc7241_e94d_4e90_8639_d96ed52c7ea8.slice/crio-4f2c49fe336309c4dd520508187255f3f9c575ac198045c48a73fd4a83a0ab8e WatchSource:0}: Error finding container 4f2c49fe336309c4dd520508187255f3f9c575ac198045c48a73fd4a83a0ab8e: Status 404 returned error can't find the container with id 4f2c49fe336309c4dd520508187255f3f9c575ac198045c48a73fd4a83a0ab8e Jul 20 17:15:00.582240 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:00.582214 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a16895-29742795-twb5x"] Jul 20 17:15:00.583385 ip-10-0-133-157 kubenswrapper[2575]: W0720 17:15:00.583360 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaa32190_84ad_4c44_9edb_7f09aaa4a05c.slice/crio-dd9b4a0cc78f06e1352808f89849ebb6e987ee7f99ff7b2effc90dd8bd344416 WatchSource:0}: Error finding container dd9b4a0cc78f06e1352808f89849ebb6e987ee7f99ff7b2effc90dd8bd344416: Status 404 returned error can't find the container with id dd9b4a0cc78f06e1352808f89849ebb6e987ee7f99ff7b2effc90dd8bd344416 Jul 20 17:15:00.614564 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:00.614541 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e142d5-29742795-r57ld"] Jul 20 17:15:00.616568 ip-10-0-133-157 kubenswrapper[2575]: W0720 17:15:00.616545 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod253d848e_8f66_4328_a23d_b67819d866a5.slice/crio-26f0a24ce8b7ad2f26abaf4c92e56bbe1f4298d57a94ec0c17b8133a0f354147 WatchSource:0}: Error finding container 26f0a24ce8b7ad2f26abaf4c92e56bbe1f4298d57a94ec0c17b8133a0f354147: Status 404 returned error can't find the container with id 26f0a24ce8b7ad2f26abaf4c92e56bbe1f4298d57a94ec0c17b8133a0f354147 Jul 20 17:15:01.230283 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:01.230188 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e142d5-29742795-r57ld" event={"ID":"253d848e-8f66-4328-a23d-b67819d866a5","Type":"ContainerStarted","Data":"a43bd274c5e2efcdf98cbf7ef0fe44de9378f8142e006ad95d84717d651da6ba"} Jul 20 17:15:01.230805 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:01.230781 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e142d5-29742795-r57ld" event={"ID":"253d848e-8f66-4328-a23d-b67819d866a5","Type":"ContainerStarted","Data":"26f0a24ce8b7ad2f26abaf4c92e56bbe1f4298d57a94ec0c17b8133a0f354147"} Jul 20 17:15:01.232214 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:01.232182 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a16895-29742795-twb5x" event={"ID":"faa32190-84ad-4c44-9edb-7f09aaa4a05c","Type":"ContainerStarted","Data":"09f99db6288946c587d418c4275e25f96b6f7e38bd9245ec742521d980662408"} Jul 20 17:15:01.232334 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:01.232232 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a16895-29742795-twb5x" event={"ID":"faa32190-84ad-4c44-9edb-7f09aaa4a05c","Type":"ContainerStarted","Data":"dd9b4a0cc78f06e1352808f89849ebb6e987ee7f99ff7b2effc90dd8bd344416"} Jul 20 17:15:01.233863 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:01.233839 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742795-85krp" event={"ID":"aacc7241-e94d-4e90-8639-d96ed52c7ea8","Type":"ContainerStarted","Data":"b9a94ee4b2ccb2b13a9dad21b2ca9c5aacf947e872c52e8e379453f835264c1d"} Jul 20 17:15:01.233969 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:01.233884 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742795-85krp" event={"ID":"aacc7241-e94d-4e90-8639-d96ed52c7ea8","Type":"ContainerStarted","Data":"4f2c49fe336309c4dd520508187255f3f9c575ac198045c48a73fd4a83a0ab8e"} Jul 20 17:15:01.260573 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:01.260516 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e142d5-29742795-r57ld" podStartSLOduration=1.260501875 podStartE2EDuration="1.260501875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:15:01.258136823 +0000 UTC m=+2726.909019337" watchObservedRunningTime="2026-07-20 17:15:01.260501875 +0000 UTC m=+2726.911384373" Jul 20 17:15:01.292563 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:01.292510 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a16895-29742795-twb5x" podStartSLOduration=1.292489828 podStartE2EDuration="1.292489828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:15:01.291435336 +0000 UTC m=+2726.942317834" watchObservedRunningTime="2026-07-20 17:15:01.292489828 +0000 UTC m=+2726.943372328" Jul 20 17:15:01.325022 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:01.324974 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742795-85krp" podStartSLOduration=1.324961056 podStartE2EDuration="1.324961056s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:15:01.323265432 +0000 UTC m=+2726.974147941" watchObservedRunningTime="2026-07-20 17:15:01.324961056 +0000 UTC m=+2726.975843554" Jul 20 17:15:02.241332 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:02.241299 2575 generic.go:356] "Generic (PLEG): container finished" podID="253d848e-8f66-4328-a23d-b67819d866a5" containerID="a43bd274c5e2efcdf98cbf7ef0fe44de9378f8142e006ad95d84717d651da6ba" exitCode=0 Jul 20 17:15:02.241824 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:02.241381 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e142d5-29742795-r57ld" event={"ID":"253d848e-8f66-4328-a23d-b67819d866a5","Type":"ContainerDied","Data":"a43bd274c5e2efcdf98cbf7ef0fe44de9378f8142e006ad95d84717d651da6ba"} Jul 20 17:15:02.243041 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:02.243011 2575 generic.go:356] "Generic (PLEG): container finished" podID="faa32190-84ad-4c44-9edb-7f09aaa4a05c" containerID="09f99db6288946c587d418c4275e25f96b6f7e38bd9245ec742521d980662408" exitCode=0 Jul 20 17:15:02.243198 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:02.243109 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a16895-29742795-twb5x" event={"ID":"faa32190-84ad-4c44-9edb-7f09aaa4a05c","Type":"ContainerDied","Data":"09f99db6288946c587d418c4275e25f96b6f7e38bd9245ec742521d980662408"} Jul 20 17:15:02.244693 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:02.244671 2575 generic.go:356] "Generic (PLEG): container finished" podID="aacc7241-e94d-4e90-8639-d96ed52c7ea8" containerID="b9a94ee4b2ccb2b13a9dad21b2ca9c5aacf947e872c52e8e379453f835264c1d" exitCode=0 Jul 20 17:15:02.244794 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:02.244723 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742795-85krp" event={"ID":"aacc7241-e94d-4e90-8639-d96ed52c7ea8","Type":"ContainerDied","Data":"b9a94ee4b2ccb2b13a9dad21b2ca9c5aacf947e872c52e8e379453f835264c1d"} Jul 20 17:15:03.408404 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:03.408378 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e142d5-29742795-r57ld" Jul 20 17:15:03.463607 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:03.463583 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742795-85krp" Jul 20 17:15:03.466857 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:03.466838 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a16895-29742795-twb5x" Jul 20 17:15:04.263989 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:04.263953 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e142d5-29742795-r57ld" Jul 20 17:15:04.264210 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:04.263988 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e142d5-29742795-r57ld" event={"ID":"253d848e-8f66-4328-a23d-b67819d866a5","Type":"ContainerDied","Data":"26f0a24ce8b7ad2f26abaf4c92e56bbe1f4298d57a94ec0c17b8133a0f354147"} Jul 20 17:15:04.264210 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:04.264069 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26f0a24ce8b7ad2f26abaf4c92e56bbe1f4298d57a94ec0c17b8133a0f354147" Jul 20 17:15:04.265392 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:04.265375 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a16895-29742795-twb5x" Jul 20 17:15:04.265510 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:04.265424 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a16895-29742795-twb5x" event={"ID":"faa32190-84ad-4c44-9edb-7f09aaa4a05c","Type":"ContainerDied","Data":"dd9b4a0cc78f06e1352808f89849ebb6e987ee7f99ff7b2effc90dd8bd344416"} Jul 20 17:15:04.265510 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:04.265466 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd9b4a0cc78f06e1352808f89849ebb6e987ee7f99ff7b2effc90dd8bd344416" Jul 20 17:15:04.267148 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:04.267127 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742795-85krp" event={"ID":"aacc7241-e94d-4e90-8639-d96ed52c7ea8","Type":"ContainerDied","Data":"4f2c49fe336309c4dd520508187255f3f9c575ac198045c48a73fd4a83a0ab8e"} Jul 20 17:15:04.267246 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:04.267161 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f2c49fe336309c4dd520508187255f3f9c575ac198045c48a73fd4a83a0ab8e" Jul 20 17:15:04.267246 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:04.267135 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742795-85krp" Jul 20 17:15:16.996286 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:16.996254 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:15:33.297512 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:33.297472 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:15:35.271232 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:35.271198 2575 scope.go:117] "RemoveContainer" containerID="bf069d0ebee9729ddf93f8af02fd9557f2271d4684be484ac5e3fde4be434da4" Jul 20 17:15:35.280078 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:15:35.280055 2575 scope.go:117] "RemoveContainer" containerID="09cd5d1fad056f97579a609b0ac77c3d6fec4aa815796dd5a392a79d9e793f2f" Jul 20 17:16:20.499909 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:20.499871 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc"] Jul 20 17:16:20.502451 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:20.500484 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faa32190-84ad-4c44-9edb-7f09aaa4a05c" containerName="cleanup" Jul 20 17:16:20.502451 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:20.500500 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="faa32190-84ad-4c44-9edb-7f09aaa4a05c" containerName="cleanup" Jul 20 17:16:20.502451 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:20.500510 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="253d848e-8f66-4328-a23d-b67819d866a5" containerName="cleanup" Jul 20 17:16:20.502451 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:20.500516 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="253d848e-8f66-4328-a23d-b67819d866a5" containerName="cleanup" Jul 20 17:16:20.502451 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:20.500537 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aacc7241-e94d-4e90-8639-d96ed52c7ea8" containerName="cleanup" Jul 20 17:16:20.502451 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:20.500543 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="aacc7241-e94d-4e90-8639-d96ed52c7ea8" containerName="cleanup" Jul 20 17:16:20.502451 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:20.500615 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="faa32190-84ad-4c44-9edb-7f09aaa4a05c" containerName="cleanup" Jul 20 17:16:20.502451 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:20.500625 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="aacc7241-e94d-4e90-8639-d96ed52c7ea8" containerName="cleanup" Jul 20 17:16:20.502451 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:20.500631 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="253d848e-8f66-4328-a23d-b67819d866a5" containerName="cleanup" Jul 20 17:16:20.503523 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:20.503504 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc" Jul 20 17:16:20.507892 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:20.507873 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e142d5\"/\"kube-root-ca.crt\"" Jul 20 17:16:20.507892 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:20.507882 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e142d5\"/\"rate-test-model-e142d5-kserve-self-signed-certs\"" Jul 20 17:16:20.508074 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:20.507889 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e142d5\"/\"openshift-service-ca.crt\"" Jul 20 17:16:20.508074 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:20.507936 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e142d5\"/\"default-dockercfg-4wd97\"" Jul 20 17:16:20.514956 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:20.514934 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc"] Jul 20 17:16:20.575507 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:20.575475 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95ee5135-b895-42c9-a79e-bb6cb03b123a-dshm\") pod \"rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc\" (UID: \"95ee5135-b895-42c9-a79e-bb6cb03b123a\") " pod="ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc" Jul 20 17:16:20.575681 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:20.575514 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95ee5135-b895-42c9-a79e-bb6cb03b123a-home\") pod \"rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc\" (UID: \"95ee5135-b895-42c9-a79e-bb6cb03b123a\") " pod="ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc" Jul 20 17:16:20.575681 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:20.575603 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95ee5135-b895-42c9-a79e-bb6cb03b123a-tls-certs\") pod \"rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc\" (UID: \"95ee5135-b895-42c9-a79e-bb6cb03b123a\") " pod="ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc" Jul 20 17:16:20.575681 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:20.575636 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95ee5135-b895-42c9-a79e-bb6cb03b123a-model-cache\") pod \"rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc\" (UID: \"95ee5135-b895-42c9-a79e-bb6cb03b123a\") " pod="ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc" Jul 20 17:16:20.575681 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:20.575654 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95ee5135-b895-42c9-a79e-bb6cb03b123a-tmp-dir\") pod \"rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc\" (UID: \"95ee5135-b895-42c9-a79e-bb6cb03b123a\") " pod="ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc" Jul 20 17:16:20.575823 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:20.575686 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfhv2\" (UniqueName: \"kubernetes.io/projected/95ee5135-b895-42c9-a79e-bb6cb03b123a-kube-api-access-xfhv2\") pod \"rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc\" (UID: \"95ee5135-b895-42c9-a79e-bb6cb03b123a\") " pod="ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc" Jul 20 17:16:20.676922 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:20.676884 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfhv2\" (UniqueName: \"kubernetes.io/projected/95ee5135-b895-42c9-a79e-bb6cb03b123a-kube-api-access-xfhv2\") pod \"rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc\" (UID: \"95ee5135-b895-42c9-a79e-bb6cb03b123a\") " pod="ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc" Jul 20 17:16:20.677157 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:20.676958 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95ee5135-b895-42c9-a79e-bb6cb03b123a-dshm\") pod \"rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc\" (UID: \"95ee5135-b895-42c9-a79e-bb6cb03b123a\") " pod="ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc" Jul 20 17:16:20.677157 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:20.677133 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95ee5135-b895-42c9-a79e-bb6cb03b123a-home\") pod \"rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc\" (UID: \"95ee5135-b895-42c9-a79e-bb6cb03b123a\") " pod="ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc" Jul 20 17:16:20.677304 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:20.677185 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95ee5135-b895-42c9-a79e-bb6cb03b123a-tls-certs\") pod \"rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc\" (UID: \"95ee5135-b895-42c9-a79e-bb6cb03b123a\") " pod="ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc" Jul 20 17:16:20.677304 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:20.677215 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95ee5135-b895-42c9-a79e-bb6cb03b123a-model-cache\") pod \"rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc\" (UID: \"95ee5135-b895-42c9-a79e-bb6cb03b123a\") " pod="ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc" Jul 20 17:16:20.677304 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:20.677238 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95ee5135-b895-42c9-a79e-bb6cb03b123a-tmp-dir\") pod \"rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc\" (UID: \"95ee5135-b895-42c9-a79e-bb6cb03b123a\") " pod="ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc" Jul 20 17:16:20.677558 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:20.677530 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95ee5135-b895-42c9-a79e-bb6cb03b123a-home\") pod \"rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc\" (UID: \"95ee5135-b895-42c9-a79e-bb6cb03b123a\") " pod="ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc" Jul 20 17:16:20.677627 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:20.677585 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95ee5135-b895-42c9-a79e-bb6cb03b123a-model-cache\") pod \"rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc\" (UID: \"95ee5135-b895-42c9-a79e-bb6cb03b123a\") " pod="ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc" Jul 20 17:16:20.677684 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:20.677643 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95ee5135-b895-42c9-a79e-bb6cb03b123a-tmp-dir\") pod \"rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc\" (UID: \"95ee5135-b895-42c9-a79e-bb6cb03b123a\") " pod="ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc" Jul 20 17:16:20.679487 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:20.679465 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95ee5135-b895-42c9-a79e-bb6cb03b123a-dshm\") pod \"rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc\" (UID: \"95ee5135-b895-42c9-a79e-bb6cb03b123a\") " pod="ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc" Jul 20 17:16:20.679751 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:20.679731 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95ee5135-b895-42c9-a79e-bb6cb03b123a-tls-certs\") pod \"rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc\" (UID: \"95ee5135-b895-42c9-a79e-bb6cb03b123a\") " pod="ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc" Jul 20 17:16:20.686625 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:20.686601 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfhv2\" (UniqueName: \"kubernetes.io/projected/95ee5135-b895-42c9-a79e-bb6cb03b123a-kube-api-access-xfhv2\") pod \"rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc\" (UID: \"95ee5135-b895-42c9-a79e-bb6cb03b123a\") " pod="ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc" Jul 20 17:16:20.813878 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:20.813844 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc" Jul 20 17:16:20.955812 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:20.955783 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc"] Jul 20 17:16:20.957940 ip-10-0-133-157 kubenswrapper[2575]: W0720 17:16:20.957910 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95ee5135_b895_42c9_a79e_bb6cb03b123a.slice/crio-12b5d34e77a7707bd3a2b0a7ac16373f735f5bdffba0d058249b1e461673a2dd WatchSource:0}: Error finding container 12b5d34e77a7707bd3a2b0a7ac16373f735f5bdffba0d058249b1e461673a2dd: Status 404 returned error can't find the container with id 12b5d34e77a7707bd3a2b0a7ac16373f735f5bdffba0d058249b1e461673a2dd Jul 20 17:16:21.725465 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:21.725423 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc" event={"ID":"95ee5135-b895-42c9-a79e-bb6cb03b123a","Type":"ContainerStarted","Data":"e45b7842586ea1a0c778a9dc0e3d996b95ddf8f01b63c8f1dbda932bbf02ed3c"} Jul 20 17:16:21.725941 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:21.725479 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc" event={"ID":"95ee5135-b895-42c9-a79e-bb6cb03b123a","Type":"ContainerStarted","Data":"12b5d34e77a7707bd3a2b0a7ac16373f735f5bdffba0d058249b1e461673a2dd"} Jul 20 17:16:21.755316 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:21.755262 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc" podStartSLOduration=1.7552435119999998 podStartE2EDuration="1.755243512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:16:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:16:21.752971371 +0000 UTC m=+2807.403853879" watchObservedRunningTime="2026-07-20 17:16:21.755243512 +0000 UTC m=+2807.406126036" Jul 20 17:16:24.611049 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:24.611011 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:16:30.814978 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:30.814926 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc" Jul 20 17:16:30.815444 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:30.815014 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc" Jul 20 17:16:30.827803 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:30.827775 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc" Jul 20 17:16:31.793772 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:31.793736 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc" Jul 20 17:16:35.306505 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:35.306472 2575 scope.go:117] "RemoveContainer" containerID="6446412ce6bb0b3cbefee2805057a36a3bb69d7ffe87a332e083c47464b32b4b" Jul 20 17:16:42.701473 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:42.701435 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:16:58.888824 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:16:58.888786 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:17:06.811831 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:06.811798 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc"] Jul 20 17:17:07.783690 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:07.783652 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7363-140563362527024"] Jul 20 17:17:07.787549 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:07.787532 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140563362527024" Jul 20 17:17:07.790528 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:07.790505 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-t7m62\"" Jul 20 17:17:07.794821 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:07.794796 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7363-140563362527024"] Jul 20 17:17:07.915874 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:07.915834 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qw7m\" (UniqueName: \"kubernetes.io/projected/bcdfee5b-2c56-49c4-9c95-4a0e8a932a3e-kube-api-access-9qw7m\") pod \"test-curl-7363-140563362527024\" (UID: \"bcdfee5b-2c56-49c4-9c95-4a0e8a932a3e\") " pod="opendatahub/test-curl-7363-140563362527024" Jul 20 17:17:08.016556 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:08.016520 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qw7m\" (UniqueName: \"kubernetes.io/projected/bcdfee5b-2c56-49c4-9c95-4a0e8a932a3e-kube-api-access-9qw7m\") pod \"test-curl-7363-140563362527024\" (UID: \"bcdfee5b-2c56-49c4-9c95-4a0e8a932a3e\") " pod="opendatahub/test-curl-7363-140563362527024" Jul 20 17:17:08.025574 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:08.025548 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qw7m\" (UniqueName: \"kubernetes.io/projected/bcdfee5b-2c56-49c4-9c95-4a0e8a932a3e-kube-api-access-9qw7m\") pod \"test-curl-7363-140563362527024\" (UID: \"bcdfee5b-2c56-49c4-9c95-4a0e8a932a3e\") " pod="opendatahub/test-curl-7363-140563362527024" Jul 20 17:17:08.097691 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:08.097650 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140563362527024" Jul 20 17:17:08.243646 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:08.243620 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7363-140563362527024"] Jul 20 17:17:08.246276 ip-10-0-133-157 kubenswrapper[2575]: W0720 17:17:08.246246 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbcdfee5b_2c56_49c4_9c95_4a0e8a932a3e.slice/crio-779e53c161f57dea809313e873078fa46237b8b22c186f59c78599e83b3962e3 WatchSource:0}: Error finding container 779e53c161f57dea809313e873078fa46237b8b22c186f59c78599e83b3962e3: Status 404 returned error can't find the container with id 779e53c161f57dea809313e873078fa46237b8b22c186f59c78599e83b3962e3 Jul 20 17:17:08.247751 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:08.247732 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 17:17:08.995472 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:08.995438 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7363-140563362527024" event={"ID":"bcdfee5b-2c56-49c4-9c95-4a0e8a932a3e","Type":"ContainerStarted","Data":"a1bf4feaa2c860544bb7b6945641c914e53ea1fb9499240498cfe2dfb68c0a04"} Jul 20 17:17:08.995808 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:08.995481 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7363-140563362527024" event={"ID":"bcdfee5b-2c56-49c4-9c95-4a0e8a932a3e","Type":"ContainerStarted","Data":"779e53c161f57dea809313e873078fa46237b8b22c186f59c78599e83b3962e3"} Jul 20 17:17:09.013157 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:09.013107 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7363-140563362527024" podStartSLOduration=1.32943893 podStartE2EDuration="2.013074436s" totalImagesPullingTime="683.635506ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:17:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:17:09.010647551 +0000 UTC m=+2854.661530050" watchObservedRunningTime="2026-07-20 17:17:09.013074436 +0000 UTC m=+2854.663956954" Jul 20 17:17:09.135257 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:09.135225 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7363-140563362527024_bcdfee5b-2c56-49c4-9c95-4a0e8a932a3e/test-curl-7363-140563362527024/0.log" Jul 20 17:17:10.002167 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:10.002129 2575 generic.go:356] "Generic (PLEG): container finished" podID="bcdfee5b-2c56-49c4-9c95-4a0e8a932a3e" containerID="a1bf4feaa2c860544bb7b6945641c914e53ea1fb9499240498cfe2dfb68c0a04" exitCode=0 Jul 20 17:17:10.002635 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:10.002221 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7363-140563362527024" event={"ID":"bcdfee5b-2c56-49c4-9c95-4a0e8a932a3e","Type":"ContainerDied","Data":"a1bf4feaa2c860544bb7b6945641c914e53ea1fb9499240498cfe2dfb68c0a04"} Jul 20 17:17:11.148079 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:11.148048 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140563362527024" Jul 20 17:17:11.181654 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:11.181607 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7363-140563362527024"] Jul 20 17:17:11.183990 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:11.183961 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7363-140563362527024"] Jul 20 17:17:11.247774 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:11.247737 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qw7m\" (UniqueName: \"kubernetes.io/projected/bcdfee5b-2c56-49c4-9c95-4a0e8a932a3e-kube-api-access-9qw7m\") pod \"bcdfee5b-2c56-49c4-9c95-4a0e8a932a3e\" (UID: \"bcdfee5b-2c56-49c4-9c95-4a0e8a932a3e\") " Jul 20 17:17:11.250016 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:11.249981 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcdfee5b-2c56-49c4-9c95-4a0e8a932a3e-kube-api-access-9qw7m" (OuterVolumeSpecName: "kube-api-access-9qw7m") pod "bcdfee5b-2c56-49c4-9c95-4a0e8a932a3e" (UID: "bcdfee5b-2c56-49c4-9c95-4a0e8a932a3e"). InnerVolumeSpecName "kube-api-access-9qw7m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 17:17:11.307105 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:11.307055 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7363-140563362528816"] Jul 20 17:17:11.307516 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:11.307502 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcdfee5b-2c56-49c4-9c95-4a0e8a932a3e" containerName="test-curl-7363-140563362527024" Jul 20 17:17:11.307560 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:11.307518 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcdfee5b-2c56-49c4-9c95-4a0e8a932a3e" containerName="test-curl-7363-140563362527024" Jul 20 17:17:11.307604 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:11.307584 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcdfee5b-2c56-49c4-9c95-4a0e8a932a3e" containerName="test-curl-7363-140563362527024" Jul 20 17:17:11.310643 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:11.310627 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140563362528816" Jul 20 17:17:11.321488 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:11.321465 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7363-140563362528816"] Jul 20 17:17:11.348679 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:11.348646 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qw7m\" (UniqueName: \"kubernetes.io/projected/bcdfee5b-2c56-49c4-9c95-4a0e8a932a3e-kube-api-access-9qw7m\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 17:17:11.449750 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:11.449717 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv4qc\" (UniqueName: \"kubernetes.io/projected/c91f71b5-2835-442a-b03a-c951503e8a60-kube-api-access-lv4qc\") pod \"test-curl-7363-140563362528816\" (UID: \"c91f71b5-2835-442a-b03a-c951503e8a60\") " pod="opendatahub/test-curl-7363-140563362528816" Jul 20 17:17:11.550859 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:11.550823 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv4qc\" (UniqueName: \"kubernetes.io/projected/c91f71b5-2835-442a-b03a-c951503e8a60-kube-api-access-lv4qc\") pod \"test-curl-7363-140563362528816\" (UID: \"c91f71b5-2835-442a-b03a-c951503e8a60\") " pod="opendatahub/test-curl-7363-140563362528816" Jul 20 17:17:11.559538 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:11.559471 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv4qc\" (UniqueName: \"kubernetes.io/projected/c91f71b5-2835-442a-b03a-c951503e8a60-kube-api-access-lv4qc\") pod \"test-curl-7363-140563362528816\" (UID: \"c91f71b5-2835-442a-b03a-c951503e8a60\") " pod="opendatahub/test-curl-7363-140563362528816" Jul 20 17:17:11.619527 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:11.619494 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140563362528816" Jul 20 17:17:11.762072 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:11.762042 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7363-140563362528816"] Jul 20 17:17:11.764062 ip-10-0-133-157 kubenswrapper[2575]: W0720 17:17:11.764037 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc91f71b5_2835_442a_b03a_c951503e8a60.slice/crio-bd9bb4d14320651d2376b55c8d438f735d1ad28fef2e9e3570a4ec521ad25a2c WatchSource:0}: Error finding container bd9bb4d14320651d2376b55c8d438f735d1ad28fef2e9e3570a4ec521ad25a2c: Status 404 returned error can't find the container with id bd9bb4d14320651d2376b55c8d438f735d1ad28fef2e9e3570a4ec521ad25a2c Jul 20 17:17:12.015773 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:12.015682 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7363-140563362528816" event={"ID":"c91f71b5-2835-442a-b03a-c951503e8a60","Type":"ContainerStarted","Data":"bd9bb4d14320651d2376b55c8d438f735d1ad28fef2e9e3570a4ec521ad25a2c"} Jul 20 17:17:12.017119 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:12.017098 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140563362527024" Jul 20 17:17:12.017251 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:12.017102 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="779e53c161f57dea809313e873078fa46237b8b22c186f59c78599e83b3962e3" Jul 20 17:17:12.028169 ip-10-0-133-157 kubenswrapper[2575]: E0720 17:17:12.028138 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7363-140563362527024\" is forbidden: User \"system:node:ip-10-0-133-157.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-157.ec2.internal' and this object" podUID="bcdfee5b-2c56-49c4-9c95-4a0e8a932a3e" pod="opendatahub/test-curl-7363-140563362527024" Jul 20 17:17:12.854390 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:12.854353 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcdfee5b-2c56-49c4-9c95-4a0e8a932a3e" path="/var/lib/kubelet/pods/bcdfee5b-2c56-49c4-9c95-4a0e8a932a3e/volumes" Jul 20 17:17:13.024603 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:13.024561 2575 generic.go:356] "Generic (PLEG): container finished" podID="c91f71b5-2835-442a-b03a-c951503e8a60" containerID="72e10a50c1649a44e201f267a7916d92e857857ba166cc74c254c9be18fa02af" exitCode=0 Jul 20 17:17:13.024797 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:13.024647 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7363-140563362528816" event={"ID":"c91f71b5-2835-442a-b03a-c951503e8a60","Type":"ContainerDied","Data":"72e10a50c1649a44e201f267a7916d92e857857ba166cc74c254c9be18fa02af"} Jul 20 17:17:14.170925 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:14.170897 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140563362528816" Jul 20 17:17:14.193883 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:14.193856 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7363-140563362528816_c91f71b5-2835-442a-b03a-c951503e8a60/test-curl-7363-140563362528816/0.log" Jul 20 17:17:14.228066 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:14.228032 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7363-140563362528816"] Jul 20 17:17:14.231981 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:14.231949 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7363-140563362528816"] Jul 20 17:17:14.276351 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:14.276322 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lv4qc\" (UniqueName: \"kubernetes.io/projected/c91f71b5-2835-442a-b03a-c951503e8a60-kube-api-access-lv4qc\") pod \"c91f71b5-2835-442a-b03a-c951503e8a60\" (UID: \"c91f71b5-2835-442a-b03a-c951503e8a60\") " Jul 20 17:17:14.278400 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:14.278374 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c91f71b5-2835-442a-b03a-c951503e8a60-kube-api-access-lv4qc" (OuterVolumeSpecName: "kube-api-access-lv4qc") pod "c91f71b5-2835-442a-b03a-c951503e8a60" (UID: "c91f71b5-2835-442a-b03a-c951503e8a60"). InnerVolumeSpecName "kube-api-access-lv4qc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 17:17:14.378062 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:14.378021 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lv4qc\" (UniqueName: \"kubernetes.io/projected/c91f71b5-2835-442a-b03a-c951503e8a60-kube-api-access-lv4qc\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 17:17:14.410932 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:14.410900 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7363-140563362443312"] Jul 20 17:17:14.411360 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:14.411345 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c91f71b5-2835-442a-b03a-c951503e8a60" containerName="test-curl-7363-140563362528816" Jul 20 17:17:14.411417 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:14.411362 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c91f71b5-2835-442a-b03a-c951503e8a60" containerName="test-curl-7363-140563362528816" Jul 20 17:17:14.411459 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:14.411448 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c91f71b5-2835-442a-b03a-c951503e8a60" containerName="test-curl-7363-140563362528816" Jul 20 17:17:14.414485 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:14.414468 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140563362443312" Jul 20 17:17:14.422882 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:14.422856 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7363-140563362443312"] Jul 20 17:17:14.579288 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:14.579255 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlcvh\" (UniqueName: \"kubernetes.io/projected/f1b4bd36-e532-4c64-a58c-552fdb837edb-kube-api-access-zlcvh\") pod \"test-curl-7363-140563362443312\" (UID: \"f1b4bd36-e532-4c64-a58c-552fdb837edb\") " pod="opendatahub/test-curl-7363-140563362443312" Jul 20 17:17:14.679800 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:14.679762 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlcvh\" (UniqueName: \"kubernetes.io/projected/f1b4bd36-e532-4c64-a58c-552fdb837edb-kube-api-access-zlcvh\") pod \"test-curl-7363-140563362443312\" (UID: \"f1b4bd36-e532-4c64-a58c-552fdb837edb\") " pod="opendatahub/test-curl-7363-140563362443312" Jul 20 17:17:14.689344 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:14.689307 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlcvh\" (UniqueName: \"kubernetes.io/projected/f1b4bd36-e532-4c64-a58c-552fdb837edb-kube-api-access-zlcvh\") pod \"test-curl-7363-140563362443312\" (UID: \"f1b4bd36-e532-4c64-a58c-552fdb837edb\") " pod="opendatahub/test-curl-7363-140563362443312" Jul 20 17:17:14.724949 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:14.724919 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140563362443312" Jul 20 17:17:14.855486 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:14.855403 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c91f71b5-2835-442a-b03a-c951503e8a60" path="/var/lib/kubelet/pods/c91f71b5-2835-442a-b03a-c951503e8a60/volumes" Jul 20 17:17:14.863888 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:14.863790 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7363-140563362443312"] Jul 20 17:17:14.865641 ip-10-0-133-157 kubenswrapper[2575]: W0720 17:17:14.865618 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1b4bd36_e532_4c64_a58c_552fdb837edb.slice/crio-b4f7b4e2bcd6fcc1bdbb78ac1689489ecea684eb5a1482036553ee6f2e79c04f WatchSource:0}: Error finding container b4f7b4e2bcd6fcc1bdbb78ac1689489ecea684eb5a1482036553ee6f2e79c04f: Status 404 returned error can't find the container with id b4f7b4e2bcd6fcc1bdbb78ac1689489ecea684eb5a1482036553ee6f2e79c04f Jul 20 17:17:15.039055 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:15.039029 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140563362528816" Jul 20 17:17:15.039292 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:15.039064 2575 scope.go:117] "RemoveContainer" containerID="72e10a50c1649a44e201f267a7916d92e857857ba166cc74c254c9be18fa02af" Jul 20 17:17:15.040439 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:15.040412 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7363-140563362443312" event={"ID":"f1b4bd36-e532-4c64-a58c-552fdb837edb","Type":"ContainerStarted","Data":"b4f7b4e2bcd6fcc1bdbb78ac1689489ecea684eb5a1482036553ee6f2e79c04f"} Jul 20 17:17:16.056175 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:16.056139 2575 generic.go:356] "Generic (PLEG): container finished" podID="f1b4bd36-e532-4c64-a58c-552fdb837edb" containerID="88e9841a9de333f04c5ece897c69547076e26add89770ea8bdab01a08d673bcd" exitCode=0 Jul 20 17:17:16.056581 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:16.056227 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7363-140563362443312" event={"ID":"f1b4bd36-e532-4c64-a58c-552fdb837edb","Type":"ContainerDied","Data":"88e9841a9de333f04c5ece897c69547076e26add89770ea8bdab01a08d673bcd"} Jul 20 17:17:17.202129 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:17.202101 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140563362443312" Jul 20 17:17:17.227386 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:17.227356 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7363-140563362443312_f1b4bd36-e532-4c64-a58c-552fdb837edb/test-curl-7363-140563362443312/0.log" Jul 20 17:17:17.258028 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:17.257994 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7363-140563362443312"] Jul 20 17:17:17.264501 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:17.264476 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7363-140563362443312"] Jul 20 17:17:17.308349 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:17.308323 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlcvh\" (UniqueName: \"kubernetes.io/projected/f1b4bd36-e532-4c64-a58c-552fdb837edb-kube-api-access-zlcvh\") pod \"f1b4bd36-e532-4c64-a58c-552fdb837edb\" (UID: \"f1b4bd36-e532-4c64-a58c-552fdb837edb\") " Jul 20 17:17:17.310430 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:17.310407 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1b4bd36-e532-4c64-a58c-552fdb837edb-kube-api-access-zlcvh" (OuterVolumeSpecName: "kube-api-access-zlcvh") pod "f1b4bd36-e532-4c64-a58c-552fdb837edb" (UID: "f1b4bd36-e532-4c64-a58c-552fdb837edb"). InnerVolumeSpecName "kube-api-access-zlcvh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 17:17:17.402112 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:17.402046 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7363-140563362443312"] Jul 20 17:17:17.402543 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:17.402526 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1b4bd36-e532-4c64-a58c-552fdb837edb" containerName="test-curl-7363-140563362443312" Jul 20 17:17:17.402589 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:17.402545 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1b4bd36-e532-4c64-a58c-552fdb837edb" containerName="test-curl-7363-140563362443312" Jul 20 17:17:17.402633 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:17.402624 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1b4bd36-e532-4c64-a58c-552fdb837edb" containerName="test-curl-7363-140563362443312" Jul 20 17:17:17.405863 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:17.405846 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140563362443312" Jul 20 17:17:17.409052 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:17.409031 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlcvh\" (UniqueName: \"kubernetes.io/projected/f1b4bd36-e532-4c64-a58c-552fdb837edb-kube-api-access-zlcvh\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 17:17:17.422497 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:17.422467 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7363-140563362443312"] Jul 20 17:17:17.510313 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:17.510275 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl8pl\" (UniqueName: \"kubernetes.io/projected/ffe94805-35fc-42af-a9bf-66adf0d370f7-kube-api-access-fl8pl\") pod \"test-curl-7363-140563362443312\" (UID: \"ffe94805-35fc-42af-a9bf-66adf0d370f7\") " pod="opendatahub/test-curl-7363-140563362443312" Jul 20 17:17:17.611589 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:17.611490 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl8pl\" (UniqueName: \"kubernetes.io/projected/ffe94805-35fc-42af-a9bf-66adf0d370f7-kube-api-access-fl8pl\") pod \"test-curl-7363-140563362443312\" (UID: \"ffe94805-35fc-42af-a9bf-66adf0d370f7\") " pod="opendatahub/test-curl-7363-140563362443312" Jul 20 17:17:17.621186 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:17.621153 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl8pl\" (UniqueName: \"kubernetes.io/projected/ffe94805-35fc-42af-a9bf-66adf0d370f7-kube-api-access-fl8pl\") pod \"test-curl-7363-140563362443312\" (UID: \"ffe94805-35fc-42af-a9bf-66adf0d370f7\") " pod="opendatahub/test-curl-7363-140563362443312" Jul 20 17:17:17.714789 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:17.714754 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140563362443312" Jul 20 17:17:17.847953 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:17.847925 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7363-140563362443312"] Jul 20 17:17:17.849804 ip-10-0-133-157 kubenswrapper[2575]: W0720 17:17:17.849779 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podffe94805_35fc_42af_a9bf_66adf0d370f7.slice/crio-fe47301708008fd066b12b99ef8475aee860322024e3efab0e8fddb5965c7890 WatchSource:0}: Error finding container fe47301708008fd066b12b99ef8475aee860322024e3efab0e8fddb5965c7890: Status 404 returned error can't find the container with id fe47301708008fd066b12b99ef8475aee860322024e3efab0e8fddb5965c7890 Jul 20 17:17:18.069168 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:18.069135 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140563362443312" Jul 20 17:17:18.069366 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:18.069148 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b4f7b4e2bcd6fcc1bdbb78ac1689489ecea684eb5a1482036553ee6f2e79c04f" Jul 20 17:17:18.070366 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:18.070339 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7363-140563362443312" event={"ID":"ffe94805-35fc-42af-a9bf-66adf0d370f7","Type":"ContainerStarted","Data":"fe47301708008fd066b12b99ef8475aee860322024e3efab0e8fddb5965c7890"} Jul 20 17:17:18.081954 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:18.081927 2575 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7363-140563362443312" oldPodUID="f1b4bd36-e532-4c64-a58c-552fdb837edb" podUID="ffe94805-35fc-42af-a9bf-66adf0d370f7" Jul 20 17:17:18.854068 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:18.854034 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1b4bd36-e532-4c64-a58c-552fdb837edb" path="/var/lib/kubelet/pods/f1b4bd36-e532-4c64-a58c-552fdb837edb/volumes" Jul 20 17:17:19.077717 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:19.077686 2575 generic.go:356] "Generic (PLEG): container finished" podID="ffe94805-35fc-42af-a9bf-66adf0d370f7" containerID="0957961db81c04d7cfd3cb36a76478f227290a201c5f60b89b79eed0f5c19aeb" exitCode=0 Jul 20 17:17:19.077887 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:19.077776 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7363-140563362443312" event={"ID":"ffe94805-35fc-42af-a9bf-66adf0d370f7","Type":"ContainerDied","Data":"0957961db81c04d7cfd3cb36a76478f227290a201c5f60b89b79eed0f5c19aeb"} Jul 20 17:17:19.401600 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:19.401563 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:17:20.224194 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:20.224166 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140563362443312" Jul 20 17:17:20.248311 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:20.248278 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7363-140563362443312_ffe94805-35fc-42af-a9bf-66adf0d370f7/test-curl-7363-140563362443312/0.log" Jul 20 17:17:20.277325 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:20.277289 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7363-140563362443312"] Jul 20 17:17:20.282561 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:20.282533 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7363-140563362443312"] Jul 20 17:17:20.338964 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:20.338857 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fl8pl\" (UniqueName: \"kubernetes.io/projected/ffe94805-35fc-42af-a9bf-66adf0d370f7-kube-api-access-fl8pl\") pod \"ffe94805-35fc-42af-a9bf-66adf0d370f7\" (UID: \"ffe94805-35fc-42af-a9bf-66adf0d370f7\") " Jul 20 17:17:20.340872 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:20.340847 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffe94805-35fc-42af-a9bf-66adf0d370f7-kube-api-access-fl8pl" (OuterVolumeSpecName: "kube-api-access-fl8pl") pod "ffe94805-35fc-42af-a9bf-66adf0d370f7" (UID: "ffe94805-35fc-42af-a9bf-66adf0d370f7"). InnerVolumeSpecName "kube-api-access-fl8pl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 17:17:20.415371 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:20.415333 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7363-140563362575392"] Jul 20 17:17:20.415761 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:20.415748 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffe94805-35fc-42af-a9bf-66adf0d370f7" containerName="test-curl-7363-140563362443312" Jul 20 17:17:20.415807 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:20.415762 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffe94805-35fc-42af-a9bf-66adf0d370f7" containerName="test-curl-7363-140563362443312" Jul 20 17:17:20.415842 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:20.415820 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffe94805-35fc-42af-a9bf-66adf0d370f7" containerName="test-curl-7363-140563362443312" Jul 20 17:17:20.418835 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:20.418818 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140563362575392" Jul 20 17:17:20.426120 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:20.426074 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7363-140563362575392"] Jul 20 17:17:20.439909 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:20.439883 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fl8pl\" (UniqueName: \"kubernetes.io/projected/ffe94805-35fc-42af-a9bf-66adf0d370f7-kube-api-access-fl8pl\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 17:17:20.540894 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:20.540856 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2grl\" (UniqueName: \"kubernetes.io/projected/e389777a-c921-4e0f-867c-6ce0b87554b1-kube-api-access-b2grl\") pod \"test-curl-7363-140563362575392\" (UID: \"e389777a-c921-4e0f-867c-6ce0b87554b1\") " pod="opendatahub/test-curl-7363-140563362575392" Jul 20 17:17:20.641911 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:20.641812 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2grl\" (UniqueName: \"kubernetes.io/projected/e389777a-c921-4e0f-867c-6ce0b87554b1-kube-api-access-b2grl\") pod \"test-curl-7363-140563362575392\" (UID: \"e389777a-c921-4e0f-867c-6ce0b87554b1\") " pod="opendatahub/test-curl-7363-140563362575392" Jul 20 17:17:20.652608 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:20.652571 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2grl\" (UniqueName: \"kubernetes.io/projected/e389777a-c921-4e0f-867c-6ce0b87554b1-kube-api-access-b2grl\") pod \"test-curl-7363-140563362575392\" (UID: \"e389777a-c921-4e0f-867c-6ce0b87554b1\") " pod="opendatahub/test-curl-7363-140563362575392" Jul 20 17:17:20.730641 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:20.730596 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140563362575392" Jul 20 17:17:20.862009 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:20.861972 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffe94805-35fc-42af-a9bf-66adf0d370f7" path="/var/lib/kubelet/pods/ffe94805-35fc-42af-a9bf-66adf0d370f7/volumes" Jul 20 17:17:20.870581 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:20.870558 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7363-140563362575392"] Jul 20 17:17:20.872434 ip-10-0-133-157 kubenswrapper[2575]: W0720 17:17:20.872408 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode389777a_c921_4e0f_867c_6ce0b87554b1.slice/crio-a2142527254739475053abb4bb91b37dca2381ddf070cca7b85ab6790e4dd4f9 WatchSource:0}: Error finding container a2142527254739475053abb4bb91b37dca2381ddf070cca7b85ab6790e4dd4f9: Status 404 returned error can't find the container with id a2142527254739475053abb4bb91b37dca2381ddf070cca7b85ab6790e4dd4f9 Jul 20 17:17:21.091633 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:21.091607 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140563362443312" Jul 20 17:17:21.091633 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:21.091619 2575 scope.go:117] "RemoveContainer" containerID="0957961db81c04d7cfd3cb36a76478f227290a201c5f60b89b79eed0f5c19aeb" Jul 20 17:17:21.093030 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:21.093000 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7363-140563362575392" event={"ID":"e389777a-c921-4e0f-867c-6ce0b87554b1","Type":"ContainerStarted","Data":"a2142527254739475053abb4bb91b37dca2381ddf070cca7b85ab6790e4dd4f9"} Jul 20 17:17:21.834620 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:21.834567 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc" podUID="95ee5135-b895-42c9-a79e-bb6cb03b123a" containerName="main" containerID="cri-o://e45b7842586ea1a0c778a9dc0e3d996b95ddf8f01b63c8f1dbda932bbf02ed3c" gracePeriod=45 Jul 20 17:17:22.101347 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:22.101310 2575 generic.go:356] "Generic (PLEG): container finished" podID="95ee5135-b895-42c9-a79e-bb6cb03b123a" containerID="e45b7842586ea1a0c778a9dc0e3d996b95ddf8f01b63c8f1dbda932bbf02ed3c" exitCode=0 Jul 20 17:17:22.101485 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:22.101373 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc" event={"ID":"95ee5135-b895-42c9-a79e-bb6cb03b123a","Type":"ContainerDied","Data":"e45b7842586ea1a0c778a9dc0e3d996b95ddf8f01b63c8f1dbda932bbf02ed3c"} Jul 20 17:17:22.101485 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:22.101414 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc" event={"ID":"95ee5135-b895-42c9-a79e-bb6cb03b123a","Type":"ContainerDied","Data":"12b5d34e77a7707bd3a2b0a7ac16373f735f5bdffba0d058249b1e461673a2dd"} Jul 20 17:17:22.101485 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:22.101427 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12b5d34e77a7707bd3a2b0a7ac16373f735f5bdffba0d058249b1e461673a2dd" Jul 20 17:17:22.102971 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:22.102949 2575 generic.go:356] "Generic (PLEG): container finished" podID="e389777a-c921-4e0f-867c-6ce0b87554b1" containerID="6547b2dba8eafe6b67d7897db453f3dbbd6ae0beb0b939a58aae09fba54b43d2" exitCode=0 Jul 20 17:17:22.103059 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:22.103029 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7363-140563362575392" event={"ID":"e389777a-c921-4e0f-867c-6ce0b87554b1","Type":"ContainerDied","Data":"6547b2dba8eafe6b67d7897db453f3dbbd6ae0beb0b939a58aae09fba54b43d2"} Jul 20 17:17:22.107204 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:22.107186 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc" Jul 20 17:17:22.259858 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:22.259819 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95ee5135-b895-42c9-a79e-bb6cb03b123a-tmp-dir\") pod \"95ee5135-b895-42c9-a79e-bb6cb03b123a\" (UID: \"95ee5135-b895-42c9-a79e-bb6cb03b123a\") " Jul 20 17:17:22.260053 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:22.259892 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfhv2\" (UniqueName: \"kubernetes.io/projected/95ee5135-b895-42c9-a79e-bb6cb03b123a-kube-api-access-xfhv2\") pod \"95ee5135-b895-42c9-a79e-bb6cb03b123a\" (UID: \"95ee5135-b895-42c9-a79e-bb6cb03b123a\") " Jul 20 17:17:22.260053 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:22.259978 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95ee5135-b895-42c9-a79e-bb6cb03b123a-dshm\") pod \"95ee5135-b895-42c9-a79e-bb6cb03b123a\" (UID: \"95ee5135-b895-42c9-a79e-bb6cb03b123a\") " Jul 20 17:17:22.260053 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:22.260006 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95ee5135-b895-42c9-a79e-bb6cb03b123a-model-cache\") pod \"95ee5135-b895-42c9-a79e-bb6cb03b123a\" (UID: \"95ee5135-b895-42c9-a79e-bb6cb03b123a\") " Jul 20 17:17:22.260053 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:22.260027 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95ee5135-b895-42c9-a79e-bb6cb03b123a-home\") pod \"95ee5135-b895-42c9-a79e-bb6cb03b123a\" (UID: \"95ee5135-b895-42c9-a79e-bb6cb03b123a\") " Jul 20 17:17:22.260298 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:22.260056 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95ee5135-b895-42c9-a79e-bb6cb03b123a-tls-certs\") pod \"95ee5135-b895-42c9-a79e-bb6cb03b123a\" (UID: \"95ee5135-b895-42c9-a79e-bb6cb03b123a\") " Jul 20 17:17:22.260298 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:22.260070 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95ee5135-b895-42c9-a79e-bb6cb03b123a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "95ee5135-b895-42c9-a79e-bb6cb03b123a" (UID: "95ee5135-b895-42c9-a79e-bb6cb03b123a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 17:17:22.260298 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:22.260258 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95ee5135-b895-42c9-a79e-bb6cb03b123a-home" (OuterVolumeSpecName: "home") pod "95ee5135-b895-42c9-a79e-bb6cb03b123a" (UID: "95ee5135-b895-42c9-a79e-bb6cb03b123a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 17:17:22.260462 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:22.260318 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95ee5135-b895-42c9-a79e-bb6cb03b123a-model-cache" (OuterVolumeSpecName: "model-cache") pod "95ee5135-b895-42c9-a79e-bb6cb03b123a" (UID: "95ee5135-b895-42c9-a79e-bb6cb03b123a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 17:17:22.260462 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:22.260429 2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95ee5135-b895-42c9-a79e-bb6cb03b123a-model-cache\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 17:17:22.260462 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:22.260457 2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95ee5135-b895-42c9-a79e-bb6cb03b123a-home\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 17:17:22.260604 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:22.260474 2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95ee5135-b895-42c9-a79e-bb6cb03b123a-tmp-dir\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 17:17:22.262346 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:22.262321 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95ee5135-b895-42c9-a79e-bb6cb03b123a-dshm" (OuterVolumeSpecName: "dshm") pod "95ee5135-b895-42c9-a79e-bb6cb03b123a" (UID: "95ee5135-b895-42c9-a79e-bb6cb03b123a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 17:17:22.262477 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:22.262361 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95ee5135-b895-42c9-a79e-bb6cb03b123a-kube-api-access-xfhv2" (OuterVolumeSpecName: "kube-api-access-xfhv2") pod "95ee5135-b895-42c9-a79e-bb6cb03b123a" (UID: "95ee5135-b895-42c9-a79e-bb6cb03b123a"). InnerVolumeSpecName "kube-api-access-xfhv2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 17:17:22.262477 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:22.262451 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95ee5135-b895-42c9-a79e-bb6cb03b123a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "95ee5135-b895-42c9-a79e-bb6cb03b123a" (UID: "95ee5135-b895-42c9-a79e-bb6cb03b123a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 17:17:22.361273 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:22.361194 2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95ee5135-b895-42c9-a79e-bb6cb03b123a-dshm\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 17:17:22.361273 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:22.361220 2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95ee5135-b895-42c9-a79e-bb6cb03b123a-tls-certs\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 17:17:22.361273 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:22.361232 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfhv2\" (UniqueName: \"kubernetes.io/projected/95ee5135-b895-42c9-a79e-bb6cb03b123a-kube-api-access-xfhv2\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 17:17:23.109872 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:23.109838 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc" Jul 20 17:17:23.137863 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:23.137781 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc"] Jul 20 17:17:23.144747 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:23.144719 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-e142d5/rate-test-model-e142d5-kserve-79b4c86b5f-w4kvc"] Jul 20 17:17:23.248795 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:23.248766 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140563362575392" Jul 20 17:17:23.275145 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:23.275110 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7363-140563362575392_e389777a-c921-4e0f-867c-6ce0b87554b1/test-curl-7363-140563362575392/0.log" Jul 20 17:17:23.305235 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:23.305201 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7363-140563362575392"] Jul 20 17:17:23.313626 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:23.313594 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7363-140563362575392"] Jul 20 17:17:23.368972 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:23.368946 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2grl\" (UniqueName: \"kubernetes.io/projected/e389777a-c921-4e0f-867c-6ce0b87554b1-kube-api-access-b2grl\") pod \"e389777a-c921-4e0f-867c-6ce0b87554b1\" (UID: \"e389777a-c921-4e0f-867c-6ce0b87554b1\") " Jul 20 17:17:23.371035 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:23.371011 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e389777a-c921-4e0f-867c-6ce0b87554b1-kube-api-access-b2grl" (OuterVolumeSpecName: "kube-api-access-b2grl") pod "e389777a-c921-4e0f-867c-6ce0b87554b1" (UID: "e389777a-c921-4e0f-867c-6ce0b87554b1"). InnerVolumeSpecName "kube-api-access-b2grl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 17:17:23.441245 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:23.441169 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7363-140563362575392"] Jul 20 17:17:23.441625 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:23.441611 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95ee5135-b895-42c9-a79e-bb6cb03b123a" containerName="main" Jul 20 17:17:23.441672 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:23.441627 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="95ee5135-b895-42c9-a79e-bb6cb03b123a" containerName="main" Jul 20 17:17:23.441672 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:23.441641 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e389777a-c921-4e0f-867c-6ce0b87554b1" containerName="test-curl-7363-140563362575392" Jul 20 17:17:23.441672 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:23.441648 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e389777a-c921-4e0f-867c-6ce0b87554b1" containerName="test-curl-7363-140563362575392" Jul 20 17:17:23.441762 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:23.441726 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e389777a-c921-4e0f-867c-6ce0b87554b1" containerName="test-curl-7363-140563362575392" Jul 20 17:17:23.441762 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:23.441738 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="95ee5135-b895-42c9-a79e-bb6cb03b123a" containerName="main" Jul 20 17:17:23.444717 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:23.444701 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140563362575392" Jul 20 17:17:23.451951 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:23.451915 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7363-140563362575392"] Jul 20 17:17:23.469827 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:23.469803 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2grl\" (UniqueName: \"kubernetes.io/projected/e389777a-c921-4e0f-867c-6ce0b87554b1-kube-api-access-b2grl\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 17:17:23.570371 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:23.570337 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvl94\" (UniqueName: \"kubernetes.io/projected/c0a29de3-57c6-4efa-8470-e858cdfae2c4-kube-api-access-pvl94\") pod \"test-curl-7363-140563362575392\" (UID: \"c0a29de3-57c6-4efa-8470-e858cdfae2c4\") " pod="opendatahub/test-curl-7363-140563362575392" Jul 20 17:17:23.671813 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:23.671773 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvl94\" (UniqueName: \"kubernetes.io/projected/c0a29de3-57c6-4efa-8470-e858cdfae2c4-kube-api-access-pvl94\") pod \"test-curl-7363-140563362575392\" (UID: \"c0a29de3-57c6-4efa-8470-e858cdfae2c4\") " pod="opendatahub/test-curl-7363-140563362575392" Jul 20 17:17:23.680805 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:23.680781 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvl94\" (UniqueName: \"kubernetes.io/projected/c0a29de3-57c6-4efa-8470-e858cdfae2c4-kube-api-access-pvl94\") pod \"test-curl-7363-140563362575392\" (UID: \"c0a29de3-57c6-4efa-8470-e858cdfae2c4\") " pod="opendatahub/test-curl-7363-140563362575392" Jul 20 17:17:23.755003 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:23.754924 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140563362575392" Jul 20 17:17:23.899620 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:23.899591 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7363-140563362575392"] Jul 20 17:17:23.899809 ip-10-0-133-157 kubenswrapper[2575]: W0720 17:17:23.899772 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc0a29de3_57c6_4efa_8470_e858cdfae2c4.slice/crio-d8b95eeef4d5de5b5f72670b04e76372efbf6c7aa970e84162241549491fcd5b WatchSource:0}: Error finding container d8b95eeef4d5de5b5f72670b04e76372efbf6c7aa970e84162241549491fcd5b: Status 404 returned error can't find the container with id d8b95eeef4d5de5b5f72670b04e76372efbf6c7aa970e84162241549491fcd5b Jul 20 17:17:24.124179 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:24.124144 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140563362575392" Jul 20 17:17:24.124595 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:24.124150 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a2142527254739475053abb4bb91b37dca2381ddf070cca7b85ab6790e4dd4f9" Jul 20 17:17:24.125555 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:24.125524 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7363-140563362575392" event={"ID":"c0a29de3-57c6-4efa-8470-e858cdfae2c4","Type":"ContainerStarted","Data":"d8b95eeef4d5de5b5f72670b04e76372efbf6c7aa970e84162241549491fcd5b"} Jul 20 17:17:24.138815 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:24.138790 2575 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7363-140563362575392" oldPodUID="e389777a-c921-4e0f-867c-6ce0b87554b1" podUID="c0a29de3-57c6-4efa-8470-e858cdfae2c4" Jul 20 17:17:24.854788 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:24.854753 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95ee5135-b895-42c9-a79e-bb6cb03b123a" path="/var/lib/kubelet/pods/95ee5135-b895-42c9-a79e-bb6cb03b123a/volumes" Jul 20 17:17:24.855104 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:24.855074 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e389777a-c921-4e0f-867c-6ce0b87554b1" path="/var/lib/kubelet/pods/e389777a-c921-4e0f-867c-6ce0b87554b1/volumes" Jul 20 17:17:25.133738 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:25.133645 2575 generic.go:356] "Generic (PLEG): container finished" podID="c0a29de3-57c6-4efa-8470-e858cdfae2c4" containerID="3b311ba1af0468f09c473f9f711d73097531eaa789571fadbfb4be4d1bbd33ff" exitCode=0 Jul 20 17:17:25.134130 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:25.133736 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7363-140563362575392" event={"ID":"c0a29de3-57c6-4efa-8470-e858cdfae2c4","Type":"ContainerDied","Data":"3b311ba1af0468f09c473f9f711d73097531eaa789571fadbfb4be4d1bbd33ff"} Jul 20 17:17:26.277415 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:26.277393 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140563362575392" Jul 20 17:17:26.303528 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:26.303504 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7363-140563362575392_c0a29de3-57c6-4efa-8470-e858cdfae2c4/test-curl-7363-140563362575392/0.log" Jul 20 17:17:26.336332 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:26.336303 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7363-140563362575392"] Jul 20 17:17:26.341650 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:26.341627 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7363-140563362575392"] Jul 20 17:17:26.394910 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:26.394836 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvl94\" (UniqueName: \"kubernetes.io/projected/c0a29de3-57c6-4efa-8470-e858cdfae2c4-kube-api-access-pvl94\") pod \"c0a29de3-57c6-4efa-8470-e858cdfae2c4\" (UID: \"c0a29de3-57c6-4efa-8470-e858cdfae2c4\") " Jul 20 17:17:26.396910 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:26.396885 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0a29de3-57c6-4efa-8470-e858cdfae2c4-kube-api-access-pvl94" (OuterVolumeSpecName: "kube-api-access-pvl94") pod "c0a29de3-57c6-4efa-8470-e858cdfae2c4" (UID: "c0a29de3-57c6-4efa-8470-e858cdfae2c4"). InnerVolumeSpecName "kube-api-access-pvl94". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 17:17:26.496589 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:26.496554 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvl94\" (UniqueName: \"kubernetes.io/projected/c0a29de3-57c6-4efa-8470-e858cdfae2c4-kube-api-access-pvl94\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 17:17:26.591038 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:26.590964 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a16895-ghslc"] Jul 20 17:17:26.591427 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:26.591412 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0a29de3-57c6-4efa-8470-e858cdfae2c4" containerName="test-curl-7363-140563362575392" Jul 20 17:17:26.591475 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:26.591429 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0a29de3-57c6-4efa-8470-e858cdfae2c4" containerName="test-curl-7363-140563362575392" Jul 20 17:17:26.591547 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:26.591537 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0a29de3-57c6-4efa-8470-e858cdfae2c4" containerName="test-curl-7363-140563362575392" Jul 20 17:17:26.594571 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:26.594556 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a16895-ghslc" Jul 20 17:17:26.598403 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:26.598382 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d9prm\"" Jul 20 17:17:26.599734 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:26.599719 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 20 17:17:26.615490 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:26.615464 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a16895-ghslc"] Jul 20 17:17:26.697790 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:26.697703 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fd6f2a4-e9c7-4e8a-8b9a-051dff25dac1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-a16895-ghslc\" (UID: \"5fd6f2a4-e9c7-4e8a-8b9a-051dff25dac1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a16895-ghslc" Jul 20 17:17:26.798475 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:26.798435 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fd6f2a4-e9c7-4e8a-8b9a-051dff25dac1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-a16895-ghslc\" (UID: \"5fd6f2a4-e9c7-4e8a-8b9a-051dff25dac1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a16895-ghslc" Jul 20 17:17:26.799074 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:26.799055 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fd6f2a4-e9c7-4e8a-8b9a-051dff25dac1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-a16895-ghslc\" (UID: \"5fd6f2a4-e9c7-4e8a-8b9a-051dff25dac1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a16895-ghslc" Jul 20 17:17:26.854788 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:26.854752 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0a29de3-57c6-4efa-8470-e858cdfae2c4" path="/var/lib/kubelet/pods/c0a29de3-57c6-4efa-8470-e858cdfae2c4/volumes" Jul 20 17:17:26.904561 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:26.904532 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a16895-ghslc" Jul 20 17:17:27.044341 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:27.044144 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a16895-ghslc"] Jul 20 17:17:27.046568 ip-10-0-133-157 kubenswrapper[2575]: W0720 17:17:27.046530 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fd6f2a4_e9c7_4e8a_8b9a_051dff25dac1.slice/crio-65dd92ae712884d77918faf14cc834506921b34447e91be253fcbac29f8459cc WatchSource:0}: Error finding container 65dd92ae712884d77918faf14cc834506921b34447e91be253fcbac29f8459cc: Status 404 returned error can't find the container with id 65dd92ae712884d77918faf14cc834506921b34447e91be253fcbac29f8459cc Jul 20 17:17:27.148422 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:27.148395 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140563362575392" Jul 20 17:17:27.148583 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:27.148455 2575 scope.go:117] "RemoveContainer" containerID="3b311ba1af0468f09c473f9f711d73097531eaa789571fadbfb4be4d1bbd33ff" Jul 20 17:17:27.149858 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:27.149824 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a16895-ghslc" event={"ID":"5fd6f2a4-e9c7-4e8a-8b9a-051dff25dac1","Type":"ContainerStarted","Data":"65dd92ae712884d77918faf14cc834506921b34447e91be253fcbac29f8459cc"} Jul 20 17:17:28.157035 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:28.156998 2575 generic.go:356] "Generic (PLEG): container finished" podID="5fd6f2a4-e9c7-4e8a-8b9a-051dff25dac1" containerID="65e657dfea58fd312001130b53818f9c725c601e8bfba791d30d0fc22e2a0101" exitCode=0 Jul 20 17:17:28.157475 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:28.157093 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a16895-ghslc" event={"ID":"5fd6f2a4-e9c7-4e8a-8b9a-051dff25dac1","Type":"ContainerDied","Data":"65e657dfea58fd312001130b53818f9c725c601e8bfba791d30d0fc22e2a0101"} Jul 20 17:17:29.305857 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:29.305832 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a16895-ghslc" Jul 20 17:17:29.322093 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:29.322065 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fd6f2a4-e9c7-4e8a-8b9a-051dff25dac1-maas-api-service-ca\") pod \"5fd6f2a4-e9c7-4e8a-8b9a-051dff25dac1\" (UID: \"5fd6f2a4-e9c7-4e8a-8b9a-051dff25dac1\") " Jul 20 17:17:29.322398 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:29.322377 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fd6f2a4-e9c7-4e8a-8b9a-051dff25dac1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5fd6f2a4-e9c7-4e8a-8b9a-051dff25dac1" (UID: "5fd6f2a4-e9c7-4e8a-8b9a-051dff25dac1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 17:17:29.422797 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:29.422710 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fd6f2a4-e9c7-4e8a-8b9a-051dff25dac1-maas-api-service-ca\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 17:17:30.171299 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:30.171267 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a16895-ghslc" Jul 20 17:17:30.171560 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:30.171306 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a16895-ghslc" event={"ID":"5fd6f2a4-e9c7-4e8a-8b9a-051dff25dac1","Type":"ContainerDied","Data":"65dd92ae712884d77918faf14cc834506921b34447e91be253fcbac29f8459cc"} Jul 20 17:17:30.171560 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:30.171359 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="65dd92ae712884d77918faf14cc834506921b34447e91be253fcbac29f8459cc" Jul 20 17:17:37.138846 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:37.138806 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a16895-29742795-twb5x"] Jul 20 17:17:37.143776 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:37.143747 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a16895-29742795-twb5x"] Jul 20 17:17:38.853773 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:38.853733 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="faa32190-84ad-4c44-9edb-7f09aaa4a05c" path="/var/lib/kubelet/pods/faa32190-84ad-4c44-9edb-7f09aaa4a05c/volumes" Jul 20 17:17:40.204420 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:40.204374 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:17:41.696884 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:41.696846 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a16895-ghslc"] Jul 20 17:17:41.699211 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:41.699185 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a16895-ghslc"] Jul 20 17:17:42.853212 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:42.853181 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fd6f2a4-e9c7-4e8a-8b9a-051dff25dac1" path="/var/lib/kubelet/pods/5fd6f2a4-e9c7-4e8a-8b9a-051dff25dac1/volumes" Jul 20 17:17:49.170190 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:49.170154 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e142d5-t4jtr"] Jul 20 17:17:49.170566 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:49.170546 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fd6f2a4-e9c7-4e8a-8b9a-051dff25dac1" containerName="revoke-keys" Jul 20 17:17:49.170566 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:49.170557 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fd6f2a4-e9c7-4e8a-8b9a-051dff25dac1" containerName="revoke-keys" Jul 20 17:17:49.170638 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:49.170634 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fd6f2a4-e9c7-4e8a-8b9a-051dff25dac1" containerName="revoke-keys" Jul 20 17:17:49.173891 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:49.173873 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e142d5-t4jtr" Jul 20 17:17:49.177621 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:49.177600 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 20 17:17:49.177890 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:49.177873 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d9prm\"" Jul 20 17:17:49.192422 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:49.192388 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e142d5-t4jtr"] Jul 20 17:17:49.295959 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:49.295921 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a61d4462-3ce2-45be-a052-4f45a727b7bc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-e142d5-t4jtr\" (UID: \"a61d4462-3ce2-45be-a052-4f45a727b7bc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e142d5-t4jtr" Jul 20 17:17:49.397451 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:49.397409 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a61d4462-3ce2-45be-a052-4f45a727b7bc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-e142d5-t4jtr\" (UID: \"a61d4462-3ce2-45be-a052-4f45a727b7bc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e142d5-t4jtr" Jul 20 17:17:49.398074 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:49.398052 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a61d4462-3ce2-45be-a052-4f45a727b7bc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-e142d5-t4jtr\" (UID: \"a61d4462-3ce2-45be-a052-4f45a727b7bc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e142d5-t4jtr" Jul 20 17:17:49.485350 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:49.485263 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e142d5-t4jtr" Jul 20 17:17:49.634385 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:49.634357 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e142d5-t4jtr"] Jul 20 17:17:49.636779 ip-10-0-133-157 kubenswrapper[2575]: W0720 17:17:49.636742 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda61d4462_3ce2_45be_a052_4f45a727b7bc.slice/crio-797b8ef75f18562996e07ed205e5c5b3eb54adf7b2bc3490bd29eb9f70f18357 WatchSource:0}: Error finding container 797b8ef75f18562996e07ed205e5c5b3eb54adf7b2bc3490bd29eb9f70f18357: Status 404 returned error can't find the container with id 797b8ef75f18562996e07ed205e5c5b3eb54adf7b2bc3490bd29eb9f70f18357 Jul 20 17:17:50.290812 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:50.290775 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e142d5-t4jtr" event={"ID":"a61d4462-3ce2-45be-a052-4f45a727b7bc","Type":"ContainerStarted","Data":"ae6003bb9a9038f0ca8e4015b216ad098ba7199e8bcd583d5dfb57077d5cb4b3"} Jul 20 17:17:50.291254 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:50.290832 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e142d5-t4jtr" event={"ID":"a61d4462-3ce2-45be-a052-4f45a727b7bc","Type":"ContainerStarted","Data":"797b8ef75f18562996e07ed205e5c5b3eb54adf7b2bc3490bd29eb9f70f18357"} Jul 20 17:17:50.322856 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:50.322797 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e142d5-t4jtr" podStartSLOduration=1.3227822360000001 podStartE2EDuration="1.322782236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:17:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:17:50.320054662 +0000 UTC m=+2895.970937161" watchObservedRunningTime="2026-07-20 17:17:50.322782236 +0000 UTC m=+2895.973664735" Jul 20 17:17:51.298906 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:51.298866 2575 generic.go:356] "Generic (PLEG): container finished" podID="a61d4462-3ce2-45be-a052-4f45a727b7bc" containerID="ae6003bb9a9038f0ca8e4015b216ad098ba7199e8bcd583d5dfb57077d5cb4b3" exitCode=0 Jul 20 17:17:51.299320 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:51.298955 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e142d5-t4jtr" event={"ID":"a61d4462-3ce2-45be-a052-4f45a727b7bc","Type":"ContainerDied","Data":"ae6003bb9a9038f0ca8e4015b216ad098ba7199e8bcd583d5dfb57077d5cb4b3"} Jul 20 17:17:52.446688 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:52.446663 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e142d5-t4jtr" Jul 20 17:17:52.525966 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:52.525930 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a61d4462-3ce2-45be-a052-4f45a727b7bc-maas-api-service-ca\") pod \"a61d4462-3ce2-45be-a052-4f45a727b7bc\" (UID: \"a61d4462-3ce2-45be-a052-4f45a727b7bc\") " Jul 20 17:17:52.526331 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:52.526308 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a61d4462-3ce2-45be-a052-4f45a727b7bc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a61d4462-3ce2-45be-a052-4f45a727b7bc" (UID: "a61d4462-3ce2-45be-a052-4f45a727b7bc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 17:17:52.627515 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:52.627425 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a61d4462-3ce2-45be-a052-4f45a727b7bc-maas-api-service-ca\") on node \"ip-10-0-133-157.ec2.internal\" DevicePath \"\"" Jul 20 17:17:53.312469 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:53.312435 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e142d5-t4jtr" Jul 20 17:17:53.312663 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:53.312437 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e142d5-t4jtr" event={"ID":"a61d4462-3ce2-45be-a052-4f45a727b7bc","Type":"ContainerDied","Data":"797b8ef75f18562996e07ed205e5c5b3eb54adf7b2bc3490bd29eb9f70f18357"} Jul 20 17:17:53.312663 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:53.312561 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="797b8ef75f18562996e07ed205e5c5b3eb54adf7b2bc3490bd29eb9f70f18357" Jul 20 17:17:59.805711 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:59.805673 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e142d5-29742795-r57ld"] Jul 20 17:17:59.809009 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:17:59.808985 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e142d5-29742795-r57ld"] Jul 20 17:18:00.854927 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:00.854889 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="253d848e-8f66-4328-a23d-b67819d866a5" path="/var/lib/kubelet/pods/253d848e-8f66-4328-a23d-b67819d866a5/volumes" Jul 20 17:18:02.600252 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:02.600215 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l9nlc"] Jul 20 17:18:04.380394 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:04.380358 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e142d5-t4jtr"] Jul 20 17:18:04.382744 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:04.382721 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e142d5-t4jtr"] Jul 20 17:18:04.855983 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:04.855943 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a61d4462-3ce2-45be-a052-4f45a727b7bc" path="/var/lib/kubelet/pods/a61d4462-3ce2-45be-a052-4f45a727b7bc/volumes" Jul 20 17:18:12.266388 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:12.266354 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7fcc6c6794-jnxn7_c9de8109-5603-46a7-83b6-8348299b17bb/authorino/0.log" Jul 20 17:18:18.623770 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:18.623713 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-p6m8f_86060b94-ae8c-40c8-aabd-d1e7e2f57551/manager/0.log" Jul 20 17:18:18.780797 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:18.780764 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-rm6gj_27426379-57c1-4039-9806-d47166bc988b/manager/0.log" Jul 20 17:18:19.335787 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:19.335763 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9d55867bb-5zffd_e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0/copy-manifests/0.log" Jul 20 17:18:19.345341 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:19.345308 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9d55867bb-5zffd_e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0/manager/0.log" Jul 20 17:18:20.348175 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:20.348142 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29742780-nds7w_a20daa01-02c0-45a7-b097-6bc35f082e6d/cleanup/0.log" Jul 20 17:18:20.476639 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:20.476605 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29742795-85krp_aacc7241-e94d-4e90-8639-d96ed52c7ea8/cleanup/0.log" Jul 20 17:18:21.566404 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:21.566375 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjbkp_b45f64be-088c-4a68-b16a-1e983f00c412/util/0.log" Jul 20 17:18:21.574131 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:21.574108 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjbkp_b45f64be-088c-4a68-b16a-1e983f00c412/pull/0.log" Jul 20 17:18:21.580863 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:21.580842 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjbkp_b45f64be-088c-4a68-b16a-1e983f00c412/extract/0.log" Jul 20 17:18:21.712575 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:21.712541 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq_9d3f783b-c0c5-4339-ac41-fd774ffbf836/util/0.log" Jul 20 17:18:21.719765 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:21.719739 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq_9d3f783b-c0c5-4339-ac41-fd774ffbf836/pull/0.log" Jul 20 17:18:21.727583 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:21.727566 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq_9d3f783b-c0c5-4339-ac41-fd774ffbf836/extract/0.log" Jul 20 17:18:21.868185 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:21.868106 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69_71c42723-8e56-4b44-8fef-002bb28236a2/util/0.log" Jul 20 17:18:21.875935 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:21.875913 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69_71c42723-8e56-4b44-8fef-002bb28236a2/pull/0.log" Jul 20 17:18:21.882649 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:21.882632 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69_71c42723-8e56-4b44-8fef-002bb28236a2/extract/0.log" Jul 20 17:18:22.015817 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:22.015789 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b_ab971744-c2b6-4eb5-ab76-77819f5debbd/extract/0.log" Jul 20 17:18:22.023463 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:22.023441 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b_ab971744-c2b6-4eb5-ab76-77819f5debbd/util/0.log" Jul 20 17:18:22.030535 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:22.030511 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b_ab971744-c2b6-4eb5-ab76-77819f5debbd/pull/0.log" Jul 20 17:18:22.167468 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:22.167388 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7fcc6c6794-jnxn7_c9de8109-5603-46a7-83b6-8348299b17bb/authorino/0.log" Jul 20 17:18:22.317325 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:22.317292 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-tld2z_48af0a4e-80b2-4402-ab3e-52f55162918d/manager/0.log" Jul 20 17:18:22.755037 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:22.755004 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-hvf8w_f72bc7da-b5e2-455e-80d5-485d5b376a03/registry-server/0.log" Jul 20 17:18:22.914863 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:22.914834 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fxrlw_c8f6d557-e53d-4f50-ae67-dcc929ac3074/manager/0.log" Jul 20 17:18:23.097665 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:23.097635 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-l9nlc_7dff765a-14af-4f25-9dae-c2af7972f17d/limitador/0.log" Jul 20 17:18:24.581336 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:24.581310 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9c5c4477b-t6gf6_70abe44f-c09a-4818-b892-7b725bc197ae/router/0.log" Jul 20 17:18:31.684561 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:31.684525 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-m6c6l/must-gather-7rsjf"] Jul 20 17:18:31.685184 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:31.685152 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a61d4462-3ce2-45be-a052-4f45a727b7bc" containerName="revoke-keys" Jul 20 17:18:31.685184 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:31.685173 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a61d4462-3ce2-45be-a052-4f45a727b7bc" containerName="revoke-keys" Jul 20 17:18:31.685332 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:31.685317 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a61d4462-3ce2-45be-a052-4f45a727b7bc" containerName="revoke-keys" Jul 20 17:18:31.688877 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:31.688852 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m6c6l/must-gather-7rsjf" Jul 20 17:18:31.691930 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:31.691904 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-m6c6l\"/\"default-dockercfg-szprv\"" Jul 20 17:18:31.693163 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:31.693146 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m6c6l\"/\"openshift-service-ca.crt\"" Jul 20 17:18:31.693334 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:31.693315 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m6c6l\"/\"kube-root-ca.crt\"" Jul 20 17:18:31.705956 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:31.705929 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m6c6l/must-gather-7rsjf"] Jul 20 17:18:31.789877 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:31.789841 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhxwc\" (UniqueName: \"kubernetes.io/projected/85768547-afea-4776-afa8-be41d80c4966-kube-api-access-hhxwc\") pod \"must-gather-7rsjf\" (UID: \"85768547-afea-4776-afa8-be41d80c4966\") " pod="openshift-must-gather-m6c6l/must-gather-7rsjf" Jul 20 17:18:31.790053 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:31.789884 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/85768547-afea-4776-afa8-be41d80c4966-must-gather-output\") pod \"must-gather-7rsjf\" (UID: \"85768547-afea-4776-afa8-be41d80c4966\") " pod="openshift-must-gather-m6c6l/must-gather-7rsjf" Jul 20 17:18:31.891416 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:31.891369 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhxwc\" (UniqueName: \"kubernetes.io/projected/85768547-afea-4776-afa8-be41d80c4966-kube-api-access-hhxwc\") pod \"must-gather-7rsjf\" (UID: \"85768547-afea-4776-afa8-be41d80c4966\") " pod="openshift-must-gather-m6c6l/must-gather-7rsjf" Jul 20 17:18:31.891580 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:31.891428 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/85768547-afea-4776-afa8-be41d80c4966-must-gather-output\") pod \"must-gather-7rsjf\" (UID: \"85768547-afea-4776-afa8-be41d80c4966\") " pod="openshift-must-gather-m6c6l/must-gather-7rsjf" Jul 20 17:18:31.891768 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:31.891753 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/85768547-afea-4776-afa8-be41d80c4966-must-gather-output\") pod \"must-gather-7rsjf\" (UID: \"85768547-afea-4776-afa8-be41d80c4966\") " pod="openshift-must-gather-m6c6l/must-gather-7rsjf" Jul 20 17:18:31.918797 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:31.918771 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhxwc\" (UniqueName: \"kubernetes.io/projected/85768547-afea-4776-afa8-be41d80c4966-kube-api-access-hhxwc\") pod \"must-gather-7rsjf\" (UID: \"85768547-afea-4776-afa8-be41d80c4966\") " pod="openshift-must-gather-m6c6l/must-gather-7rsjf" Jul 20 17:18:31.998534 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:31.998439 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m6c6l/must-gather-7rsjf" Jul 20 17:18:32.149625 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:32.149599 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m6c6l/must-gather-7rsjf"] Jul 20 17:18:32.151746 ip-10-0-133-157 kubenswrapper[2575]: W0720 17:18:32.151717 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod85768547_afea_4776_afa8_be41d80c4966.slice/crio-24427077c52bd8030671fd9c7bbc2a11182ee197432869db7ca1a4db68d6fcf0 WatchSource:0}: Error finding container 24427077c52bd8030671fd9c7bbc2a11182ee197432869db7ca1a4db68d6fcf0: Status 404 returned error can't find the container with id 24427077c52bd8030671fd9c7bbc2a11182ee197432869db7ca1a4db68d6fcf0 Jul 20 17:18:32.546145 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:32.546110 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m6c6l/must-gather-7rsjf" event={"ID":"85768547-afea-4776-afa8-be41d80c4966","Type":"ContainerStarted","Data":"24427077c52bd8030671fd9c7bbc2a11182ee197432869db7ca1a4db68d6fcf0"} Jul 20 17:18:33.557576 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:33.557534 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m6c6l/must-gather-7rsjf" event={"ID":"85768547-afea-4776-afa8-be41d80c4966","Type":"ContainerStarted","Data":"94d24c2256d6d65f2dd179997a08b01d59a9342276e70ed6270387ca22956b6e"} Jul 20 17:18:33.558056 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:33.557595 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m6c6l/must-gather-7rsjf" event={"ID":"85768547-afea-4776-afa8-be41d80c4966","Type":"ContainerStarted","Data":"970e6ef918ee43978f591c8676029e35c64b970f894f7c66c54332beeeb71ae8"} Jul 20 17:18:35.209054 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:35.209017 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bpbjs_e60cf0cf-f42e-4d8c-a1be-977d5eab29ef/global-pull-secret-syncer/0.log" Jul 20 17:18:35.503694 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:35.503621 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-r7vpx_846c8111-559c-4131-a066-2c2338f37da7/konnectivity-agent/0.log" Jul 20 17:18:35.642236 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:35.642203 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-157.ec2.internal_8b50f7e977174ad9e7171a45678a56bb/haproxy/0.log" Jul 20 17:18:39.904396 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:39.904364 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjbkp_b45f64be-088c-4a68-b16a-1e983f00c412/extract/0.log" Jul 20 17:18:39.935215 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:39.935029 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjbkp_b45f64be-088c-4a68-b16a-1e983f00c412/util/0.log" Jul 20 17:18:39.967559 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:39.967497 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjbkp_b45f64be-088c-4a68-b16a-1e983f00c412/pull/0.log" Jul 20 17:18:40.002724 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:40.002662 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq_9d3f783b-c0c5-4339-ac41-fd774ffbf836/extract/0.log" Jul 20 17:18:40.036854 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:40.036827 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq_9d3f783b-c0c5-4339-ac41-fd774ffbf836/util/0.log" Jul 20 17:18:40.076197 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:40.076132 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0h2gtq_9d3f783b-c0c5-4339-ac41-fd774ffbf836/pull/0.log" Jul 20 17:18:40.118017 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:40.117986 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69_71c42723-8e56-4b44-8fef-002bb28236a2/extract/0.log" Jul 20 17:18:40.156787 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:40.156701 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69_71c42723-8e56-4b44-8fef-002bb28236a2/util/0.log" Jul 20 17:18:40.189450 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:40.189422 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739zf69_71c42723-8e56-4b44-8fef-002bb28236a2/pull/0.log" Jul 20 17:18:40.274607 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:40.274581 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b_ab971744-c2b6-4eb5-ab76-77819f5debbd/extract/0.log" Jul 20 17:18:40.324791 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:40.324747 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b_ab971744-c2b6-4eb5-ab76-77819f5debbd/util/0.log" Jul 20 17:18:40.366129 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:40.366097 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d6z8b_ab971744-c2b6-4eb5-ab76-77819f5debbd/pull/0.log" Jul 20 17:18:40.855070 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:40.855022 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7fcc6c6794-jnxn7_c9de8109-5603-46a7-83b6-8348299b17bb/authorino/0.log" Jul 20 17:18:40.909625 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:40.909545 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-tld2z_48af0a4e-80b2-4402-ab3e-52f55162918d/manager/0.log" Jul 20 17:18:41.057750 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:41.057704 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-hvf8w_f72bc7da-b5e2-455e-80d5-485d5b376a03/registry-server/0.log" Jul 20 17:18:41.365590 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:41.365550 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fxrlw_c8f6d557-e53d-4f50-ae67-dcc929ac3074/manager/0.log" Jul 20 17:18:41.445787 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:41.445745 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-l9nlc_7dff765a-14af-4f25-9dae-c2af7972f17d/limitador/0.log" Jul 20 17:18:43.212497 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:43.212462 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_79de569a-6f31-4490-a540-3f5cb67f2a16/alertmanager/0.log" Jul 20 17:18:43.249969 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:43.249911 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_79de569a-6f31-4490-a540-3f5cb67f2a16/config-reloader/0.log" Jul 20 17:18:43.282042 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:43.282010 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_79de569a-6f31-4490-a540-3f5cb67f2a16/kube-rbac-proxy-web/0.log" Jul 20 17:18:43.315977 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:43.315939 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_79de569a-6f31-4490-a540-3f5cb67f2a16/kube-rbac-proxy/0.log" Jul 20 17:18:43.359998 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:43.359897 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_79de569a-6f31-4490-a540-3f5cb67f2a16/kube-rbac-proxy-metric/0.log" Jul 20 17:18:43.389040 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:43.389009 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_79de569a-6f31-4490-a540-3f5cb67f2a16/prom-label-proxy/0.log" Jul 20 17:18:43.428647 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:43.428607 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_79de569a-6f31-4490-a540-3f5cb67f2a16/init-config-reloader/0.log" Jul 20 17:18:43.483413 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:43.483334 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-8dqnv_53105f6d-e4c4-497b-b5a9-b0e37d4c2eb3/cluster-monitoring-operator/0.log" Jul 20 17:18:43.620572 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:43.620542 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-967997db4-64vzd_4f8759ae-541e-45f6-972f-87742e533649/metrics-server/0.log" Jul 20 17:18:43.694166 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:43.694048 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bzfp8_48ee35a2-9bda-4328-9452-ab5ee276fc6e/node-exporter/0.log" Jul 20 17:18:43.715962 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:43.715927 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bzfp8_48ee35a2-9bda-4328-9452-ab5ee276fc6e/kube-rbac-proxy/0.log" Jul 20 17:18:43.740230 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:43.740066 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bzfp8_48ee35a2-9bda-4328-9452-ab5ee276fc6e/init-textfile/0.log" Jul 20 17:18:43.957832 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:43.957796 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-qzbcz_efee9b27-14b5-4e57-bf01-1da41f07676b/kube-rbac-proxy-main/0.log" Jul 20 17:18:43.984747 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:43.984720 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-qzbcz_efee9b27-14b5-4e57-bf01-1da41f07676b/kube-rbac-proxy-self/0.log" Jul 20 17:18:44.012469 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:44.012385 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-qzbcz_efee9b27-14b5-4e57-bf01-1da41f07676b/openshift-state-metrics/0.log" Jul 20 17:18:44.429213 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:44.429178 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86dfc96c8c-ndslv_7498d949-4441-4c92-97c4-7934451c62a7/telemeter-client/0.log" Jul 20 17:18:44.463852 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:44.463824 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86dfc96c8c-ndslv_7498d949-4441-4c92-97c4-7934451c62a7/reload/0.log" Jul 20 17:18:44.495388 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:44.495358 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86dfc96c8c-ndslv_7498d949-4441-4c92-97c4-7934451c62a7/kube-rbac-proxy/0.log" Jul 20 17:18:44.532078 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:44.532050 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-866c9b644b-k4wdq_e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a/thanos-query/0.log" Jul 20 17:18:44.590458 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:44.590411 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-866c9b644b-k4wdq_e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a/kube-rbac-proxy-web/0.log" Jul 20 17:18:44.663550 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:44.663506 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-866c9b644b-k4wdq_e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a/kube-rbac-proxy/0.log" Jul 20 17:18:44.724767 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:44.724686 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-866c9b644b-k4wdq_e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a/prom-label-proxy/0.log" Jul 20 17:18:44.751258 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:44.751231 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-866c9b644b-k4wdq_e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a/kube-rbac-proxy-rules/0.log" Jul 20 17:18:44.779358 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:44.779329 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-866c9b644b-k4wdq_e857eb6c-ecf2-4c09-8b7e-ed70b6025b3a/kube-rbac-proxy-metrics/0.log" Jul 20 17:18:45.156883 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:45.156814 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-m6c6l/must-gather-7rsjf" podStartSLOduration=12.977716168 podStartE2EDuration="14.156790575s" totalImagesPullingTime="1.179074407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:18:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:18:33.584261981 +0000 UTC m=+2939.235144508" watchObservedRunningTime="2026-07-20 17:18:45.156790575 +0000 UTC m=+2950.807673073" Jul 20 17:18:45.158987 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:45.158956 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-m6c6l/perf-node-gather-daemonset-m7lxg"] Jul 20 17:18:45.166765 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:45.166732 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-m7lxg" Jul 20 17:18:45.187851 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:45.187810 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m6c6l/perf-node-gather-daemonset-m7lxg"] Jul 20 17:18:45.228251 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:45.228219 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmmsm\" (UniqueName: \"kubernetes.io/projected/dc22f697-0d76-4a38-9d35-53fb399a93ce-kube-api-access-jmmsm\") pod \"perf-node-gather-daemonset-m7lxg\" (UID: \"dc22f697-0d76-4a38-9d35-53fb399a93ce\") " pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-m7lxg" Jul 20 17:18:45.228497 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:45.228485 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dc22f697-0d76-4a38-9d35-53fb399a93ce-lib-modules\") pod \"perf-node-gather-daemonset-m7lxg\" (UID: \"dc22f697-0d76-4a38-9d35-53fb399a93ce\") " pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-m7lxg" Jul 20 17:18:45.228600 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:45.228588 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dc22f697-0d76-4a38-9d35-53fb399a93ce-proc\") pod \"perf-node-gather-daemonset-m7lxg\" (UID: \"dc22f697-0d76-4a38-9d35-53fb399a93ce\") " pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-m7lxg" Jul 20 17:18:45.228739 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:45.228730 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc22f697-0d76-4a38-9d35-53fb399a93ce-sys\") pod \"perf-node-gather-daemonset-m7lxg\" (UID: \"dc22f697-0d76-4a38-9d35-53fb399a93ce\") " pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-m7lxg" Jul 20 17:18:45.228832 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:45.228823 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dc22f697-0d76-4a38-9d35-53fb399a93ce-podres\") pod \"perf-node-gather-daemonset-m7lxg\" (UID: \"dc22f697-0d76-4a38-9d35-53fb399a93ce\") " pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-m7lxg" Jul 20 17:18:45.329629 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:45.329588 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc22f697-0d76-4a38-9d35-53fb399a93ce-sys\") pod \"perf-node-gather-daemonset-m7lxg\" (UID: \"dc22f697-0d76-4a38-9d35-53fb399a93ce\") " pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-m7lxg" Jul 20 17:18:45.329838 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:45.329641 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dc22f697-0d76-4a38-9d35-53fb399a93ce-podres\") pod \"perf-node-gather-daemonset-m7lxg\" (UID: \"dc22f697-0d76-4a38-9d35-53fb399a93ce\") " pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-m7lxg" Jul 20 17:18:45.329838 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:45.329698 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmmsm\" (UniqueName: \"kubernetes.io/projected/dc22f697-0d76-4a38-9d35-53fb399a93ce-kube-api-access-jmmsm\") pod \"perf-node-gather-daemonset-m7lxg\" (UID: \"dc22f697-0d76-4a38-9d35-53fb399a93ce\") " pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-m7lxg" Jul 20 17:18:45.329838 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:45.329724 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dc22f697-0d76-4a38-9d35-53fb399a93ce-lib-modules\") pod \"perf-node-gather-daemonset-m7lxg\" (UID: \"dc22f697-0d76-4a38-9d35-53fb399a93ce\") " pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-m7lxg" Jul 20 17:18:45.329838 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:45.329736 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc22f697-0d76-4a38-9d35-53fb399a93ce-sys\") pod \"perf-node-gather-daemonset-m7lxg\" (UID: \"dc22f697-0d76-4a38-9d35-53fb399a93ce\") " pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-m7lxg" Jul 20 17:18:45.329838 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:45.329743 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dc22f697-0d76-4a38-9d35-53fb399a93ce-proc\") pod \"perf-node-gather-daemonset-m7lxg\" (UID: \"dc22f697-0d76-4a38-9d35-53fb399a93ce\") " pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-m7lxg" Jul 20 17:18:45.329838 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:45.329816 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dc22f697-0d76-4a38-9d35-53fb399a93ce-proc\") pod \"perf-node-gather-daemonset-m7lxg\" (UID: \"dc22f697-0d76-4a38-9d35-53fb399a93ce\") " pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-m7lxg" Jul 20 17:18:45.329838 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:45.329831 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dc22f697-0d76-4a38-9d35-53fb399a93ce-podres\") pod \"perf-node-gather-daemonset-m7lxg\" (UID: \"dc22f697-0d76-4a38-9d35-53fb399a93ce\") " pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-m7lxg" Jul 20 17:18:45.330180 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:45.329914 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dc22f697-0d76-4a38-9d35-53fb399a93ce-lib-modules\") pod \"perf-node-gather-daemonset-m7lxg\" (UID: \"dc22f697-0d76-4a38-9d35-53fb399a93ce\") " pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-m7lxg" Jul 20 17:18:45.339021 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:45.338990 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmmsm\" (UniqueName: \"kubernetes.io/projected/dc22f697-0d76-4a38-9d35-53fb399a93ce-kube-api-access-jmmsm\") pod \"perf-node-gather-daemonset-m7lxg\" (UID: \"dc22f697-0d76-4a38-9d35-53fb399a93ce\") " pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-m7lxg" Jul 20 17:18:45.479346 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:45.479253 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-m7lxg" Jul 20 17:18:45.668671 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:45.668643 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m6c6l/perf-node-gather-daemonset-m7lxg"] Jul 20 17:18:45.671039 ip-10-0-133-157 kubenswrapper[2575]: W0720 17:18:45.671000 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddc22f697_0d76_4a38_9d35_53fb399a93ce.slice/crio-9a2a14877c09044ce51870a87c554df4045bc4577d6e7d863d173873f844aaf7 WatchSource:0}: Error finding container 9a2a14877c09044ce51870a87c554df4045bc4577d6e7d863d173873f844aaf7: Status 404 returned error can't find the container with id 9a2a14877c09044ce51870a87c554df4045bc4577d6e7d863d173873f844aaf7 Jul 20 17:18:45.688111 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:45.684606 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-m7lxg" event={"ID":"dc22f697-0d76-4a38-9d35-53fb399a93ce","Type":"ContainerStarted","Data":"9a2a14877c09044ce51870a87c554df4045bc4577d6e7d863d173873f844aaf7"} Jul 20 17:18:46.009311 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:46.009225 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-5659v_8ee47b7a-0762-47f2-9d04-d564e41fb936/networking-console-plugin/0.log" Jul 20 17:18:46.618012 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:46.617973 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-99wqw_0ec4c40f-7638-4fe3-8bff-edb2579a3b3b/console-operator/1.log" Jul 20 17:18:46.624668 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:46.624641 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-99wqw_0ec4c40f-7638-4fe3-8bff-edb2579a3b3b/console-operator/2.log" Jul 20 17:18:46.696294 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:46.696253 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-m7lxg" event={"ID":"dc22f697-0d76-4a38-9d35-53fb399a93ce","Type":"ContainerStarted","Data":"d81e06b77d6244f95c4085dfbd78bc3a9224ff8cdefac3ebddbf91b51af48e7d"} Jul 20 17:18:46.696515 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:46.696491 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-m7lxg" Jul 20 17:18:46.715619 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:46.715557 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-m7lxg" podStartSLOduration=1.7155359909999999 podStartE2EDuration="1.715535991s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 17:18:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:18:46.715034217 +0000 UTC m=+2952.365916720" watchObservedRunningTime="2026-07-20 17:18:46.715535991 +0000 UTC m=+2952.366418490" Jul 20 17:18:47.103468 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:47.103442 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f596f5875-z7ltl_9a1cf680-8a22-48c0-a19d-5e126eaf951e/console/0.log" Jul 20 17:18:47.146403 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:47.146372 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-dcggk_dec857bc-bb8a-4a89-8ece-24125904bfde/download-server/0.log" Jul 20 17:18:47.760401 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:47.760364 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-tw742_bbfb6c85-631b-4639-8b95-5342f1f06c3a/volume-data-source-validator/0.log" Jul 20 17:18:48.961642 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:48.961615 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mfsjt_bd433e6a-a361-4daf-bbbe-053e843cca00/dns/0.log" Jul 20 17:18:48.991313 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:48.991281 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mfsjt_bd433e6a-a361-4daf-bbbe-053e843cca00/kube-rbac-proxy/0.log" Jul 20 17:18:49.100845 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:49.100815 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kh6zc_7377db3f-fd05-4a8f-9ac0-35a3245062da/dns-node-resolver/0.log" Jul 20 17:18:49.789431 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:49.789360 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m275f_4f85b138-a3e7-4242-be3e-1a237173570a/node-ca/0.log" Jul 20 17:18:51.332884 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:51.332854 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9c5c4477b-t6gf6_70abe44f-c09a-4818-b892-7b725bc197ae/router/0.log" Jul 20 17:18:52.047256 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:52.047223 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-642qq_f3ca3fdc-9728-4d63-8847-448196cf79ab/serve-healthcheck-canary/0.log" Jul 20 17:18:52.661942 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:52.661902 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-fzrfs_36b61e21-6ab6-46aa-853b-299dcee26854/insights-operator/0.log" Jul 20 17:18:52.662416 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:52.662170 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-fzrfs_36b61e21-6ab6-46aa-853b-299dcee26854/insights-operator/1.log" Jul 20 17:18:52.716316 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:52.716279 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-m6c6l/perf-node-gather-daemonset-m7lxg" Jul 20 17:18:52.882859 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:52.882830 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hg27p_47e9b2bf-923f-4e16-b106-a2f7be0575ae/kube-rbac-proxy/0.log" Jul 20 17:18:52.910554 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:52.910530 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hg27p_47e9b2bf-923f-4e16-b106-a2f7be0575ae/exporter/0.log" Jul 20 17:18:52.939004 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:52.938925 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hg27p_47e9b2bf-923f-4e16-b106-a2f7be0575ae/extractor/0.log" Jul 20 17:18:55.618853 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:55.618818 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-p6m8f_86060b94-ae8c-40c8-aabd-d1e7e2f57551/manager/0.log" Jul 20 17:18:55.841804 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:55.841773 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-rm6gj_27426379-57c1-4039-9806-d47166bc988b/manager/0.log" Jul 20 17:18:56.344242 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:56.344216 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9d55867bb-5zffd_e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0/manager/0.log" Jul 20 17:18:56.359261 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:56.359232 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9c5c4477b-t6gf6_70abe44f-c09a-4818-b892-7b725bc197ae/router/0.log" Jul 20 17:18:56.375051 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:56.375022 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9d55867bb-5zffd_e2660ebd-e9eb-4ecb-a7f7-c09edd4798c0/copy-manifests/0.log" Jul 20 17:18:57.819749 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:57.819722 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6775c44bcb-8k9cz_d92e6f2f-4404-43bd-b460-6811be1b450f/manager/0.log" Jul 20 17:18:58.001012 ip-10-0-133-157 kubenswrapper[2575]: I0720 17:18:58.000982 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9c5c4477b-t6gf6_70abe44f-c09a-4818-b892-7b725bc197ae/router/0.log"