Jun 05 03:40:38.170780 ip-10-0-132-53 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 05 03:40:38.170925 ip-10-0-132-53 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 05 03:40:38.170942 ip-10-0-132-53 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 05 03:40:38.171396 ip-10-0-132-53 systemd[1]: Failed to start Kubernetes Kubelet. Jun 05 03:40:48.252071 ip-10-0-132-53 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 05 03:40:48.252089 ip-10-0-132-53 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot c5b036ce8e824ddf9fddcd6a0a0b536f -- Jun 05 03:43:20.601724 ip-10-0-132-53 systemd[1]: Starting Kubernetes Kubelet... Jun 05 03:43:21.041131 ip-10-0-132-53 kubenswrapper[2548]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 03:43:21.041131 ip-10-0-132-53 kubenswrapper[2548]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 05 03:43:21.041131 ip-10-0-132-53 kubenswrapper[2548]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 03:43:21.041131 ip-10-0-132-53 kubenswrapper[2548]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 05 03:43:21.041131 ip-10-0-132-53 kubenswrapper[2548]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 03:43:21.043174 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.043081 2548 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 05 03:43:21.048053 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048036 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 03:43:21.048053 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048054 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 03:43:21.048118 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048057 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 03:43:21.048118 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048061 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 03:43:21.048118 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048064 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 03:43:21.048118 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048066 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 03:43:21.048118 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048070 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 03:43:21.048118 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048073 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 03:43:21.048118 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048076 2548 feature_gate.go:328] unrecognized feature gate: Example Jun 05 03:43:21.048118 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048079 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 03:43:21.048118 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048081 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 03:43:21.048118 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048083 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 03:43:21.048118 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048086 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 03:43:21.048118 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048089 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 03:43:21.048118 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048092 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 03:43:21.048118 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048094 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 03:43:21.048118 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048097 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 03:43:21.048118 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048099 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 03:43:21.048118 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048102 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 03:43:21.048118 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048106 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 03:43:21.048118 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048108 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 03:43:21.048118 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048111 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 03:43:21.048602 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048113 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 03:43:21.048602 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048116 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 03:43:21.048602 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048119 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 03:43:21.048602 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048122 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 03:43:21.048602 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048125 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 03:43:21.048602 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048127 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 03:43:21.048602 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048130 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 03:43:21.048602 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048133 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 03:43:21.048602 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048135 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 03:43:21.048602 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048138 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 03:43:21.048602 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048141 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 03:43:21.048602 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048144 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 03:43:21.048602 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048146 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 03:43:21.048602 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048149 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 03:43:21.048602 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048151 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 03:43:21.048602 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048154 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 03:43:21.048602 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048157 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 03:43:21.048602 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048159 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 03:43:21.048602 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048162 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 03:43:21.048602 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048164 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 03:43:21.049074 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048167 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 03:43:21.049074 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048170 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 03:43:21.049074 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048172 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 03:43:21.049074 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048174 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 03:43:21.049074 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048177 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 03:43:21.049074 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048179 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 03:43:21.049074 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048182 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 03:43:21.049074 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048185 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 03:43:21.049074 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048187 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 03:43:21.049074 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048190 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 03:43:21.049074 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048192 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 03:43:21.049074 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048194 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 03:43:21.049074 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048197 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 03:43:21.049074 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048201 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 03:43:21.049074 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048203 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 03:43:21.049074 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048206 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 03:43:21.049074 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048208 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 03:43:21.049074 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048211 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 03:43:21.049074 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048213 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 03:43:21.049074 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048216 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 03:43:21.049567 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048219 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 03:43:21.049567 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048221 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 03:43:21.049567 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048224 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 03:43:21.049567 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048228 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 03:43:21.049567 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048232 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 03:43:21.049567 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048235 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 03:43:21.049567 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048238 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 03:43:21.049567 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048241 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 03:43:21.049567 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048244 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 03:43:21.049567 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048246 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 03:43:21.049567 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048249 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 03:43:21.049567 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048252 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 03:43:21.049567 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048255 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 03:43:21.049567 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048258 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 03:43:21.049567 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048260 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 03:43:21.049567 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048264 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 03:43:21.049567 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048267 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 03:43:21.049567 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048270 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 03:43:21.049567 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048273 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 03:43:21.050023 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048275 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 03:43:21.050023 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048285 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 03:43:21.050023 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048288 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 03:43:21.050023 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048291 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 03:43:21.050023 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048293 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 03:43:21.050023 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048297 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 03:43:21.050023 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048302 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 03:43:21.050023 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048305 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 03:43:21.050023 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048308 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 03:43:21.050023 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048311 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 03:43:21.050023 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048313 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 03:43:21.050023 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048316 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 03:43:21.050023 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048318 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 03:43:21.050023 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048320 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 03:43:21.050023 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048324 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 03:43:21.050023 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048327 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 03:43:21.050023 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048330 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 03:43:21.050023 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.048333 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 03:43:21.050023 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049125 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 03:43:21.050599 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049138 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 03:43:21.050599 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049142 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 03:43:21.050599 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049145 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 03:43:21.050599 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049148 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 03:43:21.050599 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049151 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 03:43:21.050599 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049154 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 03:43:21.050599 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049157 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 03:43:21.050599 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049160 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 03:43:21.050599 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049162 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 03:43:21.050599 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049165 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 03:43:21.050599 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049167 2548 feature_gate.go:328] unrecognized feature gate: Example Jun 05 03:43:21.050599 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049170 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 03:43:21.050599 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049173 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 03:43:21.050599 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049176 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 03:43:21.050599 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049178 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 03:43:21.050599 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049181 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 03:43:21.050599 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049183 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 03:43:21.050599 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049186 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 03:43:21.050599 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049188 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 03:43:21.050599 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049191 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 03:43:21.051096 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049194 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 03:43:21.051096 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049197 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 03:43:21.051096 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049199 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 03:43:21.051096 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049202 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 03:43:21.051096 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049204 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 03:43:21.051096 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049207 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 03:43:21.051096 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049209 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 03:43:21.051096 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049212 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 03:43:21.051096 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049217 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 03:43:21.051096 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049221 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 03:43:21.051096 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049224 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 03:43:21.051096 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049227 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 03:43:21.051096 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049231 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 03:43:21.051096 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049234 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 03:43:21.051096 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049236 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 03:43:21.051096 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049239 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 03:43:21.051096 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049242 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 03:43:21.051096 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049244 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 03:43:21.051096 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049247 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 03:43:21.051096 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049250 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 03:43:21.051616 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049253 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 03:43:21.051616 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049255 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 03:43:21.051616 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049257 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 03:43:21.051616 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049260 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 03:43:21.051616 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049263 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 03:43:21.051616 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049265 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 03:43:21.051616 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049268 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 03:43:21.051616 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049270 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 03:43:21.051616 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049273 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 03:43:21.051616 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049275 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 03:43:21.051616 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049278 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 03:43:21.051616 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049280 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 03:43:21.051616 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049283 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 03:43:21.051616 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049285 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 03:43:21.051616 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049289 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 03:43:21.051616 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049293 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 03:43:21.051616 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049296 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 03:43:21.051616 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049299 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 03:43:21.051616 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049302 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 03:43:21.052098 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049304 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 03:43:21.052098 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049307 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 03:43:21.052098 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049310 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 03:43:21.052098 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049312 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 03:43:21.052098 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049315 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 03:43:21.052098 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049318 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 03:43:21.052098 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049321 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 03:43:21.052098 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049323 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 03:43:21.052098 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049326 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 03:43:21.052098 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049329 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 03:43:21.052098 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049332 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 03:43:21.052098 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049334 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 03:43:21.052098 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049336 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 03:43:21.052098 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049339 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 03:43:21.052098 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049341 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 03:43:21.052098 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049344 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 03:43:21.052098 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049346 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 03:43:21.052098 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049349 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 03:43:21.052098 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049352 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 03:43:21.052098 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049355 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 03:43:21.052603 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049358 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 03:43:21.052603 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049360 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 03:43:21.052603 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049363 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 03:43:21.052603 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049365 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 03:43:21.052603 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049370 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 03:43:21.052603 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049374 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 03:43:21.052603 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049377 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 03:43:21.052603 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049380 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 03:43:21.052603 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049383 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 03:43:21.052603 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049385 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 03:43:21.052603 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049388 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 03:43:21.052603 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049391 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 03:43:21.052603 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049394 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 03:43:21.052603 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049396 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 03:43:21.052603 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049399 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 03:43:21.052603 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049402 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 03:43:21.052603 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049404 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 03:43:21.052603 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049407 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 03:43:21.052603 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049410 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 03:43:21.053068 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049799 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 03:43:21.053068 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049804 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 03:43:21.053068 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049807 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 03:43:21.053068 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049811 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 03:43:21.053068 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049813 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 03:43:21.053068 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049816 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 03:43:21.053068 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049819 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 03:43:21.053068 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049821 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 03:43:21.053068 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049824 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 03:43:21.053068 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049826 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 03:43:21.053068 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049829 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 03:43:21.053068 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049832 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 03:43:21.053068 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049834 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 03:43:21.053068 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049837 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 03:43:21.053068 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049839 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 03:43:21.053068 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049841 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 03:43:21.053068 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049845 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 03:43:21.053068 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049849 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 03:43:21.053068 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049852 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 03:43:21.053068 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049854 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 03:43:21.053615 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049861 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 03:43:21.053615 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049863 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 03:43:21.053615 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049866 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 03:43:21.053615 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049868 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 03:43:21.053615 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049871 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 03:43:21.053615 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049874 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 03:43:21.053615 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049876 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 03:43:21.053615 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049878 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 03:43:21.053615 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049881 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 03:43:21.053615 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049883 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 03:43:21.053615 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049886 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 03:43:21.053615 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049889 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 03:43:21.053615 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049892 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 03:43:21.053615 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049894 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 03:43:21.053615 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049898 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 03:43:21.053615 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049900 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 03:43:21.053615 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049903 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 03:43:21.053615 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049905 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 03:43:21.053615 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049908 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 03:43:21.053615 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049910 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 03:43:21.054116 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049914 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 03:43:21.054116 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049917 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 03:43:21.054116 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049920 2548 feature_gate.go:328] unrecognized feature gate: Example Jun 05 03:43:21.054116 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049923 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 03:43:21.054116 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049926 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 03:43:21.054116 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049929 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 03:43:21.054116 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049931 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 03:43:21.054116 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049934 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 03:43:21.054116 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049937 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 03:43:21.054116 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049939 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 03:43:21.054116 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049942 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 03:43:21.054116 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049944 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 03:43:21.054116 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049951 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 03:43:21.054116 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049954 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 03:43:21.054116 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049956 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 03:43:21.054116 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049959 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 03:43:21.054116 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049961 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 03:43:21.054116 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049963 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 03:43:21.054116 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049966 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 03:43:21.054116 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049969 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 03:43:21.054634 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049971 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 03:43:21.054634 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049973 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 03:43:21.054634 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049977 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 03:43:21.054634 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049979 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 03:43:21.054634 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049982 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 03:43:21.054634 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049986 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 03:43:21.054634 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049988 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 03:43:21.054634 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049991 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 03:43:21.054634 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049993 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 03:43:21.054634 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049996 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 03:43:21.054634 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.049998 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 03:43:21.054634 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050001 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 03:43:21.054634 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050003 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 03:43:21.054634 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050006 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 03:43:21.054634 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050008 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 03:43:21.054634 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050011 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 03:43:21.054634 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050013 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 03:43:21.054634 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050015 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 03:43:21.054634 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050018 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 03:43:21.055152 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050020 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 03:43:21.055152 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050023 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 03:43:21.055152 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050026 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 03:43:21.055152 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050028 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 03:43:21.055152 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050031 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 03:43:21.055152 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050035 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 03:43:21.055152 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050038 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 03:43:21.055152 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050041 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 03:43:21.055152 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050043 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 03:43:21.055152 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050046 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 03:43:21.055152 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050048 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 03:43:21.055152 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050052 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 03:43:21.055152 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050054 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 03:43:21.055152 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050057 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 03:43:21.055152 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050061 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 03:43:21.055152 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050064 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 03:43:21.055152 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050067 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 03:43:21.055152 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050070 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 03:43:21.055152 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050072 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 03:43:21.055152 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050075 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 03:43:21.055689 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050151 2548 flags.go:64] FLAG: --address="0.0.0.0" Jun 05 03:43:21.055689 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050158 2548 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 05 03:43:21.055689 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050164 2548 flags.go:64] FLAG: --anonymous-auth="true" Jun 05 03:43:21.055689 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050169 2548 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 05 03:43:21.055689 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050173 2548 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 05 03:43:21.055689 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050177 2548 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 05 03:43:21.055689 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050181 2548 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 05 03:43:21.055689 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050185 2548 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 05 03:43:21.055689 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050188 2548 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 05 03:43:21.055689 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050191 2548 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 05 03:43:21.055689 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050194 2548 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 05 03:43:21.055689 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050198 2548 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 05 03:43:21.055689 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050200 2548 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 05 03:43:21.055689 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050203 2548 flags.go:64] FLAG: --cgroup-root="" Jun 05 03:43:21.055689 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050206 2548 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 05 03:43:21.055689 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050209 2548 flags.go:64] FLAG: --client-ca-file="" Jun 05 03:43:21.055689 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050212 2548 flags.go:64] FLAG: --cloud-provider="external" Jun 05 03:43:21.055689 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050216 2548 flags.go:64] FLAG: --cluster-dns="[]" Jun 05 03:43:21.055689 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050220 2548 flags.go:64] FLAG: --cluster-domain="" Jun 05 03:43:21.055689 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050223 2548 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 05 03:43:21.055689 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050226 2548 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 05 03:43:21.055689 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050229 2548 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 05 03:43:21.055689 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050232 2548 flags.go:64] FLAG: --container-log-max-files="5" Jun 05 03:43:21.055689 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050235 2548 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 05 03:43:21.056308 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050238 2548 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 05 03:43:21.056308 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050241 2548 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 05 03:43:21.056308 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050244 2548 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 05 03:43:21.056308 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050247 2548 flags.go:64] FLAG: --contention-profiling="false" Jun 05 03:43:21.056308 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050250 2548 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 05 03:43:21.056308 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050253 2548 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 05 03:43:21.056308 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050256 2548 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 05 03:43:21.056308 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050258 2548 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 05 03:43:21.056308 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050263 2548 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 05 03:43:21.056308 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050266 2548 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 05 03:43:21.056308 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050269 2548 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 05 03:43:21.056308 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050271 2548 flags.go:64] FLAG: --enable-load-reader="false" Jun 05 03:43:21.056308 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050274 2548 flags.go:64] FLAG: --enable-server="true" Jun 05 03:43:21.056308 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050277 2548 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 05 03:43:21.056308 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050282 2548 flags.go:64] FLAG: --event-burst="100" Jun 05 03:43:21.056308 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050284 2548 flags.go:64] FLAG: --event-qps="50" Jun 05 03:43:21.056308 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050287 2548 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 05 03:43:21.056308 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050290 2548 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 05 03:43:21.056308 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050293 2548 flags.go:64] FLAG: --eviction-hard="" Jun 05 03:43:21.056308 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050297 2548 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 05 03:43:21.056308 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050299 2548 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 05 03:43:21.056308 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050302 2548 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 05 03:43:21.056308 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050305 2548 flags.go:64] FLAG: --eviction-soft="" Jun 05 03:43:21.056308 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050308 2548 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 05 03:43:21.056308 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050311 2548 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 05 03:43:21.056955 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050315 2548 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 05 03:43:21.056955 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050318 2548 flags.go:64] FLAG: --experimental-mounter-path="" Jun 05 03:43:21.056955 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050321 2548 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 05 03:43:21.056955 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050323 2548 flags.go:64] FLAG: --fail-swap-on="true" Jun 05 03:43:21.056955 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050326 2548 flags.go:64] FLAG: --feature-gates="" Jun 05 03:43:21.056955 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050329 2548 flags.go:64] FLAG: --file-check-frequency="20s" Jun 05 03:43:21.056955 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050332 2548 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 05 03:43:21.056955 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050335 2548 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 05 03:43:21.056955 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050338 2548 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 05 03:43:21.056955 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050341 2548 flags.go:64] FLAG: --healthz-port="10248" Jun 05 03:43:21.056955 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050344 2548 flags.go:64] FLAG: --help="false" Jun 05 03:43:21.056955 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050347 2548 flags.go:64] FLAG: --hostname-override="ip-10-0-132-53.ec2.internal" Jun 05 03:43:21.056955 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050350 2548 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 05 03:43:21.056955 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050353 2548 flags.go:64] FLAG: --http-check-frequency="20s" Jun 05 03:43:21.056955 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050356 2548 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 05 03:43:21.056955 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050359 2548 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 05 03:43:21.056955 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050363 2548 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 05 03:43:21.056955 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050366 2548 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 05 03:43:21.056955 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050369 2548 flags.go:64] FLAG: --image-service-endpoint="" Jun 05 03:43:21.056955 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050371 2548 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 05 03:43:21.056955 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050374 2548 flags.go:64] FLAG: --kube-api-burst="100" Jun 05 03:43:21.056955 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050377 2548 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 05 03:43:21.056955 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050379 2548 flags.go:64] FLAG: --kube-api-qps="50" Jun 05 03:43:21.056955 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050382 2548 flags.go:64] FLAG: --kube-reserved="" Jun 05 03:43:21.057574 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050385 2548 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 05 03:43:21.057574 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050387 2548 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 05 03:43:21.057574 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050390 2548 flags.go:64] FLAG: --kubelet-cgroups="" Jun 05 03:43:21.057574 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050393 2548 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 05 03:43:21.057574 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050395 2548 flags.go:64] FLAG: --lock-file="" Jun 05 03:43:21.057574 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050398 2548 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 05 03:43:21.057574 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050401 2548 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 05 03:43:21.057574 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050404 2548 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 05 03:43:21.057574 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050411 2548 flags.go:64] FLAG: --log-json-split-stream="false" Jun 05 03:43:21.057574 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050414 2548 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 05 03:43:21.057574 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050416 2548 flags.go:64] FLAG: --log-text-split-stream="false" Jun 05 03:43:21.057574 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050419 2548 flags.go:64] FLAG: --logging-format="text" Jun 05 03:43:21.057574 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050422 2548 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 05 03:43:21.057574 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050442 2548 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 05 03:43:21.057574 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050446 2548 flags.go:64] FLAG: --manifest-url="" Jun 05 03:43:21.057574 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050451 2548 flags.go:64] FLAG: --manifest-url-header="" Jun 05 03:43:21.057574 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050458 2548 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 05 03:43:21.057574 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050463 2548 flags.go:64] FLAG: --max-open-files="1000000" Jun 05 03:43:21.057574 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050468 2548 flags.go:64] FLAG: --max-pods="110" Jun 05 03:43:21.057574 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050471 2548 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 05 03:43:21.057574 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050474 2548 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 05 03:43:21.057574 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050477 2548 flags.go:64] FLAG: --memory-manager-policy="None" Jun 05 03:43:21.057574 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050480 2548 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 05 03:43:21.057574 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050483 2548 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 05 03:43:21.057574 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050486 2548 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 05 03:43:21.058205 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050489 2548 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 05 03:43:21.058205 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050496 2548 flags.go:64] FLAG: --node-status-max-images="50" Jun 05 03:43:21.058205 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050499 2548 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 05 03:43:21.058205 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050502 2548 flags.go:64] FLAG: --oom-score-adj="-999" Jun 05 03:43:21.058205 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050505 2548 flags.go:64] FLAG: --pod-cidr="" Jun 05 03:43:21.058205 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050507 2548 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 05 03:43:21.058205 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050513 2548 flags.go:64] FLAG: --pod-manifest-path="" Jun 05 03:43:21.058205 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050515 2548 flags.go:64] FLAG: --pod-max-pids="-1" Jun 05 03:43:21.058205 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050518 2548 flags.go:64] FLAG: --pods-per-core="0" Jun 05 03:43:21.058205 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050521 2548 flags.go:64] FLAG: --port="10250" Jun 05 03:43:21.058205 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050524 2548 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 05 03:43:21.058205 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050527 2548 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03d2229e4d5361168" Jun 05 03:43:21.058205 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050530 2548 flags.go:64] FLAG: --qos-reserved="" Jun 05 03:43:21.058205 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050533 2548 flags.go:64] FLAG: --read-only-port="10255" Jun 05 03:43:21.058205 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050536 2548 flags.go:64] FLAG: --register-node="true" Jun 05 03:43:21.058205 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050540 2548 flags.go:64] FLAG: --register-with-taints="" Jun 05 03:43:21.058205 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050544 2548 flags.go:64] FLAG: --registry-burst="10" Jun 05 03:43:21.058205 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050547 2548 flags.go:64] FLAG: --registry-qps="5" Jun 05 03:43:21.058205 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050550 2548 flags.go:64] FLAG: --reserved-cpus="" Jun 05 03:43:21.058205 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050552 2548 flags.go:64] FLAG: --reserved-memory="" Jun 05 03:43:21.058205 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050556 2548 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 05 03:43:21.058205 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050559 2548 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 05 03:43:21.058205 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050562 2548 flags.go:64] FLAG: --rotate-certificates="false" Jun 05 03:43:21.058205 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050565 2548 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 05 03:43:21.058205 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050567 2548 flags.go:64] FLAG: --runonce="false" Jun 05 03:43:21.059156 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050570 2548 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 05 03:43:21.059156 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050573 2548 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 05 03:43:21.059156 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050576 2548 flags.go:64] FLAG: --seccomp-default="false" Jun 05 03:43:21.059156 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050578 2548 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 05 03:43:21.059156 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050581 2548 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 05 03:43:21.059156 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050584 2548 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 05 03:43:21.059156 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050587 2548 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 05 03:43:21.059156 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050590 2548 flags.go:64] FLAG: --storage-driver-password="root" Jun 05 03:43:21.059156 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050594 2548 flags.go:64] FLAG: --storage-driver-secure="false" Jun 05 03:43:21.059156 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050597 2548 flags.go:64] FLAG: --storage-driver-table="stats" Jun 05 03:43:21.059156 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050600 2548 flags.go:64] FLAG: --storage-driver-user="root" Jun 05 03:43:21.059156 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050603 2548 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 05 03:43:21.059156 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050606 2548 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 05 03:43:21.059156 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050609 2548 flags.go:64] FLAG: --system-cgroups="" Jun 05 03:43:21.059156 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050612 2548 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 05 03:43:21.059156 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050617 2548 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 05 03:43:21.059156 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050619 2548 flags.go:64] FLAG: --tls-cert-file="" Jun 05 03:43:21.059156 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050622 2548 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 05 03:43:21.059156 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050626 2548 flags.go:64] FLAG: --tls-min-version="" Jun 05 03:43:21.059156 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050629 2548 flags.go:64] FLAG: --tls-private-key-file="" Jun 05 03:43:21.059156 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050632 2548 flags.go:64] FLAG: --topology-manager-policy="none" Jun 05 03:43:21.059156 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050634 2548 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 05 03:43:21.059156 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050638 2548 flags.go:64] FLAG: --topology-manager-scope="container" Jun 05 03:43:21.059156 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050641 2548 flags.go:64] FLAG: --v="2" Jun 05 03:43:21.059156 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050645 2548 flags.go:64] FLAG: --version="false" Jun 05 03:43:21.060183 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050649 2548 flags.go:64] FLAG: --vmodule="" Jun 05 03:43:21.060183 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050653 2548 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 05 03:43:21.060183 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.050656 2548 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 05 03:43:21.060183 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050770 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 03:43:21.060183 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050774 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 03:43:21.060183 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050777 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 03:43:21.060183 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050780 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 03:43:21.060183 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050783 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 03:43:21.060183 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050786 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 03:43:21.060183 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050789 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 03:43:21.060183 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050791 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 03:43:21.060183 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050794 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 03:43:21.060183 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050797 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 03:43:21.060183 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050799 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 03:43:21.060183 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050802 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 03:43:21.060183 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050804 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 03:43:21.060183 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050810 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 03:43:21.060183 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050813 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 03:43:21.060183 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050815 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 03:43:21.060183 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050818 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 03:43:21.060995 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050820 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 03:43:21.060995 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050823 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 03:43:21.060995 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050827 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 03:43:21.060995 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050830 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 03:43:21.060995 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050833 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 03:43:21.060995 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050836 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 03:43:21.060995 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050838 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 03:43:21.060995 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050841 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 03:43:21.060995 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050844 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 03:43:21.060995 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050848 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 03:43:21.060995 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050850 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 03:43:21.060995 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050853 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 03:43:21.060995 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050855 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 03:43:21.060995 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050858 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 03:43:21.060995 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050861 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 03:43:21.060995 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050864 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 03:43:21.060995 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050867 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 03:43:21.060995 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050871 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 03:43:21.060995 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050874 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 03:43:21.061510 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050878 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 03:43:21.061510 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050881 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 03:43:21.061510 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050883 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 03:43:21.061510 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050886 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 03:43:21.061510 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050889 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 03:43:21.061510 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050891 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 03:43:21.061510 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050894 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 03:43:21.061510 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050897 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 03:43:21.061510 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050900 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 03:43:21.061510 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050902 2548 feature_gate.go:328] unrecognized feature gate: Example Jun 05 03:43:21.061510 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050905 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 03:43:21.061510 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050908 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 03:43:21.061510 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050914 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 03:43:21.061510 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050916 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 03:43:21.061510 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050919 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 03:43:21.061510 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050921 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 03:43:21.061510 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050924 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 03:43:21.061510 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050926 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 03:43:21.061510 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050929 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 03:43:21.061510 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050931 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 03:43:21.062364 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050934 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 03:43:21.062364 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050936 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 03:43:21.062364 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050940 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 03:43:21.062364 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050942 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 03:43:21.062364 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050945 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 03:43:21.062364 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050947 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 03:43:21.062364 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050950 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 03:43:21.062364 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050952 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 03:43:21.062364 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050955 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 03:43:21.062364 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050958 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 03:43:21.062364 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050960 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 03:43:21.062364 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050963 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 03:43:21.062364 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050965 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 03:43:21.062364 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050968 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 03:43:21.062364 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050970 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 03:43:21.062364 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050972 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 03:43:21.062364 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050975 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 03:43:21.062364 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050977 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 03:43:21.062364 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050979 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 03:43:21.062364 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050982 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 03:43:21.063192 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050984 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 03:43:21.063192 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050987 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 03:43:21.063192 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050989 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 03:43:21.063192 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050992 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 03:43:21.063192 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.050995 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 03:43:21.063192 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.051006 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 03:43:21.063192 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.051009 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 03:43:21.063192 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.051012 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 03:43:21.063192 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.051014 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 03:43:21.063192 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.051017 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 03:43:21.063192 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.051019 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 03:43:21.063192 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.051022 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 03:43:21.063192 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.051025 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 03:43:21.063192 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.051027 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 03:43:21.063192 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.051030 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 03:43:21.063192 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.051033 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 03:43:21.063192 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.051036 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 03:43:21.063192 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.051039 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 03:43:21.063192 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.051041 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 03:43:21.063192 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.051043 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 03:43:21.063709 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.051046 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 03:43:21.063709 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.051048 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 03:43:21.063709 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.051051 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 03:43:21.063709 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.051823 2548 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 03:43:21.063709 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.060649 2548 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 05 03:43:21.063709 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.060669 2548 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 05 03:43:21.063709 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.061516 2548 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 05 03:43:21.063709 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.061531 2548 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 05 03:43:21.063709 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061624 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 03:43:21.063709 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061633 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 03:43:21.063709 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061638 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 03:43:21.063709 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061643 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 03:43:21.063709 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061647 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 03:43:21.063709 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061651 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 03:43:21.063709 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061656 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 03:43:21.064331 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061660 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 03:43:21.064331 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061665 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 03:43:21.064331 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061669 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 03:43:21.064331 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061673 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 03:43:21.064331 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061677 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 03:43:21.064331 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061681 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 03:43:21.064331 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061685 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 03:43:21.064331 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061690 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 03:43:21.064331 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061694 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 03:43:21.064331 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061698 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 03:43:21.064331 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061702 2548 feature_gate.go:328] unrecognized feature gate: Example Jun 05 03:43:21.064331 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061708 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 03:43:21.064331 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061712 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 03:43:21.064331 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061716 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 03:43:21.064331 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061720 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 03:43:21.064331 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061724 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 03:43:21.064331 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061729 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 03:43:21.064331 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061734 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 03:43:21.064331 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061738 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 03:43:21.064331 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061742 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 03:43:21.064963 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061746 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 03:43:21.064963 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061751 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 03:43:21.064963 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061756 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 03:43:21.064963 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061760 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 03:43:21.064963 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061764 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 03:43:21.064963 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061768 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 03:43:21.064963 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061773 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 03:43:21.064963 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061777 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 03:43:21.064963 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061781 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 03:43:21.064963 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061785 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 03:43:21.064963 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061789 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 03:43:21.064963 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061793 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 03:43:21.064963 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061798 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 03:43:21.064963 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061802 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 03:43:21.064963 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061806 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 03:43:21.064963 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061810 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 03:43:21.064963 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061814 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 03:43:21.064963 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061818 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 03:43:21.064963 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061822 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 03:43:21.065503 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061826 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 03:43:21.065503 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061831 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 03:43:21.065503 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061835 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 03:43:21.065503 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061840 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 03:43:21.065503 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061844 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 03:43:21.065503 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061848 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 03:43:21.065503 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061853 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 03:43:21.065503 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061857 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 03:43:21.065503 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061861 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 03:43:21.065503 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061866 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 03:43:21.065503 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061870 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 03:43:21.065503 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061874 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 03:43:21.065503 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061878 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 03:43:21.065503 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061882 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 03:43:21.065503 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061886 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 03:43:21.065503 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061891 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 03:43:21.065503 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061895 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 03:43:21.065503 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061900 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 03:43:21.065503 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061904 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 03:43:21.065503 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061911 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 03:43:21.065984 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061917 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 03:43:21.065984 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061921 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 03:43:21.065984 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061926 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 03:43:21.065984 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061930 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 03:43:21.065984 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061934 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 03:43:21.065984 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061938 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 03:43:21.065984 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061943 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 03:43:21.065984 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061947 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 03:43:21.065984 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061951 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 03:43:21.065984 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061956 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 03:43:21.065984 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061960 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 03:43:21.065984 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061964 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 03:43:21.065984 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061968 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 03:43:21.065984 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061979 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 03:43:21.065984 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061983 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 03:43:21.065984 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061987 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 03:43:21.065984 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061991 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 03:43:21.065984 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.061996 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 03:43:21.065984 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062000 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 03:43:21.065984 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062004 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 03:43:21.066757 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062008 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 03:43:21.066757 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062012 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 03:43:21.066757 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062016 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 03:43:21.066757 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062022 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 03:43:21.066757 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062027 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 03:43:21.066757 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062031 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 03:43:21.066757 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062036 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 03:43:21.066757 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062041 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 03:43:21.066757 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062045 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 03:43:21.066757 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062052 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 03:43:21.066757 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062057 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 03:43:21.066757 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062063 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 03:43:21.066757 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062067 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 03:43:21.066757 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.062075 2548 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 03:43:21.067265 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062290 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 03:43:21.067265 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062300 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 03:43:21.067265 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062306 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 03:43:21.067265 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062311 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 03:43:21.067265 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062315 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 03:43:21.067265 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062319 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 03:43:21.067265 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062323 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 03:43:21.067265 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062328 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 03:43:21.067265 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062332 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 03:43:21.067265 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062336 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 03:43:21.067265 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062340 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 03:43:21.067265 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062345 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 03:43:21.067265 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062350 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 03:43:21.067265 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062376 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 03:43:21.067265 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062382 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 03:43:21.067265 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062387 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 03:43:21.067265 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062392 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 03:43:21.067265 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062396 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 03:43:21.067265 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062401 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 03:43:21.067265 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062405 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 03:43:21.067814 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062409 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 03:43:21.067814 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062413 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 03:43:21.067814 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062418 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 03:43:21.067814 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062424 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 03:43:21.067814 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062451 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 03:43:21.067814 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062456 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 03:43:21.067814 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062461 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 03:43:21.067814 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062466 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 03:43:21.067814 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062471 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 03:43:21.067814 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062476 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 03:43:21.067814 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062480 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 03:43:21.067814 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062484 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 03:43:21.067814 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062488 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 03:43:21.067814 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062492 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 03:43:21.067814 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062497 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 03:43:21.067814 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062501 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 03:43:21.067814 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062505 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 03:43:21.067814 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062509 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 03:43:21.067814 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062513 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 03:43:21.068401 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062517 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 03:43:21.068401 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062522 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 03:43:21.068401 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062526 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 03:43:21.068401 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062530 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 03:43:21.068401 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062534 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 03:43:21.068401 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062538 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 03:43:21.068401 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062543 2548 feature_gate.go:328] unrecognized feature gate: Example Jun 05 03:43:21.068401 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062550 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 03:43:21.068401 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062555 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 03:43:21.068401 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062559 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 03:43:21.068401 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062564 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 03:43:21.068401 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062568 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 03:43:21.068401 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062572 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 03:43:21.068401 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062576 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 03:43:21.068401 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062580 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 03:43:21.068401 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062584 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 03:43:21.068401 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062590 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 03:43:21.068401 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062596 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 03:43:21.068401 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062600 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 03:43:21.068932 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062604 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 03:43:21.068932 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062608 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 03:43:21.068932 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062613 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 03:43:21.068932 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062617 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 03:43:21.068932 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062621 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 03:43:21.068932 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062626 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 03:43:21.068932 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062630 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 03:43:21.068932 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062634 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 03:43:21.068932 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062638 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 03:43:21.068932 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062643 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 03:43:21.068932 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062646 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 03:43:21.068932 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062650 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 03:43:21.068932 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062654 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 03:43:21.068932 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062659 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 03:43:21.068932 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062663 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 03:43:21.068932 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062667 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 03:43:21.068932 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062672 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 03:43:21.068932 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062676 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 03:43:21.068932 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062680 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 03:43:21.068932 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062684 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 03:43:21.069482 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062689 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 03:43:21.069482 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062693 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 03:43:21.069482 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062697 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 03:43:21.069482 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062701 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 03:43:21.069482 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062705 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 03:43:21.069482 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062709 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 03:43:21.069482 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062713 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 03:43:21.069482 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062717 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 03:43:21.069482 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062721 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 03:43:21.069482 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062725 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 03:43:21.069482 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062729 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 03:43:21.069482 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062734 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 03:43:21.069482 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062738 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 03:43:21.069482 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062743 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 03:43:21.069482 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062747 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 03:43:21.069482 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062751 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 03:43:21.069482 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062755 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 03:43:21.069482 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062759 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 03:43:21.069482 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062763 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 03:43:21.069482 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062767 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 03:43:21.070034 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:21.062771 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 03:43:21.070034 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.062779 2548 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 03:43:21.070034 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.062942 2548 server.go:962] "Client rotation is on, will bootstrap in background" Jun 05 03:43:21.070034 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.067825 2548 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 05 03:43:21.070034 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.069666 2548 server.go:1019] "Starting client certificate rotation" Jun 05 03:43:21.070034 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.069777 2548 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 03:43:21.070034 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.069856 2548 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 03:43:21.072741 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.072723 2548 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 03:43:21.073940 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.073915 2548 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 03:43:21.091206 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.091179 2548 log.go:25] "Validated CRI v1 runtime API" Jun 05 03:43:21.095021 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.094782 2548 log.go:25] "Validated CRI v1 image API" Jun 05 03:43:21.096198 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.096181 2548 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 05 03:43:21.098781 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.098762 2548 fs.go:135] Filesystem UUIDs: map[615018f4-4a15-4a1f-a475-8f700f1bd3ae:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 dac8d6de-ae4e-4a5f-af58-86bd249cb7ca:/dev/nvme0n1p4] Jun 05 03:43:21.098848 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.098780 2548 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 05 03:43:21.101195 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.101175 2548 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 03:43:21.104745 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.104614 2548 manager.go:216] Machine: {Timestamp:2026-06-05 03:43:21.103161296 +0000 UTC m=+0.372937605 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3114804 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26080615d4c4d73ba361260cd52f76 SystemUUID:ec260806-15d4-c4d7-3ba3-61260cd52f76 BootID:c5b036ce-8e82-4ddf-9fdd-cd6a0a0b536f Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:49:74:99:9b:e9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:49:74:99:9b:e9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:42:88:e4:8f:ae:56 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 05 03:43:21.104745 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.104738 2548 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 05 03:43:21.104896 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.104820 2548 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 05 03:43:21.108831 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.108803 2548 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 05 03:43:21.109050 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.108834 2548 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-53.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 05 03:43:21.109809 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.109796 2548 topology_manager.go:138] "Creating topology manager with none policy" Jun 05 03:43:21.109863 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.109814 2548 container_manager_linux.go:309] "Creating device plugin manager" Jun 05 03:43:21.109863 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.109832 2548 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 03:43:21.109863 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.109856 2548 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 03:43:21.111236 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.111224 2548 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 05 03:43:21.115734 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.115719 2548 state_mem.go:36] "Initialized new in-memory state store" Jun 05 03:43:21.115907 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.115895 2548 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 05 03:43:21.115966 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.115943 2548 kubelet.go:486] "Attempting to sync node with API server" Jun 05 03:43:21.115966 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.115957 2548 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 05 03:43:21.116064 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.115976 2548 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 05 03:43:21.116064 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.115991 2548 kubelet.go:398] "Adding apiserver pod source" Jun 05 03:43:21.116064 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.116004 2548 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 05 03:43:21.116503 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.116489 2548 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 03:43:21.116624 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.116513 2548 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 03:43:21.123730 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.123699 2548 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b8vzz" Jun 05 03:43:21.124604 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.124579 2548 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 05 03:43:21.126952 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.126932 2548 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 05 03:43:21.127065 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.126964 2548 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 05 03:43:21.128500 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.128487 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 05 03:43:21.128500 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.128504 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 05 03:43:21.128614 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.128514 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 05 03:43:21.128614 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.128523 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 05 03:43:21.128614 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.128534 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 05 03:43:21.128614 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.128546 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 05 03:43:21.128614 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.128557 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 05 03:43:21.128614 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.128565 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 05 03:43:21.128614 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.128574 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 05 03:43:21.128614 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.128583 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 05 03:43:21.128614 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.128594 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 05 03:43:21.128614 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.128602 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 05 03:43:21.128892 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:21.128704 2548 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-53.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 05 03:43:21.128892 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:21.128731 2548 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 05 03:43:21.129026 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.129012 2548 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b8vzz" Jun 05 03:43:21.130462 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.130449 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 05 03:43:21.130509 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.130464 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 05 03:43:21.133740 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.133728 2548 server.go:1268] "Started kubelet" Jun 05 03:43:21.133871 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.133826 2548 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 05 03:43:21.133933 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.133891 2548 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 05 03:43:21.133933 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.133910 2548 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 05 03:43:21.134590 ip-10-0-132-53 systemd[1]: Started Kubernetes Kubelet. Jun 05 03:43:21.135990 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.135975 2548 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 05 03:43:21.136414 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.136397 2548 server.go:310] "Adding debug handlers to kubelet server" Jun 05 03:43:21.142311 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.142292 2548 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 05 03:43:21.143088 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.143071 2548 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 05 03:43:21.143198 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:21.143176 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-53.ec2.internal\" not found" Jun 05 03:43:21.144257 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.143837 2548 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 05 03:43:21.144257 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.143852 2548 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 05 03:43:21.144257 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.143901 2548 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 05 03:43:21.144257 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.144009 2548 reconstruct.go:97] "Volume reconstruction finished" Jun 05 03:43:21.144257 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.144017 2548 reconciler.go:29] "Reconciler: start to sync state" Jun 05 03:43:21.145186 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:21.145157 2548 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 05 03:43:21.145693 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.145677 2548 factory.go:55] Registering systemd factory Jun 05 03:43:21.145746 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.145698 2548 factory.go:223] Registration of the systemd container factory successfully Jun 05 03:43:21.145929 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.145912 2548 factory.go:153] Registering CRI-O factory Jun 05 03:43:21.145929 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.145930 2548 factory.go:223] Registration of the crio container factory successfully Jun 05 03:43:21.146125 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.145984 2548 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 05 03:43:21.146125 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.146012 2548 factory.go:103] Registering Raw factory Jun 05 03:43:21.146125 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.146028 2548 manager.go:1196] Started watching for new ooms in manager Jun 05 03:43:21.146278 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.146265 2548 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 03:43:21.146703 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.146691 2548 manager.go:349] Starting recovery of all containers Jun 05 03:43:21.149472 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:21.149391 2548 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-53.ec2.internal\" not found" node="ip-10-0-132-53.ec2.internal" Jun 05 03:43:21.150613 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.150591 2548 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-132-53.ec2.internal" not found Jun 05 03:43:21.159784 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.159661 2548 manager.go:354] Recovery completed Jun 05 03:43:21.163875 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.163862 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 03:43:21.165398 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.165380 2548 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-132-53.ec2.internal" not found Jun 05 03:43:21.166107 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.166083 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-53.ec2.internal" event="NodeHasSufficientMemory" Jun 05 03:43:21.166190 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.166116 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-53.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 03:43:21.166190 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.166126 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-53.ec2.internal" event="NodeHasSufficientPID" Jun 05 03:43:21.166750 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.166736 2548 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 05 03:43:21.166750 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.166743 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 03:43:21.166828 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.166750 2548 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 05 03:43:21.166828 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.166770 2548 state_mem.go:36] "Initialized new in-memory state store" Jun 05 03:43:21.167422 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.167409 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-53.ec2.internal" event="NodeHasSufficientMemory" Jun 05 03:43:21.167490 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.167450 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-53.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 03:43:21.167490 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.167461 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-53.ec2.internal" event="NodeHasSufficientPID" Jun 05 03:43:21.168859 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.168848 2548 policy_none.go:49] "None policy: Start" Jun 05 03:43:21.168899 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.168863 2548 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 05 03:43:21.168899 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.168874 2548 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 05 03:43:21.170586 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.170573 2548 policy_none.go:47] "Start" Jun 05 03:43:21.210038 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.210023 2548 manager.go:337] "Starting Device Plugin manager" Jun 05 03:43:21.226991 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:21.210055 2548 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 05 03:43:21.226991 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.210066 2548 server.go:87] "Starting device plugin registration server" Jun 05 03:43:21.226991 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.210344 2548 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 05 03:43:21.226991 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.210357 2548 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 05 03:43:21.226991 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.210459 2548 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 05 03:43:21.226991 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.210530 2548 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 05 03:43:21.226991 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.210537 2548 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 05 03:43:21.226991 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:21.211138 2548 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 05 03:43:21.226991 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:21.211188 2548 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-53.ec2.internal\" not found" Jun 05 03:43:21.226991 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.220902 2548 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 05 03:43:21.226991 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.222151 2548 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 05 03:43:21.226991 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.222153 2548 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-132-53.ec2.internal" not found Jun 05 03:43:21.226991 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.222189 2548 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 05 03:43:21.226991 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.222217 2548 kubelet.go:2448] "Starting kubelet main sync loop" Jun 05 03:43:21.226991 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:21.222246 2548 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 05 03:43:21.226991 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.224106 2548 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 03:43:21.310551 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.310472 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 03:43:21.311737 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.311718 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-53.ec2.internal" event="NodeHasSufficientMemory" Jun 05 03:43:21.311784 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.311762 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-53.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 03:43:21.311816 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.311785 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-53.ec2.internal" event="NodeHasSufficientPID" Jun 05 03:43:21.311816 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.311810 2548 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-53.ec2.internal" Jun 05 03:43:21.321326 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.321308 2548 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-53.ec2.internal" Jun 05 03:43:21.321372 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:21.321331 2548 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-53.ec2.internal\": node \"ip-10-0-132-53.ec2.internal\" not found" Jun 05 03:43:21.322868 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.322852 2548 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-53.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-53.ec2.internal"] Jun 05 03:43:21.322921 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.322912 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 03:43:21.323780 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.323764 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-53.ec2.internal" event="NodeHasSufficientMemory" Jun 05 03:43:21.323875 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.323790 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-53.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 03:43:21.323875 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.323800 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-53.ec2.internal" event="NodeHasSufficientPID" Jun 05 03:43:21.326236 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.326222 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 03:43:21.326345 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.326332 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-53.ec2.internal" Jun 05 03:43:21.326391 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.326381 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 03:43:21.326933 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.326919 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-53.ec2.internal" event="NodeHasSufficientMemory" Jun 05 03:43:21.327025 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.326938 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-53.ec2.internal" event="NodeHasSufficientMemory" Jun 05 03:43:21.327025 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.326962 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-53.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 03:43:21.327025 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.326978 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-53.ec2.internal" event="NodeHasSufficientPID" Jun 05 03:43:21.327025 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.326940 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-53.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 03:43:21.327208 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.327030 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-53.ec2.internal" event="NodeHasSufficientPID" Jun 05 03:43:21.329184 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.329165 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-53.ec2.internal" Jun 05 03:43:21.329227 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.329203 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 03:43:21.329905 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.329890 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-53.ec2.internal" event="NodeHasSufficientMemory" Jun 05 03:43:21.329991 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.329916 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-53.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 03:43:21.329991 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.329925 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-53.ec2.internal" event="NodeHasSufficientPID" Jun 05 03:43:21.334019 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:21.334004 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-53.ec2.internal\" not found" Jun 05 03:43:21.345305 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.345283 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/68915a77bd6e05c81d6d7f866eccee2c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-53.ec2.internal\" (UID: \"68915a77bd6e05c81d6d7f866eccee2c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-53.ec2.internal" Jun 05 03:43:21.345402 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.345312 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68915a77bd6e05c81d6d7f866eccee2c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-53.ec2.internal\" (UID: \"68915a77bd6e05c81d6d7f866eccee2c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-53.ec2.internal" Jun 05 03:43:21.345402 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.345330 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0c9f235f3ca1afcafebb0bbf5be2792c-config\") pod \"kube-apiserver-proxy-ip-10-0-132-53.ec2.internal\" (UID: \"0c9f235f3ca1afcafebb0bbf5be2792c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-53.ec2.internal" Jun 05 03:43:21.365179 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:21.365154 2548 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-53.ec2.internal\" not found" node="ip-10-0-132-53.ec2.internal" Jun 05 03:43:21.369688 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:21.369672 2548 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-53.ec2.internal\" not found" node="ip-10-0-132-53.ec2.internal" Jun 05 03:43:21.434707 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:21.434675 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-53.ec2.internal\" not found" Jun 05 03:43:21.446247 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.446222 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/68915a77bd6e05c81d6d7f866eccee2c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-53.ec2.internal\" (UID: \"68915a77bd6e05c81d6d7f866eccee2c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-53.ec2.internal" Jun 05 03:43:21.446361 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.446254 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68915a77bd6e05c81d6d7f866eccee2c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-53.ec2.internal\" (UID: \"68915a77bd6e05c81d6d7f866eccee2c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-53.ec2.internal" Jun 05 03:43:21.446361 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.446275 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0c9f235f3ca1afcafebb0bbf5be2792c-config\") pod \"kube-apiserver-proxy-ip-10-0-132-53.ec2.internal\" (UID: \"0c9f235f3ca1afcafebb0bbf5be2792c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-53.ec2.internal" Jun 05 03:43:21.446361 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.446325 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0c9f235f3ca1afcafebb0bbf5be2792c-config\") pod \"kube-apiserver-proxy-ip-10-0-132-53.ec2.internal\" (UID: \"0c9f235f3ca1afcafebb0bbf5be2792c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-53.ec2.internal" Jun 05 03:43:21.446361 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.446341 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/68915a77bd6e05c81d6d7f866eccee2c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-53.ec2.internal\" (UID: \"68915a77bd6e05c81d6d7f866eccee2c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-53.ec2.internal" Jun 05 03:43:21.446361 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.446350 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68915a77bd6e05c81d6d7f866eccee2c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-53.ec2.internal\" (UID: \"68915a77bd6e05c81d6d7f866eccee2c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-53.ec2.internal" Jun 05 03:43:21.534793 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:21.534746 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-53.ec2.internal\" not found" Jun 05 03:43:21.635561 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:21.635495 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-53.ec2.internal\" not found" Jun 05 03:43:21.672022 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.671999 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-53.ec2.internal" Jun 05 03:43:21.676904 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:21.676680 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-53.ec2.internal" Jun 05 03:43:21.736302 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:21.736266 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-53.ec2.internal\" not found" Jun 05 03:43:21.836851 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:21.836812 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-53.ec2.internal\" not found" Jun 05 03:43:21.937394 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:21.937314 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-53.ec2.internal\" not found" Jun 05 03:43:22.037908 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:22.037875 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-53.ec2.internal\" not found" Jun 05 03:43:22.068332 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:22.068308 2548 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 05 03:43:22.068915 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:22.068471 2548 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 03:43:22.068915 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:22.068485 2548 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 03:43:22.135825 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:22.135786 2548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-04 03:38:21 +0000 UTC" deadline="2027-12-12 08:34:39.730554445 +0000 UTC" Jun 05 03:43:22.135825 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:22.135821 2548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13324h51m17.594738162s" Jun 05 03:43:22.138938 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:22.138919 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-53.ec2.internal\" not found" Jun 05 03:43:22.160271 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:22.160244 2548 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 03:43:22.187839 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:22.187787 2548 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 03:43:22.220614 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:22.220584 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c9f235f3ca1afcafebb0bbf5be2792c.slice/crio-e1f76eaf896650780b1246412504d61837731c490d912044777296a340ebdd92 WatchSource:0}: Error finding container e1f76eaf896650780b1246412504d61837731c490d912044777296a340ebdd92: Status 404 returned error can't find the container with id e1f76eaf896650780b1246412504d61837731c490d912044777296a340ebdd92 Jun 05 03:43:22.221002 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:22.220985 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68915a77bd6e05c81d6d7f866eccee2c.slice/crio-aeedc345965c1de01c87f3fef9476e7e950eb0c23bbd8068a5e07f84b81d8b2e WatchSource:0}: Error finding container aeedc345965c1de01c87f3fef9476e7e950eb0c23bbd8068a5e07f84b81d8b2e: Status 404 returned error can't find the container with id aeedc345965c1de01c87f3fef9476e7e950eb0c23bbd8068a5e07f84b81d8b2e Jun 05 03:43:22.227338 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:22.227221 2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 03:43:22.228314 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:22.228259 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-53.ec2.internal" event={"ID":"0c9f235f3ca1afcafebb0bbf5be2792c","Type":"ContainerStarted","Data":"e1f76eaf896650780b1246412504d61837731c490d912044777296a340ebdd92"} Jun 05 03:43:22.229181 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:22.229162 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-53.ec2.internal" event={"ID":"68915a77bd6e05c81d6d7f866eccee2c","Type":"ContainerStarted","Data":"aeedc345965c1de01c87f3fef9476e7e950eb0c23bbd8068a5e07f84b81d8b2e"} Jun 05 03:43:22.244321 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:22.244304 2548 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-53.ec2.internal" Jun 05 03:43:22.255073 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:22.255052 2548 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 03:43:22.256154 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:22.256142 2548 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-53.ec2.internal" Jun 05 03:43:22.266213 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:22.266196 2548 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 03:43:23.117087 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.117051 2548 apiserver.go:52] "Watching apiserver" Jun 05 03:43:23.125450 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.125410 2548 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 05 03:43:23.126685 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.126659 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-8lg5x","openshift-multus/multus-additional-cni-plugins-cpmtr","openshift-network-diagnostics/network-check-target-tx8nn","openshift-cluster-node-tuning-operator/tuned-k5sbh","openshift-dns/node-resolver-nfv6x","openshift-image-registry/node-ca-dtx66","openshift-multus/network-metrics-daemon-7fqv9","openshift-network-operator/iptables-alerter-j78s9","openshift-ovn-kubernetes/ovnkube-node-whn2g","kube-system/global-pull-secret-syncer-q9df4","kube-system/konnectivity-agent-w4d7w","kube-system/kube-apiserver-proxy-ip-10-0-132-53.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grkjm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-53.ec2.internal"] Jun 05 03:43:23.128842 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.128814 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:43:23.128947 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:23.128895 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fqv9" podUID="f15442b9-7c90-4861-8089-8084f3784bf6" Jun 05 03:43:23.130914 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.130893 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grkjm" Jun 05 03:43:23.132914 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.132891 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tx8nn" Jun 05 03:43:23.133030 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:23.132968 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tx8nn" podUID="5dab8672-15ed-4938-b29c-75a0ed4e517d" Jun 05 03:43:23.133651 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.133464 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 05 03:43:23.133651 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.133474 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 05 03:43:23.133651 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.133526 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 05 03:43:23.133651 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.133529 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nm2w2\"" Jun 05 03:43:23.135020 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.134991 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.137130 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.137112 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nfv6x" Jun 05 03:43:23.137130 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.137127 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 05 03:43:23.137276 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.137214 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 05 03:43:23.137418 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.137401 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-flnct\"" Jun 05 03:43:23.139254 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.139204 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 05 03:43:23.139254 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.139239 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 05 03:43:23.139555 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.139539 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gqx7m\"" Jun 05 03:43:23.139833 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.139816 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dtx66" Jun 05 03:43:23.141948 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.141931 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 05 03:43:23.142041 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.141969 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.142257 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.142162 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m27lp\"" Jun 05 03:43:23.142359 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.142343 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 05 03:43:23.142508 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.142493 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 05 03:43:23.143917 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.143887 2548 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 05 03:43:23.145109 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.144274 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.145192 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.145125 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 05 03:43:23.145260 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.145234 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 05 03:43:23.145336 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.145318 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 05 03:43:23.145460 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.145357 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 05 03:43:23.145566 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.145558 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 05 03:43:23.145730 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.145711 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 05 03:43:23.145819 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.145774 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c87mw\"" Jun 05 03:43:23.146463 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.146417 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 05 03:43:23.147181 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.147164 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-w7np5\"" Jun 05 03:43:23.147917 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.147898 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 05 03:43:23.148026 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.147985 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 05 03:43:23.148086 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.148022 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 05 03:43:23.149900 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.149850 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cpmtr" Jun 05 03:43:23.152527 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.152358 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 05 03:43:23.152527 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.152454 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 05 03:43:23.152527 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.152505 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7zcc7\"" Jun 05 03:43:23.152800 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.152779 2548 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 03:43:23.153093 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.153075 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9df4" Jun 05 03:43:23.153178 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:23.153137 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q9df4" podUID="8e00145e-4995-452b-998a-fbf922eb164b" Jun 05 03:43:23.155503 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.155447 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w4d7w" Jun 05 03:43:23.155819 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.155804 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8bcs\" (UniqueName: \"kubernetes.io/projected/5dab8672-15ed-4938-b29c-75a0ed4e517d-kube-api-access-h8bcs\") pod \"network-check-target-tx8nn\" (UID: \"5dab8672-15ed-4938-b29c-75a0ed4e517d\") " pod="openshift-network-diagnostics/network-check-target-tx8nn" Jun 05 03:43:23.155900 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.155826 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-host-run-k8s-cni-cncf-io\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.155900 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.155842 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-host-kubelet\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.155900 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.155864 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-run-openvswitch\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.155900 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.155887 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e613e69d-cdca-4b90-8d23-ac1d27658278-sys-fs\") pod \"aws-ebs-csi-driver-node-grkjm\" (UID: \"e613e69d-cdca-4b90-8d23-ac1d27658278\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grkjm" Jun 05 03:43:23.156178 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.155908 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3351fdf-83ad-4dcd-93d9-798d33f0742e-lib-modules\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.156178 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.155929 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c3351fdf-83ad-4dcd-93d9-798d33f0742e-etc-tuned\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.156178 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.155980 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-log-socket\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.156178 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.156038 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-host-cni-bin\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.156178 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.156070 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0707e72d-344a-483e-910d-fa1ccfc535db-multus-daemon-config\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.156178 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.156096 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c3351fdf-83ad-4dcd-93d9-798d33f0742e-etc-sysconfig\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.156178 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.156117 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb3edaa5-bb4c-4a42-9388-0ecb2db9c42e-serviceca\") pod \"node-ca-dtx66\" (UID: \"eb3edaa5-bb4c-4a42-9388-0ecb2db9c42e\") " pod="openshift-image-registry/node-ca-dtx66" Jun 05 03:43:23.156178 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.156132 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdngd\" (UniqueName: \"kubernetes.io/projected/eb3edaa5-bb4c-4a42-9388-0ecb2db9c42e-kube-api-access-hdngd\") pod \"node-ca-dtx66\" (UID: \"eb3edaa5-bb4c-4a42-9388-0ecb2db9c42e\") " pod="openshift-image-registry/node-ca-dtx66" Jun 05 03:43:23.156178 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.156150 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-run-systemd\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.156178 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.156173 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-multus-cni-dir\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.156730 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.156201 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-os-release\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.156730 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.156220 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-host-var-lib-kubelet\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.156730 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.156241 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-var-lib-openvswitch\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.156730 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.156258 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-hostroot\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.156730 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.156286 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-multus-conf-dir\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.156730 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.156306 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r5k9\" (UniqueName: \"kubernetes.io/projected/0707e72d-344a-483e-910d-fa1ccfc535db-kube-api-access-2r5k9\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.156730 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.156324 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c3351fdf-83ad-4dcd-93d9-798d33f0742e-etc-modprobe-d\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.156730 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.156358 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c3351fdf-83ad-4dcd-93d9-798d33f0742e-etc-sysctl-d\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.156730 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.156542 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c3351fdf-83ad-4dcd-93d9-798d33f0742e-etc-systemd\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.156730 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.156572 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5986d90f-3a60-4e38-b15f-cc0c69c89abf-tmp-dir\") pod \"node-resolver-nfv6x\" (UID: \"5986d90f-3a60-4e38-b15f-cc0c69c89abf\") " pod="openshift-dns/node-resolver-nfv6x" Jun 05 03:43:23.156730 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.156594 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9139fc4f-a2c4-4323-aac8-55b73d33aba2-env-overrides\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.156730 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.156626 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e613e69d-cdca-4b90-8d23-ac1d27658278-device-dir\") pod \"aws-ebs-csi-driver-node-grkjm\" (UID: \"e613e69d-cdca-4b90-8d23-ac1d27658278\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grkjm" Jun 05 03:43:23.156730 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.156657 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-host-var-lib-cni-bin\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.156730 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.156683 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3351fdf-83ad-4dcd-93d9-798d33f0742e-sys\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.156730 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.156715 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnjf5\" (UniqueName: \"kubernetes.io/projected/5986d90f-3a60-4e38-b15f-cc0c69c89abf-kube-api-access-bnjf5\") pod \"node-resolver-nfv6x\" (UID: \"5986d90f-3a60-4e38-b15f-cc0c69c89abf\") " pod="openshift-dns/node-resolver-nfv6x" Jun 05 03:43:23.157363 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.156745 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9139fc4f-a2c4-4323-aac8-55b73d33aba2-ovn-node-metrics-cert\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.157363 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.156769 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2tzc\" (UniqueName: \"kubernetes.io/projected/9139fc4f-a2c4-4323-aac8-55b73d33aba2-kube-api-access-p2tzc\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.157363 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.156794 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-multus-socket-dir-parent\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.157363 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.156845 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5986d90f-3a60-4e38-b15f-cc0c69c89abf-hosts-file\") pod \"node-resolver-nfv6x\" (UID: \"5986d90f-3a60-4e38-b15f-cc0c69c89abf\") " pod="openshift-dns/node-resolver-nfv6x" Jun 05 03:43:23.157363 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.156875 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-systemd-units\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.157363 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.156912 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0707e72d-344a-483e-910d-fa1ccfc535db-cni-binary-copy\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.157363 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.156933 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f15442b9-7c90-4861-8089-8084f3784bf6-metrics-certs\") pod \"network-metrics-daemon-7fqv9\" (UID: \"f15442b9-7c90-4861-8089-8084f3784bf6\") " pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:43:23.157363 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.156956 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c3351fdf-83ad-4dcd-93d9-798d33f0742e-run\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.157363 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.156986 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3351fdf-83ad-4dcd-93d9-798d33f0742e-var-lib-kubelet\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.157363 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.157012 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-host-run-netns\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.157363 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.157038 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrl5h\" (UniqueName: \"kubernetes.io/projected/f15442b9-7c90-4861-8089-8084f3784bf6-kube-api-access-rrl5h\") pod \"network-metrics-daemon-7fqv9\" (UID: \"f15442b9-7c90-4861-8089-8084f3784bf6\") " pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:43:23.157363 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.157063 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-host-run-ovn-kubernetes\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.157363 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.157097 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb3edaa5-bb4c-4a42-9388-0ecb2db9c42e-host\") pod \"node-ca-dtx66\" (UID: \"eb3edaa5-bb4c-4a42-9388-0ecb2db9c42e\") " pod="openshift-image-registry/node-ca-dtx66" Jun 05 03:43:23.157363 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.157145 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-etc-kubernetes\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.157363 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.157163 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c3351fdf-83ad-4dcd-93d9-798d33f0742e-host\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.157363 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.157185 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-node-log\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.157363 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.157237 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e613e69d-cdca-4b90-8d23-ac1d27658278-etc-selinux\") pod \"aws-ebs-csi-driver-node-grkjm\" (UID: \"e613e69d-cdca-4b90-8d23-ac1d27658278\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grkjm" Jun 05 03:43:23.158282 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.157283 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-etc-openvswitch\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.158282 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.157314 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9139fc4f-a2c4-4323-aac8-55b73d33aba2-ovnkube-config\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.158282 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.157336 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9139fc4f-a2c4-4323-aac8-55b73d33aba2-ovnkube-script-lib\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.158282 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.157368 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-host-var-lib-cni-multus\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.158282 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.157405 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c3351fdf-83ad-4dcd-93d9-798d33f0742e-etc-sysctl-conf\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.158282 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.157462 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3351fdf-83ad-4dcd-93d9-798d33f0742e-tmp\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.158282 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.157490 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngmns\" (UniqueName: \"kubernetes.io/projected/c3351fdf-83ad-4dcd-93d9-798d33f0742e-kube-api-access-ngmns\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.158282 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.157508 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-run-ovn\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.158282 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.157541 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.158282 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.157570 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e613e69d-cdca-4b90-8d23-ac1d27658278-kubelet-dir\") pod \"aws-ebs-csi-driver-node-grkjm\" (UID: \"e613e69d-cdca-4b90-8d23-ac1d27658278\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grkjm" Jun 05 03:43:23.158282 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.157596 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-system-cni-dir\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.158282 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.157618 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3351fdf-83ad-4dcd-93d9-798d33f0742e-etc-kubernetes\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.158282 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.157624 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 05 03:43:23.158282 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.157646 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-host-run-netns\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.158282 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.157667 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e613e69d-cdca-4b90-8d23-ac1d27658278-socket-dir\") pod \"aws-ebs-csi-driver-node-grkjm\" (UID: \"e613e69d-cdca-4b90-8d23-ac1d27658278\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grkjm" Jun 05 03:43:23.158282 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.157677 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dt5sx\"" Jun 05 03:43:23.158282 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.157699 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-host-run-multus-certs\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.158282 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.157721 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-cnibin\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.158924 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.157744 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j78s9" Jun 05 03:43:23.158924 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.157768 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e613e69d-cdca-4b90-8d23-ac1d27658278-registration-dir\") pod \"aws-ebs-csi-driver-node-grkjm\" (UID: \"e613e69d-cdca-4b90-8d23-ac1d27658278\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grkjm" Jun 05 03:43:23.158924 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.157785 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 05 03:43:23.158924 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.157816 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krfj5\" (UniqueName: \"kubernetes.io/projected/e613e69d-cdca-4b90-8d23-ac1d27658278-kube-api-access-krfj5\") pod \"aws-ebs-csi-driver-node-grkjm\" (UID: \"e613e69d-cdca-4b90-8d23-ac1d27658278\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grkjm" Jun 05 03:43:23.158924 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.157859 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-host-slash\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.158924 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.157884 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-host-cni-netd\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.159906 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.159888 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 05 03:43:23.160099 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.160075 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 05 03:43:23.160193 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.160116 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9c99j\"" Jun 05 03:43:23.160193 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.160156 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 05 03:43:23.169034 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.169016 2548 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-p6kbd" Jun 05 03:43:23.178180 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.178161 2548 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-p6kbd" Jun 05 03:43:23.244536 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.244513 2548 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 05 03:43:23.258375 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.258350 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c3351fdf-83ad-4dcd-93d9-798d33f0742e-etc-modprobe-d\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.258534 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.258380 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c3351fdf-83ad-4dcd-93d9-798d33f0742e-etc-sysctl-d\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.258534 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.258409 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c3351fdf-83ad-4dcd-93d9-798d33f0742e-etc-systemd\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.258534 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.258448 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5986d90f-3a60-4e38-b15f-cc0c69c89abf-tmp-dir\") pod \"node-resolver-nfv6x\" (UID: \"5986d90f-3a60-4e38-b15f-cc0c69c89abf\") " pod="openshift-dns/node-resolver-nfv6x" Jun 05 03:43:23.258534 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.258473 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9139fc4f-a2c4-4323-aac8-55b73d33aba2-env-overrides\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.258534 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.258495 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e613e69d-cdca-4b90-8d23-ac1d27658278-device-dir\") pod \"aws-ebs-csi-driver-node-grkjm\" (UID: \"e613e69d-cdca-4b90-8d23-ac1d27658278\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grkjm" Jun 05 03:43:23.258534 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.258517 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-host-var-lib-cni-bin\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.258534 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.258519 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c3351fdf-83ad-4dcd-93d9-798d33f0742e-etc-systemd\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.258948 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.258554 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3351fdf-83ad-4dcd-93d9-798d33f0742e-sys\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.258948 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.258566 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c3351fdf-83ad-4dcd-93d9-798d33f0742e-etc-sysctl-d\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.262060 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.258562 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-host-var-lib-cni-bin\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.262060 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.258566 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c3351fdf-83ad-4dcd-93d9-798d33f0742e-etc-modprobe-d\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.262060 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.259413 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9139fc4f-a2c4-4323-aac8-55b73d33aba2-env-overrides\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.262060 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.259486 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5986d90f-3a60-4e38-b15f-cc0c69c89abf-tmp-dir\") pod \"node-resolver-nfv6x\" (UID: \"5986d90f-3a60-4e38-b15f-cc0c69c89abf\") " pod="openshift-dns/node-resolver-nfv6x" Jun 05 03:43:23.262060 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.259548 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3351fdf-83ad-4dcd-93d9-798d33f0742e-sys\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.262060 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.259609 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e613e69d-cdca-4b90-8d23-ac1d27658278-device-dir\") pod \"aws-ebs-csi-driver-node-grkjm\" (UID: \"e613e69d-cdca-4b90-8d23-ac1d27658278\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grkjm" Jun 05 03:43:23.262060 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.259729 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnjf5\" (UniqueName: \"kubernetes.io/projected/5986d90f-3a60-4e38-b15f-cc0c69c89abf-kube-api-access-bnjf5\") pod \"node-resolver-nfv6x\" (UID: \"5986d90f-3a60-4e38-b15f-cc0c69c89abf\") " pod="openshift-dns/node-resolver-nfv6x" Jun 05 03:43:23.262060 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.259773 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9139fc4f-a2c4-4323-aac8-55b73d33aba2-ovn-node-metrics-cert\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.262060 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.259793 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2tzc\" (UniqueName: \"kubernetes.io/projected/9139fc4f-a2c4-4323-aac8-55b73d33aba2-kube-api-access-p2tzc\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.262060 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.259890 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-multus-socket-dir-parent\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.262060 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.260277 2548 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 05 03:43:23.262060 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.260307 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-multus-socket-dir-parent\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.262060 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.260367 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5986d90f-3a60-4e38-b15f-cc0c69c89abf-hosts-file\") pod \"node-resolver-nfv6x\" (UID: \"5986d90f-3a60-4e38-b15f-cc0c69c89abf\") " pod="openshift-dns/node-resolver-nfv6x" Jun 05 03:43:23.262060 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.260404 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-systemd-units\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.262060 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.260459 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84e6b26c-cb84-463b-ab01-0bac0e2c8096-cnibin\") pod \"multus-additional-cni-plugins-cpmtr\" (UID: \"84e6b26c-cb84-463b-ab01-0bac0e2c8096\") " pod="openshift-multus/multus-additional-cni-plugins-cpmtr" Jun 05 03:43:23.262060 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.260504 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/84e6b26c-cb84-463b-ab01-0bac0e2c8096-os-release\") pod \"multus-additional-cni-plugins-cpmtr\" (UID: \"84e6b26c-cb84-463b-ab01-0bac0e2c8096\") " pod="openshift-multus/multus-additional-cni-plugins-cpmtr" Jun 05 03:43:23.262060 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.260516 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5986d90f-3a60-4e38-b15f-cc0c69c89abf-hosts-file\") pod \"node-resolver-nfv6x\" (UID: \"5986d90f-3a60-4e38-b15f-cc0c69c89abf\") " pod="openshift-dns/node-resolver-nfv6x" Jun 05 03:43:23.262060 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.260540 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0707e72d-344a-483e-910d-fa1ccfc535db-cni-binary-copy\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.262974 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.260616 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f15442b9-7c90-4861-8089-8084f3784bf6-metrics-certs\") pod \"network-metrics-daemon-7fqv9\" (UID: \"f15442b9-7c90-4861-8089-8084f3784bf6\") " pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:43:23.262974 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.260700 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c3351fdf-83ad-4dcd-93d9-798d33f0742e-run\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.262974 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.260728 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3351fdf-83ad-4dcd-93d9-798d33f0742e-var-lib-kubelet\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.262974 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.260762 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8e00145e-4995-452b-998a-fbf922eb164b-dbus\") pod \"global-pull-secret-syncer-q9df4\" (UID: \"8e00145e-4995-452b-998a-fbf922eb164b\") " pod="kube-system/global-pull-secret-syncer-q9df4" Jun 05 03:43:23.262974 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.260847 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3351fdf-83ad-4dcd-93d9-798d33f0742e-var-lib-kubelet\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.262974 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.260884 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f52355f5-a3a3-41a7-a7b4-1cc79455252c-agent-certs\") pod \"konnectivity-agent-w4d7w\" (UID: \"f52355f5-a3a3-41a7-a7b4-1cc79455252c\") " pod="kube-system/konnectivity-agent-w4d7w" Jun 05 03:43:23.262974 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.260914 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c60eea31-0868-440b-94cc-32ccbb82a29e-host-slash\") pod \"iptables-alerter-j78s9\" (UID: \"c60eea31-0868-440b-94cc-32ccbb82a29e\") " pod="openshift-network-operator/iptables-alerter-j78s9" Jun 05 03:43:23.262974 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.260940 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-host-run-netns\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.262974 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.260972 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrl5h\" (UniqueName: \"kubernetes.io/projected/f15442b9-7c90-4861-8089-8084f3784bf6-kube-api-access-rrl5h\") pod \"network-metrics-daemon-7fqv9\" (UID: \"f15442b9-7c90-4861-8089-8084f3784bf6\") " pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:43:23.262974 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.261002 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-host-run-ovn-kubernetes\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.262974 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.261131 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0707e72d-344a-483e-910d-fa1ccfc535db-cni-binary-copy\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.262974 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.261191 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f52355f5-a3a3-41a7-a7b4-1cc79455252c-konnectivity-ca\") pod \"konnectivity-agent-w4d7w\" (UID: \"f52355f5-a3a3-41a7-a7b4-1cc79455252c\") " pod="kube-system/konnectivity-agent-w4d7w" Jun 05 03:43:23.262974 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.261224 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-428dc\" (UniqueName: \"kubernetes.io/projected/84e6b26c-cb84-463b-ab01-0bac0e2c8096-kube-api-access-428dc\") pod \"multus-additional-cni-plugins-cpmtr\" (UID: \"84e6b26c-cb84-463b-ab01-0bac0e2c8096\") " pod="openshift-multus/multus-additional-cni-plugins-cpmtr" Jun 05 03:43:23.262974 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.261252 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb3edaa5-bb4c-4a42-9388-0ecb2db9c42e-host\") pod \"node-ca-dtx66\" (UID: \"eb3edaa5-bb4c-4a42-9388-0ecb2db9c42e\") " pod="openshift-image-registry/node-ca-dtx66" Jun 05 03:43:23.262974 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.261299 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8e00145e-4995-452b-998a-fbf922eb164b-kubelet-config\") pod \"global-pull-secret-syncer-q9df4\" (UID: \"8e00145e-4995-452b-998a-fbf922eb164b\") " pod="kube-system/global-pull-secret-syncer-q9df4" Jun 05 03:43:23.262974 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.261329 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e00145e-4995-452b-998a-fbf922eb164b-original-pull-secret\") pod \"global-pull-secret-syncer-q9df4\" (UID: \"8e00145e-4995-452b-998a-fbf922eb164b\") " pod="kube-system/global-pull-secret-syncer-q9df4" Jun 05 03:43:23.262974 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.261358 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84e6b26c-cb84-463b-ab01-0bac0e2c8096-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cpmtr\" (UID: \"84e6b26c-cb84-463b-ab01-0bac0e2c8096\") " pod="openshift-multus/multus-additional-cni-plugins-cpmtr" Jun 05 03:43:23.263793 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.261408 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-host-run-ovn-kubernetes\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.263793 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.261449 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-systemd-units\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.263793 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.261472 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-host-run-netns\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.263793 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.261506 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c3351fdf-83ad-4dcd-93d9-798d33f0742e-run\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.263793 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:23.261603 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:43:23.263793 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.261634 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-etc-kubernetes\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.263793 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.261694 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb3edaa5-bb4c-4a42-9388-0ecb2db9c42e-host\") pod \"node-ca-dtx66\" (UID: \"eb3edaa5-bb4c-4a42-9388-0ecb2db9c42e\") " pod="openshift-image-registry/node-ca-dtx66" Jun 05 03:43:23.263793 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.261728 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-etc-kubernetes\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.263793 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.261730 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c3351fdf-83ad-4dcd-93d9-798d33f0742e-host\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.263793 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.261768 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-node-log\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.263793 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.261821 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c3351fdf-83ad-4dcd-93d9-798d33f0742e-host\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.263793 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.261859 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c60eea31-0868-440b-94cc-32ccbb82a29e-iptables-alerter-script\") pod \"iptables-alerter-j78s9\" (UID: \"c60eea31-0868-440b-94cc-32ccbb82a29e\") " pod="openshift-network-operator/iptables-alerter-j78s9" Jun 05 03:43:23.263793 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.261917 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84e6b26c-cb84-463b-ab01-0bac0e2c8096-system-cni-dir\") pod \"multus-additional-cni-plugins-cpmtr\" (UID: \"84e6b26c-cb84-463b-ab01-0bac0e2c8096\") " pod="openshift-multus/multus-additional-cni-plugins-cpmtr" Jun 05 03:43:23.263793 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.261947 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e613e69d-cdca-4b90-8d23-ac1d27658278-etc-selinux\") pod \"aws-ebs-csi-driver-node-grkjm\" (UID: \"e613e69d-cdca-4b90-8d23-ac1d27658278\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grkjm" Jun 05 03:43:23.263793 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:23.262005 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f15442b9-7c90-4861-8089-8084f3784bf6-metrics-certs podName:f15442b9-7c90-4861-8089-8084f3784bf6 nodeName:}" failed. No retries permitted until 2026-06-05 03:43:23.76194972 +0000 UTC m=+3.031726038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f15442b9-7c90-4861-8089-8084f3784bf6-metrics-certs") pod "network-metrics-daemon-7fqv9" (UID: "f15442b9-7c90-4861-8089-8084f3784bf6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:43:23.263793 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.262050 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-etc-openvswitch\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.263793 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.262058 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e613e69d-cdca-4b90-8d23-ac1d27658278-etc-selinux\") pod \"aws-ebs-csi-driver-node-grkjm\" (UID: \"e613e69d-cdca-4b90-8d23-ac1d27658278\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grkjm" Jun 05 03:43:23.264575 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.262130 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-node-log\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.264575 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.262186 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-etc-openvswitch\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.264575 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.262242 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9139fc4f-a2c4-4323-aac8-55b73d33aba2-ovnkube-config\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.264575 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.262292 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9139fc4f-a2c4-4323-aac8-55b73d33aba2-ovnkube-script-lib\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.264575 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.262349 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-host-var-lib-cni-multus\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.264575 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.262409 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c3351fdf-83ad-4dcd-93d9-798d33f0742e-etc-sysctl-conf\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.264575 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.262456 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3351fdf-83ad-4dcd-93d9-798d33f0742e-tmp\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.264575 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.262527 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngmns\" (UniqueName: \"kubernetes.io/projected/c3351fdf-83ad-4dcd-93d9-798d33f0742e-kube-api-access-ngmns\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.264575 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.262788 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9139fc4f-a2c4-4323-aac8-55b73d33aba2-ovnkube-config\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.264575 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.263034 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-host-var-lib-cni-multus\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.264575 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.263067 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9139fc4f-a2c4-4323-aac8-55b73d33aba2-ovnkube-script-lib\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.264575 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.263069 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-run-ovn\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.264575 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.263137 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-run-ovn\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.264575 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.263259 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c3351fdf-83ad-4dcd-93d9-798d33f0742e-etc-sysctl-conf\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.264575 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.263468 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.264575 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.263510 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e613e69d-cdca-4b90-8d23-ac1d27658278-kubelet-dir\") pod \"aws-ebs-csi-driver-node-grkjm\" (UID: \"e613e69d-cdca-4b90-8d23-ac1d27658278\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grkjm" Jun 05 03:43:23.264575 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.263519 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.265324 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.263541 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-system-cni-dir\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.265324 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.263609 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-system-cni-dir\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.265324 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.263610 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e613e69d-cdca-4b90-8d23-ac1d27658278-kubelet-dir\") pod \"aws-ebs-csi-driver-node-grkjm\" (UID: \"e613e69d-cdca-4b90-8d23-ac1d27658278\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grkjm" Jun 05 03:43:23.265324 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.263640 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3351fdf-83ad-4dcd-93d9-798d33f0742e-etc-kubernetes\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.265324 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.263676 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-host-run-netns\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.265324 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.263708 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e613e69d-cdca-4b90-8d23-ac1d27658278-socket-dir\") pod \"aws-ebs-csi-driver-node-grkjm\" (UID: \"e613e69d-cdca-4b90-8d23-ac1d27658278\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grkjm" Jun 05 03:43:23.265324 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.263740 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3351fdf-83ad-4dcd-93d9-798d33f0742e-etc-kubernetes\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.265324 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.263741 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-host-run-multus-certs\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.265324 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.263781 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-host-run-multus-certs\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.265324 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.263801 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-cnibin\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.265324 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.263854 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-host-run-netns\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.265324 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.263868 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-cnibin\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.265324 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.263909 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e613e69d-cdca-4b90-8d23-ac1d27658278-registration-dir\") pod \"aws-ebs-csi-driver-node-grkjm\" (UID: \"e613e69d-cdca-4b90-8d23-ac1d27658278\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grkjm" Jun 05 03:43:23.265324 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.263949 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krfj5\" (UniqueName: \"kubernetes.io/projected/e613e69d-cdca-4b90-8d23-ac1d27658278-kube-api-access-krfj5\") pod \"aws-ebs-csi-driver-node-grkjm\" (UID: \"e613e69d-cdca-4b90-8d23-ac1d27658278\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grkjm" Jun 05 03:43:23.265324 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.263970 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e613e69d-cdca-4b90-8d23-ac1d27658278-socket-dir\") pod \"aws-ebs-csi-driver-node-grkjm\" (UID: \"e613e69d-cdca-4b90-8d23-ac1d27658278\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grkjm" Jun 05 03:43:23.265324 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.263982 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-host-slash\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.265324 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.264009 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e613e69d-cdca-4b90-8d23-ac1d27658278-registration-dir\") pod \"aws-ebs-csi-driver-node-grkjm\" (UID: \"e613e69d-cdca-4b90-8d23-ac1d27658278\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grkjm" Jun 05 03:43:23.266086 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.264044 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-host-slash\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.266086 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.264121 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-host-cni-netd\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.266086 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.264157 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wptg4\" (UniqueName: \"kubernetes.io/projected/c60eea31-0868-440b-94cc-32ccbb82a29e-kube-api-access-wptg4\") pod \"iptables-alerter-j78s9\" (UID: \"c60eea31-0868-440b-94cc-32ccbb82a29e\") " pod="openshift-network-operator/iptables-alerter-j78s9" Jun 05 03:43:23.266086 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.264180 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-host-cni-netd\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.266086 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.264195 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8bcs\" (UniqueName: \"kubernetes.io/projected/5dab8672-15ed-4938-b29c-75a0ed4e517d-kube-api-access-h8bcs\") pod \"network-check-target-tx8nn\" (UID: \"5dab8672-15ed-4938-b29c-75a0ed4e517d\") " pod="openshift-network-diagnostics/network-check-target-tx8nn" Jun 05 03:43:23.266086 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.264227 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-host-run-k8s-cni-cncf-io\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.266086 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.264260 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-host-kubelet\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.266086 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.264291 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-run-openvswitch\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.266086 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.264318 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-host-run-k8s-cni-cncf-io\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.266086 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.264324 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e613e69d-cdca-4b90-8d23-ac1d27658278-sys-fs\") pod \"aws-ebs-csi-driver-node-grkjm\" (UID: \"e613e69d-cdca-4b90-8d23-ac1d27658278\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grkjm" Jun 05 03:43:23.266086 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.264381 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3351fdf-83ad-4dcd-93d9-798d33f0742e-lib-modules\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.266086 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.264388 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-host-kubelet\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.266086 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.264424 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c3351fdf-83ad-4dcd-93d9-798d33f0742e-etc-tuned\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.266086 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.264448 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-run-openvswitch\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.266086 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.264382 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e613e69d-cdca-4b90-8d23-ac1d27658278-sys-fs\") pod \"aws-ebs-csi-driver-node-grkjm\" (UID: \"e613e69d-cdca-4b90-8d23-ac1d27658278\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grkjm" Jun 05 03:43:23.266086 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.264482 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-log-socket\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.266086 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.264516 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3351fdf-83ad-4dcd-93d9-798d33f0742e-lib-modules\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.266889 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.264518 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-host-cni-bin\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.266889 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.264563 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-host-cni-bin\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.266889 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.264564 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84e6b26c-cb84-463b-ab01-0bac0e2c8096-cni-binary-copy\") pod \"multus-additional-cni-plugins-cpmtr\" (UID: \"84e6b26c-cb84-463b-ab01-0bac0e2c8096\") " pod="openshift-multus/multus-additional-cni-plugins-cpmtr" Jun 05 03:43:23.266889 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.264568 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-log-socket\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.266889 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.264610 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0707e72d-344a-483e-910d-fa1ccfc535db-multus-daemon-config\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.266889 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.264726 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c3351fdf-83ad-4dcd-93d9-798d33f0742e-etc-sysconfig\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.266889 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.264751 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb3edaa5-bb4c-4a42-9388-0ecb2db9c42e-serviceca\") pod \"node-ca-dtx66\" (UID: \"eb3edaa5-bb4c-4a42-9388-0ecb2db9c42e\") " pod="openshift-image-registry/node-ca-dtx66" Jun 05 03:43:23.266889 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.264781 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdngd\" (UniqueName: \"kubernetes.io/projected/eb3edaa5-bb4c-4a42-9388-0ecb2db9c42e-kube-api-access-hdngd\") pod \"node-ca-dtx66\" (UID: \"eb3edaa5-bb4c-4a42-9388-0ecb2db9c42e\") " pod="openshift-image-registry/node-ca-dtx66" Jun 05 03:43:23.266889 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.264826 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c3351fdf-83ad-4dcd-93d9-798d33f0742e-etc-sysconfig\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.266889 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.264868 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-run-systemd\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.266889 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.264936 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-run-systemd\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.266889 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.264961 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/84e6b26c-cb84-463b-ab01-0bac0e2c8096-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cpmtr\" (UID: \"84e6b26c-cb84-463b-ab01-0bac0e2c8096\") " pod="openshift-multus/multus-additional-cni-plugins-cpmtr" Jun 05 03:43:23.266889 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.265037 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/84e6b26c-cb84-463b-ab01-0bac0e2c8096-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cpmtr\" (UID: \"84e6b26c-cb84-463b-ab01-0bac0e2c8096\") " pod="openshift-multus/multus-additional-cni-plugins-cpmtr" Jun 05 03:43:23.266889 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.265083 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-multus-cni-dir\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.266889 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.265115 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-os-release\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.266889 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.265144 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-host-var-lib-kubelet\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.266889 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.265198 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-var-lib-openvswitch\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.267584 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.265220 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb3edaa5-bb4c-4a42-9388-0ecb2db9c42e-serviceca\") pod \"node-ca-dtx66\" (UID: \"eb3edaa5-bb4c-4a42-9388-0ecb2db9c42e\") " pod="openshift-image-registry/node-ca-dtx66" Jun 05 03:43:23.267584 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.265238 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9139fc4f-a2c4-4323-aac8-55b73d33aba2-var-lib-openvswitch\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.267584 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.265263 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-multus-cni-dir\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.267584 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.265269 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-hostroot\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.267584 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.265294 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-host-var-lib-kubelet\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.267584 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.265270 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0707e72d-344a-483e-910d-fa1ccfc535db-multus-daemon-config\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.267584 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.265303 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-multus-conf-dir\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.267584 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.265309 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-os-release\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.267584 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.265314 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-hostroot\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.267584 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.265465 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0707e72d-344a-483e-910d-fa1ccfc535db-multus-conf-dir\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.267584 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.265525 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r5k9\" (UniqueName: \"kubernetes.io/projected/0707e72d-344a-483e-910d-fa1ccfc535db-kube-api-access-2r5k9\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.267584 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.266521 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9139fc4f-a2c4-4323-aac8-55b73d33aba2-ovn-node-metrics-cert\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.267584 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.267475 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c3351fdf-83ad-4dcd-93d9-798d33f0742e-etc-tuned\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.269198 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:23.269176 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 03:43:23.269286 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:23.269204 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 03:43:23.269286 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:23.269221 2548 projected.go:196] Error preparing data for projected volume kube-api-access-h8bcs for pod openshift-network-diagnostics/network-check-target-tx8nn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:43:23.269400 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:23.269308 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5dab8672-15ed-4938-b29c-75a0ed4e517d-kube-api-access-h8bcs podName:5dab8672-15ed-4938-b29c-75a0ed4e517d nodeName:}" failed. No retries permitted until 2026-06-05 03:43:23.769290411 +0000 UTC m=+3.039066730 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-h8bcs" (UniqueName: "kubernetes.io/projected/5dab8672-15ed-4938-b29c-75a0ed4e517d-kube-api-access-h8bcs") pod "network-check-target-tx8nn" (UID: "5dab8672-15ed-4938-b29c-75a0ed4e517d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:43:23.269540 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.269516 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2tzc\" (UniqueName: \"kubernetes.io/projected/9139fc4f-a2c4-4323-aac8-55b73d33aba2-kube-api-access-p2tzc\") pod \"ovnkube-node-whn2g\" (UID: \"9139fc4f-a2c4-4323-aac8-55b73d33aba2\") " pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.269969 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.269928 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnjf5\" (UniqueName: \"kubernetes.io/projected/5986d90f-3a60-4e38-b15f-cc0c69c89abf-kube-api-access-bnjf5\") pod \"node-resolver-nfv6x\" (UID: \"5986d90f-3a60-4e38-b15f-cc0c69c89abf\") " pod="openshift-dns/node-resolver-nfv6x" Jun 05 03:43:23.271374 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.271347 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngmns\" (UniqueName: \"kubernetes.io/projected/c3351fdf-83ad-4dcd-93d9-798d33f0742e-kube-api-access-ngmns\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.271560 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.271535 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrl5h\" (UniqueName: \"kubernetes.io/projected/f15442b9-7c90-4861-8089-8084f3784bf6-kube-api-access-rrl5h\") pod \"network-metrics-daemon-7fqv9\" (UID: \"f15442b9-7c90-4861-8089-8084f3784bf6\") " pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:43:23.271979 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.271950 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krfj5\" (UniqueName: \"kubernetes.io/projected/e613e69d-cdca-4b90-8d23-ac1d27658278-kube-api-access-krfj5\") pod \"aws-ebs-csi-driver-node-grkjm\" (UID: \"e613e69d-cdca-4b90-8d23-ac1d27658278\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grkjm" Jun 05 03:43:23.272349 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.272310 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3351fdf-83ad-4dcd-93d9-798d33f0742e-tmp\") pod \"tuned-k5sbh\" (UID: \"c3351fdf-83ad-4dcd-93d9-798d33f0742e\") " pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.272349 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.272320 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdngd\" (UniqueName: \"kubernetes.io/projected/eb3edaa5-bb4c-4a42-9388-0ecb2db9c42e-kube-api-access-hdngd\") pod \"node-ca-dtx66\" (UID: \"eb3edaa5-bb4c-4a42-9388-0ecb2db9c42e\") " pod="openshift-image-registry/node-ca-dtx66" Jun 05 03:43:23.272765 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.272747 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r5k9\" (UniqueName: \"kubernetes.io/projected/0707e72d-344a-483e-910d-fa1ccfc535db-kube-api-access-2r5k9\") pod \"multus-8lg5x\" (UID: \"0707e72d-344a-483e-910d-fa1ccfc535db\") " pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.346943 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.346910 2548 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 03:43:23.366272 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.366244 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wptg4\" (UniqueName: \"kubernetes.io/projected/c60eea31-0868-440b-94cc-32ccbb82a29e-kube-api-access-wptg4\") pod \"iptables-alerter-j78s9\" (UID: \"c60eea31-0868-440b-94cc-32ccbb82a29e\") " pod="openshift-network-operator/iptables-alerter-j78s9" Jun 05 03:43:23.366421 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.366288 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84e6b26c-cb84-463b-ab01-0bac0e2c8096-cni-binary-copy\") pod \"multus-additional-cni-plugins-cpmtr\" (UID: \"84e6b26c-cb84-463b-ab01-0bac0e2c8096\") " pod="openshift-multus/multus-additional-cni-plugins-cpmtr" Jun 05 03:43:23.366421 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.366308 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/84e6b26c-cb84-463b-ab01-0bac0e2c8096-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cpmtr\" (UID: \"84e6b26c-cb84-463b-ab01-0bac0e2c8096\") " pod="openshift-multus/multus-additional-cni-plugins-cpmtr" Jun 05 03:43:23.366421 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.366334 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/84e6b26c-cb84-463b-ab01-0bac0e2c8096-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cpmtr\" (UID: \"84e6b26c-cb84-463b-ab01-0bac0e2c8096\") " pod="openshift-multus/multus-additional-cni-plugins-cpmtr" Jun 05 03:43:23.366421 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.366372 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84e6b26c-cb84-463b-ab01-0bac0e2c8096-cnibin\") pod \"multus-additional-cni-plugins-cpmtr\" (UID: \"84e6b26c-cb84-463b-ab01-0bac0e2c8096\") " pod="openshift-multus/multus-additional-cni-plugins-cpmtr" Jun 05 03:43:23.366421 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.366396 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/84e6b26c-cb84-463b-ab01-0bac0e2c8096-os-release\") pod \"multus-additional-cni-plugins-cpmtr\" (UID: \"84e6b26c-cb84-463b-ab01-0bac0e2c8096\") " pod="openshift-multus/multus-additional-cni-plugins-cpmtr" Jun 05 03:43:23.366700 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.366456 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8e00145e-4995-452b-998a-fbf922eb164b-dbus\") pod \"global-pull-secret-syncer-q9df4\" (UID: \"8e00145e-4995-452b-998a-fbf922eb164b\") " pod="kube-system/global-pull-secret-syncer-q9df4" Jun 05 03:43:23.366700 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.366481 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f52355f5-a3a3-41a7-a7b4-1cc79455252c-agent-certs\") pod \"konnectivity-agent-w4d7w\" (UID: \"f52355f5-a3a3-41a7-a7b4-1cc79455252c\") " pod="kube-system/konnectivity-agent-w4d7w" Jun 05 03:43:23.366700 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.366516 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c60eea31-0868-440b-94cc-32ccbb82a29e-host-slash\") pod \"iptables-alerter-j78s9\" (UID: \"c60eea31-0868-440b-94cc-32ccbb82a29e\") " pod="openshift-network-operator/iptables-alerter-j78s9" Jun 05 03:43:23.366700 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.366542 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f52355f5-a3a3-41a7-a7b4-1cc79455252c-konnectivity-ca\") pod \"konnectivity-agent-w4d7w\" (UID: \"f52355f5-a3a3-41a7-a7b4-1cc79455252c\") " pod="kube-system/konnectivity-agent-w4d7w" Jun 05 03:43:23.366700 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.366567 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-428dc\" (UniqueName: \"kubernetes.io/projected/84e6b26c-cb84-463b-ab01-0bac0e2c8096-kube-api-access-428dc\") pod \"multus-additional-cni-plugins-cpmtr\" (UID: \"84e6b26c-cb84-463b-ab01-0bac0e2c8096\") " pod="openshift-multus/multus-additional-cni-plugins-cpmtr" Jun 05 03:43:23.366700 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.366590 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8e00145e-4995-452b-998a-fbf922eb164b-kubelet-config\") pod \"global-pull-secret-syncer-q9df4\" (UID: \"8e00145e-4995-452b-998a-fbf922eb164b\") " pod="kube-system/global-pull-secret-syncer-q9df4" Jun 05 03:43:23.366700 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.366612 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e00145e-4995-452b-998a-fbf922eb164b-original-pull-secret\") pod \"global-pull-secret-syncer-q9df4\" (UID: \"8e00145e-4995-452b-998a-fbf922eb164b\") " pod="kube-system/global-pull-secret-syncer-q9df4" Jun 05 03:43:23.366700 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.366661 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84e6b26c-cb84-463b-ab01-0bac0e2c8096-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cpmtr\" (UID: \"84e6b26c-cb84-463b-ab01-0bac0e2c8096\") " pod="openshift-multus/multus-additional-cni-plugins-cpmtr" Jun 05 03:43:23.367081 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.366724 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c60eea31-0868-440b-94cc-32ccbb82a29e-iptables-alerter-script\") pod \"iptables-alerter-j78s9\" (UID: \"c60eea31-0868-440b-94cc-32ccbb82a29e\") " pod="openshift-network-operator/iptables-alerter-j78s9" Jun 05 03:43:23.367081 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.366750 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84e6b26c-cb84-463b-ab01-0bac0e2c8096-system-cni-dir\") pod \"multus-additional-cni-plugins-cpmtr\" (UID: \"84e6b26c-cb84-463b-ab01-0bac0e2c8096\") " pod="openshift-multus/multus-additional-cni-plugins-cpmtr" Jun 05 03:43:23.367081 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.366838 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84e6b26c-cb84-463b-ab01-0bac0e2c8096-system-cni-dir\") pod \"multus-additional-cni-plugins-cpmtr\" (UID: \"84e6b26c-cb84-463b-ab01-0bac0e2c8096\") " pod="openshift-multus/multus-additional-cni-plugins-cpmtr" Jun 05 03:43:23.367081 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:23.366862 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 03:43:23.367081 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.366916 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84e6b26c-cb84-463b-ab01-0bac0e2c8096-cni-binary-copy\") pod \"multus-additional-cni-plugins-cpmtr\" (UID: \"84e6b26c-cb84-463b-ab01-0bac0e2c8096\") " pod="openshift-multus/multus-additional-cni-plugins-cpmtr" Jun 05 03:43:23.367081 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:23.366937 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e00145e-4995-452b-998a-fbf922eb164b-original-pull-secret podName:8e00145e-4995-452b-998a-fbf922eb164b nodeName:}" failed. No retries permitted until 2026-06-05 03:43:23.866918081 +0000 UTC m=+3.136694379 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e00145e-4995-452b-998a-fbf922eb164b-original-pull-secret") pod "global-pull-secret-syncer-q9df4" (UID: "8e00145e-4995-452b-998a-fbf922eb164b") : object "kube-system"/"original-pull-secret" not registered Jun 05 03:43:23.367081 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.366943 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84e6b26c-cb84-463b-ab01-0bac0e2c8096-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cpmtr\" (UID: \"84e6b26c-cb84-463b-ab01-0bac0e2c8096\") " pod="openshift-multus/multus-additional-cni-plugins-cpmtr" Jun 05 03:43:23.367081 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.366984 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8e00145e-4995-452b-998a-fbf922eb164b-kubelet-config\") pod \"global-pull-secret-syncer-q9df4\" (UID: \"8e00145e-4995-452b-998a-fbf922eb164b\") " pod="kube-system/global-pull-secret-syncer-q9df4" Jun 05 03:43:23.367081 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.367038 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84e6b26c-cb84-463b-ab01-0bac0e2c8096-cnibin\") pod \"multus-additional-cni-plugins-cpmtr\" (UID: \"84e6b26c-cb84-463b-ab01-0bac0e2c8096\") " pod="openshift-multus/multus-additional-cni-plugins-cpmtr" Jun 05 03:43:23.367530 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.367084 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/84e6b26c-cb84-463b-ab01-0bac0e2c8096-os-release\") pod \"multus-additional-cni-plugins-cpmtr\" (UID: \"84e6b26c-cb84-463b-ab01-0bac0e2c8096\") " pod="openshift-multus/multus-additional-cni-plugins-cpmtr" Jun 05 03:43:23.367530 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.367090 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8e00145e-4995-452b-998a-fbf922eb164b-dbus\") pod \"global-pull-secret-syncer-q9df4\" (UID: \"8e00145e-4995-452b-998a-fbf922eb164b\") " pod="kube-system/global-pull-secret-syncer-q9df4" Jun 05 03:43:23.367530 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.367131 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c60eea31-0868-440b-94cc-32ccbb82a29e-host-slash\") pod \"iptables-alerter-j78s9\" (UID: \"c60eea31-0868-440b-94cc-32ccbb82a29e\") " pod="openshift-network-operator/iptables-alerter-j78s9" Jun 05 03:43:23.367530 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.367288 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f52355f5-a3a3-41a7-a7b4-1cc79455252c-konnectivity-ca\") pod \"konnectivity-agent-w4d7w\" (UID: \"f52355f5-a3a3-41a7-a7b4-1cc79455252c\") " pod="kube-system/konnectivity-agent-w4d7w" Jun 05 03:43:23.367530 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.367451 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c60eea31-0868-440b-94cc-32ccbb82a29e-iptables-alerter-script\") pod \"iptables-alerter-j78s9\" (UID: \"c60eea31-0868-440b-94cc-32ccbb82a29e\") " pod="openshift-network-operator/iptables-alerter-j78s9" Jun 05 03:43:23.367530 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.367515 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/84e6b26c-cb84-463b-ab01-0bac0e2c8096-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cpmtr\" (UID: \"84e6b26c-cb84-463b-ab01-0bac0e2c8096\") " pod="openshift-multus/multus-additional-cni-plugins-cpmtr" Jun 05 03:43:23.367776 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.367712 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/84e6b26c-cb84-463b-ab01-0bac0e2c8096-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cpmtr\" (UID: \"84e6b26c-cb84-463b-ab01-0bac0e2c8096\") " pod="openshift-multus/multus-additional-cni-plugins-cpmtr" Jun 05 03:43:23.369639 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.369614 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f52355f5-a3a3-41a7-a7b4-1cc79455252c-agent-certs\") pod \"konnectivity-agent-w4d7w\" (UID: \"f52355f5-a3a3-41a7-a7b4-1cc79455252c\") " pod="kube-system/konnectivity-agent-w4d7w" Jun 05 03:43:23.375380 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.375352 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wptg4\" (UniqueName: \"kubernetes.io/projected/c60eea31-0868-440b-94cc-32ccbb82a29e-kube-api-access-wptg4\") pod \"iptables-alerter-j78s9\" (UID: \"c60eea31-0868-440b-94cc-32ccbb82a29e\") " pod="openshift-network-operator/iptables-alerter-j78s9" Jun 05 03:43:23.375474 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.375382 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-428dc\" (UniqueName: \"kubernetes.io/projected/84e6b26c-cb84-463b-ab01-0bac0e2c8096-kube-api-access-428dc\") pod \"multus-additional-cni-plugins-cpmtr\" (UID: \"84e6b26c-cb84-463b-ab01-0bac0e2c8096\") " pod="openshift-multus/multus-additional-cni-plugins-cpmtr" Jun 05 03:43:23.429646 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.429603 2548 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 03:43:23.441873 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.441845 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grkjm" Jun 05 03:43:23.452368 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.452347 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" Jun 05 03:43:23.461842 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.461825 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nfv6x" Jun 05 03:43:23.466481 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.466460 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dtx66" Jun 05 03:43:23.473214 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.473197 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:23.479958 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.479943 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8lg5x" Jun 05 03:43:23.486610 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.486590 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cpmtr" Jun 05 03:43:23.492186 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.492163 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w4d7w" Jun 05 03:43:23.498756 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.498741 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j78s9" Jun 05 03:43:23.770414 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.770384 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f15442b9-7c90-4861-8089-8084f3784bf6-metrics-certs\") pod \"network-metrics-daemon-7fqv9\" (UID: \"f15442b9-7c90-4861-8089-8084f3784bf6\") " pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:43:23.770579 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.770446 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8bcs\" (UniqueName: \"kubernetes.io/projected/5dab8672-15ed-4938-b29c-75a0ed4e517d-kube-api-access-h8bcs\") pod \"network-check-target-tx8nn\" (UID: \"5dab8672-15ed-4938-b29c-75a0ed4e517d\") " pod="openshift-network-diagnostics/network-check-target-tx8nn" Jun 05 03:43:23.770579 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:23.770526 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:43:23.770579 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:23.770537 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 03:43:23.770579 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:23.770551 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 03:43:23.770579 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:23.770559 2548 projected.go:196] Error preparing data for projected volume kube-api-access-h8bcs for pod openshift-network-diagnostics/network-check-target-tx8nn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:43:23.770579 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:23.770582 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f15442b9-7c90-4861-8089-8084f3784bf6-metrics-certs podName:f15442b9-7c90-4861-8089-8084f3784bf6 nodeName:}" failed. No retries permitted until 2026-06-05 03:43:24.770567415 +0000 UTC m=+4.040343714 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f15442b9-7c90-4861-8089-8084f3784bf6-metrics-certs") pod "network-metrics-daemon-7fqv9" (UID: "f15442b9-7c90-4861-8089-8084f3784bf6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:43:23.770807 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:23.770600 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5dab8672-15ed-4938-b29c-75a0ed4e517d-kube-api-access-h8bcs podName:5dab8672-15ed-4938-b29c-75a0ed4e517d nodeName:}" failed. No retries permitted until 2026-06-05 03:43:24.770588507 +0000 UTC m=+4.040364808 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-h8bcs" (UniqueName: "kubernetes.io/projected/5dab8672-15ed-4938-b29c-75a0ed4e517d-kube-api-access-h8bcs") pod "network-check-target-tx8nn" (UID: "5dab8672-15ed-4938-b29c-75a0ed4e517d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:43:23.870989 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:23.870954 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e00145e-4995-452b-998a-fbf922eb164b-original-pull-secret\") pod \"global-pull-secret-syncer-q9df4\" (UID: \"8e00145e-4995-452b-998a-fbf922eb164b\") " pod="kube-system/global-pull-secret-syncer-q9df4" Jun 05 03:43:23.871157 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:23.871113 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 03:43:23.871227 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:23.871178 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e00145e-4995-452b-998a-fbf922eb164b-original-pull-secret podName:8e00145e-4995-452b-998a-fbf922eb164b nodeName:}" failed. No retries permitted until 2026-06-05 03:43:24.871158525 +0000 UTC m=+4.140934835 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e00145e-4995-452b-998a-fbf922eb164b-original-pull-secret") pod "global-pull-secret-syncer-q9df4" (UID: "8e00145e-4995-452b-998a-fbf922eb164b") : object "kube-system"/"original-pull-secret" not registered Jun 05 03:43:24.035005 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:24.034969 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5986d90f_3a60_4e38_b15f_cc0c69c89abf.slice/crio-15687b49b422fda957e5285ac2bccc591d2b9f050442763a3b72ceba5fa97703 WatchSource:0}: Error finding container 15687b49b422fda957e5285ac2bccc591d2b9f050442763a3b72ceba5fa97703: Status 404 returned error can't find the container with id 15687b49b422fda957e5285ac2bccc591d2b9f050442763a3b72ceba5fa97703 Jun 05 03:43:24.035891 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:24.035867 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84e6b26c_cb84_463b_ab01_0bac0e2c8096.slice/crio-65a87df207c984af343f52ad951f7a1f7c2208122d6e7f0d3760764bd507659c WatchSource:0}: Error finding container 65a87df207c984af343f52ad951f7a1f7c2208122d6e7f0d3760764bd507659c: Status 404 returned error can't find the container with id 65a87df207c984af343f52ad951f7a1f7c2208122d6e7f0d3760764bd507659c Jun 05 03:43:24.037674 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:24.037653 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0707e72d_344a_483e_910d_fa1ccfc535db.slice/crio-12af096f966ef703deb92f0a19c75eb9eda66e865a9bc62c42c4f807340e1ae4 WatchSource:0}: Error finding container 12af096f966ef703deb92f0a19c75eb9eda66e865a9bc62c42c4f807340e1ae4: Status 404 returned error can't find the container with id 12af096f966ef703deb92f0a19c75eb9eda66e865a9bc62c42c4f807340e1ae4 Jun 05 03:43:24.039016 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:24.038978 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf52355f5_a3a3_41a7_a7b4_1cc79455252c.slice/crio-76ae882419dbbde1f5f1e795ddbeb8ac8ad8f086eca8b2e179423d3ad58a9b62 WatchSource:0}: Error finding container 76ae882419dbbde1f5f1e795ddbeb8ac8ad8f086eca8b2e179423d3ad58a9b62: Status 404 returned error can't find the container with id 76ae882419dbbde1f5f1e795ddbeb8ac8ad8f086eca8b2e179423d3ad58a9b62 Jun 05 03:43:24.061636 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:24.061605 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9139fc4f_a2c4_4323_aac8_55b73d33aba2.slice/crio-9291452064c43448decaf07f83f827efd5117427e6dba6a733beb28998e70104 WatchSource:0}: Error finding container 9291452064c43448decaf07f83f827efd5117427e6dba6a733beb28998e70104: Status 404 returned error can't find the container with id 9291452064c43448decaf07f83f827efd5117427e6dba6a733beb28998e70104 Jun 05 03:43:24.064056 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:24.064036 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode613e69d_cdca_4b90_8d23_ac1d27658278.slice/crio-442d3e2bb6c8d7c8fc05d3e37679a2b27d7859ebb4d22bfb229c788b3135c54d WatchSource:0}: Error finding container 442d3e2bb6c8d7c8fc05d3e37679a2b27d7859ebb4d22bfb229c788b3135c54d: Status 404 returned error can't find the container with id 442d3e2bb6c8d7c8fc05d3e37679a2b27d7859ebb4d22bfb229c788b3135c54d Jun 05 03:43:24.064870 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:24.064848 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3351fdf_83ad_4dcd_93d9_798d33f0742e.slice/crio-effe9b5789036c0742ae173e29e376ae808a719c2548f6a36b4e9046072adbab WatchSource:0}: Error finding container effe9b5789036c0742ae173e29e376ae808a719c2548f6a36b4e9046072adbab: Status 404 returned error can't find the container with id effe9b5789036c0742ae173e29e376ae808a719c2548f6a36b4e9046072adbab Jun 05 03:43:24.067241 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:24.067227 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc60eea31_0868_440b_94cc_32ccbb82a29e.slice/crio-62d884efcc50bb5d3862835ddc30d2916bb4f069b680350b68478f4c7ed98115 WatchSource:0}: Error finding container 62d884efcc50bb5d3862835ddc30d2916bb4f069b680350b68478f4c7ed98115: Status 404 returned error can't find the container with id 62d884efcc50bb5d3862835ddc30d2916bb4f069b680350b68478f4c7ed98115 Jun 05 03:43:24.067515 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:24.067484 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb3edaa5_bb4c_4a42_9388_0ecb2db9c42e.slice/crio-7ef6821ce6b429ded5e857851f9797c8a3589d68ca4abd7e362c26e6b98db58f WatchSource:0}: Error finding container 7ef6821ce6b429ded5e857851f9797c8a3589d68ca4abd7e362c26e6b98db58f: Status 404 returned error can't find the container with id 7ef6821ce6b429ded5e857851f9797c8a3589d68ca4abd7e362c26e6b98db58f Jun 05 03:43:24.181232 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:24.181067 2548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 03:38:23 +0000 UTC" deadline="2028-01-02 12:07:20.343462374 +0000 UTC" Jun 05 03:43:24.181617 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:24.181242 2548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13832h23m56.162235235s" Jun 05 03:43:24.233021 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:24.232983 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8lg5x" event={"ID":"0707e72d-344a-483e-910d-fa1ccfc535db","Type":"ContainerStarted","Data":"12af096f966ef703deb92f0a19c75eb9eda66e865a9bc62c42c4f807340e1ae4"} Jun 05 03:43:24.234160 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:24.234106 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cpmtr" event={"ID":"84e6b26c-cb84-463b-ab01-0bac0e2c8096","Type":"ContainerStarted","Data":"65a87df207c984af343f52ad951f7a1f7c2208122d6e7f0d3760764bd507659c"} Jun 05 03:43:24.235100 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:24.235080 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nfv6x" event={"ID":"5986d90f-3a60-4e38-b15f-cc0c69c89abf","Type":"ContainerStarted","Data":"15687b49b422fda957e5285ac2bccc591d2b9f050442763a3b72ceba5fa97703"} Jun 05 03:43:24.236933 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:24.236899 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-53.ec2.internal" event={"ID":"0c9f235f3ca1afcafebb0bbf5be2792c","Type":"ContainerStarted","Data":"9a324898e4a495aed36a05f6b3308e766b316f738783fd1a70562c4c2c6e59d2"} Jun 05 03:43:24.238106 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:24.238086 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" event={"ID":"c3351fdf-83ad-4dcd-93d9-798d33f0742e","Type":"ContainerStarted","Data":"effe9b5789036c0742ae173e29e376ae808a719c2548f6a36b4e9046072adbab"} Jun 05 03:43:24.239399 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:24.239380 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grkjm" event={"ID":"e613e69d-cdca-4b90-8d23-ac1d27658278","Type":"ContainerStarted","Data":"442d3e2bb6c8d7c8fc05d3e37679a2b27d7859ebb4d22bfb229c788b3135c54d"} Jun 05 03:43:24.240559 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:24.240539 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w4d7w" event={"ID":"f52355f5-a3a3-41a7-a7b4-1cc79455252c","Type":"ContainerStarted","Data":"76ae882419dbbde1f5f1e795ddbeb8ac8ad8f086eca8b2e179423d3ad58a9b62"} Jun 05 03:43:24.241759 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:24.241742 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dtx66" event={"ID":"eb3edaa5-bb4c-4a42-9388-0ecb2db9c42e","Type":"ContainerStarted","Data":"7ef6821ce6b429ded5e857851f9797c8a3589d68ca4abd7e362c26e6b98db58f"} Jun 05 03:43:24.242857 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:24.242838 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j78s9" event={"ID":"c60eea31-0868-440b-94cc-32ccbb82a29e","Type":"ContainerStarted","Data":"62d884efcc50bb5d3862835ddc30d2916bb4f069b680350b68478f4c7ed98115"} Jun 05 03:43:24.243830 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:24.243810 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" event={"ID":"9139fc4f-a2c4-4323-aac8-55b73d33aba2","Type":"ContainerStarted","Data":"9291452064c43448decaf07f83f827efd5117427e6dba6a733beb28998e70104"} Jun 05 03:43:24.250286 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:24.250107 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-53.ec2.internal" podStartSLOduration=2.250095497 podStartE2EDuration="2.250095497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:43:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:43:24.249691545 +0000 UTC m=+3.519467863" watchObservedRunningTime="2026-06-05 03:43:24.250095497 +0000 UTC m=+3.519871805" Jun 05 03:43:24.778488 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:24.777654 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f15442b9-7c90-4861-8089-8084f3784bf6-metrics-certs\") pod \"network-metrics-daemon-7fqv9\" (UID: \"f15442b9-7c90-4861-8089-8084f3784bf6\") " pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:43:24.778488 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:24.777743 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8bcs\" (UniqueName: \"kubernetes.io/projected/5dab8672-15ed-4938-b29c-75a0ed4e517d-kube-api-access-h8bcs\") pod \"network-check-target-tx8nn\" (UID: \"5dab8672-15ed-4938-b29c-75a0ed4e517d\") " pod="openshift-network-diagnostics/network-check-target-tx8nn" Jun 05 03:43:24.778488 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:24.777906 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 03:43:24.778488 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:24.777923 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 03:43:24.778488 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:24.777936 2548 projected.go:196] Error preparing data for projected volume kube-api-access-h8bcs for pod openshift-network-diagnostics/network-check-target-tx8nn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:43:24.778488 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:24.777999 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5dab8672-15ed-4938-b29c-75a0ed4e517d-kube-api-access-h8bcs podName:5dab8672-15ed-4938-b29c-75a0ed4e517d nodeName:}" failed. No retries permitted until 2026-06-05 03:43:26.777978779 +0000 UTC m=+6.047755097 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-h8bcs" (UniqueName: "kubernetes.io/projected/5dab8672-15ed-4938-b29c-75a0ed4e517d-kube-api-access-h8bcs") pod "network-check-target-tx8nn" (UID: "5dab8672-15ed-4938-b29c-75a0ed4e517d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:43:24.778488 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:24.778385 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:43:24.778488 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:24.778450 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f15442b9-7c90-4861-8089-8084f3784bf6-metrics-certs podName:f15442b9-7c90-4861-8089-8084f3784bf6 nodeName:}" failed. No retries permitted until 2026-06-05 03:43:26.778415464 +0000 UTC m=+6.048191764 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f15442b9-7c90-4861-8089-8084f3784bf6-metrics-certs") pod "network-metrics-daemon-7fqv9" (UID: "f15442b9-7c90-4861-8089-8084f3784bf6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:43:24.878932 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:24.878895 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e00145e-4995-452b-998a-fbf922eb164b-original-pull-secret\") pod \"global-pull-secret-syncer-q9df4\" (UID: \"8e00145e-4995-452b-998a-fbf922eb164b\") " pod="kube-system/global-pull-secret-syncer-q9df4" Jun 05 03:43:24.879130 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:24.879065 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 03:43:24.879203 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:24.879151 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e00145e-4995-452b-998a-fbf922eb164b-original-pull-secret podName:8e00145e-4995-452b-998a-fbf922eb164b nodeName:}" failed. No retries permitted until 2026-06-05 03:43:26.879111353 +0000 UTC m=+6.148887663 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e00145e-4995-452b-998a-fbf922eb164b-original-pull-secret") pod "global-pull-secret-syncer-q9df4" (UID: "8e00145e-4995-452b-998a-fbf922eb164b") : object "kube-system"/"original-pull-secret" not registered Jun 05 03:43:25.182481 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:25.182328 2548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 03:38:23 +0000 UTC" deadline="2028-01-24 13:55:29.024216194 +0000 UTC" Jun 05 03:43:25.182481 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:25.182388 2548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14362h12m3.841832462s" Jun 05 03:43:25.225541 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:25.224826 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tx8nn" Jun 05 03:43:25.225541 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:25.224933 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tx8nn" podUID="5dab8672-15ed-4938-b29c-75a0ed4e517d" Jun 05 03:43:25.225541 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:25.225275 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9df4" Jun 05 03:43:25.225541 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:25.225355 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q9df4" podUID="8e00145e-4995-452b-998a-fbf922eb164b" Jun 05 03:43:25.225541 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:25.225398 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:43:25.225541 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:25.225487 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fqv9" podUID="f15442b9-7c90-4861-8089-8084f3784bf6" Jun 05 03:43:25.257042 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:25.257006 2548 generic.go:356] "Generic (PLEG): container finished" podID="68915a77bd6e05c81d6d7f866eccee2c" containerID="7362a5353e3406ec85e2a7bdd9f7668d711b3ac5d072bcb727022acbaba54691" exitCode=0 Jun 05 03:43:25.257904 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:25.257876 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-53.ec2.internal" event={"ID":"68915a77bd6e05c81d6d7f866eccee2c","Type":"ContainerDied","Data":"7362a5353e3406ec85e2a7bdd9f7668d711b3ac5d072bcb727022acbaba54691"} Jun 05 03:43:26.278380 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:26.277602 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-53.ec2.internal" event={"ID":"68915a77bd6e05c81d6d7f866eccee2c","Type":"ContainerStarted","Data":"03cdde093e55cbeefdb79ff76f34259a9bd6971de9d7f4de7951f56d86cf171f"} Jun 05 03:43:26.798084 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:26.798047 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f15442b9-7c90-4861-8089-8084f3784bf6-metrics-certs\") pod \"network-metrics-daemon-7fqv9\" (UID: \"f15442b9-7c90-4861-8089-8084f3784bf6\") " pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:43:26.798315 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:26.798130 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8bcs\" (UniqueName: \"kubernetes.io/projected/5dab8672-15ed-4938-b29c-75a0ed4e517d-kube-api-access-h8bcs\") pod \"network-check-target-tx8nn\" (UID: \"5dab8672-15ed-4938-b29c-75a0ed4e517d\") " pod="openshift-network-diagnostics/network-check-target-tx8nn" Jun 05 03:43:26.798315 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:26.798279 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 03:43:26.798315 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:26.798299 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 03:43:26.798315 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:26.798313 2548 projected.go:196] Error preparing data for projected volume kube-api-access-h8bcs for pod openshift-network-diagnostics/network-check-target-tx8nn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:43:26.798578 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:26.798375 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5dab8672-15ed-4938-b29c-75a0ed4e517d-kube-api-access-h8bcs podName:5dab8672-15ed-4938-b29c-75a0ed4e517d nodeName:}" failed. No retries permitted until 2026-06-05 03:43:30.798356231 +0000 UTC m=+10.068132533 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-h8bcs" (UniqueName: "kubernetes.io/projected/5dab8672-15ed-4938-b29c-75a0ed4e517d-kube-api-access-h8bcs") pod "network-check-target-tx8nn" (UID: "5dab8672-15ed-4938-b29c-75a0ed4e517d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:43:26.798578 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:26.798556 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:43:26.798697 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:26.798593 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f15442b9-7c90-4861-8089-8084f3784bf6-metrics-certs podName:f15442b9-7c90-4861-8089-8084f3784bf6 nodeName:}" failed. No retries permitted until 2026-06-05 03:43:30.798580833 +0000 UTC m=+10.068357138 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f15442b9-7c90-4861-8089-8084f3784bf6-metrics-certs") pod "network-metrics-daemon-7fqv9" (UID: "f15442b9-7c90-4861-8089-8084f3784bf6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:43:26.898784 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:26.898750 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e00145e-4995-452b-998a-fbf922eb164b-original-pull-secret\") pod \"global-pull-secret-syncer-q9df4\" (UID: \"8e00145e-4995-452b-998a-fbf922eb164b\") " pod="kube-system/global-pull-secret-syncer-q9df4" Jun 05 03:43:26.898960 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:26.898934 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 03:43:26.899030 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:26.899021 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e00145e-4995-452b-998a-fbf922eb164b-original-pull-secret podName:8e00145e-4995-452b-998a-fbf922eb164b nodeName:}" failed. No retries permitted until 2026-06-05 03:43:30.89898997 +0000 UTC m=+10.168766289 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e00145e-4995-452b-998a-fbf922eb164b-original-pull-secret") pod "global-pull-secret-syncer-q9df4" (UID: "8e00145e-4995-452b-998a-fbf922eb164b") : object "kube-system"/"original-pull-secret" not registered Jun 05 03:43:27.223414 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:27.222853 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9df4" Jun 05 03:43:27.223414 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:27.222853 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tx8nn" Jun 05 03:43:27.223414 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:27.222995 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q9df4" podUID="8e00145e-4995-452b-998a-fbf922eb164b" Jun 05 03:43:27.223414 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:27.222853 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:43:27.223414 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:27.223144 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tx8nn" podUID="5dab8672-15ed-4938-b29c-75a0ed4e517d" Jun 05 03:43:27.223414 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:27.223229 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fqv9" podUID="f15442b9-7c90-4861-8089-8084f3784bf6" Jun 05 03:43:29.223129 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:29.223092 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:43:29.223614 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:29.223144 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tx8nn" Jun 05 03:43:29.223614 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:29.223260 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fqv9" podUID="f15442b9-7c90-4861-8089-8084f3784bf6" Jun 05 03:43:29.223614 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:29.223320 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9df4" Jun 05 03:43:29.223614 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:29.223448 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q9df4" podUID="8e00145e-4995-452b-998a-fbf922eb164b" Jun 05 03:43:29.223614 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:29.223545 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tx8nn" podUID="5dab8672-15ed-4938-b29c-75a0ed4e517d" Jun 05 03:43:30.833880 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:30.833305 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8bcs\" (UniqueName: \"kubernetes.io/projected/5dab8672-15ed-4938-b29c-75a0ed4e517d-kube-api-access-h8bcs\") pod \"network-check-target-tx8nn\" (UID: \"5dab8672-15ed-4938-b29c-75a0ed4e517d\") " pod="openshift-network-diagnostics/network-check-target-tx8nn" Jun 05 03:43:30.833880 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:30.833379 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f15442b9-7c90-4861-8089-8084f3784bf6-metrics-certs\") pod \"network-metrics-daemon-7fqv9\" (UID: \"f15442b9-7c90-4861-8089-8084f3784bf6\") " pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:43:30.833880 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:30.833496 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 03:43:30.833880 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:30.833515 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 03:43:30.833880 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:30.833517 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:43:30.833880 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:30.833528 2548 projected.go:196] Error preparing data for projected volume kube-api-access-h8bcs for pod openshift-network-diagnostics/network-check-target-tx8nn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:43:30.833880 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:30.833570 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5dab8672-15ed-4938-b29c-75a0ed4e517d-kube-api-access-h8bcs podName:5dab8672-15ed-4938-b29c-75a0ed4e517d nodeName:}" failed. No retries permitted until 2026-06-05 03:43:38.833552534 +0000 UTC m=+18.103328830 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-h8bcs" (UniqueName: "kubernetes.io/projected/5dab8672-15ed-4938-b29c-75a0ed4e517d-kube-api-access-h8bcs") pod "network-check-target-tx8nn" (UID: "5dab8672-15ed-4938-b29c-75a0ed4e517d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:43:30.833880 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:30.833587 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f15442b9-7c90-4861-8089-8084f3784bf6-metrics-certs podName:f15442b9-7c90-4861-8089-8084f3784bf6 nodeName:}" failed. No retries permitted until 2026-06-05 03:43:38.833578171 +0000 UTC m=+18.103354467 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f15442b9-7c90-4861-8089-8084f3784bf6-metrics-certs") pod "network-metrics-daemon-7fqv9" (UID: "f15442b9-7c90-4861-8089-8084f3784bf6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:43:30.934611 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:30.934573 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e00145e-4995-452b-998a-fbf922eb164b-original-pull-secret\") pod \"global-pull-secret-syncer-q9df4\" (UID: \"8e00145e-4995-452b-998a-fbf922eb164b\") " pod="kube-system/global-pull-secret-syncer-q9df4" Jun 05 03:43:30.934759 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:30.934715 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 03:43:30.934796 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:30.934774 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e00145e-4995-452b-998a-fbf922eb164b-original-pull-secret podName:8e00145e-4995-452b-998a-fbf922eb164b nodeName:}" failed. No retries permitted until 2026-06-05 03:43:38.934754627 +0000 UTC m=+18.204530928 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e00145e-4995-452b-998a-fbf922eb164b-original-pull-secret") pod "global-pull-secret-syncer-q9df4" (UID: "8e00145e-4995-452b-998a-fbf922eb164b") : object "kube-system"/"original-pull-secret" not registered Jun 05 03:43:31.224726 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:31.224245 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tx8nn" Jun 05 03:43:31.224726 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:31.224260 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9df4" Jun 05 03:43:31.224726 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:31.224271 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:43:31.224726 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:31.224361 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tx8nn" podUID="5dab8672-15ed-4938-b29c-75a0ed4e517d" Jun 05 03:43:31.224726 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:31.224534 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q9df4" podUID="8e00145e-4995-452b-998a-fbf922eb164b" Jun 05 03:43:31.224726 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:31.224642 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fqv9" podUID="f15442b9-7c90-4861-8089-8084f3784bf6" Jun 05 03:43:33.223551 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:33.223039 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:43:33.223551 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:33.223047 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tx8nn" Jun 05 03:43:33.223551 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:33.223187 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9df4" Jun 05 03:43:33.223551 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:33.223175 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fqv9" podUID="f15442b9-7c90-4861-8089-8084f3784bf6" Jun 05 03:43:33.223551 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:33.223273 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tx8nn" podUID="5dab8672-15ed-4938-b29c-75a0ed4e517d" Jun 05 03:43:33.223551 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:33.223324 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q9df4" podUID="8e00145e-4995-452b-998a-fbf922eb164b" Jun 05 03:43:35.223066 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:35.223032 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9df4" Jun 05 03:43:35.223066 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:35.223052 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:43:35.223597 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:35.223032 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tx8nn" Jun 05 03:43:35.223597 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:35.223223 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q9df4" podUID="8e00145e-4995-452b-998a-fbf922eb164b" Jun 05 03:43:35.223597 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:35.223369 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fqv9" podUID="f15442b9-7c90-4861-8089-8084f3784bf6" Jun 05 03:43:35.223597 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:35.223478 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tx8nn" podUID="5dab8672-15ed-4938-b29c-75a0ed4e517d" Jun 05 03:43:37.223400 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:37.223363 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:43:37.223888 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:37.223524 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fqv9" podUID="f15442b9-7c90-4861-8089-8084f3784bf6" Jun 05 03:43:37.223981 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:37.223963 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tx8nn" Jun 05 03:43:37.224070 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:37.224052 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tx8nn" podUID="5dab8672-15ed-4938-b29c-75a0ed4e517d" Jun 05 03:43:37.224227 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:37.224204 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9df4" Jun 05 03:43:37.224342 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:37.224306 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q9df4" podUID="8e00145e-4995-452b-998a-fbf922eb164b" Jun 05 03:43:38.894295 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:38.894259 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f15442b9-7c90-4861-8089-8084f3784bf6-metrics-certs\") pod \"network-metrics-daemon-7fqv9\" (UID: \"f15442b9-7c90-4861-8089-8084f3784bf6\") " pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:43:38.894780 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:38.894353 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8bcs\" (UniqueName: \"kubernetes.io/projected/5dab8672-15ed-4938-b29c-75a0ed4e517d-kube-api-access-h8bcs\") pod \"network-check-target-tx8nn\" (UID: \"5dab8672-15ed-4938-b29c-75a0ed4e517d\") " pod="openshift-network-diagnostics/network-check-target-tx8nn" Jun 05 03:43:38.894780 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:38.894453 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:43:38.894780 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:38.894494 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 03:43:38.894780 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:38.894516 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 03:43:38.894780 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:38.894530 2548 projected.go:196] Error preparing data for projected volume kube-api-access-h8bcs for pod openshift-network-diagnostics/network-check-target-tx8nn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:43:38.894780 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:38.894540 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f15442b9-7c90-4861-8089-8084f3784bf6-metrics-certs podName:f15442b9-7c90-4861-8089-8084f3784bf6 nodeName:}" failed. No retries permitted until 2026-06-05 03:43:54.894517088 +0000 UTC m=+34.164293402 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f15442b9-7c90-4861-8089-8084f3784bf6-metrics-certs") pod "network-metrics-daemon-7fqv9" (UID: "f15442b9-7c90-4861-8089-8084f3784bf6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:43:38.894780 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:38.894573 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5dab8672-15ed-4938-b29c-75a0ed4e517d-kube-api-access-h8bcs podName:5dab8672-15ed-4938-b29c-75a0ed4e517d nodeName:}" failed. No retries permitted until 2026-06-05 03:43:54.894562588 +0000 UTC m=+34.164338887 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-h8bcs" (UniqueName: "kubernetes.io/projected/5dab8672-15ed-4938-b29c-75a0ed4e517d-kube-api-access-h8bcs") pod "network-check-target-tx8nn" (UID: "5dab8672-15ed-4938-b29c-75a0ed4e517d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:43:38.995324 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:38.995290 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e00145e-4995-452b-998a-fbf922eb164b-original-pull-secret\") pod \"global-pull-secret-syncer-q9df4\" (UID: \"8e00145e-4995-452b-998a-fbf922eb164b\") " pod="kube-system/global-pull-secret-syncer-q9df4" Jun 05 03:43:38.995515 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:38.995413 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 03:43:38.995515 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:38.995499 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e00145e-4995-452b-998a-fbf922eb164b-original-pull-secret podName:8e00145e-4995-452b-998a-fbf922eb164b nodeName:}" failed. No retries permitted until 2026-06-05 03:43:54.995481496 +0000 UTC m=+34.265257807 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e00145e-4995-452b-998a-fbf922eb164b-original-pull-secret") pod "global-pull-secret-syncer-q9df4" (UID: "8e00145e-4995-452b-998a-fbf922eb164b") : object "kube-system"/"original-pull-secret" not registered Jun 05 03:43:39.223318 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:39.223234 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tx8nn" Jun 05 03:43:39.223318 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:39.223288 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:43:39.223567 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:39.223239 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9df4" Jun 05 03:43:39.223567 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:39.223380 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tx8nn" podUID="5dab8672-15ed-4938-b29c-75a0ed4e517d" Jun 05 03:43:39.223567 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:39.223532 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fqv9" podUID="f15442b9-7c90-4861-8089-8084f3784bf6" Jun 05 03:43:39.223696 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:39.223623 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q9df4" podUID="8e00145e-4995-452b-998a-fbf922eb164b" Jun 05 03:43:41.223376 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:41.223341 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:43:41.223939 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:41.223465 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9df4" Jun 05 03:43:41.223939 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:41.223505 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tx8nn" Jun 05 03:43:41.223939 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:41.223513 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fqv9" podUID="f15442b9-7c90-4861-8089-8084f3784bf6" Jun 05 03:43:41.223939 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:41.223576 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tx8nn" podUID="5dab8672-15ed-4938-b29c-75a0ed4e517d" Jun 05 03:43:41.223939 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:41.223664 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q9df4" podUID="8e00145e-4995-452b-998a-fbf922eb164b" Jun 05 03:43:43.223129 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:43.222955 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9df4" Jun 05 03:43:43.223598 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:43.222969 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tx8nn" Jun 05 03:43:43.223598 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:43.223207 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q9df4" podUID="8e00145e-4995-452b-998a-fbf922eb164b" Jun 05 03:43:43.223598 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:43.223005 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:43:43.223598 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:43.223285 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tx8nn" podUID="5dab8672-15ed-4938-b29c-75a0ed4e517d" Jun 05 03:43:43.223598 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:43.223365 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fqv9" podUID="f15442b9-7c90-4861-8089-8084f3784bf6" Jun 05 03:43:43.316796 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:43.316770 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" event={"ID":"c3351fdf-83ad-4dcd-93d9-798d33f0742e","Type":"ContainerStarted","Data":"edfae777cf618aa341acf35ffaa364bb532f74f316a642b4ecff985802ebdd42"} Jun 05 03:43:43.319505 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:43.319228 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grkjm" event={"ID":"e613e69d-cdca-4b90-8d23-ac1d27658278","Type":"ContainerStarted","Data":"cc384bdb83c65f993d89b96805dd7cf5c7b96e8aaba982ad65546330ce52a02b"} Jun 05 03:43:43.320881 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:43.320850 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w4d7w" event={"ID":"f52355f5-a3a3-41a7-a7b4-1cc79455252c","Type":"ContainerStarted","Data":"04a38181a7d8aa1af72589507eb1721ed67e6fdd3fdef1c3888e62b5880a7e65"} Jun 05 03:43:43.322409 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:43.322383 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dtx66" event={"ID":"eb3edaa5-bb4c-4a42-9388-0ecb2db9c42e","Type":"ContainerStarted","Data":"80f0a81e16e3308338ebf63a1bfdf09c44b1919cffd9630ff1e2628c5e655821"} Jun 05 03:43:43.324370 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:43.324350 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" event={"ID":"9139fc4f-a2c4-4323-aac8-55b73d33aba2","Type":"ContainerStarted","Data":"2b4eccba2b44bf6b67b5f1b1a32d60f9cd5dea2e4f814fae56b6e3150c4890fa"} Jun 05 03:43:43.324487 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:43.324416 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" event={"ID":"9139fc4f-a2c4-4323-aac8-55b73d33aba2","Type":"ContainerStarted","Data":"520ad39e07c1a1640144f2847223fbc15dc8de9048ed72d0b4db418c02bbdb32"} Jun 05 03:43:43.325931 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:43.325904 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8lg5x" event={"ID":"0707e72d-344a-483e-910d-fa1ccfc535db","Type":"ContainerStarted","Data":"bf79e2d2ca3025098f1f2251ef284c758dc4d3c391e4e6885057db0c5a7e99f9"} Jun 05 03:43:43.327702 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:43.327682 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cpmtr" event={"ID":"84e6b26c-cb84-463b-ab01-0bac0e2c8096","Type":"ContainerStarted","Data":"ccbf436d105b5ef6622c6fbfe7e646465faeb83d31011b1bed913bb67b06ce1a"} Jun 05 03:43:43.329913 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:43.329892 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nfv6x" event={"ID":"5986d90f-3a60-4e38-b15f-cc0c69c89abf","Type":"ContainerStarted","Data":"9c8380c8ef1161365a6cfd8687446333f2d4f892d0f38014343d4e5da8a89a98"} Jun 05 03:43:43.334182 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:43.334142 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-53.ec2.internal" podStartSLOduration=21.334125949 podStartE2EDuration="21.334125949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:43:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:43:26.294994304 +0000 UTC m=+5.564770617" watchObservedRunningTime="2026-06-05 03:43:43.334125949 +0000 UTC m=+22.603902262" Jun 05 03:43:43.334389 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:43.334366 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-k5sbh" podStartSLOduration=3.4767325700000002 podStartE2EDuration="22.334360605s" totalImagesPullingTime="18.857628035s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:43:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:43:43.333952893 +0000 UTC m=+22.603729211" watchObservedRunningTime="2026-06-05 03:43:43.334360605 +0000 UTC m=+22.604136922" Jun 05 03:43:43.346211 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:43.346160 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dtx66" podStartSLOduration=3.4922194859999998 podStartE2EDuration="22.346145021s" totalImagesPullingTime="18.853925535s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:43:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:43:43.345901245 +0000 UTC m=+22.615677564" watchObservedRunningTime="2026-06-05 03:43:43.346145021 +0000 UTC m=+22.615921339" Jun 05 03:43:43.364725 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:43.364681 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8lg5x" podStartSLOduration=3.4713799180000002 podStartE2EDuration="22.364665324s" totalImagesPullingTime="18.893285406s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:43:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:43:43.364229451 +0000 UTC m=+22.634005770" watchObservedRunningTime="2026-06-05 03:43:43.364665324 +0000 UTC m=+22.634441641" Jun 05 03:43:43.396686 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:43.396638 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nfv6x" podStartSLOduration=3.512066687 podStartE2EDuration="22.396622072s" totalImagesPullingTime="18.884555385s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:43:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:43:43.396172741 +0000 UTC m=+22.665949059" watchObservedRunningTime="2026-06-05 03:43:43.396622072 +0000 UTC m=+22.666398390" Jun 05 03:43:43.409902 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:43.409854 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-w4d7w" podStartSLOduration=8.055809364 podStartE2EDuration="22.409842699s" totalImagesPullingTime="14.354033335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:43:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:43:43.409349412 +0000 UTC m=+22.679125730" watchObservedRunningTime="2026-06-05 03:43:43.409842699 +0000 UTC m=+22.679619016" Jun 05 03:43:43.506831 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:43.506798 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w4d7w_f52355f5-a3a3-41a7-a7b4-1cc79455252c/konnectivity-agent/0.log" limit=1024 Jun 05 03:43:43.584129 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:43.583896 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w4d7w_f52355f5-a3a3-41a7-a7b4-1cc79455252c/konnectivity-agent/0.log" limit=1024 Jun 05 03:43:44.095612 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:44.095584 2548 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 05 03:43:44.223605 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:44.223508 2548 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-05T03:43:44.095608197Z","UUID":"e80a7f69-c51c-404f-92dd-1a8706a71bf0","Handler":null,"Name":"","Endpoint":""} Jun 05 03:43:44.224852 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:44.224834 2548 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 05 03:43:44.224924 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:44.224869 2548 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 05 03:43:44.333317 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:44.333272 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j78s9" event={"ID":"c60eea31-0868-440b-94cc-32ccbb82a29e","Type":"ContainerStarted","Data":"6067b01f5c2476a228ddabd490da63c3cbf2072b56bc825f10ec2f508546d364"} Jun 05 03:43:44.335950 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:44.335927 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whn2g_9139fc4f-a2c4-4323-aac8-55b73d33aba2/ovn-acl-logging/0.log" Jun 05 03:43:44.336258 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:44.336234 2548 generic.go:356] "Generic (PLEG): container finished" podID="9139fc4f-a2c4-4323-aac8-55b73d33aba2" containerID="2b4eccba2b44bf6b67b5f1b1a32d60f9cd5dea2e4f814fae56b6e3150c4890fa" exitCode=1 Jun 05 03:43:44.336356 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:44.336293 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" event={"ID":"9139fc4f-a2c4-4323-aac8-55b73d33aba2","Type":"ContainerDied","Data":"2b4eccba2b44bf6b67b5f1b1a32d60f9cd5dea2e4f814fae56b6e3150c4890fa"} Jun 05 03:43:44.336413 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:44.336357 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" event={"ID":"9139fc4f-a2c4-4323-aac8-55b73d33aba2","Type":"ContainerStarted","Data":"62f6a3b9441ec05ce323774c90c62bee9e2c73f90038540e50cca0a8fb98e042"} Jun 05 03:43:44.336413 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:44.336390 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" event={"ID":"9139fc4f-a2c4-4323-aac8-55b73d33aba2","Type":"ContainerStarted","Data":"3e081f670e37b42882881b41a2ccc547f14ad2a1dd4c306a86e6b32192e8ed45"} Jun 05 03:43:44.336540 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:44.336452 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" event={"ID":"9139fc4f-a2c4-4323-aac8-55b73d33aba2","Type":"ContainerStarted","Data":"22d87bb6bff1207605cb3acfb95b027629769d5fb012e7670a3f41438ee94ffd"} Jun 05 03:43:44.336540 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:44.336487 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" event={"ID":"9139fc4f-a2c4-4323-aac8-55b73d33aba2","Type":"ContainerStarted","Data":"f996d0b5c1d277f255ecc60a9e0e70f65cc994f7a6408701e438045cc82c6495"} Jun 05 03:43:44.337722 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:44.337702 2548 generic.go:356] "Generic (PLEG): container finished" podID="84e6b26c-cb84-463b-ab01-0bac0e2c8096" containerID="ccbf436d105b5ef6622c6fbfe7e646465faeb83d31011b1bed913bb67b06ce1a" exitCode=0 Jun 05 03:43:44.337809 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:44.337771 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cpmtr" event={"ID":"84e6b26c-cb84-463b-ab01-0bac0e2c8096","Type":"ContainerDied","Data":"ccbf436d105b5ef6622c6fbfe7e646465faeb83d31011b1bed913bb67b06ce1a"} Jun 05 03:43:44.339471 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:44.339447 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grkjm" event={"ID":"e613e69d-cdca-4b90-8d23-ac1d27658278","Type":"ContainerStarted","Data":"d8ae093804175471fd124058e72101ac210dddb4d3772df9f287a670d3c3dec5"} Jun 05 03:43:44.367547 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:44.367501 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-j78s9" podStartSLOduration=4.543006355 podStartE2EDuration="23.367487123s" totalImagesPullingTime="18.824480768s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:43:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:43:44.348360966 +0000 UTC m=+23.618137278" watchObservedRunningTime="2026-06-05 03:43:44.367487123 +0000 UTC m=+23.637263440" Jun 05 03:43:44.465380 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:44.465299 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w4d7w_f52355f5-a3a3-41a7-a7b4-1cc79455252c/konnectivity-agent/0.log" limit=1024 Jun 05 03:43:44.526418 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:44.526385 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w4d7w_f52355f5-a3a3-41a7-a7b4-1cc79455252c/konnectivity-agent/0.log" limit=1024 Jun 05 03:43:45.222770 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:45.222686 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9df4" Jun 05 03:43:45.222938 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:45.222686 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tx8nn" Jun 05 03:43:45.222938 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:45.222824 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:43:45.222938 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:45.222823 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q9df4" podUID="8e00145e-4995-452b-998a-fbf922eb164b" Jun 05 03:43:45.222938 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:45.222904 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tx8nn" podUID="5dab8672-15ed-4938-b29c-75a0ed4e517d" Jun 05 03:43:45.223140 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:45.222959 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fqv9" podUID="f15442b9-7c90-4861-8089-8084f3784bf6" Jun 05 03:43:45.344476 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:45.344420 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grkjm" event={"ID":"e613e69d-cdca-4b90-8d23-ac1d27658278","Type":"ContainerStarted","Data":"fca8ee05ca9309035055c1f6a0089780629995eb0fd9952887f90eddd5bbc034"} Jun 05 03:43:45.361297 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:45.361251 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grkjm" podStartSLOduration=3.870660203 podStartE2EDuration="24.361236626s" totalImagesPullingTime="20.490576423s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:43:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:43:45.361065878 +0000 UTC m=+24.630842199" watchObservedRunningTime="2026-06-05 03:43:45.361236626 +0000 UTC m=+24.631012943" Jun 05 03:43:45.510818 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:45.510786 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w4d7w_f52355f5-a3a3-41a7-a7b4-1cc79455252c/konnectivity-agent/0.log" limit=1024 Jun 05 03:43:45.565637 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:45.565601 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w4d7w_f52355f5-a3a3-41a7-a7b4-1cc79455252c/konnectivity-agent/0.log" limit=1024 Jun 05 03:43:45.849169 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:45.848964 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-w4d7w" Jun 05 03:43:45.849570 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:45.849551 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-w4d7w" Jun 05 03:43:46.350706 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:46.350677 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whn2g_9139fc4f-a2c4-4323-aac8-55b73d33aba2/ovn-acl-logging/0.log" Jun 05 03:43:46.351258 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:46.351115 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" event={"ID":"9139fc4f-a2c4-4323-aac8-55b73d33aba2","Type":"ContainerStarted","Data":"aad4e0bd942aa128ad0b5f28228e36772d26e1a979d2cdd8c0b2dbea9b280742"} Jun 05 03:43:46.351642 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:46.351618 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-w4d7w" Jun 05 03:43:46.351871 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:46.351853 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-w4d7w" Jun 05 03:43:46.408234 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:46.408193 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w4d7w_f52355f5-a3a3-41a7-a7b4-1cc79455252c/konnectivity-agent/0.log" limit=1024 Jun 05 03:43:47.222821 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:47.222786 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tx8nn" Jun 05 03:43:47.222821 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:47.222827 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:43:47.223074 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:47.222913 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tx8nn" podUID="5dab8672-15ed-4938-b29c-75a0ed4e517d" Jun 05 03:43:47.223074 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:47.222958 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9df4" Jun 05 03:43:47.223184 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:47.223065 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fqv9" podUID="f15442b9-7c90-4861-8089-8084f3784bf6" Jun 05 03:43:47.223184 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:47.223156 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q9df4" podUID="8e00145e-4995-452b-998a-fbf922eb164b" Jun 05 03:43:48.360651 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:48.360373 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whn2g_9139fc4f-a2c4-4323-aac8-55b73d33aba2/ovn-acl-logging/0.log" Jun 05 03:43:48.361425 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:48.361173 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" event={"ID":"9139fc4f-a2c4-4323-aac8-55b73d33aba2","Type":"ContainerStarted","Data":"6e6f36164fbb2d7b638f2dd11faadd0d41bd7d66c714e8c248c771fa2bfe7e01"} Jun 05 03:43:48.364824 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:48.361958 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:48.364824 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:48.362019 2548 scope.go:117] "RemoveContainer" containerID="2b4eccba2b44bf6b67b5f1b1a32d60f9cd5dea2e4f814fae56b6e3150c4890fa" Jun 05 03:43:48.364824 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:48.362064 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:48.367847 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:48.367820 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cpmtr" event={"ID":"84e6b26c-cb84-463b-ab01-0bac0e2c8096","Type":"ContainerStarted","Data":"32e66e004bfc2e8bcc6b613fb77984241d45332418730ad562a6cc18f53d8374"} Jun 05 03:43:48.383390 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:48.383366 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:48.383665 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:48.383640 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:48.440172 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:48.440062 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w4d7w_f52355f5-a3a3-41a7-a7b4-1cc79455252c/konnectivity-agent/0.log" limit=1024 Jun 05 03:43:48.490404 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:48.490365 2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w4d7w_f52355f5-a3a3-41a7-a7b4-1cc79455252c/konnectivity-agent/0.log" limit=1024 Jun 05 03:43:48.772447 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:48.772408 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:43:49.223392 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:49.223352 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tx8nn" Jun 05 03:43:49.223551 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:49.223352 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:43:49.223551 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:49.223488 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tx8nn" podUID="5dab8672-15ed-4938-b29c-75a0ed4e517d" Jun 05 03:43:49.223644 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:49.223352 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9df4" Jun 05 03:43:49.223644 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:49.223583 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fqv9" podUID="f15442b9-7c90-4861-8089-8084f3784bf6" Jun 05 03:43:49.223644 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:49.223621 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q9df4" podUID="8e00145e-4995-452b-998a-fbf922eb164b" Jun 05 03:43:49.374646 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:49.374612 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whn2g_9139fc4f-a2c4-4323-aac8-55b73d33aba2/ovn-acl-logging/0.log" Jun 05 03:43:49.375108 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:49.375064 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" event={"ID":"9139fc4f-a2c4-4323-aac8-55b73d33aba2","Type":"ContainerStarted","Data":"8a89a5d37f64be3a1232f1db8c7ccf1ea4f7c9211a859d132f2e29b352eb0b28"} Jun 05 03:43:49.376993 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:49.376966 2548 generic.go:356] "Generic (PLEG): container finished" podID="84e6b26c-cb84-463b-ab01-0bac0e2c8096" containerID="32e66e004bfc2e8bcc6b613fb77984241d45332418730ad562a6cc18f53d8374" exitCode=0 Jun 05 03:43:49.377124 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:49.377022 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cpmtr" event={"ID":"84e6b26c-cb84-463b-ab01-0bac0e2c8096","Type":"ContainerDied","Data":"32e66e004bfc2e8bcc6b613fb77984241d45332418730ad562a6cc18f53d8374"} Jun 05 03:43:49.402694 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:49.402572 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" podStartSLOduration=9.479825911 podStartE2EDuration="28.402556229s" totalImagesPullingTime="18.922730318s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:43:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:43:49.401111303 +0000 UTC m=+28.670887620" watchObservedRunningTime="2026-06-05 03:43:49.402556229 +0000 UTC m=+28.672332547" Jun 05 03:43:50.142795 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:50.142576 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q9df4"] Jun 05 03:43:50.142951 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:50.142928 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9df4" Jun 05 03:43:50.143064 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:50.143044 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q9df4" podUID="8e00145e-4995-452b-998a-fbf922eb164b" Jun 05 03:43:50.147152 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:50.147123 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7fqv9"] Jun 05 03:43:50.147292 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:50.147269 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:43:50.147411 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:50.147389 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fqv9" podUID="f15442b9-7c90-4861-8089-8084f3784bf6" Jun 05 03:43:50.147798 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:50.147778 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tx8nn"] Jun 05 03:43:50.147895 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:50.147876 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tx8nn" Jun 05 03:43:50.147983 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:50.147965 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tx8nn" podUID="5dab8672-15ed-4938-b29c-75a0ed4e517d" Jun 05 03:43:50.381366 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:50.381332 2548 generic.go:356] "Generic (PLEG): container finished" podID="84e6b26c-cb84-463b-ab01-0bac0e2c8096" containerID="a2eb656017b568f025ec208515dc2cf47e1463ba90e3722750faeeb0caca4889" exitCode=0 Jun 05 03:43:50.381739 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:50.381407 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cpmtr" event={"ID":"84e6b26c-cb84-463b-ab01-0bac0e2c8096","Type":"ContainerDied","Data":"a2eb656017b568f025ec208515dc2cf47e1463ba90e3722750faeeb0caca4889"} Jun 05 03:43:51.385511 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:51.385479 2548 generic.go:356] "Generic (PLEG): container finished" podID="84e6b26c-cb84-463b-ab01-0bac0e2c8096" containerID="7b15dc9e01a3d257e7676ecec9df6933e2d7973939f129f9940b45e438fb18f1" exitCode=0 Jun 05 03:43:51.385511 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:51.385516 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cpmtr" event={"ID":"84e6b26c-cb84-463b-ab01-0bac0e2c8096","Type":"ContainerDied","Data":"7b15dc9e01a3d257e7676ecec9df6933e2d7973939f129f9940b45e438fb18f1"} Jun 05 03:43:52.223077 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:52.223046 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:43:52.223267 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:52.223092 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9df4" Jun 05 03:43:52.223267 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:52.223164 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tx8nn" Jun 05 03:43:52.223267 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:52.223181 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fqv9" podUID="f15442b9-7c90-4861-8089-8084f3784bf6" Jun 05 03:43:52.223267 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:52.223256 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q9df4" podUID="8e00145e-4995-452b-998a-fbf922eb164b" Jun 05 03:43:52.223495 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:52.223335 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tx8nn" podUID="5dab8672-15ed-4938-b29c-75a0ed4e517d" Jun 05 03:43:54.223216 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:54.223186 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:43:54.223942 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:54.223316 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fqv9" podUID="f15442b9-7c90-4861-8089-8084f3784bf6" Jun 05 03:43:54.223942 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:54.223350 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tx8nn" Jun 05 03:43:54.223942 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:54.223366 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9df4" Jun 05 03:43:54.223942 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:54.223423 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tx8nn" podUID="5dab8672-15ed-4938-b29c-75a0ed4e517d" Jun 05 03:43:54.224172 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:54.224138 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q9df4" podUID="8e00145e-4995-452b-998a-fbf922eb164b" Jun 05 03:43:54.913846 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:54.913808 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f15442b9-7c90-4861-8089-8084f3784bf6-metrics-certs\") pod \"network-metrics-daemon-7fqv9\" (UID: \"f15442b9-7c90-4861-8089-8084f3784bf6\") " pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:43:54.914103 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:54.913894 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8bcs\" (UniqueName: \"kubernetes.io/projected/5dab8672-15ed-4938-b29c-75a0ed4e517d-kube-api-access-h8bcs\") pod \"network-check-target-tx8nn\" (UID: \"5dab8672-15ed-4938-b29c-75a0ed4e517d\") " pod="openshift-network-diagnostics/network-check-target-tx8nn" Jun 05 03:43:54.914103 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:54.913942 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:43:54.914103 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:54.914024 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f15442b9-7c90-4861-8089-8084f3784bf6-metrics-certs podName:f15442b9-7c90-4861-8089-8084f3784bf6 nodeName:}" failed. No retries permitted until 2026-06-05 03:44:26.914005695 +0000 UTC m=+66.183781994 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f15442b9-7c90-4861-8089-8084f3784bf6-metrics-certs") pod "network-metrics-daemon-7fqv9" (UID: "f15442b9-7c90-4861-8089-8084f3784bf6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:43:54.914103 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:54.914056 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 03:43:54.914103 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:54.914078 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 03:43:54.914103 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:54.914089 2548 projected.go:196] Error preparing data for projected volume kube-api-access-h8bcs for pod openshift-network-diagnostics/network-check-target-tx8nn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:43:54.914371 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:54.914142 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5dab8672-15ed-4938-b29c-75a0ed4e517d-kube-api-access-h8bcs podName:5dab8672-15ed-4938-b29c-75a0ed4e517d nodeName:}" failed. No retries permitted until 2026-06-05 03:44:26.914127537 +0000 UTC m=+66.183903857 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-h8bcs" (UniqueName: "kubernetes.io/projected/5dab8672-15ed-4938-b29c-75a0ed4e517d-kube-api-access-h8bcs") pod "network-check-target-tx8nn" (UID: "5dab8672-15ed-4938-b29c-75a0ed4e517d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:43:55.014556 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:55.014514 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e00145e-4995-452b-998a-fbf922eb164b-original-pull-secret\") pod \"global-pull-secret-syncer-q9df4\" (UID: \"8e00145e-4995-452b-998a-fbf922eb164b\") " pod="kube-system/global-pull-secret-syncer-q9df4" Jun 05 03:43:55.014769 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:55.014698 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 03:43:55.014844 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:55.014775 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e00145e-4995-452b-998a-fbf922eb164b-original-pull-secret podName:8e00145e-4995-452b-998a-fbf922eb164b nodeName:}" failed. No retries permitted until 2026-06-05 03:44:27.014751916 +0000 UTC m=+66.284528235 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e00145e-4995-452b-998a-fbf922eb164b-original-pull-secret") pod "global-pull-secret-syncer-q9df4" (UID: "8e00145e-4995-452b-998a-fbf922eb164b") : object "kube-system"/"original-pull-secret" not registered Jun 05 03:43:56.045141 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.045119 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-53.ec2.internal" event="NodeReady" Jun 05 03:43:56.045582 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.045251 2548 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 05 03:43:56.085650 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.085620 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mhbhg"] Jun 05 03:43:56.105736 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.105704 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5lqng"] Jun 05 03:43:56.105864 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.105830 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mhbhg" Jun 05 03:43:56.108337 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.108306 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 05 03:43:56.108337 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.108323 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 05 03:43:56.108337 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.108332 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q4t6d\"" Jun 05 03:43:56.121780 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.121707 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mhbhg"] Jun 05 03:43:56.121780 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.121751 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5lqng"] Jun 05 03:43:56.121953 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.121828 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5lqng" Jun 05 03:43:56.124150 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.124126 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-phxs2\"" Jun 05 03:43:56.124150 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.124134 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 05 03:43:56.124373 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.124135 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 05 03:43:56.124373 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.124136 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 05 03:43:56.223321 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.223296 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tx8nn" Jun 05 03:43:56.223516 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.223301 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:43:56.223588 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.223404 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9df4" Jun 05 03:43:56.225782 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.225760 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-tmp-dir\") pod \"dns-default-mhbhg\" (UID: \"f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce\") " pod="openshift-dns/dns-default-mhbhg" Jun 05 03:43:56.225892 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.225795 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wr82\" (UniqueName: \"kubernetes.io/projected/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-kube-api-access-6wr82\") pod \"dns-default-mhbhg\" (UID: \"f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce\") " pod="openshift-dns/dns-default-mhbhg" Jun 05 03:43:56.225892 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.225829 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-config-volume\") pod \"dns-default-mhbhg\" (UID: \"f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce\") " pod="openshift-dns/dns-default-mhbhg" Jun 05 03:43:56.225892 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.225847 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-metrics-tls\") pod \"dns-default-mhbhg\" (UID: \"f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce\") " pod="openshift-dns/dns-default-mhbhg" Jun 05 03:43:56.226061 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.225918 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d85ffe46-0e4f-4c48-bcf1-f56d2f0fb4ef-cert\") pod \"ingress-canary-5lqng\" (UID: \"d85ffe46-0e4f-4c48-bcf1-f56d2f0fb4ef\") " pod="openshift-ingress-canary/ingress-canary-5lqng" Jun 05 03:43:56.226061 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.225942 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdbbn\" (UniqueName: \"kubernetes.io/projected/d85ffe46-0e4f-4c48-bcf1-f56d2f0fb4ef-kube-api-access-fdbbn\") pod \"ingress-canary-5lqng\" (UID: \"d85ffe46-0e4f-4c48-bcf1-f56d2f0fb4ef\") " pod="openshift-ingress-canary/ingress-canary-5lqng" Jun 05 03:43:56.226239 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.226221 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 03:43:56.226314 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.226239 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 03:43:56.226377 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.226343 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k7rr7\"" Jun 05 03:43:56.226450 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.226425 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 03:43:56.226506 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.226499 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 03:43:56.226558 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.226514 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-45r96\"" Jun 05 03:43:56.327316 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.327276 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-tmp-dir\") pod \"dns-default-mhbhg\" (UID: \"f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce\") " pod="openshift-dns/dns-default-mhbhg" Jun 05 03:43:56.327316 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.327317 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wr82\" (UniqueName: \"kubernetes.io/projected/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-kube-api-access-6wr82\") pod \"dns-default-mhbhg\" (UID: \"f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce\") " pod="openshift-dns/dns-default-mhbhg" Jun 05 03:43:56.327596 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.327368 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-config-volume\") pod \"dns-default-mhbhg\" (UID: \"f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce\") " pod="openshift-dns/dns-default-mhbhg" Jun 05 03:43:56.327596 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.327385 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-metrics-tls\") pod \"dns-default-mhbhg\" (UID: \"f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce\") " pod="openshift-dns/dns-default-mhbhg" Jun 05 03:43:56.327596 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.327421 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d85ffe46-0e4f-4c48-bcf1-f56d2f0fb4ef-cert\") pod \"ingress-canary-5lqng\" (UID: \"d85ffe46-0e4f-4c48-bcf1-f56d2f0fb4ef\") " pod="openshift-ingress-canary/ingress-canary-5lqng" Jun 05 03:43:56.327596 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.327465 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdbbn\" (UniqueName: \"kubernetes.io/projected/d85ffe46-0e4f-4c48-bcf1-f56d2f0fb4ef-kube-api-access-fdbbn\") pod \"ingress-canary-5lqng\" (UID: \"d85ffe46-0e4f-4c48-bcf1-f56d2f0fb4ef\") " pod="openshift-ingress-canary/ingress-canary-5lqng" Jun 05 03:43:56.327596 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:56.327561 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 03:43:56.327878 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:56.327639 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-metrics-tls podName:f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce nodeName:}" failed. No retries permitted until 2026-06-05 03:43:56.827617648 +0000 UTC m=+36.097393948 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-metrics-tls") pod "dns-default-mhbhg" (UID: "f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce") : secret "dns-default-metrics-tls" not found Jun 05 03:43:56.327878 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.327830 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-tmp-dir\") pod \"dns-default-mhbhg\" (UID: \"f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce\") " pod="openshift-dns/dns-default-mhbhg" Jun 05 03:43:56.328262 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.328103 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-config-volume\") pod \"dns-default-mhbhg\" (UID: \"f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce\") " pod="openshift-dns/dns-default-mhbhg" Jun 05 03:43:56.331869 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.331848 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d85ffe46-0e4f-4c48-bcf1-f56d2f0fb4ef-cert\") pod \"ingress-canary-5lqng\" (UID: \"d85ffe46-0e4f-4c48-bcf1-f56d2f0fb4ef\") " pod="openshift-ingress-canary/ingress-canary-5lqng" Jun 05 03:43:56.336237 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.336219 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdbbn\" (UniqueName: \"kubernetes.io/projected/d85ffe46-0e4f-4c48-bcf1-f56d2f0fb4ef-kube-api-access-fdbbn\") pod \"ingress-canary-5lqng\" (UID: \"d85ffe46-0e4f-4c48-bcf1-f56d2f0fb4ef\") " pod="openshift-ingress-canary/ingress-canary-5lqng" Jun 05 03:43:56.336503 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.336484 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wr82\" (UniqueName: \"kubernetes.io/projected/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-kube-api-access-6wr82\") pod \"dns-default-mhbhg\" (UID: \"f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce\") " pod="openshift-dns/dns-default-mhbhg" Jun 05 03:43:56.402955 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.402846 2548 generic.go:356] "Generic (PLEG): container finished" podID="84e6b26c-cb84-463b-ab01-0bac0e2c8096" containerID="12006aaac2a0b3f245007eca456f1aa648237213b8b0975098344d8118a444b6" exitCode=0 Jun 05 03:43:56.402955 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.402886 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cpmtr" event={"ID":"84e6b26c-cb84-463b-ab01-0bac0e2c8096","Type":"ContainerDied","Data":"12006aaac2a0b3f245007eca456f1aa648237213b8b0975098344d8118a444b6"} Jun 05 03:43:56.429525 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.429490 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5lqng" Jun 05 03:43:56.615592 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.615551 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5lqng"] Jun 05 03:43:56.664322 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:43:56.664250 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd85ffe46_0e4f_4c48_bcf1_f56d2f0fb4ef.slice/crio-0e874a4ed8241e5e6db7db3f2d3b1954e8a112a02377baec18ccb2d8b657785b WatchSource:0}: Error finding container 0e874a4ed8241e5e6db7db3f2d3b1954e8a112a02377baec18ccb2d8b657785b: Status 404 returned error can't find the container with id 0e874a4ed8241e5e6db7db3f2d3b1954e8a112a02377baec18ccb2d8b657785b Jun 05 03:43:56.831806 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:56.831771 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-metrics-tls\") pod \"dns-default-mhbhg\" (UID: \"f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce\") " pod="openshift-dns/dns-default-mhbhg" Jun 05 03:43:56.831975 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:56.831932 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 03:43:56.832029 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:56.831998 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-metrics-tls podName:f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce nodeName:}" failed. No retries permitted until 2026-06-05 03:43:57.831982485 +0000 UTC m=+37.101758781 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-metrics-tls") pod "dns-default-mhbhg" (UID: "f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce") : secret "dns-default-metrics-tls" not found Jun 05 03:43:57.409075 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:57.409035 2548 generic.go:356] "Generic (PLEG): container finished" podID="84e6b26c-cb84-463b-ab01-0bac0e2c8096" containerID="eff85089c3a42c9e1732d4ef41692fad213a80f9d0d6c6c80aadb8ef5bbcc24c" exitCode=0 Jun 05 03:43:57.409560 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:57.409150 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cpmtr" event={"ID":"84e6b26c-cb84-463b-ab01-0bac0e2c8096","Type":"ContainerDied","Data":"eff85089c3a42c9e1732d4ef41692fad213a80f9d0d6c6c80aadb8ef5bbcc24c"} Jun 05 03:43:57.410468 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:57.410424 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5lqng" event={"ID":"d85ffe46-0e4f-4c48-bcf1-f56d2f0fb4ef","Type":"ContainerStarted","Data":"0e874a4ed8241e5e6db7db3f2d3b1954e8a112a02377baec18ccb2d8b657785b"} Jun 05 03:43:57.840208 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:57.839981 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-metrics-tls\") pod \"dns-default-mhbhg\" (UID: \"f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce\") " pod="openshift-dns/dns-default-mhbhg" Jun 05 03:43:57.840403 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:57.840127 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 03:43:57.840403 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:57.840296 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-metrics-tls podName:f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce nodeName:}" failed. No retries permitted until 2026-06-05 03:43:59.840278781 +0000 UTC m=+39.110055077 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-metrics-tls") pod "dns-default-mhbhg" (UID: "f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce") : secret "dns-default-metrics-tls" not found Jun 05 03:43:58.417673 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:58.417640 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cpmtr" event={"ID":"84e6b26c-cb84-463b-ab01-0bac0e2c8096","Type":"ContainerStarted","Data":"010b883aca3f146a75780ede6ff18265af747cc198b53f16d71fa67fe2e063a1"} Jun 05 03:43:58.441967 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:58.441913 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cpmtr" podStartSLOduration=9.170565353 podStartE2EDuration="37.441896849s" totalImagesPullingTime="28.271331496s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:43:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:43:58.441756548 +0000 UTC m=+37.711532868" watchObservedRunningTime="2026-06-05 03:43:58.441896849 +0000 UTC m=+37.711673166" Jun 05 03:43:59.424077 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:59.424038 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5lqng" event={"ID":"d85ffe46-0e4f-4c48-bcf1-f56d2f0fb4ef","Type":"ContainerStarted","Data":"085ecbd30e26a12a42a37fc0ee7d4a4371b2996db8fbe6584ba2ff354c9a4637"} Jun 05 03:43:59.441840 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:59.441794 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5lqng" podStartSLOduration=1.237387644 podStartE2EDuration="3.441781214s" totalImagesPullingTime="2.20439357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:43:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:43:59.440324877 +0000 UTC m=+38.710101205" watchObservedRunningTime="2026-06-05 03:43:59.441781214 +0000 UTC m=+38.711557532" Jun 05 03:43:59.855170 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:43:59.855114 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-metrics-tls\") pod \"dns-default-mhbhg\" (UID: \"f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce\") " pod="openshift-dns/dns-default-mhbhg" Jun 05 03:43:59.855352 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:59.855279 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 03:43:59.855416 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:43:59.855360 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-metrics-tls podName:f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce nodeName:}" failed. No retries permitted until 2026-06-05 03:44:03.855338116 +0000 UTC m=+43.125114430 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-metrics-tls") pod "dns-default-mhbhg" (UID: "f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce") : secret "dns-default-metrics-tls" not found Jun 05 03:44:03.883199 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:44:03.883155 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-metrics-tls\") pod \"dns-default-mhbhg\" (UID: \"f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce\") " pod="openshift-dns/dns-default-mhbhg" Jun 05 03:44:03.883821 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:44:03.883326 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 03:44:03.883821 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:44:03.883405 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-metrics-tls podName:f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce nodeName:}" failed. No retries permitted until 2026-06-05 03:44:11.8833847 +0000 UTC m=+51.153160999 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-metrics-tls") pod "dns-default-mhbhg" (UID: "f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce") : secret "dns-default-metrics-tls" not found Jun 05 03:44:11.938886 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:44:11.938847 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-metrics-tls\") pod \"dns-default-mhbhg\" (UID: \"f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce\") " pod="openshift-dns/dns-default-mhbhg" Jun 05 03:44:11.939423 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:44:11.939014 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 03:44:11.939423 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:44:11.939095 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-metrics-tls podName:f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce nodeName:}" failed. No retries permitted until 2026-06-05 03:44:27.93906665 +0000 UTC m=+67.208842947 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-metrics-tls") pod "dns-default-mhbhg" (UID: "f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce") : secret "dns-default-metrics-tls" not found Jun 05 03:44:20.392722 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:44:20.392695 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-whn2g" Jun 05 03:44:26.943830 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:44:26.943786 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8bcs\" (UniqueName: \"kubernetes.io/projected/5dab8672-15ed-4938-b29c-75a0ed4e517d-kube-api-access-h8bcs\") pod \"network-check-target-tx8nn\" (UID: \"5dab8672-15ed-4938-b29c-75a0ed4e517d\") " pod="openshift-network-diagnostics/network-check-target-tx8nn" Jun 05 03:44:26.944322 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:44:26.943851 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f15442b9-7c90-4861-8089-8084f3784bf6-metrics-certs\") pod \"network-metrics-daemon-7fqv9\" (UID: \"f15442b9-7c90-4861-8089-8084f3784bf6\") " pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:44:26.946654 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:44:26.946633 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 03:44:26.946940 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:44:26.946919 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 03:44:26.954085 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:44:26.954061 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 03:44:26.954181 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:44:26.954127 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f15442b9-7c90-4861-8089-8084f3784bf6-metrics-certs podName:f15442b9-7c90-4861-8089-8084f3784bf6 nodeName:}" failed. No retries permitted until 2026-06-05 03:45:30.954111409 +0000 UTC m=+130.223887708 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f15442b9-7c90-4861-8089-8084f3784bf6-metrics-certs") pod "network-metrics-daemon-7fqv9" (UID: "f15442b9-7c90-4861-8089-8084f3784bf6") : secret "metrics-daemon-secret" not found Jun 05 03:44:26.956337 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:44:26.956321 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 03:44:26.968928 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:44:26.968907 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8bcs\" (UniqueName: \"kubernetes.io/projected/5dab8672-15ed-4938-b29c-75a0ed4e517d-kube-api-access-h8bcs\") pod \"network-check-target-tx8nn\" (UID: \"5dab8672-15ed-4938-b29c-75a0ed4e517d\") " pod="openshift-network-diagnostics/network-check-target-tx8nn" Jun 05 03:44:27.044203 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:44:27.044168 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e00145e-4995-452b-998a-fbf922eb164b-original-pull-secret\") pod \"global-pull-secret-syncer-q9df4\" (UID: \"8e00145e-4995-452b-998a-fbf922eb164b\") " pod="kube-system/global-pull-secret-syncer-q9df4" Jun 05 03:44:27.047248 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:44:27.047231 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 03:44:27.056721 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:44:27.056692 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e00145e-4995-452b-998a-fbf922eb164b-original-pull-secret\") pod \"global-pull-secret-syncer-q9df4\" (UID: \"8e00145e-4995-452b-998a-fbf922eb164b\") " pod="kube-system/global-pull-secret-syncer-q9df4" Jun 05 03:44:27.136111 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:44:27.136077 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-45r96\"" Jun 05 03:44:27.143745 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:44:27.143715 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tx8nn" Jun 05 03:44:27.143821 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:44:27.143803 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q9df4" Jun 05 03:44:27.306006 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:44:27.305980 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tx8nn"] Jun 05 03:44:27.330484 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:44:27.330456 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q9df4"] Jun 05 03:44:27.333697 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:44:27.333623 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e00145e_4995_452b_998a_fbf922eb164b.slice/crio-555d67b5ba047f773ed441438b00191ad37610ab4e3b2f25c6908055e1c7de98 WatchSource:0}: Error finding container 555d67b5ba047f773ed441438b00191ad37610ab4e3b2f25c6908055e1c7de98: Status 404 returned error can't find the container with id 555d67b5ba047f773ed441438b00191ad37610ab4e3b2f25c6908055e1c7de98 Jun 05 03:44:27.492478 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:44:27.492379 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q9df4" event={"ID":"8e00145e-4995-452b-998a-fbf922eb164b","Type":"ContainerStarted","Data":"555d67b5ba047f773ed441438b00191ad37610ab4e3b2f25c6908055e1c7de98"} Jun 05 03:44:27.493370 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:44:27.493346 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tx8nn" event={"ID":"5dab8672-15ed-4938-b29c-75a0ed4e517d","Type":"ContainerStarted","Data":"b5f4be18748edec16040c30124104bf74a9cdc320a2dd2427a1bc3f172d4a211"} Jun 05 03:44:27.960133 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:44:27.960094 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-metrics-tls\") pod \"dns-default-mhbhg\" (UID: \"f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce\") " pod="openshift-dns/dns-default-mhbhg" Jun 05 03:44:27.960622 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:44:27.960231 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 03:44:27.960622 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:44:27.960291 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-metrics-tls podName:f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce nodeName:}" failed. No retries permitted until 2026-06-05 03:44:59.960272835 +0000 UTC m=+99.230049131 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-metrics-tls") pod "dns-default-mhbhg" (UID: "f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce") : secret "dns-default-metrics-tls" not found Jun 05 03:44:32.508873 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:44:32.508832 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q9df4" event={"ID":"8e00145e-4995-452b-998a-fbf922eb164b","Type":"ContainerStarted","Data":"d9e280f4d063b4e8fe7ad9f7638a46c19c5bd0dc8558e4482305c1d29020566c"} Jun 05 03:44:32.510338 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:44:32.510314 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tx8nn" event={"ID":"5dab8672-15ed-4938-b29c-75a0ed4e517d","Type":"ContainerStarted","Data":"94a12891a6adbd8be34b65ec97e6c3d9ccc0bd9365c59451bb9d9abf88eac74f"} Jun 05 03:44:32.510490 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:44:32.510365 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tx8nn" Jun 05 03:44:32.523806 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:44:32.523760 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-q9df4" podStartSLOduration=67.191564904 podStartE2EDuration="1m11.523749083s" totalImagesPullingTime="4.332184179s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:43:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:44:32.522638737 +0000 UTC m=+71.792415055" watchObservedRunningTime="2026-06-05 03:44:32.523749083 +0000 UTC m=+71.793525400" Jun 05 03:44:59.982446 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:44:59.982305 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-metrics-tls\") pod \"dns-default-mhbhg\" (UID: \"f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce\") " pod="openshift-dns/dns-default-mhbhg" Jun 05 03:44:59.982832 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:44:59.982475 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 03:44:59.982832 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:44:59.982547 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-metrics-tls podName:f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce nodeName:}" failed. No retries permitted until 2026-06-05 03:46:03.982531337 +0000 UTC m=+163.252307633 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-metrics-tls") pod "dns-default-mhbhg" (UID: "f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce") : secret "dns-default-metrics-tls" not found Jun 05 03:45:03.515018 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:45:03.514983 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tx8nn" Jun 05 03:45:03.531075 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:45:03.531013 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tx8nn" podStartSLOduration=98.178892888 podStartE2EDuration="1m42.530998057s" totalImagesPullingTime="4.352105169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:43:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:44:32.53661054 +0000 UTC m=+71.806386858" watchObservedRunningTime="2026-06-05 03:45:03.530998057 +0000 UTC m=+102.800774427" Jun 05 03:45:30.995091 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:45:30.995034 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f15442b9-7c90-4861-8089-8084f3784bf6-metrics-certs\") pod \"network-metrics-daemon-7fqv9\" (UID: \"f15442b9-7c90-4861-8089-8084f3784bf6\") " pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:45:30.995613 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:45:30.995172 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 03:45:30.995613 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:45:30.995237 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f15442b9-7c90-4861-8089-8084f3784bf6-metrics-certs podName:f15442b9-7c90-4861-8089-8084f3784bf6 nodeName:}" failed. No retries permitted until 2026-06-05 03:47:32.995221803 +0000 UTC m=+252.264998099 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f15442b9-7c90-4861-8089-8084f3784bf6-metrics-certs") pod "network-metrics-daemon-7fqv9" (UID: "f15442b9-7c90-4861-8089-8084f3784bf6") : secret "metrics-daemon-secret" not found Jun 05 03:45:59.122516 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:45:59.122473 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mhbhg" podUID="f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce" Jun 05 03:45:59.238451 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:45:59.238387 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-7fqv9" podUID="f15442b9-7c90-4861-8089-8084f3784bf6" Jun 05 03:45:59.719686 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:45:59.719657 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mhbhg" Jun 05 03:46:04.016951 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:46:04.016909 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-metrics-tls\") pod \"dns-default-mhbhg\" (UID: \"f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce\") " pod="openshift-dns/dns-default-mhbhg" Jun 05 03:46:04.017481 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:46:04.017100 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 03:46:04.017481 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:46:04.017202 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-metrics-tls podName:f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce nodeName:}" failed. No retries permitted until 2026-06-05 03:48:06.017175584 +0000 UTC m=+285.286951882 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-metrics-tls") pod "dns-default-mhbhg" (UID: "f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce") : secret "dns-default-metrics-tls" not found Jun 05 03:46:10.223254 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:46:10.223152 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:47:17.116381 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.116345 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-6tcdh"] Jun 05 03:47:17.119143 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.119116 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-6tcdh" Jun 05 03:47:17.120820 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.120798 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dwvgc"] Jun 05 03:47:17.121988 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.121966 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-n2hbr\"" Jun 05 03:47:17.122362 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.122154 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 05 03:47:17.122976 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.122722 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 05 03:47:17.126829 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.126809 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dwvgc" Jun 05 03:47:17.127667 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.127642 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rk9d"] Jun 05 03:47:17.130341 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.130323 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6b9cd897b-fx89g"] Jun 05 03:47:17.130457 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.130414 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 05 03:47:17.130527 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.130461 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rk9d" Jun 05 03:47:17.130527 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.130484 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-jsf9z\"" Jun 05 03:47:17.130527 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.130507 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 05 03:47:17.130674 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.130619 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 05 03:47:17.130734 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.130722 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 05 03:47:17.133039 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.133022 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" Jun 05 03:47:17.135537 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.135520 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 05 03:47:17.135614 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.135519 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 05 03:47:17.136008 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.135993 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-xvb6w\"" Jun 05 03:47:17.136323 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.136268 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 05 03:47:17.136938 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.136920 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6ccnq\"" Jun 05 03:47:17.137156 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.137140 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 05 03:47:17.138206 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.138187 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 05 03:47:17.138336 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.138208 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 05 03:47:17.141364 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.141345 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 05 03:47:17.141770 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.141754 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dwvgc"] Jun 05 03:47:17.145096 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.145046 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-6tcdh"] Jun 05 03:47:17.151601 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.151582 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b9cd897b-fx89g"] Jun 05 03:47:17.161290 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.161268 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rk9d"] Jun 05 03:47:17.213638 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.213598 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24hbh\" (UniqueName: \"kubernetes.io/projected/458ec980-45f2-4f75-933c-d383b83e09e5-kube-api-access-24hbh\") pod \"volume-data-source-validator-78dd696465-6tcdh\" (UID: \"458ec980-45f2-4f75-933c-d383b83e09e5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-6tcdh" Jun 05 03:47:17.213638 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.213638 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5f45f77e-672b-485c-a367-cf29229799e2-ca-trust-extracted\") pod \"image-registry-6b9cd897b-fx89g\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" Jun 05 03:47:17.213935 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.213664 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5f45f77e-672b-485c-a367-cf29229799e2-registry-certificates\") pod \"image-registry-6b9cd897b-fx89g\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" Jun 05 03:47:17.213935 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.213692 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqxr8\" (UniqueName: \"kubernetes.io/projected/ebd772ab-7759-4b30-aa65-584cb9a1d3ba-kube-api-access-bqxr8\") pod \"cluster-samples-operator-854f8b96b6-4rk9d\" (UID: \"ebd772ab-7759-4b30-aa65-584cb9a1d3ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rk9d" Jun 05 03:47:17.213935 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.213716 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp2d6\" (UniqueName: \"kubernetes.io/projected/c99614d1-0e51-4cda-b1c0-51b5b8a2fa88-kube-api-access-gp2d6\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-dwvgc\" (UID: \"c99614d1-0e51-4cda-b1c0-51b5b8a2fa88\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dwvgc" Jun 05 03:47:17.213935 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.213738 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ebd772ab-7759-4b30-aa65-584cb9a1d3ba-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4rk9d\" (UID: \"ebd772ab-7759-4b30-aa65-584cb9a1d3ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rk9d" Jun 05 03:47:17.213935 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.213790 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f45f77e-672b-485c-a367-cf29229799e2-bound-sa-token\") pod \"image-registry-6b9cd897b-fx89g\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" Jun 05 03:47:17.213935 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.213849 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5f45f77e-672b-485c-a367-cf29229799e2-image-registry-private-configuration\") pod \"image-registry-6b9cd897b-fx89g\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" Jun 05 03:47:17.213935 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.213873 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c99614d1-0e51-4cda-b1c0-51b5b8a2fa88-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-dwvgc\" (UID: \"c99614d1-0e51-4cda-b1c0-51b5b8a2fa88\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dwvgc" Jun 05 03:47:17.213935 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.213900 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f45f77e-672b-485c-a367-cf29229799e2-registry-tls\") pod \"image-registry-6b9cd897b-fx89g\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" Jun 05 03:47:17.213935 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.213920 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5f45f77e-672b-485c-a367-cf29229799e2-installation-pull-secrets\") pod \"image-registry-6b9cd897b-fx89g\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" Jun 05 03:47:17.214233 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.213947 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c99614d1-0e51-4cda-b1c0-51b5b8a2fa88-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-dwvgc\" (UID: \"c99614d1-0e51-4cda-b1c0-51b5b8a2fa88\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dwvgc" Jun 05 03:47:17.214233 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.213974 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5f45f77e-672b-485c-a367-cf29229799e2-trusted-ca\") pod \"image-registry-6b9cd897b-fx89g\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" Jun 05 03:47:17.214233 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.213998 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrtzg\" (UniqueName: \"kubernetes.io/projected/5f45f77e-672b-485c-a367-cf29229799e2-kube-api-access-qrtzg\") pod \"image-registry-6b9cd897b-fx89g\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" Jun 05 03:47:17.215915 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.215892 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7ttbz"] Jun 05 03:47:17.218863 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.218846 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7ttbz" Jun 05 03:47:17.221310 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.221292 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 05 03:47:17.222706 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.222687 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 05 03:47:17.222812 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.222686 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7xhzj\"" Jun 05 03:47:17.222812 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.222743 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 05 03:47:17.222812 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.222754 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 05 03:47:17.233937 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.233915 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7ttbz"] Jun 05 03:47:17.308266 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.308229 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-k2rfr"] Jun 05 03:47:17.311101 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.311086 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-k2rfr" Jun 05 03:47:17.313693 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.313669 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 05 03:47:17.313825 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.313672 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 05 03:47:17.313825 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.313675 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-6qgvj\"" Jun 05 03:47:17.313825 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.313679 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 05 03:47:17.313989 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.313976 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 05 03:47:17.314255 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.314237 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5f45f77e-672b-485c-a367-cf29229799e2-image-registry-private-configuration\") pod \"image-registry-6b9cd897b-fx89g\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" Jun 05 03:47:17.314331 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.314271 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c99614d1-0e51-4cda-b1c0-51b5b8a2fa88-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-dwvgc\" (UID: \"c99614d1-0e51-4cda-b1c0-51b5b8a2fa88\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dwvgc" Jun 05 03:47:17.314331 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.314301 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f45f77e-672b-485c-a367-cf29229799e2-registry-tls\") pod \"image-registry-6b9cd897b-fx89g\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" Jun 05 03:47:17.314452 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:17.314393 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 03:47:17.314452 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:17.314407 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b9cd897b-fx89g: secret "image-registry-tls" not found Jun 05 03:47:17.314452 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.314420 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5f45f77e-672b-485c-a367-cf29229799e2-installation-pull-secrets\") pod \"image-registry-6b9cd897b-fx89g\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" Jun 05 03:47:17.314609 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:17.314486 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f45f77e-672b-485c-a367-cf29229799e2-registry-tls podName:5f45f77e-672b-485c-a367-cf29229799e2 nodeName:}" failed. No retries permitted until 2026-06-05 03:47:17.814467937 +0000 UTC m=+237.084244233 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5f45f77e-672b-485c-a367-cf29229799e2-registry-tls") pod "image-registry-6b9cd897b-fx89g" (UID: "5f45f77e-672b-485c-a367-cf29229799e2") : secret "image-registry-tls" not found Jun 05 03:47:17.314609 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.314516 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c99614d1-0e51-4cda-b1c0-51b5b8a2fa88-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-dwvgc\" (UID: \"c99614d1-0e51-4cda-b1c0-51b5b8a2fa88\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dwvgc" Jun 05 03:47:17.314609 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.314558 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5f45f77e-672b-485c-a367-cf29229799e2-trusted-ca\") pod \"image-registry-6b9cd897b-fx89g\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" Jun 05 03:47:17.314609 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.314589 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrtzg\" (UniqueName: \"kubernetes.io/projected/5f45f77e-672b-485c-a367-cf29229799e2-kube-api-access-qrtzg\") pod \"image-registry-6b9cd897b-fx89g\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" Jun 05 03:47:17.314817 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.314620 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3b670160-bbf2-4468-98ee-55269506ff2a-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-7ttbz\" (UID: \"3b670160-bbf2-4468-98ee-55269506ff2a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7ttbz" Jun 05 03:47:17.314817 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.314658 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24hbh\" (UniqueName: \"kubernetes.io/projected/458ec980-45f2-4f75-933c-d383b83e09e5-kube-api-access-24hbh\") pod \"volume-data-source-validator-78dd696465-6tcdh\" (UID: \"458ec980-45f2-4f75-933c-d383b83e09e5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-6tcdh" Jun 05 03:47:17.314817 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.314684 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5f45f77e-672b-485c-a367-cf29229799e2-ca-trust-extracted\") pod \"image-registry-6b9cd897b-fx89g\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" Jun 05 03:47:17.314817 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.314714 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5f45f77e-672b-485c-a367-cf29229799e2-registry-certificates\") pod \"image-registry-6b9cd897b-fx89g\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" Jun 05 03:47:17.315008 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.314920 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c99614d1-0e51-4cda-b1c0-51b5b8a2fa88-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-dwvgc\" (UID: \"c99614d1-0e51-4cda-b1c0-51b5b8a2fa88\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dwvgc" Jun 05 03:47:17.315167 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.315139 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nzv2\" (UniqueName: \"kubernetes.io/projected/3b670160-bbf2-4468-98ee-55269506ff2a-kube-api-access-7nzv2\") pod \"cluster-monitoring-operator-74bbf69bbb-7ttbz\" (UID: \"3b670160-bbf2-4468-98ee-55269506ff2a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7ttbz" Jun 05 03:47:17.315464 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.315209 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5f45f77e-672b-485c-a367-cf29229799e2-ca-trust-extracted\") pod \"image-registry-6b9cd897b-fx89g\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" Jun 05 03:47:17.315464 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.315315 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqxr8\" (UniqueName: \"kubernetes.io/projected/ebd772ab-7759-4b30-aa65-584cb9a1d3ba-kube-api-access-bqxr8\") pod \"cluster-samples-operator-854f8b96b6-4rk9d\" (UID: \"ebd772ab-7759-4b30-aa65-584cb9a1d3ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rk9d" Jun 05 03:47:17.315464 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.315363 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp2d6\" (UniqueName: \"kubernetes.io/projected/c99614d1-0e51-4cda-b1c0-51b5b8a2fa88-kube-api-access-gp2d6\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-dwvgc\" (UID: \"c99614d1-0e51-4cda-b1c0-51b5b8a2fa88\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dwvgc" Jun 05 03:47:17.315464 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.315397 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ebd772ab-7759-4b30-aa65-584cb9a1d3ba-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4rk9d\" (UID: \"ebd772ab-7759-4b30-aa65-584cb9a1d3ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rk9d" Jun 05 03:47:17.315464 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.315421 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f45f77e-672b-485c-a367-cf29229799e2-bound-sa-token\") pod \"image-registry-6b9cd897b-fx89g\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" Jun 05 03:47:17.315783 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.315466 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b670160-bbf2-4468-98ee-55269506ff2a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7ttbz\" (UID: \"3b670160-bbf2-4468-98ee-55269506ff2a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7ttbz" Jun 05 03:47:17.316143 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:17.316119 2548 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 03:47:17.316143 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.316133 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5f45f77e-672b-485c-a367-cf29229799e2-trusted-ca\") pod \"image-registry-6b9cd897b-fx89g\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" Jun 05 03:47:17.316299 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:17.316178 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebd772ab-7759-4b30-aa65-584cb9a1d3ba-samples-operator-tls podName:ebd772ab-7759-4b30-aa65-584cb9a1d3ba nodeName:}" failed. No retries permitted until 2026-06-05 03:47:17.816162206 +0000 UTC m=+237.085938502 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ebd772ab-7759-4b30-aa65-584cb9a1d3ba-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-4rk9d" (UID: "ebd772ab-7759-4b30-aa65-584cb9a1d3ba") : secret "samples-operator-tls" not found Jun 05 03:47:17.316299 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.316225 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5f45f77e-672b-485c-a367-cf29229799e2-registry-certificates\") pod \"image-registry-6b9cd897b-fx89g\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" Jun 05 03:47:17.317293 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.317273 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c99614d1-0e51-4cda-b1c0-51b5b8a2fa88-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-dwvgc\" (UID: \"c99614d1-0e51-4cda-b1c0-51b5b8a2fa88\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dwvgc" Jun 05 03:47:17.317385 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.317297 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5f45f77e-672b-485c-a367-cf29229799e2-image-registry-private-configuration\") pod \"image-registry-6b9cd897b-fx89g\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" Jun 05 03:47:17.318094 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.318074 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5f45f77e-672b-485c-a367-cf29229799e2-installation-pull-secrets\") pod \"image-registry-6b9cd897b-fx89g\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" Jun 05 03:47:17.323308 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.323285 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 05 03:47:17.324091 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.324064 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-k2rfr"] Jun 05 03:47:17.329505 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.329474 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrtzg\" (UniqueName: \"kubernetes.io/projected/5f45f77e-672b-485c-a367-cf29229799e2-kube-api-access-qrtzg\") pod \"image-registry-6b9cd897b-fx89g\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" Jun 05 03:47:17.332062 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.332033 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqxr8\" (UniqueName: \"kubernetes.io/projected/ebd772ab-7759-4b30-aa65-584cb9a1d3ba-kube-api-access-bqxr8\") pod \"cluster-samples-operator-854f8b96b6-4rk9d\" (UID: \"ebd772ab-7759-4b30-aa65-584cb9a1d3ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rk9d" Jun 05 03:47:17.332137 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.332085 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24hbh\" (UniqueName: \"kubernetes.io/projected/458ec980-45f2-4f75-933c-d383b83e09e5-kube-api-access-24hbh\") pod \"volume-data-source-validator-78dd696465-6tcdh\" (UID: \"458ec980-45f2-4f75-933c-d383b83e09e5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-6tcdh" Jun 05 03:47:17.332286 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.332263 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f45f77e-672b-485c-a367-cf29229799e2-bound-sa-token\") pod \"image-registry-6b9cd897b-fx89g\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" Jun 05 03:47:17.332372 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.332310 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp2d6\" (UniqueName: \"kubernetes.io/projected/c99614d1-0e51-4cda-b1c0-51b5b8a2fa88-kube-api-access-gp2d6\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-dwvgc\" (UID: \"c99614d1-0e51-4cda-b1c0-51b5b8a2fa88\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dwvgc" Jun 05 03:47:17.416656 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.416564 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8c8c99-1a56-4948-9760-df876ce368b4-service-ca-bundle\") pod \"insights-operator-896549976-k2rfr\" (UID: \"1e8c8c99-1a56-4948-9760-df876ce368b4\") " pod="openshift-insights/insights-operator-896549976-k2rfr" Jun 05 03:47:17.416656 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.416612 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1e8c8c99-1a56-4948-9760-df876ce368b4-serving-cert\") pod \"insights-operator-896549976-k2rfr\" (UID: \"1e8c8c99-1a56-4948-9760-df876ce368b4\") " pod="openshift-insights/insights-operator-896549976-k2rfr" Jun 05 03:47:17.416857 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.416659 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l2jr\" (UniqueName: \"kubernetes.io/projected/1e8c8c99-1a56-4948-9760-df876ce368b4-kube-api-access-8l2jr\") pod \"insights-operator-896549976-k2rfr\" (UID: \"1e8c8c99-1a56-4948-9760-df876ce368b4\") " pod="openshift-insights/insights-operator-896549976-k2rfr" Jun 05 03:47:17.416857 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.416678 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3b670160-bbf2-4468-98ee-55269506ff2a-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-7ttbz\" (UID: \"3b670160-bbf2-4468-98ee-55269506ff2a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7ttbz" Jun 05 03:47:17.416857 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.416698 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nzv2\" (UniqueName: \"kubernetes.io/projected/3b670160-bbf2-4468-98ee-55269506ff2a-kube-api-access-7nzv2\") pod \"cluster-monitoring-operator-74bbf69bbb-7ttbz\" (UID: \"3b670160-bbf2-4468-98ee-55269506ff2a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7ttbz" Jun 05 03:47:17.416857 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.416723 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b670160-bbf2-4468-98ee-55269506ff2a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7ttbz\" (UID: \"3b670160-bbf2-4468-98ee-55269506ff2a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7ttbz" Jun 05 03:47:17.416857 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.416743 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8c8c99-1a56-4948-9760-df876ce368b4-trusted-ca-bundle\") pod \"insights-operator-896549976-k2rfr\" (UID: \"1e8c8c99-1a56-4948-9760-df876ce368b4\") " pod="openshift-insights/insights-operator-896549976-k2rfr" Jun 05 03:47:17.416857 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.416758 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e8c8c99-1a56-4948-9760-df876ce368b4-tmp\") pod \"insights-operator-896549976-k2rfr\" (UID: \"1e8c8c99-1a56-4948-9760-df876ce368b4\") " pod="openshift-insights/insights-operator-896549976-k2rfr" Jun 05 03:47:17.416857 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.416775 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1e8c8c99-1a56-4948-9760-df876ce368b4-snapshots\") pod \"insights-operator-896549976-k2rfr\" (UID: \"1e8c8c99-1a56-4948-9760-df876ce368b4\") " pod="openshift-insights/insights-operator-896549976-k2rfr" Jun 05 03:47:17.417176 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:17.416905 2548 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 03:47:17.417176 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:17.416993 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b670160-bbf2-4468-98ee-55269506ff2a-cluster-monitoring-operator-tls podName:3b670160-bbf2-4468-98ee-55269506ff2a nodeName:}" failed. No retries permitted until 2026-06-05 03:47:17.916971658 +0000 UTC m=+237.186747957 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3b670160-bbf2-4468-98ee-55269506ff2a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-7ttbz" (UID: "3b670160-bbf2-4468-98ee-55269506ff2a") : secret "cluster-monitoring-operator-tls" not found Jun 05 03:47:17.417360 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.417339 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3b670160-bbf2-4468-98ee-55269506ff2a-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-7ttbz\" (UID: \"3b670160-bbf2-4468-98ee-55269506ff2a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7ttbz" Jun 05 03:47:17.427134 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.427095 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nzv2\" (UniqueName: \"kubernetes.io/projected/3b670160-bbf2-4468-98ee-55269506ff2a-kube-api-access-7nzv2\") pod \"cluster-monitoring-operator-74bbf69bbb-7ttbz\" (UID: \"3b670160-bbf2-4468-98ee-55269506ff2a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7ttbz" Jun 05 03:47:17.432872 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.432854 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-6tcdh" Jun 05 03:47:17.439788 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.439768 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dwvgc" Jun 05 03:47:17.519208 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.517971 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e8c8c99-1a56-4948-9760-df876ce368b4-tmp\") pod \"insights-operator-896549976-k2rfr\" (UID: \"1e8c8c99-1a56-4948-9760-df876ce368b4\") " pod="openshift-insights/insights-operator-896549976-k2rfr" Jun 05 03:47:17.519208 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.518008 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1e8c8c99-1a56-4948-9760-df876ce368b4-snapshots\") pod \"insights-operator-896549976-k2rfr\" (UID: \"1e8c8c99-1a56-4948-9760-df876ce368b4\") " pod="openshift-insights/insights-operator-896549976-k2rfr" Jun 05 03:47:17.519208 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.518058 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8c8c99-1a56-4948-9760-df876ce368b4-service-ca-bundle\") pod \"insights-operator-896549976-k2rfr\" (UID: \"1e8c8c99-1a56-4948-9760-df876ce368b4\") " pod="openshift-insights/insights-operator-896549976-k2rfr" Jun 05 03:47:17.519208 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.518086 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1e8c8c99-1a56-4948-9760-df876ce368b4-serving-cert\") pod \"insights-operator-896549976-k2rfr\" (UID: \"1e8c8c99-1a56-4948-9760-df876ce368b4\") " pod="openshift-insights/insights-operator-896549976-k2rfr" Jun 05 03:47:17.519208 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.518126 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l2jr\" (UniqueName: \"kubernetes.io/projected/1e8c8c99-1a56-4948-9760-df876ce368b4-kube-api-access-8l2jr\") pod \"insights-operator-896549976-k2rfr\" (UID: \"1e8c8c99-1a56-4948-9760-df876ce368b4\") " pod="openshift-insights/insights-operator-896549976-k2rfr" Jun 05 03:47:17.519208 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.518164 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8c8c99-1a56-4948-9760-df876ce368b4-trusted-ca-bundle\") pod \"insights-operator-896549976-k2rfr\" (UID: \"1e8c8c99-1a56-4948-9760-df876ce368b4\") " pod="openshift-insights/insights-operator-896549976-k2rfr" Jun 05 03:47:17.519208 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.518420 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e8c8c99-1a56-4948-9760-df876ce368b4-tmp\") pod \"insights-operator-896549976-k2rfr\" (UID: \"1e8c8c99-1a56-4948-9760-df876ce368b4\") " pod="openshift-insights/insights-operator-896549976-k2rfr" Jun 05 03:47:17.519208 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.518758 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8c8c99-1a56-4948-9760-df876ce368b4-service-ca-bundle\") pod \"insights-operator-896549976-k2rfr\" (UID: \"1e8c8c99-1a56-4948-9760-df876ce368b4\") " pod="openshift-insights/insights-operator-896549976-k2rfr" Jun 05 03:47:17.519208 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.518917 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8c8c99-1a56-4948-9760-df876ce368b4-trusted-ca-bundle\") pod \"insights-operator-896549976-k2rfr\" (UID: \"1e8c8c99-1a56-4948-9760-df876ce368b4\") " pod="openshift-insights/insights-operator-896549976-k2rfr" Jun 05 03:47:17.519655 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.519312 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1e8c8c99-1a56-4948-9760-df876ce368b4-snapshots\") pod \"insights-operator-896549976-k2rfr\" (UID: \"1e8c8c99-1a56-4948-9760-df876ce368b4\") " pod="openshift-insights/insights-operator-896549976-k2rfr" Jun 05 03:47:17.521786 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.521745 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1e8c8c99-1a56-4948-9760-df876ce368b4-serving-cert\") pod \"insights-operator-896549976-k2rfr\" (UID: \"1e8c8c99-1a56-4948-9760-df876ce368b4\") " pod="openshift-insights/insights-operator-896549976-k2rfr" Jun 05 03:47:17.526817 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.526785 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l2jr\" (UniqueName: \"kubernetes.io/projected/1e8c8c99-1a56-4948-9760-df876ce368b4-kube-api-access-8l2jr\") pod \"insights-operator-896549976-k2rfr\" (UID: \"1e8c8c99-1a56-4948-9760-df876ce368b4\") " pod="openshift-insights/insights-operator-896549976-k2rfr" Jun 05 03:47:17.560622 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.560587 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-6tcdh"] Jun 05 03:47:17.564491 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:47:17.564462 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod458ec980_45f2_4f75_933c_d383b83e09e5.slice/crio-7156a7d0f23a13466a95bd5a9fa75f9843f06c008661dfb89c62550bba16dbad WatchSource:0}: Error finding container 7156a7d0f23a13466a95bd5a9fa75f9843f06c008661dfb89c62550bba16dbad: Status 404 returned error can't find the container with id 7156a7d0f23a13466a95bd5a9fa75f9843f06c008661dfb89c62550bba16dbad Jun 05 03:47:17.577556 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.577528 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dwvgc"] Jun 05 03:47:17.580460 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:47:17.580416 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc99614d1_0e51_4cda_b1c0_51b5b8a2fa88.slice/crio-3376e9d638c4da733e64455297927c177e1651470b78d8ecc49bcc90b2f5087c WatchSource:0}: Error finding container 3376e9d638c4da733e64455297927c177e1651470b78d8ecc49bcc90b2f5087c: Status 404 returned error can't find the container with id 3376e9d638c4da733e64455297927c177e1651470b78d8ecc49bcc90b2f5087c Jun 05 03:47:17.629480 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.629422 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-k2rfr" Jun 05 03:47:17.753564 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.753532 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-k2rfr"] Jun 05 03:47:17.756190 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:47:17.756163 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e8c8c99_1a56_4948_9760_df876ce368b4.slice/crio-0c8c06265b13c6ba4edb33b9717dc88cd18afe6ef993d40995027f291e4a5cd7 WatchSource:0}: Error finding container 0c8c06265b13c6ba4edb33b9717dc88cd18afe6ef993d40995027f291e4a5cd7: Status 404 returned error can't find the container with id 0c8c06265b13c6ba4edb33b9717dc88cd18afe6ef993d40995027f291e4a5cd7 Jun 05 03:47:17.820372 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.820337 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ebd772ab-7759-4b30-aa65-584cb9a1d3ba-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4rk9d\" (UID: \"ebd772ab-7759-4b30-aa65-584cb9a1d3ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rk9d" Jun 05 03:47:17.820567 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.820381 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f45f77e-672b-485c-a367-cf29229799e2-registry-tls\") pod \"image-registry-6b9cd897b-fx89g\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" Jun 05 03:47:17.820567 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:17.820515 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 03:47:17.820567 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:17.820517 2548 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 03:47:17.820567 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:17.820526 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b9cd897b-fx89g: secret "image-registry-tls" not found Jun 05 03:47:17.820692 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:17.820579 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f45f77e-672b-485c-a367-cf29229799e2-registry-tls podName:5f45f77e-672b-485c-a367-cf29229799e2 nodeName:}" failed. No retries permitted until 2026-06-05 03:47:18.820565461 +0000 UTC m=+238.090341757 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5f45f77e-672b-485c-a367-cf29229799e2-registry-tls") pod "image-registry-6b9cd897b-fx89g" (UID: "5f45f77e-672b-485c-a367-cf29229799e2") : secret "image-registry-tls" not found Jun 05 03:47:17.820692 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:17.820591 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebd772ab-7759-4b30-aa65-584cb9a1d3ba-samples-operator-tls podName:ebd772ab-7759-4b30-aa65-584cb9a1d3ba nodeName:}" failed. No retries permitted until 2026-06-05 03:47:18.82058558 +0000 UTC m=+238.090361876 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ebd772ab-7759-4b30-aa65-584cb9a1d3ba-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-4rk9d" (UID: "ebd772ab-7759-4b30-aa65-584cb9a1d3ba") : secret "samples-operator-tls" not found Jun 05 03:47:17.900597 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.900558 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dwvgc" event={"ID":"c99614d1-0e51-4cda-b1c0-51b5b8a2fa88","Type":"ContainerStarted","Data":"3376e9d638c4da733e64455297927c177e1651470b78d8ecc49bcc90b2f5087c"} Jun 05 03:47:17.901611 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.901584 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-k2rfr" event={"ID":"1e8c8c99-1a56-4948-9760-df876ce368b4","Type":"ContainerStarted","Data":"0c8c06265b13c6ba4edb33b9717dc88cd18afe6ef993d40995027f291e4a5cd7"} Jun 05 03:47:17.902554 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.902533 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-6tcdh" event={"ID":"458ec980-45f2-4f75-933c-d383b83e09e5","Type":"ContainerStarted","Data":"7156a7d0f23a13466a95bd5a9fa75f9843f06c008661dfb89c62550bba16dbad"} Jun 05 03:47:17.920949 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:17.920921 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b670160-bbf2-4468-98ee-55269506ff2a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7ttbz\" (UID: \"3b670160-bbf2-4468-98ee-55269506ff2a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7ttbz" Jun 05 03:47:17.921084 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:17.921066 2548 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 03:47:17.921140 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:17.921131 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b670160-bbf2-4468-98ee-55269506ff2a-cluster-monitoring-operator-tls podName:3b670160-bbf2-4468-98ee-55269506ff2a nodeName:}" failed. No retries permitted until 2026-06-05 03:47:18.921116468 +0000 UTC m=+238.190892764 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3b670160-bbf2-4468-98ee-55269506ff2a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-7ttbz" (UID: "3b670160-bbf2-4468-98ee-55269506ff2a") : secret "cluster-monitoring-operator-tls" not found Jun 05 03:47:18.829617 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:18.829586 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ebd772ab-7759-4b30-aa65-584cb9a1d3ba-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4rk9d\" (UID: \"ebd772ab-7759-4b30-aa65-584cb9a1d3ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rk9d" Jun 05 03:47:18.830012 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:18.829656 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f45f77e-672b-485c-a367-cf29229799e2-registry-tls\") pod \"image-registry-6b9cd897b-fx89g\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" Jun 05 03:47:18.830012 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:18.829731 2548 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 03:47:18.830012 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:18.829769 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 03:47:18.830012 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:18.829784 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b9cd897b-fx89g: secret "image-registry-tls" not found Jun 05 03:47:18.830012 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:18.829796 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebd772ab-7759-4b30-aa65-584cb9a1d3ba-samples-operator-tls podName:ebd772ab-7759-4b30-aa65-584cb9a1d3ba nodeName:}" failed. No retries permitted until 2026-06-05 03:47:20.829779552 +0000 UTC m=+240.099555849 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ebd772ab-7759-4b30-aa65-584cb9a1d3ba-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-4rk9d" (UID: "ebd772ab-7759-4b30-aa65-584cb9a1d3ba") : secret "samples-operator-tls" not found Jun 05 03:47:18.830012 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:18.829834 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f45f77e-672b-485c-a367-cf29229799e2-registry-tls podName:5f45f77e-672b-485c-a367-cf29229799e2 nodeName:}" failed. No retries permitted until 2026-06-05 03:47:20.829816693 +0000 UTC m=+240.099593007 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5f45f77e-672b-485c-a367-cf29229799e2-registry-tls") pod "image-registry-6b9cd897b-fx89g" (UID: "5f45f77e-672b-485c-a367-cf29229799e2") : secret "image-registry-tls" not found Jun 05 03:47:18.907758 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:18.907722 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-6tcdh" event={"ID":"458ec980-45f2-4f75-933c-d383b83e09e5","Type":"ContainerStarted","Data":"efbae9787ccf76821bafee48e8be336faf196ece7b7cbaa08f6d292d94437d52"} Jun 05 03:47:18.930241 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:18.930169 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b670160-bbf2-4468-98ee-55269506ff2a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7ttbz\" (UID: \"3b670160-bbf2-4468-98ee-55269506ff2a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7ttbz" Jun 05 03:47:18.930479 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:18.930299 2548 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 03:47:18.930479 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:18.930360 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b670160-bbf2-4468-98ee-55269506ff2a-cluster-monitoring-operator-tls podName:3b670160-bbf2-4468-98ee-55269506ff2a nodeName:}" failed. No retries permitted until 2026-06-05 03:47:20.930342062 +0000 UTC m=+240.200118360 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3b670160-bbf2-4468-98ee-55269506ff2a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-7ttbz" (UID: "3b670160-bbf2-4468-98ee-55269506ff2a") : secret "cluster-monitoring-operator-tls" not found Jun 05 03:47:18.930479 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:18.930389 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-6tcdh" podStartSLOduration=0.700299796 podStartE2EDuration="1.930374328s" totalImagesPullingTime="1.230074532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:47:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:47:18.929791224 +0000 UTC m=+238.199567543" watchObservedRunningTime="2026-06-05 03:47:18.930374328 +0000 UTC m=+238.200150647" Jun 05 03:47:20.845019 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:20.844968 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ebd772ab-7759-4b30-aa65-584cb9a1d3ba-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4rk9d\" (UID: \"ebd772ab-7759-4b30-aa65-584cb9a1d3ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rk9d" Jun 05 03:47:20.845019 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:20.845030 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f45f77e-672b-485c-a367-cf29229799e2-registry-tls\") pod \"image-registry-6b9cd897b-fx89g\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" Jun 05 03:47:20.845496 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:20.845140 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 03:47:20.845496 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:20.845144 2548 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 03:47:20.845496 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:20.845224 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebd772ab-7759-4b30-aa65-584cb9a1d3ba-samples-operator-tls podName:ebd772ab-7759-4b30-aa65-584cb9a1d3ba nodeName:}" failed. No retries permitted until 2026-06-05 03:47:24.845204706 +0000 UTC m=+244.114981009 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ebd772ab-7759-4b30-aa65-584cb9a1d3ba-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-4rk9d" (UID: "ebd772ab-7759-4b30-aa65-584cb9a1d3ba") : secret "samples-operator-tls" not found Jun 05 03:47:20.845496 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:20.845151 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b9cd897b-fx89g: secret "image-registry-tls" not found Jun 05 03:47:20.845496 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:20.845274 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f45f77e-672b-485c-a367-cf29229799e2-registry-tls podName:5f45f77e-672b-485c-a367-cf29229799e2 nodeName:}" failed. No retries permitted until 2026-06-05 03:47:24.845263383 +0000 UTC m=+244.115039679 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5f45f77e-672b-485c-a367-cf29229799e2-registry-tls") pod "image-registry-6b9cd897b-fx89g" (UID: "5f45f77e-672b-485c-a367-cf29229799e2") : secret "image-registry-tls" not found Jun 05 03:47:20.915903 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:20.915868 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-k2rfr" event={"ID":"1e8c8c99-1a56-4948-9760-df876ce368b4","Type":"ContainerStarted","Data":"2301d3ff35e496ccb2a945b3967e521590bbd178c0ec2eae12e2b493342afa4c"} Jun 05 03:47:20.917496 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:20.917470 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dwvgc" event={"ID":"c99614d1-0e51-4cda-b1c0-51b5b8a2fa88","Type":"ContainerStarted","Data":"55c5bab305938dc62cf42feff0a675bb91624af665a2788798e1f44474be2e3a"} Jun 05 03:47:20.931848 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:20.931804 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-k2rfr" podStartSLOduration=1.774459991 podStartE2EDuration="3.9317855s" totalImagesPullingTime="2.157325509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:47:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:47:20.930138794 +0000 UTC m=+240.199915111" watchObservedRunningTime="2026-06-05 03:47:20.9317855 +0000 UTC m=+240.201561818" Jun 05 03:47:20.946074 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:20.946043 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b670160-bbf2-4468-98ee-55269506ff2a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7ttbz\" (UID: \"3b670160-bbf2-4468-98ee-55269506ff2a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7ttbz" Jun 05 03:47:20.946218 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:20.946184 2548 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 03:47:20.946263 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:20.946243 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b670160-bbf2-4468-98ee-55269506ff2a-cluster-monitoring-operator-tls podName:3b670160-bbf2-4468-98ee-55269506ff2a nodeName:}" failed. No retries permitted until 2026-06-05 03:47:24.946228577 +0000 UTC m=+244.216004873 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3b670160-bbf2-4468-98ee-55269506ff2a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-7ttbz" (UID: "3b670160-bbf2-4468-98ee-55269506ff2a") : secret "cluster-monitoring-operator-tls" not found Jun 05 03:47:20.950415 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:20.950367 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dwvgc" podStartSLOduration=2.151131072 podStartE2EDuration="3.950349082s" totalImagesPullingTime="1.79921801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:47:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:47:20.949491988 +0000 UTC m=+240.219268304" watchObservedRunningTime="2026-06-05 03:47:20.950349082 +0000 UTC m=+240.220125401" Jun 05 03:47:24.685236 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:24.685209 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nfv6x_5986d90f-3a60-4e38-b15f-cc0c69c89abf/dns-node-resolver/0.log" Jun 05 03:47:24.879150 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:24.879102 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ebd772ab-7759-4b30-aa65-584cb9a1d3ba-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4rk9d\" (UID: \"ebd772ab-7759-4b30-aa65-584cb9a1d3ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rk9d" Jun 05 03:47:24.879328 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:24.879186 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f45f77e-672b-485c-a367-cf29229799e2-registry-tls\") pod \"image-registry-6b9cd897b-fx89g\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" Jun 05 03:47:24.879328 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:24.879247 2548 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 03:47:24.879409 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:24.879330 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebd772ab-7759-4b30-aa65-584cb9a1d3ba-samples-operator-tls podName:ebd772ab-7759-4b30-aa65-584cb9a1d3ba nodeName:}" failed. No retries permitted until 2026-06-05 03:47:32.879312256 +0000 UTC m=+252.149088554 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ebd772ab-7759-4b30-aa65-584cb9a1d3ba-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-4rk9d" (UID: "ebd772ab-7759-4b30-aa65-584cb9a1d3ba") : secret "samples-operator-tls" not found Jun 05 03:47:24.879409 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:24.879327 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 03:47:24.879409 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:24.879351 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b9cd897b-fx89g: secret "image-registry-tls" not found Jun 05 03:47:24.879409 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:24.879407 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f45f77e-672b-485c-a367-cf29229799e2-registry-tls podName:5f45f77e-672b-485c-a367-cf29229799e2 nodeName:}" failed. No retries permitted until 2026-06-05 03:47:32.8793919 +0000 UTC m=+252.149168196 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5f45f77e-672b-485c-a367-cf29229799e2-registry-tls") pod "image-registry-6b9cd897b-fx89g" (UID: "5f45f77e-672b-485c-a367-cf29229799e2") : secret "image-registry-tls" not found Jun 05 03:47:24.979972 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:24.979885 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b670160-bbf2-4468-98ee-55269506ff2a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7ttbz\" (UID: \"3b670160-bbf2-4468-98ee-55269506ff2a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7ttbz" Jun 05 03:47:24.980116 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:24.980010 2548 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 03:47:24.980116 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:24.980060 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b670160-bbf2-4468-98ee-55269506ff2a-cluster-monitoring-operator-tls podName:3b670160-bbf2-4468-98ee-55269506ff2a nodeName:}" failed. No retries permitted until 2026-06-05 03:47:32.980047793 +0000 UTC m=+252.249824089 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3b670160-bbf2-4468-98ee-55269506ff2a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-7ttbz" (UID: "3b670160-bbf2-4468-98ee-55269506ff2a") : secret "cluster-monitoring-operator-tls" not found Jun 05 03:47:25.484186 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:25.484161 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dtx66_eb3edaa5-bb4c-4a42-9388-0ecb2db9c42e/node-ca/0.log" Jun 05 03:47:26.284523 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:26.284496 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5lqng_d85ffe46-0e4f-4c48-bcf1-f56d2f0fb4ef/serve-healthcheck-canary/0.log" Jun 05 03:47:27.085651 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:27.085616 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-dwvgc_c99614d1-0e51-4cda-b1c0-51b5b8a2fa88/kube-storage-version-migrator-operator/0.log" Jun 05 03:47:32.947897 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:32.947856 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f45f77e-672b-485c-a367-cf29229799e2-registry-tls\") pod \"image-registry-6b9cd897b-fx89g\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" Jun 05 03:47:32.948287 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:32.947956 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ebd772ab-7759-4b30-aa65-584cb9a1d3ba-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4rk9d\" (UID: \"ebd772ab-7759-4b30-aa65-584cb9a1d3ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rk9d" Jun 05 03:47:32.950500 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:32.950472 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f45f77e-672b-485c-a367-cf29229799e2-registry-tls\") pod \"image-registry-6b9cd897b-fx89g\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" Jun 05 03:47:32.950664 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:32.950502 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ebd772ab-7759-4b30-aa65-584cb9a1d3ba-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4rk9d\" (UID: \"ebd772ab-7759-4b30-aa65-584cb9a1d3ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rk9d" Jun 05 03:47:33.049232 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:33.049193 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b670160-bbf2-4468-98ee-55269506ff2a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7ttbz\" (UID: \"3b670160-bbf2-4468-98ee-55269506ff2a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7ttbz" Jun 05 03:47:33.049419 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:33.049244 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f15442b9-7c90-4861-8089-8084f3784bf6-metrics-certs\") pod \"network-metrics-daemon-7fqv9\" (UID: \"f15442b9-7c90-4861-8089-8084f3784bf6\") " pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:47:33.049419 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:33.049295 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-xvb6w\"" Jun 05 03:47:33.049419 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:33.049346 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 03:47:33.049419 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:33.049411 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f15442b9-7c90-4861-8089-8084f3784bf6-metrics-certs podName:f15442b9-7c90-4861-8089-8084f3784bf6 nodeName:}" failed. No retries permitted until 2026-06-05 03:49:35.049393576 +0000 UTC m=+374.319169874 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f15442b9-7c90-4861-8089-8084f3784bf6-metrics-certs") pod "network-metrics-daemon-7fqv9" (UID: "f15442b9-7c90-4861-8089-8084f3784bf6") : secret "metrics-daemon-secret" not found Jun 05 03:47:33.051692 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:33.051673 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b670160-bbf2-4468-98ee-55269506ff2a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7ttbz\" (UID: \"3b670160-bbf2-4468-98ee-55269506ff2a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7ttbz" Jun 05 03:47:33.054480 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:33.054465 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6ccnq\"" Jun 05 03:47:33.057379 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:33.057364 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rk9d" Jun 05 03:47:33.063469 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:33.063455 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" Jun 05 03:47:33.131226 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:33.131200 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7xhzj\"" Jun 05 03:47:33.139247 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:33.139222 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7ttbz" Jun 05 03:47:33.196473 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:33.196421 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b9cd897b-fx89g"] Jun 05 03:47:33.199269 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:47:33.199208 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f45f77e_672b_485c_a367_cf29229799e2.slice/crio-9e3c2d2b4b7c9eca8564ee02a93261b7cf0c080e10c25146fe6acd07b4c6f6e8 WatchSource:0}: Error finding container 9e3c2d2b4b7c9eca8564ee02a93261b7cf0c080e10c25146fe6acd07b4c6f6e8: Status 404 returned error can't find the container with id 9e3c2d2b4b7c9eca8564ee02a93261b7cf0c080e10c25146fe6acd07b4c6f6e8 Jun 05 03:47:33.214261 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:33.214204 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rk9d"] Jun 05 03:47:33.273309 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:33.273279 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7ttbz"] Jun 05 03:47:33.275665 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:47:33.275631 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b670160_bbf2_4468_98ee_55269506ff2a.slice/crio-fa39bec8827353a717ea7a7499d9b1a72d995a1df1206dc89a737abd5f7bfdb2 WatchSource:0}: Error finding container fa39bec8827353a717ea7a7499d9b1a72d995a1df1206dc89a737abd5f7bfdb2: Status 404 returned error can't find the container with id fa39bec8827353a717ea7a7499d9b1a72d995a1df1206dc89a737abd5f7bfdb2 Jun 05 03:47:33.957373 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:33.957326 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rk9d" event={"ID":"ebd772ab-7759-4b30-aa65-584cb9a1d3ba","Type":"ContainerStarted","Data":"741dc02b471cfc7e0a4aa045b5079d151ff8c6bc8b72725882871dc4134ebc00"} Jun 05 03:47:33.961578 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:33.960988 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" event={"ID":"5f45f77e-672b-485c-a367-cf29229799e2","Type":"ContainerStarted","Data":"f1ff11c974880e315ab021406942ca5b9e6ebad09109229077fa52b93a0481d4"} Jun 05 03:47:33.961578 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:33.961039 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" event={"ID":"5f45f77e-672b-485c-a367-cf29229799e2","Type":"ContainerStarted","Data":"9e3c2d2b4b7c9eca8564ee02a93261b7cf0c080e10c25146fe6acd07b4c6f6e8"} Jun 05 03:47:33.961578 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:33.961077 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" Jun 05 03:47:33.963109 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:33.963085 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7ttbz" event={"ID":"3b670160-bbf2-4468-98ee-55269506ff2a","Type":"ContainerStarted","Data":"fa39bec8827353a717ea7a7499d9b1a72d995a1df1206dc89a737abd5f7bfdb2"} Jun 05 03:47:33.979703 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:33.979533 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" podStartSLOduration=16.979514939 podStartE2EDuration="16.979514939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:47:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:47:33.978930198 +0000 UTC m=+253.248706522" watchObservedRunningTime="2026-06-05 03:47:33.979514939 +0000 UTC m=+253.249291262" Jun 05 03:47:35.970333 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:35.970289 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7ttbz" event={"ID":"3b670160-bbf2-4468-98ee-55269506ff2a","Type":"ContainerStarted","Data":"64380060ebbccd97a79c2e9eed92fecad65b6db57126ef2243039dc7195c6f17"} Jun 05 03:47:35.972016 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:35.971989 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rk9d" event={"ID":"ebd772ab-7759-4b30-aa65-584cb9a1d3ba","Type":"ContainerStarted","Data":"6cfb0e3215eba4d53aa89b3feb50740ba9aa2b23a726895a723b4a979513431d"} Jun 05 03:47:35.972154 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:35.972048 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rk9d" event={"ID":"ebd772ab-7759-4b30-aa65-584cb9a1d3ba","Type":"ContainerStarted","Data":"11bb1c2c2918852f4eaeb6d53c6d148333d48ad25be6ce9b99bd5f127560f96c"} Jun 05 03:47:35.985252 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:35.985205 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7ttbz" podStartSLOduration=16.963917523 podStartE2EDuration="18.985191569s" totalImagesPullingTime="2.021274046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:47:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:47:35.984607811 +0000 UTC m=+255.254384128" watchObservedRunningTime="2026-06-05 03:47:35.985191569 +0000 UTC m=+255.254967889" Jun 05 03:47:35.999187 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:35.999142 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4rk9d" podStartSLOduration=16.952963136 podStartE2EDuration="18.999130558s" totalImagesPullingTime="2.046167422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:47:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:47:35.998296691 +0000 UTC m=+255.268073005" watchObservedRunningTime="2026-06-05 03:47:35.999130558 +0000 UTC m=+255.268906854" Jun 05 03:47:42.770692 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:42.770608 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5gfdx"] Jun 05 03:47:42.773249 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:42.773232 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5gfdx" Jun 05 03:47:42.775931 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:42.775908 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 05 03:47:42.777082 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:42.777059 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 05 03:47:42.777162 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:42.777073 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5nqgr\"" Jun 05 03:47:42.787789 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:42.787762 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5gfdx"] Jun 05 03:47:42.815199 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:42.815172 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b9cd897b-fx89g"] Jun 05 03:47:42.816107 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:42.816083 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tmr4t"] Jun 05 03:47:42.817915 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:42.817900 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tmr4t" Jun 05 03:47:42.820247 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:42.820224 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-cbdrb\"" Jun 05 03:47:42.820247 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:42.820239 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 05 03:47:42.826733 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:42.826704 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tmr4t"] Jun 05 03:47:42.850565 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:42.850532 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6855569764-bpwhz"] Jun 05 03:47:42.852265 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:42.852250 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6855569764-bpwhz" Jun 05 03:47:42.867414 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:42.867387 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6855569764-bpwhz"] Jun 05 03:47:42.929802 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:42.929761 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7719f289-6261-4f89-80c9-adb944978d2e-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-tmr4t\" (UID: \"7719f289-6261-4f89-80c9-adb944978d2e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tmr4t" Jun 05 03:47:42.929802 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:42.929804 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e912d5e2-2eaa-4bad-9af9-8ecbf3463c17-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5gfdx\" (UID: \"e912d5e2-2eaa-4bad-9af9-8ecbf3463c17\") " pod="openshift-insights/insights-runtime-extractor-5gfdx" Jun 05 03:47:42.930032 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:42.929830 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e912d5e2-2eaa-4bad-9af9-8ecbf3463c17-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5gfdx\" (UID: \"e912d5e2-2eaa-4bad-9af9-8ecbf3463c17\") " pod="openshift-insights/insights-runtime-extractor-5gfdx" Jun 05 03:47:42.930032 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:42.929909 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc67n\" (UniqueName: \"kubernetes.io/projected/e912d5e2-2eaa-4bad-9af9-8ecbf3463c17-kube-api-access-kc67n\") pod \"insights-runtime-extractor-5gfdx\" (UID: \"e912d5e2-2eaa-4bad-9af9-8ecbf3463c17\") " pod="openshift-insights/insights-runtime-extractor-5gfdx" Jun 05 03:47:42.930032 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:42.929978 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e912d5e2-2eaa-4bad-9af9-8ecbf3463c17-data-volume\") pod \"insights-runtime-extractor-5gfdx\" (UID: \"e912d5e2-2eaa-4bad-9af9-8ecbf3463c17\") " pod="openshift-insights/insights-runtime-extractor-5gfdx" Jun 05 03:47:42.930032 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:42.930007 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e912d5e2-2eaa-4bad-9af9-8ecbf3463c17-crio-socket\") pod \"insights-runtime-extractor-5gfdx\" (UID: \"e912d5e2-2eaa-4bad-9af9-8ecbf3463c17\") " pod="openshift-insights/insights-runtime-extractor-5gfdx" Jun 05 03:47:43.030731 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.030635 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e912d5e2-2eaa-4bad-9af9-8ecbf3463c17-crio-socket\") pod \"insights-runtime-extractor-5gfdx\" (UID: \"e912d5e2-2eaa-4bad-9af9-8ecbf3463c17\") " pod="openshift-insights/insights-runtime-extractor-5gfdx" Jun 05 03:47:43.030731 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.030680 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/240a9603-97bc-4acb-9553-2ddbc0aa231f-bound-sa-token\") pod \"image-registry-6855569764-bpwhz\" (UID: \"240a9603-97bc-4acb-9553-2ddbc0aa231f\") " pod="openshift-image-registry/image-registry-6855569764-bpwhz" Jun 05 03:47:43.030731 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.030700 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/240a9603-97bc-4acb-9553-2ddbc0aa231f-ca-trust-extracted\") pod \"image-registry-6855569764-bpwhz\" (UID: \"240a9603-97bc-4acb-9553-2ddbc0aa231f\") " pod="openshift-image-registry/image-registry-6855569764-bpwhz" Jun 05 03:47:43.030980 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.030739 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/240a9603-97bc-4acb-9553-2ddbc0aa231f-registry-certificates\") pod \"image-registry-6855569764-bpwhz\" (UID: \"240a9603-97bc-4acb-9553-2ddbc0aa231f\") " pod="openshift-image-registry/image-registry-6855569764-bpwhz" Jun 05 03:47:43.030980 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.030774 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e912d5e2-2eaa-4bad-9af9-8ecbf3463c17-crio-socket\") pod \"insights-runtime-extractor-5gfdx\" (UID: \"e912d5e2-2eaa-4bad-9af9-8ecbf3463c17\") " pod="openshift-insights/insights-runtime-extractor-5gfdx" Jun 05 03:47:43.030980 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.030790 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/240a9603-97bc-4acb-9553-2ddbc0aa231f-trusted-ca\") pod \"image-registry-6855569764-bpwhz\" (UID: \"240a9603-97bc-4acb-9553-2ddbc0aa231f\") " pod="openshift-image-registry/image-registry-6855569764-bpwhz" Jun 05 03:47:43.030980 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.030827 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7719f289-6261-4f89-80c9-adb944978d2e-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-tmr4t\" (UID: \"7719f289-6261-4f89-80c9-adb944978d2e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tmr4t" Jun 05 03:47:43.030980 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.030860 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e912d5e2-2eaa-4bad-9af9-8ecbf3463c17-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5gfdx\" (UID: \"e912d5e2-2eaa-4bad-9af9-8ecbf3463c17\") " pod="openshift-insights/insights-runtime-extractor-5gfdx" Jun 05 03:47:43.030980 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.030884 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/240a9603-97bc-4acb-9553-2ddbc0aa231f-installation-pull-secrets\") pod \"image-registry-6855569764-bpwhz\" (UID: \"240a9603-97bc-4acb-9553-2ddbc0aa231f\") " pod="openshift-image-registry/image-registry-6855569764-bpwhz" Jun 05 03:47:43.030980 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.030919 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e912d5e2-2eaa-4bad-9af9-8ecbf3463c17-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5gfdx\" (UID: \"e912d5e2-2eaa-4bad-9af9-8ecbf3463c17\") " pod="openshift-insights/insights-runtime-extractor-5gfdx" Jun 05 03:47:43.031285 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.031008 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/240a9603-97bc-4acb-9553-2ddbc0aa231f-image-registry-private-configuration\") pod \"image-registry-6855569764-bpwhz\" (UID: \"240a9603-97bc-4acb-9553-2ddbc0aa231f\") " pod="openshift-image-registry/image-registry-6855569764-bpwhz" Jun 05 03:47:43.031285 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.031071 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dtb8\" (UniqueName: \"kubernetes.io/projected/240a9603-97bc-4acb-9553-2ddbc0aa231f-kube-api-access-5dtb8\") pod \"image-registry-6855569764-bpwhz\" (UID: \"240a9603-97bc-4acb-9553-2ddbc0aa231f\") " pod="openshift-image-registry/image-registry-6855569764-bpwhz" Jun 05 03:47:43.031285 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.031126 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc67n\" (UniqueName: \"kubernetes.io/projected/e912d5e2-2eaa-4bad-9af9-8ecbf3463c17-kube-api-access-kc67n\") pod \"insights-runtime-extractor-5gfdx\" (UID: \"e912d5e2-2eaa-4bad-9af9-8ecbf3463c17\") " pod="openshift-insights/insights-runtime-extractor-5gfdx" Jun 05 03:47:43.031285 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.031239 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/240a9603-97bc-4acb-9553-2ddbc0aa231f-registry-tls\") pod \"image-registry-6855569764-bpwhz\" (UID: \"240a9603-97bc-4acb-9553-2ddbc0aa231f\") " pod="openshift-image-registry/image-registry-6855569764-bpwhz" Jun 05 03:47:43.031285 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.031275 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e912d5e2-2eaa-4bad-9af9-8ecbf3463c17-data-volume\") pod \"insights-runtime-extractor-5gfdx\" (UID: \"e912d5e2-2eaa-4bad-9af9-8ecbf3463c17\") " pod="openshift-insights/insights-runtime-extractor-5gfdx" Jun 05 03:47:43.031555 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.031404 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e912d5e2-2eaa-4bad-9af9-8ecbf3463c17-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5gfdx\" (UID: \"e912d5e2-2eaa-4bad-9af9-8ecbf3463c17\") " pod="openshift-insights/insights-runtime-extractor-5gfdx" Jun 05 03:47:43.031634 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.031616 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e912d5e2-2eaa-4bad-9af9-8ecbf3463c17-data-volume\") pod \"insights-runtime-extractor-5gfdx\" (UID: \"e912d5e2-2eaa-4bad-9af9-8ecbf3463c17\") " pod="openshift-insights/insights-runtime-extractor-5gfdx" Jun 05 03:47:43.033364 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.033346 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e912d5e2-2eaa-4bad-9af9-8ecbf3463c17-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5gfdx\" (UID: \"e912d5e2-2eaa-4bad-9af9-8ecbf3463c17\") " pod="openshift-insights/insights-runtime-extractor-5gfdx" Jun 05 03:47:43.033538 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.033519 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7719f289-6261-4f89-80c9-adb944978d2e-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-tmr4t\" (UID: \"7719f289-6261-4f89-80c9-adb944978d2e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tmr4t" Jun 05 03:47:43.043556 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.043536 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc67n\" (UniqueName: \"kubernetes.io/projected/e912d5e2-2eaa-4bad-9af9-8ecbf3463c17-kube-api-access-kc67n\") pod \"insights-runtime-extractor-5gfdx\" (UID: \"e912d5e2-2eaa-4bad-9af9-8ecbf3463c17\") " pod="openshift-insights/insights-runtime-extractor-5gfdx" Jun 05 03:47:43.083169 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.083133 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5gfdx" Jun 05 03:47:43.127850 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.127820 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tmr4t" Jun 05 03:47:43.132480 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.132198 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/240a9603-97bc-4acb-9553-2ddbc0aa231f-registry-tls\") pod \"image-registry-6855569764-bpwhz\" (UID: \"240a9603-97bc-4acb-9553-2ddbc0aa231f\") " pod="openshift-image-registry/image-registry-6855569764-bpwhz" Jun 05 03:47:43.132480 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.132260 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/240a9603-97bc-4acb-9553-2ddbc0aa231f-bound-sa-token\") pod \"image-registry-6855569764-bpwhz\" (UID: \"240a9603-97bc-4acb-9553-2ddbc0aa231f\") " pod="openshift-image-registry/image-registry-6855569764-bpwhz" Jun 05 03:47:43.132480 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.132374 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/240a9603-97bc-4acb-9553-2ddbc0aa231f-ca-trust-extracted\") pod \"image-registry-6855569764-bpwhz\" (UID: \"240a9603-97bc-4acb-9553-2ddbc0aa231f\") " pod="openshift-image-registry/image-registry-6855569764-bpwhz" Jun 05 03:47:43.132480 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.132401 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/240a9603-97bc-4acb-9553-2ddbc0aa231f-registry-certificates\") pod \"image-registry-6855569764-bpwhz\" (UID: \"240a9603-97bc-4acb-9553-2ddbc0aa231f\") " pod="openshift-image-registry/image-registry-6855569764-bpwhz" Jun 05 03:47:43.132772 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.132572 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/240a9603-97bc-4acb-9553-2ddbc0aa231f-trusted-ca\") pod \"image-registry-6855569764-bpwhz\" (UID: \"240a9603-97bc-4acb-9553-2ddbc0aa231f\") " pod="openshift-image-registry/image-registry-6855569764-bpwhz" Jun 05 03:47:43.132772 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.132623 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/240a9603-97bc-4acb-9553-2ddbc0aa231f-installation-pull-secrets\") pod \"image-registry-6855569764-bpwhz\" (UID: \"240a9603-97bc-4acb-9553-2ddbc0aa231f\") " pod="openshift-image-registry/image-registry-6855569764-bpwhz" Jun 05 03:47:43.132772 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.132655 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/240a9603-97bc-4acb-9553-2ddbc0aa231f-image-registry-private-configuration\") pod \"image-registry-6855569764-bpwhz\" (UID: \"240a9603-97bc-4acb-9553-2ddbc0aa231f\") " pod="openshift-image-registry/image-registry-6855569764-bpwhz" Jun 05 03:47:43.132772 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.132705 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dtb8\" (UniqueName: \"kubernetes.io/projected/240a9603-97bc-4acb-9553-2ddbc0aa231f-kube-api-access-5dtb8\") pod \"image-registry-6855569764-bpwhz\" (UID: \"240a9603-97bc-4acb-9553-2ddbc0aa231f\") " pod="openshift-image-registry/image-registry-6855569764-bpwhz" Jun 05 03:47:43.132982 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.132790 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/240a9603-97bc-4acb-9553-2ddbc0aa231f-ca-trust-extracted\") pod \"image-registry-6855569764-bpwhz\" (UID: \"240a9603-97bc-4acb-9553-2ddbc0aa231f\") " pod="openshift-image-registry/image-registry-6855569764-bpwhz" Jun 05 03:47:43.133738 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.133709 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/240a9603-97bc-4acb-9553-2ddbc0aa231f-trusted-ca\") pod \"image-registry-6855569764-bpwhz\" (UID: \"240a9603-97bc-4acb-9553-2ddbc0aa231f\") " pod="openshift-image-registry/image-registry-6855569764-bpwhz" Jun 05 03:47:43.134336 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.134276 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/240a9603-97bc-4acb-9553-2ddbc0aa231f-registry-certificates\") pod \"image-registry-6855569764-bpwhz\" (UID: \"240a9603-97bc-4acb-9553-2ddbc0aa231f\") " pod="openshift-image-registry/image-registry-6855569764-bpwhz" Jun 05 03:47:43.136824 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.136763 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/240a9603-97bc-4acb-9553-2ddbc0aa231f-registry-tls\") pod \"image-registry-6855569764-bpwhz\" (UID: \"240a9603-97bc-4acb-9553-2ddbc0aa231f\") " pod="openshift-image-registry/image-registry-6855569764-bpwhz" Jun 05 03:47:43.137137 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.137114 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/240a9603-97bc-4acb-9553-2ddbc0aa231f-image-registry-private-configuration\") pod \"image-registry-6855569764-bpwhz\" (UID: \"240a9603-97bc-4acb-9553-2ddbc0aa231f\") " pod="openshift-image-registry/image-registry-6855569764-bpwhz" Jun 05 03:47:43.137387 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.137371 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/240a9603-97bc-4acb-9553-2ddbc0aa231f-installation-pull-secrets\") pod \"image-registry-6855569764-bpwhz\" (UID: \"240a9603-97bc-4acb-9553-2ddbc0aa231f\") " pod="openshift-image-registry/image-registry-6855569764-bpwhz" Jun 05 03:47:43.142510 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.142141 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dtb8\" (UniqueName: \"kubernetes.io/projected/240a9603-97bc-4acb-9553-2ddbc0aa231f-kube-api-access-5dtb8\") pod \"image-registry-6855569764-bpwhz\" (UID: \"240a9603-97bc-4acb-9553-2ddbc0aa231f\") " pod="openshift-image-registry/image-registry-6855569764-bpwhz" Jun 05 03:47:43.144416 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.143037 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/240a9603-97bc-4acb-9553-2ddbc0aa231f-bound-sa-token\") pod \"image-registry-6855569764-bpwhz\" (UID: \"240a9603-97bc-4acb-9553-2ddbc0aa231f\") " pod="openshift-image-registry/image-registry-6855569764-bpwhz" Jun 05 03:47:43.161022 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.160992 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6855569764-bpwhz" Jun 05 03:47:43.232235 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.232204 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5gfdx"] Jun 05 03:47:43.280704 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.280676 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tmr4t"] Jun 05 03:47:43.283665 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:47:43.283641 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7719f289_6261_4f89_80c9_adb944978d2e.slice/crio-d00daf33321bd3939544776d3528278ee43e8d9a34e54cb768d995f8399c0f89 WatchSource:0}: Error finding container d00daf33321bd3939544776d3528278ee43e8d9a34e54cb768d995f8399c0f89: Status 404 returned error can't find the container with id d00daf33321bd3939544776d3528278ee43e8d9a34e54cb768d995f8399c0f89 Jun 05 03:47:43.314632 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.314598 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6855569764-bpwhz"] Jun 05 03:47:43.317612 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:47:43.317583 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod240a9603_97bc_4acb_9553_2ddbc0aa231f.slice/crio-80a10824e2621922c3965ad48bde49d0a59059a6031173069b35105f5ab0e897 WatchSource:0}: Error finding container 80a10824e2621922c3965ad48bde49d0a59059a6031173069b35105f5ab0e897: Status 404 returned error can't find the container with id 80a10824e2621922c3965ad48bde49d0a59059a6031173069b35105f5ab0e897 Jun 05 03:47:43.998554 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.998505 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6855569764-bpwhz" event={"ID":"240a9603-97bc-4acb-9553-2ddbc0aa231f","Type":"ContainerStarted","Data":"3e66e9e5c9a56d86dfdbeb1d4a52b96eb1050a2ccbc51a68aeed363b2f2a4360"} Jun 05 03:47:43.999030 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.998574 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6855569764-bpwhz" event={"ID":"240a9603-97bc-4acb-9553-2ddbc0aa231f","Type":"ContainerStarted","Data":"80a10824e2621922c3965ad48bde49d0a59059a6031173069b35105f5ab0e897"} Jun 05 03:47:43.999030 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.998603 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6855569764-bpwhz" Jun 05 03:47:43.999867 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:43.999843 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tmr4t" event={"ID":"7719f289-6261-4f89-80c9-adb944978d2e","Type":"ContainerStarted","Data":"d00daf33321bd3939544776d3528278ee43e8d9a34e54cb768d995f8399c0f89"} Jun 05 03:47:44.001414 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:44.001385 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5gfdx" event={"ID":"e912d5e2-2eaa-4bad-9af9-8ecbf3463c17","Type":"ContainerStarted","Data":"21c88947abfd85d9fcc0066b37714d1f95c39dc41547ce84b7f6e8941956cc8b"} Jun 05 03:47:44.001507 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:44.001453 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5gfdx" event={"ID":"e912d5e2-2eaa-4bad-9af9-8ecbf3463c17","Type":"ContainerStarted","Data":"7c0b8470637bcf02fdc21f83b844226d5afa97e3df75609153ce9aa9d5d1fa69"} Jun 05 03:47:44.001507 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:44.001474 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5gfdx" event={"ID":"e912d5e2-2eaa-4bad-9af9-8ecbf3463c17","Type":"ContainerStarted","Data":"cf64ad8d6d31629fe8c2963a7203b2bb6bb64906b6dfb500158a23cb6a1e42c2"} Jun 05 03:47:44.018868 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:44.018822 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6855569764-bpwhz" podStartSLOduration=2.018807677 podStartE2EDuration="2.018807677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:47:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:47:44.017892075 +0000 UTC m=+263.287668392" watchObservedRunningTime="2026-06-05 03:47:44.018807677 +0000 UTC m=+263.288583994" Jun 05 03:47:45.006514 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:45.006466 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tmr4t" event={"ID":"7719f289-6261-4f89-80c9-adb944978d2e","Type":"ContainerStarted","Data":"e00688af9bebcf679a948f437976288e43eb69400b2163ae89f7b2716ea5898d"} Jun 05 03:47:45.006987 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:45.006624 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tmr4t" Jun 05 03:47:45.012107 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:45.012084 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tmr4t" Jun 05 03:47:45.021652 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:45.021607 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tmr4t" podStartSLOduration=1.85519178 podStartE2EDuration="3.021593175s" totalImagesPullingTime="1.166401395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:47:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:47:45.02038021 +0000 UTC m=+264.290156528" watchObservedRunningTime="2026-06-05 03:47:45.021593175 +0000 UTC m=+264.291369471" Jun 05 03:47:46.011508 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:46.011464 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5gfdx" event={"ID":"e912d5e2-2eaa-4bad-9af9-8ecbf3463c17","Type":"ContainerStarted","Data":"1c6015de742df7eee0041952c2a759fa6ba588038033b48fdba6cde4f1e83480"} Jun 05 03:47:46.029170 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:46.029122 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5gfdx" podStartSLOduration=1.937717908 podStartE2EDuration="4.029107485s" totalImagesPullingTime="2.091389577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:47:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:47:46.027499506 +0000 UTC m=+265.297275820" watchObservedRunningTime="2026-06-05 03:47:46.029107485 +0000 UTC m=+265.298883804" Jun 05 03:47:50.181285 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.181246 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-5np9q"] Jun 05 03:47:50.184959 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.184935 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-5np9q" Jun 05 03:47:50.187650 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.187615 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 05 03:47:50.187750 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.187703 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-slbsh\"" Jun 05 03:47:50.187750 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.187724 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 05 03:47:50.188889 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.188863 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 05 03:47:50.190234 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.190216 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-rhvn7"] Jun 05 03:47:50.192623 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.192603 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vmq99"] Jun 05 03:47:50.192747 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.192729 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rhvn7" Jun 05 03:47:50.195296 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.195273 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vmq99" Jun 05 03:47:50.195422 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.195402 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 05 03:47:50.195515 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.195493 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 05 03:47:50.195578 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.195558 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-j6rqb\"" Jun 05 03:47:50.195812 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.195787 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-5np9q"] Jun 05 03:47:50.195895 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.195825 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 05 03:47:50.197955 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.197934 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 05 03:47:50.198053 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.197973 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 05 03:47:50.198227 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.198207 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27a8954a-c8dc-4cd9-a91d-281190eddf66-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-5np9q\" (UID: \"27a8954a-c8dc-4cd9-a91d-281190eddf66\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-5np9q" Jun 05 03:47:50.198292 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.198243 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e130185-59d5-46eb-bbfb-f740c3894b05-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-rhvn7\" (UID: \"2e130185-59d5-46eb-bbfb-f740c3894b05\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rhvn7" Jun 05 03:47:50.198292 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.198270 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/011753a9-698b-4e4d-abcf-269e73889cfa-sys\") pod \"node-exporter-vmq99\" (UID: \"011753a9-698b-4e4d-abcf-269e73889cfa\") " pod="openshift-monitoring/node-exporter-vmq99" Jun 05 03:47:50.198393 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.198299 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cgs9\" (UniqueName: \"kubernetes.io/projected/011753a9-698b-4e4d-abcf-269e73889cfa-kube-api-access-7cgs9\") pod \"node-exporter-vmq99\" (UID: \"011753a9-698b-4e4d-abcf-269e73889cfa\") " pod="openshift-monitoring/node-exporter-vmq99" Jun 05 03:47:50.198393 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.198344 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e130185-59d5-46eb-bbfb-f740c3894b05-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-rhvn7\" (UID: \"2e130185-59d5-46eb-bbfb-f740c3894b05\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rhvn7" Jun 05 03:47:50.198525 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.198402 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e130185-59d5-46eb-bbfb-f740c3894b05-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-rhvn7\" (UID: \"2e130185-59d5-46eb-bbfb-f740c3894b05\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rhvn7" Jun 05 03:47:50.198525 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.198457 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wbx5\" (UniqueName: \"kubernetes.io/projected/2e130185-59d5-46eb-bbfb-f740c3894b05-kube-api-access-6wbx5\") pod \"kube-state-metrics-57bbf8bfb5-rhvn7\" (UID: \"2e130185-59d5-46eb-bbfb-f740c3894b05\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rhvn7" Jun 05 03:47:50.198603 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.198520 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/011753a9-698b-4e4d-abcf-269e73889cfa-root\") pod \"node-exporter-vmq99\" (UID: \"011753a9-698b-4e4d-abcf-269e73889cfa\") " pod="openshift-monitoring/node-exporter-vmq99" Jun 05 03:47:50.198603 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.198562 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkj9m\" (UniqueName: \"kubernetes.io/projected/27a8954a-c8dc-4cd9-a91d-281190eddf66-kube-api-access-vkj9m\") pod \"openshift-state-metrics-65f78d5c66-5np9q\" (UID: \"27a8954a-c8dc-4cd9-a91d-281190eddf66\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-5np9q" Jun 05 03:47:50.198603 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.198597 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2e130185-59d5-46eb-bbfb-f740c3894b05-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-rhvn7\" (UID: \"2e130185-59d5-46eb-bbfb-f740c3894b05\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rhvn7" Jun 05 03:47:50.198709 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.198619 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27a8954a-c8dc-4cd9-a91d-281190eddf66-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-5np9q\" (UID: \"27a8954a-c8dc-4cd9-a91d-281190eddf66\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-5np9q" Jun 05 03:47:50.198709 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.198640 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/011753a9-698b-4e4d-abcf-269e73889cfa-node-exporter-textfile\") pod \"node-exporter-vmq99\" (UID: \"011753a9-698b-4e4d-abcf-269e73889cfa\") " pod="openshift-monitoring/node-exporter-vmq99" Jun 05 03:47:50.198709 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.198664 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/011753a9-698b-4e4d-abcf-269e73889cfa-node-exporter-wtmp\") pod \"node-exporter-vmq99\" (UID: \"011753a9-698b-4e4d-abcf-269e73889cfa\") " pod="openshift-monitoring/node-exporter-vmq99" Jun 05 03:47:50.198709 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.198688 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/011753a9-698b-4e4d-abcf-269e73889cfa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vmq99\" (UID: \"011753a9-698b-4e4d-abcf-269e73889cfa\") " pod="openshift-monitoring/node-exporter-vmq99" Jun 05 03:47:50.198883 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.198719 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/011753a9-698b-4e4d-abcf-269e73889cfa-node-exporter-accelerators-collector-config\") pod \"node-exporter-vmq99\" (UID: \"011753a9-698b-4e4d-abcf-269e73889cfa\") " pod="openshift-monitoring/node-exporter-vmq99" Jun 05 03:47:50.198883 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.198757 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2e130185-59d5-46eb-bbfb-f740c3894b05-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-rhvn7\" (UID: \"2e130185-59d5-46eb-bbfb-f740c3894b05\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rhvn7" Jun 05 03:47:50.198883 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.198796 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/011753a9-698b-4e4d-abcf-269e73889cfa-node-exporter-tls\") pod \"node-exporter-vmq99\" (UID: \"011753a9-698b-4e4d-abcf-269e73889cfa\") " pod="openshift-monitoring/node-exporter-vmq99" Jun 05 03:47:50.198883 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.198860 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/011753a9-698b-4e4d-abcf-269e73889cfa-metrics-client-ca\") pod \"node-exporter-vmq99\" (UID: \"011753a9-698b-4e4d-abcf-269e73889cfa\") " pod="openshift-monitoring/node-exporter-vmq99" Jun 05 03:47:50.199029 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.198894 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/27a8954a-c8dc-4cd9-a91d-281190eddf66-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-5np9q\" (UID: \"27a8954a-c8dc-4cd9-a91d-281190eddf66\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-5np9q" Jun 05 03:47:50.199585 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.199563 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 05 03:47:50.199668 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.199565 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-g84qt\"" Jun 05 03:47:50.204173 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.204148 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-rhvn7"] Jun 05 03:47:50.299228 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.299197 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e130185-59d5-46eb-bbfb-f740c3894b05-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-rhvn7\" (UID: \"2e130185-59d5-46eb-bbfb-f740c3894b05\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rhvn7" Jun 05 03:47:50.299228 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.299231 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/011753a9-698b-4e4d-abcf-269e73889cfa-sys\") pod \"node-exporter-vmq99\" (UID: \"011753a9-698b-4e4d-abcf-269e73889cfa\") " pod="openshift-monitoring/node-exporter-vmq99" Jun 05 03:47:50.299481 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.299253 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cgs9\" (UniqueName: \"kubernetes.io/projected/011753a9-698b-4e4d-abcf-269e73889cfa-kube-api-access-7cgs9\") pod \"node-exporter-vmq99\" (UID: \"011753a9-698b-4e4d-abcf-269e73889cfa\") " pod="openshift-monitoring/node-exporter-vmq99" Jun 05 03:47:50.299481 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.299285 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e130185-59d5-46eb-bbfb-f740c3894b05-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-rhvn7\" (UID: \"2e130185-59d5-46eb-bbfb-f740c3894b05\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rhvn7" Jun 05 03:47:50.299481 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.299314 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e130185-59d5-46eb-bbfb-f740c3894b05-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-rhvn7\" (UID: \"2e130185-59d5-46eb-bbfb-f740c3894b05\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rhvn7" Jun 05 03:47:50.299481 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.299340 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wbx5\" (UniqueName: \"kubernetes.io/projected/2e130185-59d5-46eb-bbfb-f740c3894b05-kube-api-access-6wbx5\") pod \"kube-state-metrics-57bbf8bfb5-rhvn7\" (UID: \"2e130185-59d5-46eb-bbfb-f740c3894b05\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rhvn7" Jun 05 03:47:50.299481 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.299366 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/011753a9-698b-4e4d-abcf-269e73889cfa-root\") pod \"node-exporter-vmq99\" (UID: \"011753a9-698b-4e4d-abcf-269e73889cfa\") " pod="openshift-monitoring/node-exporter-vmq99" Jun 05 03:47:50.299481 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.299388 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkj9m\" (UniqueName: \"kubernetes.io/projected/27a8954a-c8dc-4cd9-a91d-281190eddf66-kube-api-access-vkj9m\") pod \"openshift-state-metrics-65f78d5c66-5np9q\" (UID: \"27a8954a-c8dc-4cd9-a91d-281190eddf66\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-5np9q" Jun 05 03:47:50.299481 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.299338 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/011753a9-698b-4e4d-abcf-269e73889cfa-sys\") pod \"node-exporter-vmq99\" (UID: \"011753a9-698b-4e4d-abcf-269e73889cfa\") " pod="openshift-monitoring/node-exporter-vmq99" Jun 05 03:47:50.299481 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:50.299404 2548 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 05 03:47:50.299481 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.299415 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2e130185-59d5-46eb-bbfb-f740c3894b05-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-rhvn7\" (UID: \"2e130185-59d5-46eb-bbfb-f740c3894b05\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rhvn7" Jun 05 03:47:50.299918 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.299485 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/011753a9-698b-4e4d-abcf-269e73889cfa-root\") pod \"node-exporter-vmq99\" (UID: \"011753a9-698b-4e4d-abcf-269e73889cfa\") " pod="openshift-monitoring/node-exporter-vmq99" Jun 05 03:47:50.299918 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.299493 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27a8954a-c8dc-4cd9-a91d-281190eddf66-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-5np9q\" (UID: \"27a8954a-c8dc-4cd9-a91d-281190eddf66\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-5np9q" Jun 05 03:47:50.299918 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:47:50.299546 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e130185-59d5-46eb-bbfb-f740c3894b05-kube-state-metrics-tls podName:2e130185-59d5-46eb-bbfb-f740c3894b05 nodeName:}" failed. No retries permitted until 2026-06-05 03:47:50.799526093 +0000 UTC m=+270.069302393 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/2e130185-59d5-46eb-bbfb-f740c3894b05-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-rhvn7" (UID: "2e130185-59d5-46eb-bbfb-f740c3894b05") : secret "kube-state-metrics-tls" not found Jun 05 03:47:50.299918 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.299567 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/011753a9-698b-4e4d-abcf-269e73889cfa-node-exporter-textfile\") pod \"node-exporter-vmq99\" (UID: \"011753a9-698b-4e4d-abcf-269e73889cfa\") " pod="openshift-monitoring/node-exporter-vmq99" Jun 05 03:47:50.299918 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.299621 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/011753a9-698b-4e4d-abcf-269e73889cfa-node-exporter-wtmp\") pod \"node-exporter-vmq99\" (UID: \"011753a9-698b-4e4d-abcf-269e73889cfa\") " pod="openshift-monitoring/node-exporter-vmq99" Jun 05 03:47:50.299918 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.299655 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/011753a9-698b-4e4d-abcf-269e73889cfa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vmq99\" (UID: \"011753a9-698b-4e4d-abcf-269e73889cfa\") " pod="openshift-monitoring/node-exporter-vmq99" Jun 05 03:47:50.299918 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.299689 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/011753a9-698b-4e4d-abcf-269e73889cfa-node-exporter-accelerators-collector-config\") pod \"node-exporter-vmq99\" (UID: \"011753a9-698b-4e4d-abcf-269e73889cfa\") " pod="openshift-monitoring/node-exporter-vmq99" Jun 05 03:47:50.299918 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.299722 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2e130185-59d5-46eb-bbfb-f740c3894b05-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-rhvn7\" (UID: \"2e130185-59d5-46eb-bbfb-f740c3894b05\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rhvn7" Jun 05 03:47:50.299918 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.299767 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/011753a9-698b-4e4d-abcf-269e73889cfa-node-exporter-tls\") pod \"node-exporter-vmq99\" (UID: \"011753a9-698b-4e4d-abcf-269e73889cfa\") " pod="openshift-monitoring/node-exporter-vmq99" Jun 05 03:47:50.299918 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.299822 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/011753a9-698b-4e4d-abcf-269e73889cfa-metrics-client-ca\") pod \"node-exporter-vmq99\" (UID: \"011753a9-698b-4e4d-abcf-269e73889cfa\") " pod="openshift-monitoring/node-exporter-vmq99" Jun 05 03:47:50.299918 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.299845 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/27a8954a-c8dc-4cd9-a91d-281190eddf66-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-5np9q\" (UID: \"27a8954a-c8dc-4cd9-a91d-281190eddf66\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-5np9q" Jun 05 03:47:50.299918 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.299893 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27a8954a-c8dc-4cd9-a91d-281190eddf66-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-5np9q\" (UID: \"27a8954a-c8dc-4cd9-a91d-281190eddf66\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-5np9q" Jun 05 03:47:50.299918 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.299915 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2e130185-59d5-46eb-bbfb-f740c3894b05-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-rhvn7\" (UID: \"2e130185-59d5-46eb-bbfb-f740c3894b05\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rhvn7" Jun 05 03:47:50.300586 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.299940 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/011753a9-698b-4e4d-abcf-269e73889cfa-node-exporter-textfile\") pod \"node-exporter-vmq99\" (UID: \"011753a9-698b-4e4d-abcf-269e73889cfa\") " pod="openshift-monitoring/node-exporter-vmq99" Jun 05 03:47:50.300586 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.300115 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e130185-59d5-46eb-bbfb-f740c3894b05-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-rhvn7\" (UID: \"2e130185-59d5-46eb-bbfb-f740c3894b05\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rhvn7" Jun 05 03:47:50.300586 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.300115 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27a8954a-c8dc-4cd9-a91d-281190eddf66-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-5np9q\" (UID: \"27a8954a-c8dc-4cd9-a91d-281190eddf66\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-5np9q" Jun 05 03:47:50.300586 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.300247 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/011753a9-698b-4e4d-abcf-269e73889cfa-node-exporter-wtmp\") pod \"node-exporter-vmq99\" (UID: \"011753a9-698b-4e4d-abcf-269e73889cfa\") " pod="openshift-monitoring/node-exporter-vmq99" Jun 05 03:47:50.300586 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.300541 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2e130185-59d5-46eb-bbfb-f740c3894b05-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-rhvn7\" (UID: \"2e130185-59d5-46eb-bbfb-f740c3894b05\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rhvn7" Jun 05 03:47:50.301100 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.301075 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/011753a9-698b-4e4d-abcf-269e73889cfa-node-exporter-accelerators-collector-config\") pod \"node-exporter-vmq99\" (UID: \"011753a9-698b-4e4d-abcf-269e73889cfa\") " pod="openshift-monitoring/node-exporter-vmq99" Jun 05 03:47:50.301466 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.301444 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/011753a9-698b-4e4d-abcf-269e73889cfa-metrics-client-ca\") pod \"node-exporter-vmq99\" (UID: \"011753a9-698b-4e4d-abcf-269e73889cfa\") " pod="openshift-monitoring/node-exporter-vmq99" Jun 05 03:47:50.302446 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.302407 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/011753a9-698b-4e4d-abcf-269e73889cfa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vmq99\" (UID: \"011753a9-698b-4e4d-abcf-269e73889cfa\") " pod="openshift-monitoring/node-exporter-vmq99" Jun 05 03:47:50.302547 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.302525 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e130185-59d5-46eb-bbfb-f740c3894b05-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-rhvn7\" (UID: \"2e130185-59d5-46eb-bbfb-f740c3894b05\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rhvn7" Jun 05 03:47:50.302978 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.302956 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27a8954a-c8dc-4cd9-a91d-281190eddf66-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-5np9q\" (UID: \"27a8954a-c8dc-4cd9-a91d-281190eddf66\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-5np9q" Jun 05 03:47:50.303064 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.303049 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/011753a9-698b-4e4d-abcf-269e73889cfa-node-exporter-tls\") pod \"node-exporter-vmq99\" (UID: \"011753a9-698b-4e4d-abcf-269e73889cfa\") " pod="openshift-monitoring/node-exporter-vmq99" Jun 05 03:47:50.303132 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.303101 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/27a8954a-c8dc-4cd9-a91d-281190eddf66-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-5np9q\" (UID: \"27a8954a-c8dc-4cd9-a91d-281190eddf66\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-5np9q" Jun 05 03:47:50.311646 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.311626 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cgs9\" (UniqueName: \"kubernetes.io/projected/011753a9-698b-4e4d-abcf-269e73889cfa-kube-api-access-7cgs9\") pod \"node-exporter-vmq99\" (UID: \"011753a9-698b-4e4d-abcf-269e73889cfa\") " pod="openshift-monitoring/node-exporter-vmq99" Jun 05 03:47:50.314530 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.314506 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkj9m\" (UniqueName: \"kubernetes.io/projected/27a8954a-c8dc-4cd9-a91d-281190eddf66-kube-api-access-vkj9m\") pod \"openshift-state-metrics-65f78d5c66-5np9q\" (UID: \"27a8954a-c8dc-4cd9-a91d-281190eddf66\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-5np9q" Jun 05 03:47:50.314797 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.314780 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wbx5\" (UniqueName: \"kubernetes.io/projected/2e130185-59d5-46eb-bbfb-f740c3894b05-kube-api-access-6wbx5\") pod \"kube-state-metrics-57bbf8bfb5-rhvn7\" (UID: \"2e130185-59d5-46eb-bbfb-f740c3894b05\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rhvn7" Jun 05 03:47:50.494673 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.494602 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-5np9q" Jun 05 03:47:50.510155 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.510130 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vmq99" Jun 05 03:47:50.521312 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:47:50.521278 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod011753a9_698b_4e4d_abcf_269e73889cfa.slice/crio-880fd2640c9c3b068ea96af06b9270eaf0aa447d573908e813179c9dbb692b18 WatchSource:0}: Error finding container 880fd2640c9c3b068ea96af06b9270eaf0aa447d573908e813179c9dbb692b18: Status 404 returned error can't find the container with id 880fd2640c9c3b068ea96af06b9270eaf0aa447d573908e813179c9dbb692b18 Jun 05 03:47:50.629277 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.629245 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-5np9q"] Jun 05 03:47:50.631835 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:47:50.631811 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27a8954a_c8dc_4cd9_a91d_281190eddf66.slice/crio-8fce3c81767fe7d901734b4570ee4808102bcf6f830073d9c5eaff0a609756b7 WatchSource:0}: Error finding container 8fce3c81767fe7d901734b4570ee4808102bcf6f830073d9c5eaff0a609756b7: Status 404 returned error can't find the container with id 8fce3c81767fe7d901734b4570ee4808102bcf6f830073d9c5eaff0a609756b7 Jun 05 03:47:50.803794 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.803746 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e130185-59d5-46eb-bbfb-f740c3894b05-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-rhvn7\" (UID: \"2e130185-59d5-46eb-bbfb-f740c3894b05\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rhvn7" Jun 05 03:47:50.806220 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:50.806196 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e130185-59d5-46eb-bbfb-f740c3894b05-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-rhvn7\" (UID: \"2e130185-59d5-46eb-bbfb-f740c3894b05\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rhvn7" Jun 05 03:47:51.031714 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:51.031669 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-5np9q" event={"ID":"27a8954a-c8dc-4cd9-a91d-281190eddf66","Type":"ContainerStarted","Data":"d947bb098206429c3d65024476dcb83b8491242cdd96430806caf9c55b0e4931"} Jun 05 03:47:51.031904 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:51.031748 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-5np9q" event={"ID":"27a8954a-c8dc-4cd9-a91d-281190eddf66","Type":"ContainerStarted","Data":"350daf452a67d7862ca80301113956daf370c2720c6c670b31aca4591555d073"} Jun 05 03:47:51.031904 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:51.031781 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-5np9q" event={"ID":"27a8954a-c8dc-4cd9-a91d-281190eddf66","Type":"ContainerStarted","Data":"8fce3c81767fe7d901734b4570ee4808102bcf6f830073d9c5eaff0a609756b7"} Jun 05 03:47:51.033204 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:51.033173 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vmq99" event={"ID":"011753a9-698b-4e4d-abcf-269e73889cfa","Type":"ContainerStarted","Data":"880fd2640c9c3b068ea96af06b9270eaf0aa447d573908e813179c9dbb692b18"} Jun 05 03:47:51.103988 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:51.103955 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rhvn7" Jun 05 03:47:51.256086 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:51.256058 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-rhvn7"] Jun 05 03:47:51.357626 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:47:51.357507 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e130185_59d5_46eb_bbfb_f740c3894b05.slice/crio-35107c0e43d586972467646fd9b1a5f8aa548c4d52d1b31888077ee92dd68373 WatchSource:0}: Error finding container 35107c0e43d586972467646fd9b1a5f8aa548c4d52d1b31888077ee92dd68373: Status 404 returned error can't find the container with id 35107c0e43d586972467646fd9b1a5f8aa548c4d52d1b31888077ee92dd68373 Jun 05 03:47:52.040200 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:52.040066 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vmq99" event={"ID":"011753a9-698b-4e4d-abcf-269e73889cfa","Type":"ContainerDied","Data":"d187150fea75093f1ca76f8ea0dc4891b655b3689700af7cbbbb556ffa7d930c"} Jun 05 03:47:52.040692 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:52.040668 2548 generic.go:356] "Generic (PLEG): container finished" podID="011753a9-698b-4e4d-abcf-269e73889cfa" containerID="d187150fea75093f1ca76f8ea0dc4891b655b3689700af7cbbbb556ffa7d930c" exitCode=0 Jun 05 03:47:52.043680 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:52.043654 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rhvn7" event={"ID":"2e130185-59d5-46eb-bbfb-f740c3894b05","Type":"ContainerStarted","Data":"35107c0e43d586972467646fd9b1a5f8aa548c4d52d1b31888077ee92dd68373"} Jun 05 03:47:52.821733 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:52.821696 2548 patch_prober.go:28] interesting pod/image-registry-6b9cd897b-fx89g container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 03:47:52.822066 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:52.821759 2548 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" podUID="5f45f77e-672b-485c-a367-cf29229799e2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 03:47:53.050032 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.049998 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-5np9q" event={"ID":"27a8954a-c8dc-4cd9-a91d-281190eddf66","Type":"ContainerStarted","Data":"3a805a333b0f8594df4ff7d8a4a2ee5bc05c4cb3b433d9453946ae922e0d1b74"} Jun 05 03:47:53.052271 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.052244 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rhvn7" event={"ID":"2e130185-59d5-46eb-bbfb-f740c3894b05","Type":"ContainerStarted","Data":"0f3824534186b260eef88da4e7c7cd72e48d7dae790f956254df1cced40e8e39"} Jun 05 03:47:53.052389 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.052297 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rhvn7" event={"ID":"2e130185-59d5-46eb-bbfb-f740c3894b05","Type":"ContainerStarted","Data":"43a74aade123b0189a351bad86b6eaedf400406c9e577a5134dcff6a09373a42"} Jun 05 03:47:53.052389 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.052326 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rhvn7" event={"ID":"2e130185-59d5-46eb-bbfb-f740c3894b05","Type":"ContainerStarted","Data":"5a636884aaa5bb33a4b3cdea2a314497e59d2db2edbe0f25a26179c5b301201a"} Jun 05 03:47:53.054313 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.054293 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vmq99" event={"ID":"011753a9-698b-4e4d-abcf-269e73889cfa","Type":"ContainerStarted","Data":"b617df0fd25208c18e979fe5514e50a599760c66ff0f0d089662dbc5896bd65c"} Jun 05 03:47:53.054393 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.054334 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vmq99" event={"ID":"011753a9-698b-4e4d-abcf-269e73889cfa","Type":"ContainerStarted","Data":"7123b4d5ee8d0b9570de721b5779e60439d90af01ce2269236b001d6960029a5"} Jun 05 03:47:53.067020 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.066973 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-5np9q" podStartSLOduration=1.8076300010000002 podStartE2EDuration="3.066960497s" totalImagesPullingTime="1.259330496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:47:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:47:53.066038681 +0000 UTC m=+272.335815024" watchObservedRunningTime="2026-06-05 03:47:53.066960497 +0000 UTC m=+272.336736814" Jun 05 03:47:53.084325 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.084272 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rhvn7" podStartSLOduration=1.868246085 podStartE2EDuration="3.084256969s" totalImagesPullingTime="1.216010884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:47:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:47:53.082710085 +0000 UTC m=+272.352486404" watchObservedRunningTime="2026-06-05 03:47:53.084256969 +0000 UTC m=+272.354033287" Jun 05 03:47:53.104955 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.104909 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vmq99" podStartSLOduration=2.152582144 podStartE2EDuration="3.104890867s" totalImagesPullingTime="880.329204ms" totalInitContainerRuntime="71.979519ms" isStatefulPod=true podCreationTimestamp="2026-06-05 03:47:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:47:53.104203644 +0000 UTC m=+272.373979962" watchObservedRunningTime="2026-06-05 03:47:53.104890867 +0000 UTC m=+272.374667185" Jun 05 03:47:53.288504 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.288473 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt"] Jun 05 03:47:53.292283 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.292265 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt" Jun 05 03:47:53.295698 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.295675 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 05 03:47:53.295812 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.295708 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 05 03:47:53.295812 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.295709 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 05 03:47:53.296101 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.296082 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 05 03:47:53.296101 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.296092 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-5s2dg\"" Jun 05 03:47:53.296238 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.296148 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 05 03:47:53.296238 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.296094 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8nj2t2bveejku\"" Jun 05 03:47:53.312530 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.312480 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt"] Jun 05 03:47:53.320412 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.320390 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5209f51a-e87c-4932-b39f-b82ba646919b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5db4d7fd7b-jqkbt\" (UID: \"5209f51a-e87c-4932-b39f-b82ba646919b\") " pod="openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt" Jun 05 03:47:53.320501 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.320419 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5209f51a-e87c-4932-b39f-b82ba646919b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5db4d7fd7b-jqkbt\" (UID: \"5209f51a-e87c-4932-b39f-b82ba646919b\") " pod="openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt" Jun 05 03:47:53.320501 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.320459 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5209f51a-e87c-4932-b39f-b82ba646919b-metrics-client-ca\") pod \"thanos-querier-5db4d7fd7b-jqkbt\" (UID: \"5209f51a-e87c-4932-b39f-b82ba646919b\") " pod="openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt" Jun 05 03:47:53.320587 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.320515 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5209f51a-e87c-4932-b39f-b82ba646919b-secret-grpc-tls\") pod \"thanos-querier-5db4d7fd7b-jqkbt\" (UID: \"5209f51a-e87c-4932-b39f-b82ba646919b\") " pod="openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt" Jun 05 03:47:53.320587 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.320560 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5209f51a-e87c-4932-b39f-b82ba646919b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5db4d7fd7b-jqkbt\" (UID: \"5209f51a-e87c-4932-b39f-b82ba646919b\") " pod="openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt" Jun 05 03:47:53.320654 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.320603 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5209f51a-e87c-4932-b39f-b82ba646919b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5db4d7fd7b-jqkbt\" (UID: \"5209f51a-e87c-4932-b39f-b82ba646919b\") " pod="openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt" Jun 05 03:47:53.320738 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.320689 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5209f51a-e87c-4932-b39f-b82ba646919b-secret-thanos-querier-tls\") pod \"thanos-querier-5db4d7fd7b-jqkbt\" (UID: \"5209f51a-e87c-4932-b39f-b82ba646919b\") " pod="openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt" Jun 05 03:47:53.320738 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.320710 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szr44\" (UniqueName: \"kubernetes.io/projected/5209f51a-e87c-4932-b39f-b82ba646919b-kube-api-access-szr44\") pod \"thanos-querier-5db4d7fd7b-jqkbt\" (UID: \"5209f51a-e87c-4932-b39f-b82ba646919b\") " pod="openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt" Jun 05 03:47:53.421050 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.421020 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5209f51a-e87c-4932-b39f-b82ba646919b-secret-thanos-querier-tls\") pod \"thanos-querier-5db4d7fd7b-jqkbt\" (UID: \"5209f51a-e87c-4932-b39f-b82ba646919b\") " pod="openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt" Jun 05 03:47:53.421230 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.421056 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szr44\" (UniqueName: \"kubernetes.io/projected/5209f51a-e87c-4932-b39f-b82ba646919b-kube-api-access-szr44\") pod \"thanos-querier-5db4d7fd7b-jqkbt\" (UID: \"5209f51a-e87c-4932-b39f-b82ba646919b\") " pod="openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt" Jun 05 03:47:53.421230 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.421097 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5209f51a-e87c-4932-b39f-b82ba646919b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5db4d7fd7b-jqkbt\" (UID: \"5209f51a-e87c-4932-b39f-b82ba646919b\") " pod="openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt" Jun 05 03:47:53.421230 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.421117 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5209f51a-e87c-4932-b39f-b82ba646919b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5db4d7fd7b-jqkbt\" (UID: \"5209f51a-e87c-4932-b39f-b82ba646919b\") " pod="openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt" Jun 05 03:47:53.421230 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.421132 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5209f51a-e87c-4932-b39f-b82ba646919b-metrics-client-ca\") pod \"thanos-querier-5db4d7fd7b-jqkbt\" (UID: \"5209f51a-e87c-4932-b39f-b82ba646919b\") " pod="openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt" Jun 05 03:47:53.421230 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.421155 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5209f51a-e87c-4932-b39f-b82ba646919b-secret-grpc-tls\") pod \"thanos-querier-5db4d7fd7b-jqkbt\" (UID: \"5209f51a-e87c-4932-b39f-b82ba646919b\") " pod="openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt" Jun 05 03:47:53.421540 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.421314 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5209f51a-e87c-4932-b39f-b82ba646919b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5db4d7fd7b-jqkbt\" (UID: \"5209f51a-e87c-4932-b39f-b82ba646919b\") " pod="openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt" Jun 05 03:47:53.421540 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.421415 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5209f51a-e87c-4932-b39f-b82ba646919b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5db4d7fd7b-jqkbt\" (UID: \"5209f51a-e87c-4932-b39f-b82ba646919b\") " pod="openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt" Jun 05 03:47:53.422182 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.422153 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5209f51a-e87c-4932-b39f-b82ba646919b-metrics-client-ca\") pod \"thanos-querier-5db4d7fd7b-jqkbt\" (UID: \"5209f51a-e87c-4932-b39f-b82ba646919b\") " pod="openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt" Jun 05 03:47:53.424165 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.424136 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5209f51a-e87c-4932-b39f-b82ba646919b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5db4d7fd7b-jqkbt\" (UID: \"5209f51a-e87c-4932-b39f-b82ba646919b\") " pod="openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt" Jun 05 03:47:53.424290 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.424176 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5209f51a-e87c-4932-b39f-b82ba646919b-secret-grpc-tls\") pod \"thanos-querier-5db4d7fd7b-jqkbt\" (UID: \"5209f51a-e87c-4932-b39f-b82ba646919b\") " pod="openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt" Jun 05 03:47:53.424367 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.424316 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5209f51a-e87c-4932-b39f-b82ba646919b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5db4d7fd7b-jqkbt\" (UID: \"5209f51a-e87c-4932-b39f-b82ba646919b\") " pod="openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt" Jun 05 03:47:53.424367 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.424341 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5209f51a-e87c-4932-b39f-b82ba646919b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5db4d7fd7b-jqkbt\" (UID: \"5209f51a-e87c-4932-b39f-b82ba646919b\") " pod="openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt" Jun 05 03:47:53.424512 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.424468 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5209f51a-e87c-4932-b39f-b82ba646919b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5db4d7fd7b-jqkbt\" (UID: \"5209f51a-e87c-4932-b39f-b82ba646919b\") " pod="openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt" Jun 05 03:47:53.424686 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.424666 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5209f51a-e87c-4932-b39f-b82ba646919b-secret-thanos-querier-tls\") pod \"thanos-querier-5db4d7fd7b-jqkbt\" (UID: \"5209f51a-e87c-4932-b39f-b82ba646919b\") " pod="openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt" Jun 05 03:47:53.429227 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.429206 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szr44\" (UniqueName: \"kubernetes.io/projected/5209f51a-e87c-4932-b39f-b82ba646919b-kube-api-access-szr44\") pod \"thanos-querier-5db4d7fd7b-jqkbt\" (UID: \"5209f51a-e87c-4932-b39f-b82ba646919b\") " pod="openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt" Jun 05 03:47:53.601807 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.601707 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt" Jun 05 03:47:53.729928 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:53.729829 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt"] Jun 05 03:47:53.733316 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:47:53.733285 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5209f51a_e87c_4932_b39f_b82ba646919b.slice/crio-74bff30f09b23cf5037bbb4c90078699a5348ee98c73492737c7964c1161d300 WatchSource:0}: Error finding container 74bff30f09b23cf5037bbb4c90078699a5348ee98c73492737c7964c1161d300: Status 404 returned error can't find the container with id 74bff30f09b23cf5037bbb4c90078699a5348ee98c73492737c7964c1161d300 Jun 05 03:47:54.058962 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:54.058921 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt" event={"ID":"5209f51a-e87c-4932-b39f-b82ba646919b","Type":"ContainerStarted","Data":"74bff30f09b23cf5037bbb4c90078699a5348ee98c73492737c7964c1161d300"} Jun 05 03:47:54.958261 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:54.958212 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-j7jlr"] Jun 05 03:47:54.961499 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:54.961479 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-j7jlr" Jun 05 03:47:54.963871 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:54.963852 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 05 03:47:54.963964 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:54.963927 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-gxvfs\"" Jun 05 03:47:54.968829 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:54.968510 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-j7jlr"] Jun 05 03:47:55.033851 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:55.033819 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/017698ba-3b2c-46b9-a785-5a265bf1a8cf-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-j7jlr\" (UID: \"017698ba-3b2c-46b9-a785-5a265bf1a8cf\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-j7jlr" Jun 05 03:47:55.034033 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:55.033869 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lh7s\" (UniqueName: \"kubernetes.io/projected/017698ba-3b2c-46b9-a785-5a265bf1a8cf-kube-api-access-9lh7s\") pod \"monitoring-plugin-76b68cc874-j7jlr\" (UID: \"017698ba-3b2c-46b9-a785-5a265bf1a8cf\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-j7jlr" Jun 05 03:47:55.134612 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:55.134578 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/017698ba-3b2c-46b9-a785-5a265bf1a8cf-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-j7jlr\" (UID: \"017698ba-3b2c-46b9-a785-5a265bf1a8cf\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-j7jlr" Jun 05 03:47:55.135050 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:55.134627 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lh7s\" (UniqueName: \"kubernetes.io/projected/017698ba-3b2c-46b9-a785-5a265bf1a8cf-kube-api-access-9lh7s\") pod \"monitoring-plugin-76b68cc874-j7jlr\" (UID: \"017698ba-3b2c-46b9-a785-5a265bf1a8cf\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-j7jlr" Jun 05 03:47:55.137193 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:55.137167 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/017698ba-3b2c-46b9-a785-5a265bf1a8cf-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-j7jlr\" (UID: \"017698ba-3b2c-46b9-a785-5a265bf1a8cf\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-j7jlr" Jun 05 03:47:55.142477 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:55.142452 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lh7s\" (UniqueName: \"kubernetes.io/projected/017698ba-3b2c-46b9-a785-5a265bf1a8cf-kube-api-access-9lh7s\") pod \"monitoring-plugin-76b68cc874-j7jlr\" (UID: \"017698ba-3b2c-46b9-a785-5a265bf1a8cf\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-j7jlr" Jun 05 03:47:55.272057 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:55.272027 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-j7jlr" Jun 05 03:47:55.942906 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:55.942882 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-j7jlr"] Jun 05 03:47:55.945060 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:47:55.945036 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod017698ba_3b2c_46b9_a785_5a265bf1a8cf.slice/crio-1062938d8b4463cbeb4bedce2b3afe065439eb47e557066006d7af3792634c9b WatchSource:0}: Error finding container 1062938d8b4463cbeb4bedce2b3afe065439eb47e557066006d7af3792634c9b: Status 404 returned error can't find the container with id 1062938d8b4463cbeb4bedce2b3afe065439eb47e557066006d7af3792634c9b Jun 05 03:47:56.068324 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:56.068297 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt" event={"ID":"5209f51a-e87c-4932-b39f-b82ba646919b","Type":"ContainerStarted","Data":"5544405c00fa580408c9a23d00996f0119fc6f213ced73cac0a18ebff5133c61"} Jun 05 03:47:56.068503 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:56.068362 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt" event={"ID":"5209f51a-e87c-4932-b39f-b82ba646919b","Type":"ContainerStarted","Data":"509ee58abdda145cef0bbeec212632348dab757fcc6361533037219464fb4290"} Jun 05 03:47:56.068503 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:56.068389 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt" event={"ID":"5209f51a-e87c-4932-b39f-b82ba646919b","Type":"ContainerStarted","Data":"ccaf7ad939cff4c87aa52c1f94c8dfa2b378be7a3acdf6d729a14718dbbb136d"} Jun 05 03:47:56.069561 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:56.069540 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-j7jlr" event={"ID":"017698ba-3b2c-46b9-a785-5a265bf1a8cf","Type":"ContainerStarted","Data":"1062938d8b4463cbeb4bedce2b3afe065439eb47e557066006d7af3792634c9b"} Jun 05 03:47:57.077132 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:57.077054 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt" event={"ID":"5209f51a-e87c-4932-b39f-b82ba646919b","Type":"ContainerStarted","Data":"ef714b9d83731c751f4db4cc46634021009e34f7833ecc788688b2c4a7271aee"} Jun 05 03:47:57.077132 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:57.077130 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt" event={"ID":"5209f51a-e87c-4932-b39f-b82ba646919b","Type":"ContainerStarted","Data":"62003f5195ee5cf831a3741adad6c3331a06bb5b98874a8c88ee11532f9d8359"} Jun 05 03:47:57.077599 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:57.077170 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt" event={"ID":"5209f51a-e87c-4932-b39f-b82ba646919b","Type":"ContainerStarted","Data":"16792463dbd9b4f056198f902db21d5c0428ff8defbb208a80ea926e96fd5f5a"} Jun 05 03:47:57.077599 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:57.077217 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt" Jun 05 03:47:57.102853 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:57.102792 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt" podStartSLOduration=1.27954067 podStartE2EDuration="4.102775486s" totalImagesPullingTime="2.823234816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:47:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:47:57.102421038 +0000 UTC m=+276.372197356" watchObservedRunningTime="2026-06-05 03:47:57.102775486 +0000 UTC m=+276.372551805" Jun 05 03:47:58.082527 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:58.082489 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-j7jlr" event={"ID":"017698ba-3b2c-46b9-a785-5a265bf1a8cf","Type":"ContainerStarted","Data":"fb9b53d849102597ca2765dbcf9b70805de299ad6e585b469f22af0e61e521a7"} Jun 05 03:47:58.082966 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:58.082661 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-j7jlr" Jun 05 03:47:58.087361 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:58.087340 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-j7jlr" Jun 05 03:47:58.100570 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:47:58.100523 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-j7jlr" podStartSLOduration=2.669463056 podStartE2EDuration="4.100509276s" totalImagesPullingTime="1.43104622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:47:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:47:58.098993127 +0000 UTC m=+277.368769446" watchObservedRunningTime="2026-06-05 03:47:58.100509276 +0000 UTC m=+277.370285667" Jun 05 03:48:02.720607 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:48:02.720566 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mhbhg" podUID="f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce" Jun 05 03:48:02.819967 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:02.819935 2548 patch_prober.go:28] interesting pod/image-registry-6b9cd897b-fx89g container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 03:48:02.820100 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:02.820016 2548 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" podUID="5f45f77e-672b-485c-a367-cf29229799e2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 03:48:03.089190 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:03.089165 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5db4d7fd7b-jqkbt" Jun 05 03:48:03.101683 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:03.101654 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mhbhg" Jun 05 03:48:03.165758 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:03.165724 2548 patch_prober.go:28] interesting pod/image-registry-6855569764-bpwhz container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 03:48:03.165917 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:03.165788 2548 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6855569764-bpwhz" podUID="240a9603-97bc-4acb-9553-2ddbc0aa231f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 03:48:04.218628 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:04.218588 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-d8kvd"] Jun 05 03:48:04.222251 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:04.222228 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-d8kvd" Jun 05 03:48:04.224772 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:04.224737 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 05 03:48:04.224897 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:04.224867 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-d67ns\"" Jun 05 03:48:04.224897 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:04.224889 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 05 03:48:04.231388 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:04.231366 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-d8kvd"] Jun 05 03:48:04.316382 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:04.316347 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhhhl\" (UniqueName: \"kubernetes.io/projected/aa942ee0-0354-4c2f-928a-f23c4ed20aed-kube-api-access-dhhhl\") pod \"downloads-6657875f97-d8kvd\" (UID: \"aa942ee0-0354-4c2f-928a-f23c4ed20aed\") " pod="openshift-console/downloads-6657875f97-d8kvd" Jun 05 03:48:04.416982 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:04.416932 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhhhl\" (UniqueName: \"kubernetes.io/projected/aa942ee0-0354-4c2f-928a-f23c4ed20aed-kube-api-access-dhhhl\") pod \"downloads-6657875f97-d8kvd\" (UID: \"aa942ee0-0354-4c2f-928a-f23c4ed20aed\") " pod="openshift-console/downloads-6657875f97-d8kvd" Jun 05 03:48:04.425109 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:04.425083 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhhhl\" (UniqueName: \"kubernetes.io/projected/aa942ee0-0354-4c2f-928a-f23c4ed20aed-kube-api-access-dhhhl\") pod \"downloads-6657875f97-d8kvd\" (UID: \"aa942ee0-0354-4c2f-928a-f23c4ed20aed\") " pod="openshift-console/downloads-6657875f97-d8kvd" Jun 05 03:48:04.531222 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:04.531190 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-d8kvd" Jun 05 03:48:04.656415 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:04.656393 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-d8kvd"] Jun 05 03:48:04.658600 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:48:04.658573 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa942ee0_0354_4c2f_928a_f23c4ed20aed.slice/crio-835a45cdff126bd073cf5452e7b54b991548274e9f6e6c7472558b6ca42372ba WatchSource:0}: Error finding container 835a45cdff126bd073cf5452e7b54b991548274e9f6e6c7472558b6ca42372ba: Status 404 returned error can't find the container with id 835a45cdff126bd073cf5452e7b54b991548274e9f6e6c7472558b6ca42372ba Jun 05 03:48:05.010930 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:05.010906 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6855569764-bpwhz" Jun 05 03:48:05.110348 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:05.110316 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-d8kvd" event={"ID":"aa942ee0-0354-4c2f-928a-f23c4ed20aed","Type":"ContainerStarted","Data":"835a45cdff126bd073cf5452e7b54b991548274e9f6e6c7472558b6ca42372ba"} Jun 05 03:48:06.034145 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:06.034108 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-metrics-tls\") pod \"dns-default-mhbhg\" (UID: \"f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce\") " pod="openshift-dns/dns-default-mhbhg" Jun 05 03:48:06.037135 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:06.037105 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce-metrics-tls\") pod \"dns-default-mhbhg\" (UID: \"f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce\") " pod="openshift-dns/dns-default-mhbhg" Jun 05 03:48:06.105038 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:06.105007 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q4t6d\"" Jun 05 03:48:06.112548 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:06.112486 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mhbhg" Jun 05 03:48:06.257140 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:06.257111 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mhbhg"] Jun 05 03:48:06.260288 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:48:06.260257 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf65d17ee_42c8_4aaf_a90b_8b7e8a1e37ce.slice/crio-d8eb106a211f84b40f6489863181da9f88a21c0dd3ca21598c9b67bc8474fa9a WatchSource:0}: Error finding container d8eb106a211f84b40f6489863181da9f88a21c0dd3ca21598c9b67bc8474fa9a: Status 404 returned error can't find the container with id d8eb106a211f84b40f6489863181da9f88a21c0dd3ca21598c9b67bc8474fa9a Jun 05 03:48:07.122535 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:07.122484 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mhbhg" event={"ID":"f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce","Type":"ContainerStarted","Data":"d8eb106a211f84b40f6489863181da9f88a21c0dd3ca21598c9b67bc8474fa9a"} Jun 05 03:48:07.838407 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:07.838321 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" podUID="5f45f77e-672b-485c-a367-cf29229799e2" containerName="registry" containerID="cri-o://f1ff11c974880e315ab021406942ca5b9e6ebad09109229077fa52b93a0481d4" gracePeriod=30 Jun 05 03:48:08.129516 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:08.129476 2548 generic.go:356] "Generic (PLEG): container finished" podID="5f45f77e-672b-485c-a367-cf29229799e2" containerID="f1ff11c974880e315ab021406942ca5b9e6ebad09109229077fa52b93a0481d4" exitCode=0 Jun 05 03:48:08.129885 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:08.129547 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" event={"ID":"5f45f77e-672b-485c-a367-cf29229799e2","Type":"ContainerDied","Data":"f1ff11c974880e315ab021406942ca5b9e6ebad09109229077fa52b93a0481d4"} Jun 05 03:48:08.129885 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:08.129647 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" event={"ID":"5f45f77e-672b-485c-a367-cf29229799e2","Type":"ContainerDied","Data":"9e3c2d2b4b7c9eca8564ee02a93261b7cf0c080e10c25146fe6acd07b4c6f6e8"} Jun 05 03:48:08.129885 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:08.129672 2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e3c2d2b4b7c9eca8564ee02a93261b7cf0c080e10c25146fe6acd07b4c6f6e8" Jun 05 03:48:08.143621 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:08.143601 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" Jun 05 03:48:08.255217 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:08.255134 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrtzg\" (UniqueName: \"kubernetes.io/projected/5f45f77e-672b-485c-a367-cf29229799e2-kube-api-access-qrtzg\") pod \"5f45f77e-672b-485c-a367-cf29229799e2\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " Jun 05 03:48:08.255361 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:08.255287 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5f45f77e-672b-485c-a367-cf29229799e2-ca-trust-extracted\") pod \"5f45f77e-672b-485c-a367-cf29229799e2\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " Jun 05 03:48:08.255361 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:08.255346 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f45f77e-672b-485c-a367-cf29229799e2-bound-sa-token\") pod \"5f45f77e-672b-485c-a367-cf29229799e2\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " Jun 05 03:48:08.255478 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:08.255391 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5f45f77e-672b-485c-a367-cf29229799e2-image-registry-private-configuration\") pod \"5f45f77e-672b-485c-a367-cf29229799e2\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " Jun 05 03:48:08.255478 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:08.255420 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5f45f77e-672b-485c-a367-cf29229799e2-trusted-ca\") pod \"5f45f77e-672b-485c-a367-cf29229799e2\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " Jun 05 03:48:08.255569 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:08.255476 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5f45f77e-672b-485c-a367-cf29229799e2-registry-certificates\") pod \"5f45f77e-672b-485c-a367-cf29229799e2\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " Jun 05 03:48:08.255569 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:08.255508 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f45f77e-672b-485c-a367-cf29229799e2-registry-tls\") pod \"5f45f77e-672b-485c-a367-cf29229799e2\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " Jun 05 03:48:08.255569 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:08.255535 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5f45f77e-672b-485c-a367-cf29229799e2-installation-pull-secrets\") pod \"5f45f77e-672b-485c-a367-cf29229799e2\" (UID: \"5f45f77e-672b-485c-a367-cf29229799e2\") " Jun 05 03:48:08.255898 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:08.255863 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f45f77e-672b-485c-a367-cf29229799e2-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5f45f77e-672b-485c-a367-cf29229799e2" (UID: "5f45f77e-672b-485c-a367-cf29229799e2"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:48:08.256752 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:08.256727 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f45f77e-672b-485c-a367-cf29229799e2-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5f45f77e-672b-485c-a367-cf29229799e2" (UID: "5f45f77e-672b-485c-a367-cf29229799e2"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:48:08.258471 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:08.258394 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f45f77e-672b-485c-a367-cf29229799e2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5f45f77e-672b-485c-a367-cf29229799e2" (UID: "5f45f77e-672b-485c-a367-cf29229799e2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:48:08.258471 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:08.258407 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f45f77e-672b-485c-a367-cf29229799e2-kube-api-access-qrtzg" (OuterVolumeSpecName: "kube-api-access-qrtzg") pod "5f45f77e-672b-485c-a367-cf29229799e2" (UID: "5f45f77e-672b-485c-a367-cf29229799e2"). InnerVolumeSpecName "kube-api-access-qrtzg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:48:08.258654 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:08.258624 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f45f77e-672b-485c-a367-cf29229799e2-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5f45f77e-672b-485c-a367-cf29229799e2" (UID: "5f45f77e-672b-485c-a367-cf29229799e2"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 03:48:08.258654 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:08.258629 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f45f77e-672b-485c-a367-cf29229799e2-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5f45f77e-672b-485c-a367-cf29229799e2" (UID: "5f45f77e-672b-485c-a367-cf29229799e2"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:48:08.259304 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:08.259281 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f45f77e-672b-485c-a367-cf29229799e2-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5f45f77e-672b-485c-a367-cf29229799e2" (UID: "5f45f77e-672b-485c-a367-cf29229799e2"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 03:48:08.266087 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:08.266060 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f45f77e-672b-485c-a367-cf29229799e2-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5f45f77e-672b-485c-a367-cf29229799e2" (UID: "5f45f77e-672b-485c-a367-cf29229799e2"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:48:08.356800 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:08.356755 2548 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5f45f77e-672b-485c-a367-cf29229799e2-image-registry-private-configuration\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:48:08.356800 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:08.356795 2548 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5f45f77e-672b-485c-a367-cf29229799e2-trusted-ca\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:48:08.356800 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:08.356808 2548 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5f45f77e-672b-485c-a367-cf29229799e2-registry-certificates\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:48:08.357048 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:08.356817 2548 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f45f77e-672b-485c-a367-cf29229799e2-registry-tls\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:48:08.357048 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:08.356830 2548 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5f45f77e-672b-485c-a367-cf29229799e2-installation-pull-secrets\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:48:08.357048 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:08.356843 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrtzg\" (UniqueName: \"kubernetes.io/projected/5f45f77e-672b-485c-a367-cf29229799e2-kube-api-access-qrtzg\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:48:08.357048 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:08.356857 2548 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5f45f77e-672b-485c-a367-cf29229799e2-ca-trust-extracted\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:48:08.357048 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:08.356868 2548 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f45f77e-672b-485c-a367-cf29229799e2-bound-sa-token\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:48:09.136221 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.136173 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b9cd897b-fx89g" Jun 05 03:48:09.136221 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.136202 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mhbhg" event={"ID":"f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce","Type":"ContainerStarted","Data":"ee601d8075823b8956c8174870a512675551a9a954a456e57a04256f3af2c849"} Jun 05 03:48:09.136748 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.136261 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mhbhg" event={"ID":"f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce","Type":"ContainerStarted","Data":"0fa83441154923ed1905f9733efb350bf98e20093f3a0b41dedaae8fd4c9e9f5"} Jun 05 03:48:09.136748 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.136588 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mhbhg" Jun 05 03:48:09.158658 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.158591 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mhbhg" podStartSLOduration=251.405163526 podStartE2EDuration="4m13.158577012s" totalImagesPullingTime="1.753413486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:43:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:48:09.157402547 +0000 UTC m=+288.427178866" watchObservedRunningTime="2026-06-05 03:48:09.158577012 +0000 UTC m=+288.428353329" Jun 05 03:48:09.169937 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.169909 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b9cd897b-fx89g"] Jun 05 03:48:09.173710 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.173686 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6b9cd897b-fx89g"] Jun 05 03:48:09.229512 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.229441 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f45f77e-672b-485c-a367-cf29229799e2" path="/var/lib/kubelet/pods/5f45f77e-672b-485c-a367-cf29229799e2/volumes" Jun 05 03:48:09.549452 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.549393 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b769d5447-jw7xt"] Jun 05 03:48:09.549834 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.549817 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f45f77e-672b-485c-a367-cf29229799e2" containerName="registry" Jun 05 03:48:09.549908 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.549838 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f45f77e-672b-485c-a367-cf29229799e2" containerName="registry" Jun 05 03:48:09.549957 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.549908 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f45f77e-672b-485c-a367-cf29229799e2" containerName="registry" Jun 05 03:48:09.554143 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.554120 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b769d5447-jw7xt" Jun 05 03:48:09.556819 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.556796 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 05 03:48:09.556922 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.556829 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 05 03:48:09.557089 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.557068 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 05 03:48:09.557183 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.557145 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 05 03:48:09.557241 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.557207 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 05 03:48:09.557951 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.557931 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fw27x\"" Jun 05 03:48:09.562010 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.561982 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b769d5447-jw7xt"] Jun 05 03:48:09.670918 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.670883 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvw49\" (UniqueName: \"kubernetes.io/projected/12c6c855-e6f7-4bc0-842c-023f0b907519-kube-api-access-gvw49\") pod \"console-7b769d5447-jw7xt\" (UID: \"12c6c855-e6f7-4bc0-842c-023f0b907519\") " pod="openshift-console/console-7b769d5447-jw7xt" Jun 05 03:48:09.671110 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.670964 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12c6c855-e6f7-4bc0-842c-023f0b907519-service-ca\") pod \"console-7b769d5447-jw7xt\" (UID: \"12c6c855-e6f7-4bc0-842c-023f0b907519\") " pod="openshift-console/console-7b769d5447-jw7xt" Jun 05 03:48:09.671110 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.671024 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12c6c855-e6f7-4bc0-842c-023f0b907519-oauth-serving-cert\") pod \"console-7b769d5447-jw7xt\" (UID: \"12c6c855-e6f7-4bc0-842c-023f0b907519\") " pod="openshift-console/console-7b769d5447-jw7xt" Jun 05 03:48:09.671110 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.671103 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12c6c855-e6f7-4bc0-842c-023f0b907519-console-oauth-config\") pod \"console-7b769d5447-jw7xt\" (UID: \"12c6c855-e6f7-4bc0-842c-023f0b907519\") " pod="openshift-console/console-7b769d5447-jw7xt" Jun 05 03:48:09.671345 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.671134 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12c6c855-e6f7-4bc0-842c-023f0b907519-console-serving-cert\") pod \"console-7b769d5447-jw7xt\" (UID: \"12c6c855-e6f7-4bc0-842c-023f0b907519\") " pod="openshift-console/console-7b769d5447-jw7xt" Jun 05 03:48:09.671345 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.671155 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12c6c855-e6f7-4bc0-842c-023f0b907519-console-config\") pod \"console-7b769d5447-jw7xt\" (UID: \"12c6c855-e6f7-4bc0-842c-023f0b907519\") " pod="openshift-console/console-7b769d5447-jw7xt" Jun 05 03:48:09.771915 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.771879 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12c6c855-e6f7-4bc0-842c-023f0b907519-console-config\") pod \"console-7b769d5447-jw7xt\" (UID: \"12c6c855-e6f7-4bc0-842c-023f0b907519\") " pod="openshift-console/console-7b769d5447-jw7xt" Jun 05 03:48:09.771915 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.771922 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvw49\" (UniqueName: \"kubernetes.io/projected/12c6c855-e6f7-4bc0-842c-023f0b907519-kube-api-access-gvw49\") pod \"console-7b769d5447-jw7xt\" (UID: \"12c6c855-e6f7-4bc0-842c-023f0b907519\") " pod="openshift-console/console-7b769d5447-jw7xt" Jun 05 03:48:09.772163 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.771989 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12c6c855-e6f7-4bc0-842c-023f0b907519-service-ca\") pod \"console-7b769d5447-jw7xt\" (UID: \"12c6c855-e6f7-4bc0-842c-023f0b907519\") " pod="openshift-console/console-7b769d5447-jw7xt" Jun 05 03:48:09.772163 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.772017 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12c6c855-e6f7-4bc0-842c-023f0b907519-oauth-serving-cert\") pod \"console-7b769d5447-jw7xt\" (UID: \"12c6c855-e6f7-4bc0-842c-023f0b907519\") " pod="openshift-console/console-7b769d5447-jw7xt" Jun 05 03:48:09.772163 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.772078 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12c6c855-e6f7-4bc0-842c-023f0b907519-console-oauth-config\") pod \"console-7b769d5447-jw7xt\" (UID: \"12c6c855-e6f7-4bc0-842c-023f0b907519\") " pod="openshift-console/console-7b769d5447-jw7xt" Jun 05 03:48:09.772163 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.772106 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12c6c855-e6f7-4bc0-842c-023f0b907519-console-serving-cert\") pod \"console-7b769d5447-jw7xt\" (UID: \"12c6c855-e6f7-4bc0-842c-023f0b907519\") " pod="openshift-console/console-7b769d5447-jw7xt" Jun 05 03:48:09.772747 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.772719 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12c6c855-e6f7-4bc0-842c-023f0b907519-service-ca\") pod \"console-7b769d5447-jw7xt\" (UID: \"12c6c855-e6f7-4bc0-842c-023f0b907519\") " pod="openshift-console/console-7b769d5447-jw7xt" Jun 05 03:48:09.772922 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.772821 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12c6c855-e6f7-4bc0-842c-023f0b907519-console-config\") pod \"console-7b769d5447-jw7xt\" (UID: \"12c6c855-e6f7-4bc0-842c-023f0b907519\") " pod="openshift-console/console-7b769d5447-jw7xt" Jun 05 03:48:09.772922 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.772847 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12c6c855-e6f7-4bc0-842c-023f0b907519-oauth-serving-cert\") pod \"console-7b769d5447-jw7xt\" (UID: \"12c6c855-e6f7-4bc0-842c-023f0b907519\") " pod="openshift-console/console-7b769d5447-jw7xt" Jun 05 03:48:09.774886 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.774865 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12c6c855-e6f7-4bc0-842c-023f0b907519-console-oauth-config\") pod \"console-7b769d5447-jw7xt\" (UID: \"12c6c855-e6f7-4bc0-842c-023f0b907519\") " pod="openshift-console/console-7b769d5447-jw7xt" Jun 05 03:48:09.775126 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.775098 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12c6c855-e6f7-4bc0-842c-023f0b907519-console-serving-cert\") pod \"console-7b769d5447-jw7xt\" (UID: \"12c6c855-e6f7-4bc0-842c-023f0b907519\") " pod="openshift-console/console-7b769d5447-jw7xt" Jun 05 03:48:09.780802 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.780776 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvw49\" (UniqueName: \"kubernetes.io/projected/12c6c855-e6f7-4bc0-842c-023f0b907519-kube-api-access-gvw49\") pod \"console-7b769d5447-jw7xt\" (UID: \"12c6c855-e6f7-4bc0-842c-023f0b907519\") " pod="openshift-console/console-7b769d5447-jw7xt" Jun 05 03:48:09.866782 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:09.866674 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b769d5447-jw7xt" Jun 05 03:48:10.012556 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:10.012326 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b769d5447-jw7xt"] Jun 05 03:48:10.014820 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:48:10.014786 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12c6c855_e6f7_4bc0_842c_023f0b907519.slice/crio-0cd36a774e700deba051c619af669f9ad084d8d0e05b4aeb974ae7ac20bf3de2 WatchSource:0}: Error finding container 0cd36a774e700deba051c619af669f9ad084d8d0e05b4aeb974ae7ac20bf3de2: Status 404 returned error can't find the container with id 0cd36a774e700deba051c619af669f9ad084d8d0e05b4aeb974ae7ac20bf3de2 Jun 05 03:48:10.143464 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:10.143351 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b769d5447-jw7xt" event={"ID":"12c6c855-e6f7-4bc0-842c-023f0b907519","Type":"ContainerStarted","Data":"0cd36a774e700deba051c619af669f9ad084d8d0e05b4aeb974ae7ac20bf3de2"} Jun 05 03:48:13.223831 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:48:13.223783 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-7fqv9" podUID="f15442b9-7c90-4861-8089-8084f3784bf6" Jun 05 03:48:14.165922 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:14.165880 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b769d5447-jw7xt" event={"ID":"12c6c855-e6f7-4bc0-842c-023f0b907519","Type":"ContainerStarted","Data":"965e9506843af57be06207a6bd99fa87d78b8615814fcaeaddceba6df35be832"} Jun 05 03:48:14.183532 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:14.183455 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b769d5447-jw7xt" podStartSLOduration=1.570892256 podStartE2EDuration="5.183418021s" totalImagesPullingTime="3.612525765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:48:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:48:14.182183865 +0000 UTC m=+293.451960186" watchObservedRunningTime="2026-06-05 03:48:14.183418021 +0000 UTC m=+293.453194338" Jun 05 03:48:15.138831 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:15.138795 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d488c78dd-sfvsd"] Jun 05 03:48:15.143510 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:15.143486 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d488c78dd-sfvsd" Jun 05 03:48:15.151874 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:15.151853 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 05 03:48:15.153318 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:15.153260 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d488c78dd-sfvsd"] Jun 05 03:48:15.224132 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:15.224102 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20746271-c92d-4ca0-a656-f8cb1a02042d-trusted-ca-bundle\") pod \"console-6d488c78dd-sfvsd\" (UID: \"20746271-c92d-4ca0-a656-f8cb1a02042d\") " pod="openshift-console/console-6d488c78dd-sfvsd" Jun 05 03:48:15.224132 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:15.224139 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20746271-c92d-4ca0-a656-f8cb1a02042d-console-config\") pod \"console-6d488c78dd-sfvsd\" (UID: \"20746271-c92d-4ca0-a656-f8cb1a02042d\") " pod="openshift-console/console-6d488c78dd-sfvsd" Jun 05 03:48:15.224379 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:15.224167 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20746271-c92d-4ca0-a656-f8cb1a02042d-service-ca\") pod \"console-6d488c78dd-sfvsd\" (UID: \"20746271-c92d-4ca0-a656-f8cb1a02042d\") " pod="openshift-console/console-6d488c78dd-sfvsd" Jun 05 03:48:15.224379 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:15.224220 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20746271-c92d-4ca0-a656-f8cb1a02042d-console-serving-cert\") pod \"console-6d488c78dd-sfvsd\" (UID: \"20746271-c92d-4ca0-a656-f8cb1a02042d\") " pod="openshift-console/console-6d488c78dd-sfvsd" Jun 05 03:48:15.224379 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:15.224288 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20746271-c92d-4ca0-a656-f8cb1a02042d-console-oauth-config\") pod \"console-6d488c78dd-sfvsd\" (UID: \"20746271-c92d-4ca0-a656-f8cb1a02042d\") " pod="openshift-console/console-6d488c78dd-sfvsd" Jun 05 03:48:15.224379 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:15.224335 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d4wq\" (UniqueName: \"kubernetes.io/projected/20746271-c92d-4ca0-a656-f8cb1a02042d-kube-api-access-8d4wq\") pod \"console-6d488c78dd-sfvsd\" (UID: \"20746271-c92d-4ca0-a656-f8cb1a02042d\") " pod="openshift-console/console-6d488c78dd-sfvsd" Jun 05 03:48:15.224379 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:15.224364 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20746271-c92d-4ca0-a656-f8cb1a02042d-oauth-serving-cert\") pod \"console-6d488c78dd-sfvsd\" (UID: \"20746271-c92d-4ca0-a656-f8cb1a02042d\") " pod="openshift-console/console-6d488c78dd-sfvsd" Jun 05 03:48:15.325234 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:15.325189 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20746271-c92d-4ca0-a656-f8cb1a02042d-trusted-ca-bundle\") pod \"console-6d488c78dd-sfvsd\" (UID: \"20746271-c92d-4ca0-a656-f8cb1a02042d\") " pod="openshift-console/console-6d488c78dd-sfvsd" Jun 05 03:48:15.325234 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:15.325239 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20746271-c92d-4ca0-a656-f8cb1a02042d-console-config\") pod \"console-6d488c78dd-sfvsd\" (UID: \"20746271-c92d-4ca0-a656-f8cb1a02042d\") " pod="openshift-console/console-6d488c78dd-sfvsd" Jun 05 03:48:15.325544 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:15.325265 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20746271-c92d-4ca0-a656-f8cb1a02042d-service-ca\") pod \"console-6d488c78dd-sfvsd\" (UID: \"20746271-c92d-4ca0-a656-f8cb1a02042d\") " pod="openshift-console/console-6d488c78dd-sfvsd" Jun 05 03:48:15.325544 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:15.325322 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20746271-c92d-4ca0-a656-f8cb1a02042d-console-serving-cert\") pod \"console-6d488c78dd-sfvsd\" (UID: \"20746271-c92d-4ca0-a656-f8cb1a02042d\") " pod="openshift-console/console-6d488c78dd-sfvsd" Jun 05 03:48:15.325544 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:15.325365 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20746271-c92d-4ca0-a656-f8cb1a02042d-console-oauth-config\") pod \"console-6d488c78dd-sfvsd\" (UID: \"20746271-c92d-4ca0-a656-f8cb1a02042d\") " pod="openshift-console/console-6d488c78dd-sfvsd" Jun 05 03:48:15.325544 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:15.325398 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d4wq\" (UniqueName: \"kubernetes.io/projected/20746271-c92d-4ca0-a656-f8cb1a02042d-kube-api-access-8d4wq\") pod \"console-6d488c78dd-sfvsd\" (UID: \"20746271-c92d-4ca0-a656-f8cb1a02042d\") " pod="openshift-console/console-6d488c78dd-sfvsd" Jun 05 03:48:15.325544 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:15.325450 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20746271-c92d-4ca0-a656-f8cb1a02042d-oauth-serving-cert\") pod \"console-6d488c78dd-sfvsd\" (UID: \"20746271-c92d-4ca0-a656-f8cb1a02042d\") " pod="openshift-console/console-6d488c78dd-sfvsd" Jun 05 03:48:15.326136 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:15.326085 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20746271-c92d-4ca0-a656-f8cb1a02042d-console-config\") pod \"console-6d488c78dd-sfvsd\" (UID: \"20746271-c92d-4ca0-a656-f8cb1a02042d\") " pod="openshift-console/console-6d488c78dd-sfvsd" Jun 05 03:48:15.326256 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:15.326176 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20746271-c92d-4ca0-a656-f8cb1a02042d-service-ca\") pod \"console-6d488c78dd-sfvsd\" (UID: \"20746271-c92d-4ca0-a656-f8cb1a02042d\") " pod="openshift-console/console-6d488c78dd-sfvsd" Jun 05 03:48:15.326484 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:15.326410 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20746271-c92d-4ca0-a656-f8cb1a02042d-trusted-ca-bundle\") pod \"console-6d488c78dd-sfvsd\" (UID: \"20746271-c92d-4ca0-a656-f8cb1a02042d\") " pod="openshift-console/console-6d488c78dd-sfvsd" Jun 05 03:48:15.326877 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:15.326855 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20746271-c92d-4ca0-a656-f8cb1a02042d-oauth-serving-cert\") pod \"console-6d488c78dd-sfvsd\" (UID: \"20746271-c92d-4ca0-a656-f8cb1a02042d\") " pod="openshift-console/console-6d488c78dd-sfvsd" Jun 05 03:48:15.328242 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:15.328218 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20746271-c92d-4ca0-a656-f8cb1a02042d-console-serving-cert\") pod \"console-6d488c78dd-sfvsd\" (UID: \"20746271-c92d-4ca0-a656-f8cb1a02042d\") " pod="openshift-console/console-6d488c78dd-sfvsd" Jun 05 03:48:15.328479 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:15.328459 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20746271-c92d-4ca0-a656-f8cb1a02042d-console-oauth-config\") pod \"console-6d488c78dd-sfvsd\" (UID: \"20746271-c92d-4ca0-a656-f8cb1a02042d\") " pod="openshift-console/console-6d488c78dd-sfvsd" Jun 05 03:48:15.333525 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:15.333502 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d4wq\" (UniqueName: \"kubernetes.io/projected/20746271-c92d-4ca0-a656-f8cb1a02042d-kube-api-access-8d4wq\") pod \"console-6d488c78dd-sfvsd\" (UID: \"20746271-c92d-4ca0-a656-f8cb1a02042d\") " pod="openshift-console/console-6d488c78dd-sfvsd" Jun 05 03:48:15.455629 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:15.455543 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d488c78dd-sfvsd" Jun 05 03:48:19.146186 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:19.146153 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mhbhg" Jun 05 03:48:19.867216 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:19.867170 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b769d5447-jw7xt" Jun 05 03:48:19.867411 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:19.867245 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b769d5447-jw7xt" Jun 05 03:48:19.873422 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:19.873394 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b769d5447-jw7xt" Jun 05 03:48:20.198745 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:20.198656 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b769d5447-jw7xt" Jun 05 03:48:21.069351 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:21.069328 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d488c78dd-sfvsd"] Jun 05 03:48:21.077639 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:48:21.077614 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20746271_c92d_4ca0_a656_f8cb1a02042d.slice/crio-f1e7a38dbce1e558549ad2982d913ccc1f3bee8bb213e1801949d36793cb2bf5 WatchSource:0}: Error finding container f1e7a38dbce1e558549ad2982d913ccc1f3bee8bb213e1801949d36793cb2bf5: Status 404 returned error can't find the container with id f1e7a38dbce1e558549ad2982d913ccc1f3bee8bb213e1801949d36793cb2bf5 Jun 05 03:48:21.182982 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:21.182941 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whn2g_9139fc4f-a2c4-4323-aac8-55b73d33aba2/ovn-acl-logging/0.log" Jun 05 03:48:21.182982 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:21.182954 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whn2g_9139fc4f-a2c4-4323-aac8-55b73d33aba2/ovn-acl-logging/0.log" Jun 05 03:48:21.189244 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:21.189225 2548 kubelet.go:1648] "Image garbage collection succeeded" Jun 05 03:48:21.199844 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:21.199765 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d488c78dd-sfvsd" event={"ID":"20746271-c92d-4ca0-a656-f8cb1a02042d","Type":"ContainerStarted","Data":"7b05ebc6ff349f0adf14fdd5956761475656155e0d7aacf42d49896d0d1b7c03"} Jun 05 03:48:21.199844 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:21.199825 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d488c78dd-sfvsd" event={"ID":"20746271-c92d-4ca0-a656-f8cb1a02042d","Type":"ContainerStarted","Data":"f1e7a38dbce1e558549ad2982d913ccc1f3bee8bb213e1801949d36793cb2bf5"} Jun 05 03:48:21.201252 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:21.201223 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-d8kvd" event={"ID":"aa942ee0-0354-4c2f-928a-f23c4ed20aed","Type":"ContainerStarted","Data":"8d1a86183b9afcaa46f9b8ae77c3a3749d297fd936ef71d2eaeea60db6ab2ff5"} Jun 05 03:48:21.201480 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:21.201466 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-d8kvd" Jun 05 03:48:21.202418 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:21.202398 2548 patch_prober.go:28] interesting pod/downloads-6657875f97-d8kvd container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.21:8080/\": dial tcp 10.133.0.21:8080: connect: connection refused" start-of-body= Jun 05 03:48:21.202484 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:21.202463 2548 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-6657875f97-d8kvd" podUID="aa942ee0-0354-4c2f-928a-f23c4ed20aed" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.21:8080/\": dial tcp 10.133.0.21:8080: connect: connection refused" Jun 05 03:48:21.216762 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:21.216601 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d488c78dd-sfvsd" podStartSLOduration=6.216584634 podStartE2EDuration="6.216584634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:48:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:48:21.216015427 +0000 UTC m=+300.485791745" watchObservedRunningTime="2026-06-05 03:48:21.216584634 +0000 UTC m=+300.486360956" Jun 05 03:48:21.230783 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:21.230615 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-d8kvd" podStartSLOduration=0.856543564 podStartE2EDuration="17.230595727s" totalImagesPullingTime="16.374052163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:48:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:48:21.229654607 +0000 UTC m=+300.499430926" watchObservedRunningTime="2026-06-05 03:48:21.230595727 +0000 UTC m=+300.500372045" Jun 05 03:48:22.218807 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:22.218776 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-d8kvd" Jun 05 03:48:25.455776 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:25.455741 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d488c78dd-sfvsd" Jun 05 03:48:25.456346 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:25.455810 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d488c78dd-sfvsd" Jun 05 03:48:25.461379 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:25.461354 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d488c78dd-sfvsd" Jun 05 03:48:26.222445 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:26.222409 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:48:26.229724 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:26.229697 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d488c78dd-sfvsd" Jun 05 03:48:26.272810 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:26.272776 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b769d5447-jw7xt"] Jun 05 03:48:31.255117 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:31.255084 2548 generic.go:356] "Generic (PLEG): container finished" podID="c99614d1-0e51-4cda-b1c0-51b5b8a2fa88" containerID="55c5bab305938dc62cf42feff0a675bb91624af665a2788798e1f44474be2e3a" exitCode=0 Jun 05 03:48:31.255610 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:31.255123 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dwvgc" event={"ID":"c99614d1-0e51-4cda-b1c0-51b5b8a2fa88","Type":"ContainerDied","Data":"55c5bab305938dc62cf42feff0a675bb91624af665a2788798e1f44474be2e3a"} Jun 05 03:48:31.255610 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:31.255495 2548 scope.go:117] "RemoveContainer" containerID="55c5bab305938dc62cf42feff0a675bb91624af665a2788798e1f44474be2e3a" Jun 05 03:48:32.262124 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:32.262086 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dwvgc" event={"ID":"c99614d1-0e51-4cda-b1c0-51b5b8a2fa88","Type":"ContainerStarted","Data":"1793ca01e6c75d570ba6e34eaba9f4a356f359e32c71bb98434a3724d45c6b49"} Jun 05 03:48:41.299699 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:41.299664 2548 generic.go:356] "Generic (PLEG): container finished" podID="1e8c8c99-1a56-4948-9760-df876ce368b4" containerID="2301d3ff35e496ccb2a945b3967e521590bbd178c0ec2eae12e2b493342afa4c" exitCode=0 Jun 05 03:48:41.300108 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:41.299736 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-k2rfr" event={"ID":"1e8c8c99-1a56-4948-9760-df876ce368b4","Type":"ContainerDied","Data":"2301d3ff35e496ccb2a945b3967e521590bbd178c0ec2eae12e2b493342afa4c"} Jun 05 03:48:41.300108 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:41.300037 2548 scope.go:117] "RemoveContainer" containerID="2301d3ff35e496ccb2a945b3967e521590bbd178c0ec2eae12e2b493342afa4c" Jun 05 03:48:42.306187 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:42.306154 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-k2rfr" event={"ID":"1e8c8c99-1a56-4948-9760-df876ce368b4","Type":"ContainerStarted","Data":"24d00b4557cda48553091694374b8cc4a4c9ccea40761f4a89d6fdb088a13daa"} Jun 05 03:48:51.300562 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:51.300492 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7b769d5447-jw7xt" podUID="12c6c855-e6f7-4bc0-842c-023f0b907519" containerName="console" containerID="cri-o://965e9506843af57be06207a6bd99fa87d78b8615814fcaeaddceba6df35be832" gracePeriod=15 Jun 05 03:48:51.569178 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:51.569104 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b769d5447-jw7xt" Jun 05 03:48:51.657873 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:51.657836 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12c6c855-e6f7-4bc0-842c-023f0b907519-service-ca\") pod \"12c6c855-e6f7-4bc0-842c-023f0b907519\" (UID: \"12c6c855-e6f7-4bc0-842c-023f0b907519\") " Jun 05 03:48:51.657873 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:51.657876 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12c6c855-e6f7-4bc0-842c-023f0b907519-console-oauth-config\") pod \"12c6c855-e6f7-4bc0-842c-023f0b907519\" (UID: \"12c6c855-e6f7-4bc0-842c-023f0b907519\") " Jun 05 03:48:51.658060 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:51.657909 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12c6c855-e6f7-4bc0-842c-023f0b907519-oauth-serving-cert\") pod \"12c6c855-e6f7-4bc0-842c-023f0b907519\" (UID: \"12c6c855-e6f7-4bc0-842c-023f0b907519\") " Jun 05 03:48:51.658060 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:51.657937 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12c6c855-e6f7-4bc0-842c-023f0b907519-console-config\") pod \"12c6c855-e6f7-4bc0-842c-023f0b907519\" (UID: \"12c6c855-e6f7-4bc0-842c-023f0b907519\") " Jun 05 03:48:51.658060 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:51.657965 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvw49\" (UniqueName: \"kubernetes.io/projected/12c6c855-e6f7-4bc0-842c-023f0b907519-kube-api-access-gvw49\") pod \"12c6c855-e6f7-4bc0-842c-023f0b907519\" (UID: \"12c6c855-e6f7-4bc0-842c-023f0b907519\") " Jun 05 03:48:51.658060 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:51.658041 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12c6c855-e6f7-4bc0-842c-023f0b907519-console-serving-cert\") pod \"12c6c855-e6f7-4bc0-842c-023f0b907519\" (UID: \"12c6c855-e6f7-4bc0-842c-023f0b907519\") " Jun 05 03:48:51.658331 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:51.658309 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12c6c855-e6f7-4bc0-842c-023f0b907519-service-ca" (OuterVolumeSpecName: "service-ca") pod "12c6c855-e6f7-4bc0-842c-023f0b907519" (UID: "12c6c855-e6f7-4bc0-842c-023f0b907519"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:48:51.658410 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:51.658367 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12c6c855-e6f7-4bc0-842c-023f0b907519-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "12c6c855-e6f7-4bc0-842c-023f0b907519" (UID: "12c6c855-e6f7-4bc0-842c-023f0b907519"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:48:51.658410 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:51.658387 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12c6c855-e6f7-4bc0-842c-023f0b907519-console-config" (OuterVolumeSpecName: "console-config") pod "12c6c855-e6f7-4bc0-842c-023f0b907519" (UID: "12c6c855-e6f7-4bc0-842c-023f0b907519"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:48:51.660504 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:51.660465 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12c6c855-e6f7-4bc0-842c-023f0b907519-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "12c6c855-e6f7-4bc0-842c-023f0b907519" (UID: "12c6c855-e6f7-4bc0-842c-023f0b907519"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 03:48:51.660591 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:51.660537 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12c6c855-e6f7-4bc0-842c-023f0b907519-kube-api-access-gvw49" (OuterVolumeSpecName: "kube-api-access-gvw49") pod "12c6c855-e6f7-4bc0-842c-023f0b907519" (UID: "12c6c855-e6f7-4bc0-842c-023f0b907519"). InnerVolumeSpecName "kube-api-access-gvw49". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:48:51.660591 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:51.660546 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12c6c855-e6f7-4bc0-842c-023f0b907519-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "12c6c855-e6f7-4bc0-842c-023f0b907519" (UID: "12c6c855-e6f7-4bc0-842c-023f0b907519"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 03:48:51.759603 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:51.759572 2548 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12c6c855-e6f7-4bc0-842c-023f0b907519-console-serving-cert\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:48:51.759603 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:51.759599 2548 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12c6c855-e6f7-4bc0-842c-023f0b907519-service-ca\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:48:51.759603 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:51.759608 2548 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12c6c855-e6f7-4bc0-842c-023f0b907519-console-oauth-config\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:48:51.759813 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:51.759618 2548 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12c6c855-e6f7-4bc0-842c-023f0b907519-oauth-serving-cert\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:48:51.759813 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:51.759627 2548 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12c6c855-e6f7-4bc0-842c-023f0b907519-console-config\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:48:51.759813 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:51.759635 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvw49\" (UniqueName: \"kubernetes.io/projected/12c6c855-e6f7-4bc0-842c-023f0b907519-kube-api-access-gvw49\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:48:52.346018 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:52.345982 2548 generic.go:356] "Generic (PLEG): container finished" podID="12c6c855-e6f7-4bc0-842c-023f0b907519" containerID="965e9506843af57be06207a6bd99fa87d78b8615814fcaeaddceba6df35be832" exitCode=0 Jun 05 03:48:52.346493 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:52.346026 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b769d5447-jw7xt" Jun 05 03:48:52.346493 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:52.346047 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b769d5447-jw7xt" event={"ID":"12c6c855-e6f7-4bc0-842c-023f0b907519","Type":"ContainerDied","Data":"965e9506843af57be06207a6bd99fa87d78b8615814fcaeaddceba6df35be832"} Jun 05 03:48:52.346493 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:52.346108 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b769d5447-jw7xt" event={"ID":"12c6c855-e6f7-4bc0-842c-023f0b907519","Type":"ContainerDied","Data":"0cd36a774e700deba051c619af669f9ad084d8d0e05b4aeb974ae7ac20bf3de2"} Jun 05 03:48:52.346493 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:52.346138 2548 scope.go:117] "RemoveContainer" containerID="965e9506843af57be06207a6bd99fa87d78b8615814fcaeaddceba6df35be832" Jun 05 03:48:52.360560 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:52.360537 2548 scope.go:117] "RemoveContainer" containerID="965e9506843af57be06207a6bd99fa87d78b8615814fcaeaddceba6df35be832" Jun 05 03:48:52.360862 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:48:52.360838 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"965e9506843af57be06207a6bd99fa87d78b8615814fcaeaddceba6df35be832\": container with ID starting with 965e9506843af57be06207a6bd99fa87d78b8615814fcaeaddceba6df35be832 not found: ID does not exist" containerID="965e9506843af57be06207a6bd99fa87d78b8615814fcaeaddceba6df35be832" Jun 05 03:48:52.360946 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:52.360875 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"965e9506843af57be06207a6bd99fa87d78b8615814fcaeaddceba6df35be832"} err="failed to get container status \"965e9506843af57be06207a6bd99fa87d78b8615814fcaeaddceba6df35be832\": rpc error: code = NotFound desc = could not find container \"965e9506843af57be06207a6bd99fa87d78b8615814fcaeaddceba6df35be832\": container with ID starting with 965e9506843af57be06207a6bd99fa87d78b8615814fcaeaddceba6df35be832 not found: ID does not exist" Jun 05 03:48:52.369864 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:52.369840 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b769d5447-jw7xt"] Jun 05 03:48:52.375664 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:52.375642 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b769d5447-jw7xt"] Jun 05 03:48:53.227575 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:48:53.227542 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12c6c855-e6f7-4bc0-842c-023f0b907519" path="/var/lib/kubelet/pods/12c6c855-e6f7-4bc0-842c-023f0b907519/volumes" Jun 05 03:49:14.466280 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.466199 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5fd4495777-qr497"] Jun 05 03:49:14.466812 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.466598 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12c6c855-e6f7-4bc0-842c-023f0b907519" containerName="console" Jun 05 03:49:14.466812 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.466611 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="12c6c855-e6f7-4bc0-842c-023f0b907519" containerName="console" Jun 05 03:49:14.466812 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.466673 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="12c6c855-e6f7-4bc0-842c-023f0b907519" containerName="console" Jun 05 03:49:14.469413 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.469395 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5fd4495777-qr497" Jun 05 03:49:14.471674 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.471653 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 05 03:49:14.471674 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.471672 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 05 03:49:14.471825 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.471672 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 05 03:49:14.472059 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.472044 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 05 03:49:14.472133 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.472093 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-27hp4\"" Jun 05 03:49:14.473282 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.473255 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 05 03:49:14.477176 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.477156 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 05 03:49:14.483473 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.483445 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5fd4495777-qr497"] Jun 05 03:49:14.563519 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.563480 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/71737de7-5dbb-416e-8cd4-7ae72a3fdbbd-secret-telemeter-client\") pod \"telemeter-client-5fd4495777-qr497\" (UID: \"71737de7-5dbb-416e-8cd4-7ae72a3fdbbd\") " pod="openshift-monitoring/telemeter-client-5fd4495777-qr497" Jun 05 03:49:14.563519 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.563524 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/71737de7-5dbb-416e-8cd4-7ae72a3fdbbd-federate-client-tls\") pod \"telemeter-client-5fd4495777-qr497\" (UID: \"71737de7-5dbb-416e-8cd4-7ae72a3fdbbd\") " pod="openshift-monitoring/telemeter-client-5fd4495777-qr497" Jun 05 03:49:14.563711 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.563582 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/71737de7-5dbb-416e-8cd4-7ae72a3fdbbd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fd4495777-qr497\" (UID: \"71737de7-5dbb-416e-8cd4-7ae72a3fdbbd\") " pod="openshift-monitoring/telemeter-client-5fd4495777-qr497" Jun 05 03:49:14.563711 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.563636 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbxtd\" (UniqueName: \"kubernetes.io/projected/71737de7-5dbb-416e-8cd4-7ae72a3fdbbd-kube-api-access-hbxtd\") pod \"telemeter-client-5fd4495777-qr497\" (UID: \"71737de7-5dbb-416e-8cd4-7ae72a3fdbbd\") " pod="openshift-monitoring/telemeter-client-5fd4495777-qr497" Jun 05 03:49:14.563711 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.563658 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71737de7-5dbb-416e-8cd4-7ae72a3fdbbd-serving-certs-ca-bundle\") pod \"telemeter-client-5fd4495777-qr497\" (UID: \"71737de7-5dbb-416e-8cd4-7ae72a3fdbbd\") " pod="openshift-monitoring/telemeter-client-5fd4495777-qr497" Jun 05 03:49:14.563711 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.563677 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/71737de7-5dbb-416e-8cd4-7ae72a3fdbbd-telemeter-client-tls\") pod \"telemeter-client-5fd4495777-qr497\" (UID: \"71737de7-5dbb-416e-8cd4-7ae72a3fdbbd\") " pod="openshift-monitoring/telemeter-client-5fd4495777-qr497" Jun 05 03:49:14.563711 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.563693 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71737de7-5dbb-416e-8cd4-7ae72a3fdbbd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fd4495777-qr497\" (UID: \"71737de7-5dbb-416e-8cd4-7ae72a3fdbbd\") " pod="openshift-monitoring/telemeter-client-5fd4495777-qr497" Jun 05 03:49:14.563862 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.563749 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71737de7-5dbb-416e-8cd4-7ae72a3fdbbd-metrics-client-ca\") pod \"telemeter-client-5fd4495777-qr497\" (UID: \"71737de7-5dbb-416e-8cd4-7ae72a3fdbbd\") " pod="openshift-monitoring/telemeter-client-5fd4495777-qr497" Jun 05 03:49:14.664360 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.664323 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/71737de7-5dbb-416e-8cd4-7ae72a3fdbbd-secret-telemeter-client\") pod \"telemeter-client-5fd4495777-qr497\" (UID: \"71737de7-5dbb-416e-8cd4-7ae72a3fdbbd\") " pod="openshift-monitoring/telemeter-client-5fd4495777-qr497" Jun 05 03:49:14.664523 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.664366 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/71737de7-5dbb-416e-8cd4-7ae72a3fdbbd-federate-client-tls\") pod \"telemeter-client-5fd4495777-qr497\" (UID: \"71737de7-5dbb-416e-8cd4-7ae72a3fdbbd\") " pod="openshift-monitoring/telemeter-client-5fd4495777-qr497" Jun 05 03:49:14.664523 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.664403 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/71737de7-5dbb-416e-8cd4-7ae72a3fdbbd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fd4495777-qr497\" (UID: \"71737de7-5dbb-416e-8cd4-7ae72a3fdbbd\") " pod="openshift-monitoring/telemeter-client-5fd4495777-qr497" Jun 05 03:49:14.664523 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.664481 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbxtd\" (UniqueName: \"kubernetes.io/projected/71737de7-5dbb-416e-8cd4-7ae72a3fdbbd-kube-api-access-hbxtd\") pod \"telemeter-client-5fd4495777-qr497\" (UID: \"71737de7-5dbb-416e-8cd4-7ae72a3fdbbd\") " pod="openshift-monitoring/telemeter-client-5fd4495777-qr497" Jun 05 03:49:14.664523 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.664510 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71737de7-5dbb-416e-8cd4-7ae72a3fdbbd-serving-certs-ca-bundle\") pod \"telemeter-client-5fd4495777-qr497\" (UID: \"71737de7-5dbb-416e-8cd4-7ae72a3fdbbd\") " pod="openshift-monitoring/telemeter-client-5fd4495777-qr497" Jun 05 03:49:14.664713 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.664534 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/71737de7-5dbb-416e-8cd4-7ae72a3fdbbd-telemeter-client-tls\") pod \"telemeter-client-5fd4495777-qr497\" (UID: \"71737de7-5dbb-416e-8cd4-7ae72a3fdbbd\") " pod="openshift-monitoring/telemeter-client-5fd4495777-qr497" Jun 05 03:49:14.664713 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.664560 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71737de7-5dbb-416e-8cd4-7ae72a3fdbbd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fd4495777-qr497\" (UID: \"71737de7-5dbb-416e-8cd4-7ae72a3fdbbd\") " pod="openshift-monitoring/telemeter-client-5fd4495777-qr497" Jun 05 03:49:14.664713 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.664595 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71737de7-5dbb-416e-8cd4-7ae72a3fdbbd-metrics-client-ca\") pod \"telemeter-client-5fd4495777-qr497\" (UID: \"71737de7-5dbb-416e-8cd4-7ae72a3fdbbd\") " pod="openshift-monitoring/telemeter-client-5fd4495777-qr497" Jun 05 03:49:14.665330 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.665303 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71737de7-5dbb-416e-8cd4-7ae72a3fdbbd-serving-certs-ca-bundle\") pod \"telemeter-client-5fd4495777-qr497\" (UID: \"71737de7-5dbb-416e-8cd4-7ae72a3fdbbd\") " pod="openshift-monitoring/telemeter-client-5fd4495777-qr497" Jun 05 03:49:14.665683 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.665654 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71737de7-5dbb-416e-8cd4-7ae72a3fdbbd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fd4495777-qr497\" (UID: \"71737de7-5dbb-416e-8cd4-7ae72a3fdbbd\") " pod="openshift-monitoring/telemeter-client-5fd4495777-qr497" Jun 05 03:49:14.665812 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.665793 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71737de7-5dbb-416e-8cd4-7ae72a3fdbbd-metrics-client-ca\") pod \"telemeter-client-5fd4495777-qr497\" (UID: \"71737de7-5dbb-416e-8cd4-7ae72a3fdbbd\") " pod="openshift-monitoring/telemeter-client-5fd4495777-qr497" Jun 05 03:49:14.667067 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.667038 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/71737de7-5dbb-416e-8cd4-7ae72a3fdbbd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fd4495777-qr497\" (UID: \"71737de7-5dbb-416e-8cd4-7ae72a3fdbbd\") " pod="openshift-monitoring/telemeter-client-5fd4495777-qr497" Jun 05 03:49:14.667176 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.667073 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/71737de7-5dbb-416e-8cd4-7ae72a3fdbbd-federate-client-tls\") pod \"telemeter-client-5fd4495777-qr497\" (UID: \"71737de7-5dbb-416e-8cd4-7ae72a3fdbbd\") " pod="openshift-monitoring/telemeter-client-5fd4495777-qr497" Jun 05 03:49:14.667403 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.667385 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/71737de7-5dbb-416e-8cd4-7ae72a3fdbbd-secret-telemeter-client\") pod \"telemeter-client-5fd4495777-qr497\" (UID: \"71737de7-5dbb-416e-8cd4-7ae72a3fdbbd\") " pod="openshift-monitoring/telemeter-client-5fd4495777-qr497" Jun 05 03:49:14.667530 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.667509 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/71737de7-5dbb-416e-8cd4-7ae72a3fdbbd-telemeter-client-tls\") pod \"telemeter-client-5fd4495777-qr497\" (UID: \"71737de7-5dbb-416e-8cd4-7ae72a3fdbbd\") " pod="openshift-monitoring/telemeter-client-5fd4495777-qr497" Jun 05 03:49:14.672548 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.672531 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbxtd\" (UniqueName: \"kubernetes.io/projected/71737de7-5dbb-416e-8cd4-7ae72a3fdbbd-kube-api-access-hbxtd\") pod \"telemeter-client-5fd4495777-qr497\" (UID: \"71737de7-5dbb-416e-8cd4-7ae72a3fdbbd\") " pod="openshift-monitoring/telemeter-client-5fd4495777-qr497" Jun 05 03:49:14.779611 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.779574 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5fd4495777-qr497" Jun 05 03:49:14.908718 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.908694 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5fd4495777-qr497"] Jun 05 03:49:14.911066 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:49:14.911040 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71737de7_5dbb_416e_8cd4_7ae72a3fdbbd.slice/crio-a9b8a2862df8d7dd79ea72f8385e21b84f4d650d8ddbe267cb573e4b78a53dfd WatchSource:0}: Error finding container a9b8a2862df8d7dd79ea72f8385e21b84f4d650d8ddbe267cb573e4b78a53dfd: Status 404 returned error can't find the container with id a9b8a2862df8d7dd79ea72f8385e21b84f4d650d8ddbe267cb573e4b78a53dfd Jun 05 03:49:14.913042 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:14.913023 2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 03:49:15.441859 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:15.441815 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fd4495777-qr497" event={"ID":"71737de7-5dbb-416e-8cd4-7ae72a3fdbbd","Type":"ContainerStarted","Data":"a9b8a2862df8d7dd79ea72f8385e21b84f4d650d8ddbe267cb573e4b78a53dfd"} Jun 05 03:49:17.453358 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:17.453325 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fd4495777-qr497" event={"ID":"71737de7-5dbb-416e-8cd4-7ae72a3fdbbd","Type":"ContainerStarted","Data":"d828d145ceefad0eba628c07ae477b7e6da4d21cd7f3f6af372f24451906c4af"} Jun 05 03:49:18.459039 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:18.459005 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fd4495777-qr497" event={"ID":"71737de7-5dbb-416e-8cd4-7ae72a3fdbbd","Type":"ContainerStarted","Data":"072d3e8e26f9d9d7a666bf3e3c5edb136e80f547821917ea8ee1575a6c57fef7"} Jun 05 03:49:18.459470 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:18.459063 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fd4495777-qr497" event={"ID":"71737de7-5dbb-416e-8cd4-7ae72a3fdbbd","Type":"ContainerStarted","Data":"a272e1466347af4dae97c936e941c9cb34f572022453037d2e4f90aed21989b0"} Jun 05 03:49:18.481580 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:18.481526 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5fd4495777-qr497" podStartSLOduration=1.559864562 podStartE2EDuration="4.481507323s" totalImagesPullingTime="2.921642761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:49:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:49:18.480301225 +0000 UTC m=+357.750077543" watchObservedRunningTime="2026-06-05 03:49:18.481507323 +0000 UTC m=+357.751283643" Jun 05 03:49:19.210969 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:19.210932 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8cf6976f-r85k5"] Jun 05 03:49:19.214486 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:19.214467 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8cf6976f-r85k5" Jun 05 03:49:19.234408 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:19.234378 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8cf6976f-r85k5"] Jun 05 03:49:19.296834 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:19.296787 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-console-config\") pod \"console-8cf6976f-r85k5\" (UID: \"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f\") " pod="openshift-console/console-8cf6976f-r85k5" Jun 05 03:49:19.296834 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:19.296833 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-oauth-serving-cert\") pod \"console-8cf6976f-r85k5\" (UID: \"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f\") " pod="openshift-console/console-8cf6976f-r85k5" Jun 05 03:49:19.297038 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:19.296894 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-console-oauth-config\") pod \"console-8cf6976f-r85k5\" (UID: \"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f\") " pod="openshift-console/console-8cf6976f-r85k5" Jun 05 03:49:19.297038 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:19.296911 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-console-serving-cert\") pod \"console-8cf6976f-r85k5\" (UID: \"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f\") " pod="openshift-console/console-8cf6976f-r85k5" Jun 05 03:49:19.297038 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:19.296992 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-service-ca\") pod \"console-8cf6976f-r85k5\" (UID: \"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f\") " pod="openshift-console/console-8cf6976f-r85k5" Jun 05 03:49:19.297038 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:19.297024 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-trusted-ca-bundle\") pod \"console-8cf6976f-r85k5\" (UID: \"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f\") " pod="openshift-console/console-8cf6976f-r85k5" Jun 05 03:49:19.297161 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:19.297044 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx5tw\" (UniqueName: \"kubernetes.io/projected/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-kube-api-access-nx5tw\") pod \"console-8cf6976f-r85k5\" (UID: \"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f\") " pod="openshift-console/console-8cf6976f-r85k5" Jun 05 03:49:19.398403 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:19.398353 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-console-config\") pod \"console-8cf6976f-r85k5\" (UID: \"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f\") " pod="openshift-console/console-8cf6976f-r85k5" Jun 05 03:49:19.398403 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:19.398401 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-oauth-serving-cert\") pod \"console-8cf6976f-r85k5\" (UID: \"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f\") " pod="openshift-console/console-8cf6976f-r85k5" Jun 05 03:49:19.398664 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:19.398453 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-console-oauth-config\") pod \"console-8cf6976f-r85k5\" (UID: \"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f\") " pod="openshift-console/console-8cf6976f-r85k5" Jun 05 03:49:19.398664 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:19.398474 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-console-serving-cert\") pod \"console-8cf6976f-r85k5\" (UID: \"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f\") " pod="openshift-console/console-8cf6976f-r85k5" Jun 05 03:49:19.398664 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:19.398502 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-service-ca\") pod \"console-8cf6976f-r85k5\" (UID: \"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f\") " pod="openshift-console/console-8cf6976f-r85k5" Jun 05 03:49:19.398664 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:19.398518 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-trusted-ca-bundle\") pod \"console-8cf6976f-r85k5\" (UID: \"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f\") " pod="openshift-console/console-8cf6976f-r85k5" Jun 05 03:49:19.398664 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:19.398532 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx5tw\" (UniqueName: \"kubernetes.io/projected/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-kube-api-access-nx5tw\") pod \"console-8cf6976f-r85k5\" (UID: \"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f\") " pod="openshift-console/console-8cf6976f-r85k5" Jun 05 03:49:19.399228 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:19.399200 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-oauth-serving-cert\") pod \"console-8cf6976f-r85k5\" (UID: \"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f\") " pod="openshift-console/console-8cf6976f-r85k5" Jun 05 03:49:19.399414 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:19.399387 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-service-ca\") pod \"console-8cf6976f-r85k5\" (UID: \"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f\") " pod="openshift-console/console-8cf6976f-r85k5" Jun 05 03:49:19.399499 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:19.399417 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-console-config\") pod \"console-8cf6976f-r85k5\" (UID: \"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f\") " pod="openshift-console/console-8cf6976f-r85k5" Jun 05 03:49:19.399535 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:19.399497 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-trusted-ca-bundle\") pod \"console-8cf6976f-r85k5\" (UID: \"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f\") " pod="openshift-console/console-8cf6976f-r85k5" Jun 05 03:49:19.401108 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:19.401087 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-console-serving-cert\") pod \"console-8cf6976f-r85k5\" (UID: \"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f\") " pod="openshift-console/console-8cf6976f-r85k5" Jun 05 03:49:19.401189 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:19.401122 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-console-oauth-config\") pod \"console-8cf6976f-r85k5\" (UID: \"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f\") " pod="openshift-console/console-8cf6976f-r85k5" Jun 05 03:49:19.406358 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:19.406337 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx5tw\" (UniqueName: \"kubernetes.io/projected/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-kube-api-access-nx5tw\") pod \"console-8cf6976f-r85k5\" (UID: \"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f\") " pod="openshift-console/console-8cf6976f-r85k5" Jun 05 03:49:19.524234 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:19.524198 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8cf6976f-r85k5" Jun 05 03:49:19.663261 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:19.663233 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8cf6976f-r85k5"] Jun 05 03:49:19.665831 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:49:19.665802 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7a4c1a7_1582_47f3_a88b_ea0ce3b0430f.slice/crio-143ab033d423ceac74a4288e6ffcb36347143ab0ffaf02ef4d820ad5ea9de979 WatchSource:0}: Error finding container 143ab033d423ceac74a4288e6ffcb36347143ab0ffaf02ef4d820ad5ea9de979: Status 404 returned error can't find the container with id 143ab033d423ceac74a4288e6ffcb36347143ab0ffaf02ef4d820ad5ea9de979 Jun 05 03:49:20.469221 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:20.469187 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8cf6976f-r85k5" event={"ID":"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f","Type":"ContainerStarted","Data":"719845be34ea844b5da99b00113e2d9e366d330d9f745294b2d95d93a2320db6"} Jun 05 03:49:20.469532 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:20.469240 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8cf6976f-r85k5" event={"ID":"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f","Type":"ContainerStarted","Data":"143ab033d423ceac74a4288e6ffcb36347143ab0ffaf02ef4d820ad5ea9de979"} Jun 05 03:49:20.487221 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:20.487175 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8cf6976f-r85k5" podStartSLOduration=1.487158121 podStartE2EDuration="1.487158121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:49:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:49:20.485769809 +0000 UTC m=+359.755546144" watchObservedRunningTime="2026-06-05 03:49:20.487158121 +0000 UTC m=+359.756934419" Jun 05 03:49:29.524655 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:29.524613 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8cf6976f-r85k5" Jun 05 03:49:29.525042 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:29.524681 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8cf6976f-r85k5" Jun 05 03:49:29.529287 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:29.529266 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8cf6976f-r85k5" Jun 05 03:49:30.511700 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:30.511673 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8cf6976f-r85k5" Jun 05 03:49:30.554940 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:30.554900 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d488c78dd-sfvsd"] Jun 05 03:49:35.140487 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:35.140421 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f15442b9-7c90-4861-8089-8084f3784bf6-metrics-certs\") pod \"network-metrics-daemon-7fqv9\" (UID: \"f15442b9-7c90-4861-8089-8084f3784bf6\") " pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:49:35.142817 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:35.142790 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f15442b9-7c90-4861-8089-8084f3784bf6-metrics-certs\") pod \"network-metrics-daemon-7fqv9\" (UID: \"f15442b9-7c90-4861-8089-8084f3784bf6\") " pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:49:35.225676 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:35.225634 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k7rr7\"" Jun 05 03:49:35.233652 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:35.233627 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fqv9" Jun 05 03:49:35.370149 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:35.370122 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7fqv9"] Jun 05 03:49:35.372065 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:49:35.372036 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf15442b9_7c90_4861_8089_8084f3784bf6.slice/crio-89ef0a6ca4320aaba11250bfbf422779b16cb75eda3c97dd4946dde8b5a3bf3b WatchSource:0}: Error finding container 89ef0a6ca4320aaba11250bfbf422779b16cb75eda3c97dd4946dde8b5a3bf3b: Status 404 returned error can't find the container with id 89ef0a6ca4320aaba11250bfbf422779b16cb75eda3c97dd4946dde8b5a3bf3b Jun 05 03:49:35.530375 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:35.530341 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7fqv9" event={"ID":"f15442b9-7c90-4861-8089-8084f3784bf6","Type":"ContainerStarted","Data":"89ef0a6ca4320aaba11250bfbf422779b16cb75eda3c97dd4946dde8b5a3bf3b"} Jun 05 03:49:36.535462 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:36.535416 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7fqv9" event={"ID":"f15442b9-7c90-4861-8089-8084f3784bf6","Type":"ContainerStarted","Data":"673f2c96aa7ca88cba3f193dcd75b278e515339a5755fdd80e12418b9c21926e"} Jun 05 03:49:37.541388 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:37.541350 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7fqv9" event={"ID":"f15442b9-7c90-4861-8089-8084f3784bf6","Type":"ContainerStarted","Data":"f3311eba9c0d2193f1763a870fdad7628af8167309554df8a404926ac70f8342"} Jun 05 03:49:37.558192 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:37.558132 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7fqv9" podStartSLOduration=375.555137143 podStartE2EDuration="6m16.558119115s" totalImagesPullingTime="1.002981972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:43:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:49:37.557124077 +0000 UTC m=+376.826900393" watchObservedRunningTime="2026-06-05 03:49:37.558119115 +0000 UTC m=+376.827895432" Jun 05 03:49:55.577108 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:55.577046 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6d488c78dd-sfvsd" podUID="20746271-c92d-4ca0-a656-f8cb1a02042d" containerName="console" containerID="cri-o://7b05ebc6ff349f0adf14fdd5956761475656155e0d7aacf42d49896d0d1b7c03" gracePeriod=15 Jun 05 03:49:55.829744 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:55.829685 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d488c78dd-sfvsd" Jun 05 03:49:55.924614 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:55.924580 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20746271-c92d-4ca0-a656-f8cb1a02042d-console-serving-cert\") pod \"20746271-c92d-4ca0-a656-f8cb1a02042d\" (UID: \"20746271-c92d-4ca0-a656-f8cb1a02042d\") " Jun 05 03:49:55.924779 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:55.924633 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8d4wq\" (UniqueName: \"kubernetes.io/projected/20746271-c92d-4ca0-a656-f8cb1a02042d-kube-api-access-8d4wq\") pod \"20746271-c92d-4ca0-a656-f8cb1a02042d\" (UID: \"20746271-c92d-4ca0-a656-f8cb1a02042d\") " Jun 05 03:49:55.924779 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:55.924666 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20746271-c92d-4ca0-a656-f8cb1a02042d-service-ca\") pod \"20746271-c92d-4ca0-a656-f8cb1a02042d\" (UID: \"20746271-c92d-4ca0-a656-f8cb1a02042d\") " Jun 05 03:49:55.924779 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:55.924688 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20746271-c92d-4ca0-a656-f8cb1a02042d-oauth-serving-cert\") pod \"20746271-c92d-4ca0-a656-f8cb1a02042d\" (UID: \"20746271-c92d-4ca0-a656-f8cb1a02042d\") " Jun 05 03:49:55.924779 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:55.924749 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20746271-c92d-4ca0-a656-f8cb1a02042d-console-oauth-config\") pod \"20746271-c92d-4ca0-a656-f8cb1a02042d\" (UID: \"20746271-c92d-4ca0-a656-f8cb1a02042d\") " Jun 05 03:49:55.924974 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:55.924809 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20746271-c92d-4ca0-a656-f8cb1a02042d-trusted-ca-bundle\") pod \"20746271-c92d-4ca0-a656-f8cb1a02042d\" (UID: \"20746271-c92d-4ca0-a656-f8cb1a02042d\") " Jun 05 03:49:55.924974 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:55.924836 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20746271-c92d-4ca0-a656-f8cb1a02042d-console-config\") pod \"20746271-c92d-4ca0-a656-f8cb1a02042d\" (UID: \"20746271-c92d-4ca0-a656-f8cb1a02042d\") " Jun 05 03:49:55.925178 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:55.925133 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20746271-c92d-4ca0-a656-f8cb1a02042d-service-ca" (OuterVolumeSpecName: "service-ca") pod "20746271-c92d-4ca0-a656-f8cb1a02042d" (UID: "20746271-c92d-4ca0-a656-f8cb1a02042d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:49:55.925178 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:55.925145 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20746271-c92d-4ca0-a656-f8cb1a02042d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "20746271-c92d-4ca0-a656-f8cb1a02042d" (UID: "20746271-c92d-4ca0-a656-f8cb1a02042d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:49:55.925356 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:55.925232 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20746271-c92d-4ca0-a656-f8cb1a02042d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "20746271-c92d-4ca0-a656-f8cb1a02042d" (UID: "20746271-c92d-4ca0-a656-f8cb1a02042d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:49:55.925624 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:55.925599 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20746271-c92d-4ca0-a656-f8cb1a02042d-console-config" (OuterVolumeSpecName: "console-config") pod "20746271-c92d-4ca0-a656-f8cb1a02042d" (UID: "20746271-c92d-4ca0-a656-f8cb1a02042d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:49:55.926957 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:55.926923 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20746271-c92d-4ca0-a656-f8cb1a02042d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "20746271-c92d-4ca0-a656-f8cb1a02042d" (UID: "20746271-c92d-4ca0-a656-f8cb1a02042d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 03:49:55.926957 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:55.926940 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20746271-c92d-4ca0-a656-f8cb1a02042d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "20746271-c92d-4ca0-a656-f8cb1a02042d" (UID: "20746271-c92d-4ca0-a656-f8cb1a02042d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 03:49:55.927078 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:55.926955 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20746271-c92d-4ca0-a656-f8cb1a02042d-kube-api-access-8d4wq" (OuterVolumeSpecName: "kube-api-access-8d4wq") pod "20746271-c92d-4ca0-a656-f8cb1a02042d" (UID: "20746271-c92d-4ca0-a656-f8cb1a02042d"). InnerVolumeSpecName "kube-api-access-8d4wq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:49:56.025806 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:56.025754 2548 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20746271-c92d-4ca0-a656-f8cb1a02042d-console-serving-cert\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:49:56.025806 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:56.025801 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8d4wq\" (UniqueName: \"kubernetes.io/projected/20746271-c92d-4ca0-a656-f8cb1a02042d-kube-api-access-8d4wq\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:49:56.025806 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:56.025815 2548 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20746271-c92d-4ca0-a656-f8cb1a02042d-service-ca\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:49:56.026048 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:56.025830 2548 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20746271-c92d-4ca0-a656-f8cb1a02042d-oauth-serving-cert\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:49:56.026048 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:56.025841 2548 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20746271-c92d-4ca0-a656-f8cb1a02042d-console-oauth-config\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:49:56.026048 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:56.025852 2548 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20746271-c92d-4ca0-a656-f8cb1a02042d-trusted-ca-bundle\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:49:56.026048 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:56.025863 2548 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20746271-c92d-4ca0-a656-f8cb1a02042d-console-config\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:49:56.620383 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:56.620346 2548 generic.go:356] "Generic (PLEG): container finished" podID="20746271-c92d-4ca0-a656-f8cb1a02042d" containerID="7b05ebc6ff349f0adf14fdd5956761475656155e0d7aacf42d49896d0d1b7c03" exitCode=0 Jun 05 03:49:56.620383 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:56.620385 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d488c78dd-sfvsd" Jun 05 03:49:56.620841 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:56.620388 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d488c78dd-sfvsd" event={"ID":"20746271-c92d-4ca0-a656-f8cb1a02042d","Type":"ContainerDied","Data":"7b05ebc6ff349f0adf14fdd5956761475656155e0d7aacf42d49896d0d1b7c03"} Jun 05 03:49:56.620841 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:56.620517 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d488c78dd-sfvsd" event={"ID":"20746271-c92d-4ca0-a656-f8cb1a02042d","Type":"ContainerDied","Data":"f1e7a38dbce1e558549ad2982d913ccc1f3bee8bb213e1801949d36793cb2bf5"} Jun 05 03:49:56.620841 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:56.620546 2548 scope.go:117] "RemoveContainer" containerID="7b05ebc6ff349f0adf14fdd5956761475656155e0d7aacf42d49896d0d1b7c03" Jun 05 03:49:56.629344 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:56.629330 2548 scope.go:117] "RemoveContainer" containerID="7b05ebc6ff349f0adf14fdd5956761475656155e0d7aacf42d49896d0d1b7c03" Jun 05 03:49:56.629619 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:49:56.629600 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b05ebc6ff349f0adf14fdd5956761475656155e0d7aacf42d49896d0d1b7c03\": container with ID starting with 7b05ebc6ff349f0adf14fdd5956761475656155e0d7aacf42d49896d0d1b7c03 not found: ID does not exist" containerID="7b05ebc6ff349f0adf14fdd5956761475656155e0d7aacf42d49896d0d1b7c03" Jun 05 03:49:56.629690 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:56.629631 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b05ebc6ff349f0adf14fdd5956761475656155e0d7aacf42d49896d0d1b7c03"} err="failed to get container status \"7b05ebc6ff349f0adf14fdd5956761475656155e0d7aacf42d49896d0d1b7c03\": rpc error: code = NotFound desc = could not find container \"7b05ebc6ff349f0adf14fdd5956761475656155e0d7aacf42d49896d0d1b7c03\": container with ID starting with 7b05ebc6ff349f0adf14fdd5956761475656155e0d7aacf42d49896d0d1b7c03 not found: ID does not exist" Jun 05 03:49:56.641054 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:56.641026 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d488c78dd-sfvsd"] Jun 05 03:49:56.647764 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:56.647741 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d488c78dd-sfvsd"] Jun 05 03:49:57.227713 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:49:57.227680 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20746271-c92d-4ca0-a656-f8cb1a02042d" path="/var/lib/kubelet/pods/20746271-c92d-4ca0-a656-f8cb1a02042d/volumes" Jun 05 03:50:29.601093 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:29.601058 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57b876f5b8-hf8kx"] Jun 05 03:50:29.601543 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:29.601364 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20746271-c92d-4ca0-a656-f8cb1a02042d" containerName="console" Jun 05 03:50:29.601543 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:29.601375 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="20746271-c92d-4ca0-a656-f8cb1a02042d" containerName="console" Jun 05 03:50:29.601543 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:29.601461 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="20746271-c92d-4ca0-a656-f8cb1a02042d" containerName="console" Jun 05 03:50:29.605592 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:29.605571 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57b876f5b8-hf8kx" Jun 05 03:50:29.615901 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:29.615874 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57b876f5b8-hf8kx"] Jun 05 03:50:29.694624 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:29.694582 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11b7b154-1085-47cf-9a98-2dbb46dbeb87-console-serving-cert\") pod \"console-57b876f5b8-hf8kx\" (UID: \"11b7b154-1085-47cf-9a98-2dbb46dbeb87\") " pod="openshift-console/console-57b876f5b8-hf8kx" Jun 05 03:50:29.694624 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:29.694632 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11b7b154-1085-47cf-9a98-2dbb46dbeb87-console-oauth-config\") pod \"console-57b876f5b8-hf8kx\" (UID: \"11b7b154-1085-47cf-9a98-2dbb46dbeb87\") " pod="openshift-console/console-57b876f5b8-hf8kx" Jun 05 03:50:29.694862 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:29.694650 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11b7b154-1085-47cf-9a98-2dbb46dbeb87-console-config\") pod \"console-57b876f5b8-hf8kx\" (UID: \"11b7b154-1085-47cf-9a98-2dbb46dbeb87\") " pod="openshift-console/console-57b876f5b8-hf8kx" Jun 05 03:50:29.694862 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:29.694670 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11b7b154-1085-47cf-9a98-2dbb46dbeb87-trusted-ca-bundle\") pod \"console-57b876f5b8-hf8kx\" (UID: \"11b7b154-1085-47cf-9a98-2dbb46dbeb87\") " pod="openshift-console/console-57b876f5b8-hf8kx" Jun 05 03:50:29.694862 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:29.694755 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpj4s\" (UniqueName: \"kubernetes.io/projected/11b7b154-1085-47cf-9a98-2dbb46dbeb87-kube-api-access-qpj4s\") pod \"console-57b876f5b8-hf8kx\" (UID: \"11b7b154-1085-47cf-9a98-2dbb46dbeb87\") " pod="openshift-console/console-57b876f5b8-hf8kx" Jun 05 03:50:29.694862 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:29.694819 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11b7b154-1085-47cf-9a98-2dbb46dbeb87-oauth-serving-cert\") pod \"console-57b876f5b8-hf8kx\" (UID: \"11b7b154-1085-47cf-9a98-2dbb46dbeb87\") " pod="openshift-console/console-57b876f5b8-hf8kx" Jun 05 03:50:29.694862 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:29.694854 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11b7b154-1085-47cf-9a98-2dbb46dbeb87-service-ca\") pod \"console-57b876f5b8-hf8kx\" (UID: \"11b7b154-1085-47cf-9a98-2dbb46dbeb87\") " pod="openshift-console/console-57b876f5b8-hf8kx" Jun 05 03:50:29.795596 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:29.795550 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11b7b154-1085-47cf-9a98-2dbb46dbeb87-oauth-serving-cert\") pod \"console-57b876f5b8-hf8kx\" (UID: \"11b7b154-1085-47cf-9a98-2dbb46dbeb87\") " pod="openshift-console/console-57b876f5b8-hf8kx" Jun 05 03:50:29.795837 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:29.795605 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11b7b154-1085-47cf-9a98-2dbb46dbeb87-service-ca\") pod \"console-57b876f5b8-hf8kx\" (UID: \"11b7b154-1085-47cf-9a98-2dbb46dbeb87\") " pod="openshift-console/console-57b876f5b8-hf8kx" Jun 05 03:50:29.795837 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:29.795696 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11b7b154-1085-47cf-9a98-2dbb46dbeb87-console-serving-cert\") pod \"console-57b876f5b8-hf8kx\" (UID: \"11b7b154-1085-47cf-9a98-2dbb46dbeb87\") " pod="openshift-console/console-57b876f5b8-hf8kx" Jun 05 03:50:29.795837 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:29.795788 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11b7b154-1085-47cf-9a98-2dbb46dbeb87-console-oauth-config\") pod \"console-57b876f5b8-hf8kx\" (UID: \"11b7b154-1085-47cf-9a98-2dbb46dbeb87\") " pod="openshift-console/console-57b876f5b8-hf8kx" Jun 05 03:50:29.795837 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:29.795812 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11b7b154-1085-47cf-9a98-2dbb46dbeb87-console-config\") pod \"console-57b876f5b8-hf8kx\" (UID: \"11b7b154-1085-47cf-9a98-2dbb46dbeb87\") " pod="openshift-console/console-57b876f5b8-hf8kx" Jun 05 03:50:29.795837 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:29.795833 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11b7b154-1085-47cf-9a98-2dbb46dbeb87-trusted-ca-bundle\") pod \"console-57b876f5b8-hf8kx\" (UID: \"11b7b154-1085-47cf-9a98-2dbb46dbeb87\") " pod="openshift-console/console-57b876f5b8-hf8kx" Jun 05 03:50:29.796109 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:29.795939 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpj4s\" (UniqueName: \"kubernetes.io/projected/11b7b154-1085-47cf-9a98-2dbb46dbeb87-kube-api-access-qpj4s\") pod \"console-57b876f5b8-hf8kx\" (UID: \"11b7b154-1085-47cf-9a98-2dbb46dbeb87\") " pod="openshift-console/console-57b876f5b8-hf8kx" Jun 05 03:50:29.796455 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:29.796415 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11b7b154-1085-47cf-9a98-2dbb46dbeb87-service-ca\") pod \"console-57b876f5b8-hf8kx\" (UID: \"11b7b154-1085-47cf-9a98-2dbb46dbeb87\") " pod="openshift-console/console-57b876f5b8-hf8kx" Jun 05 03:50:29.796771 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:29.796477 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11b7b154-1085-47cf-9a98-2dbb46dbeb87-console-config\") pod \"console-57b876f5b8-hf8kx\" (UID: \"11b7b154-1085-47cf-9a98-2dbb46dbeb87\") " pod="openshift-console/console-57b876f5b8-hf8kx" Jun 05 03:50:29.796884 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:29.796860 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11b7b154-1085-47cf-9a98-2dbb46dbeb87-trusted-ca-bundle\") pod \"console-57b876f5b8-hf8kx\" (UID: \"11b7b154-1085-47cf-9a98-2dbb46dbeb87\") " pod="openshift-console/console-57b876f5b8-hf8kx" Jun 05 03:50:29.796884 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:29.796484 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11b7b154-1085-47cf-9a98-2dbb46dbeb87-oauth-serving-cert\") pod \"console-57b876f5b8-hf8kx\" (UID: \"11b7b154-1085-47cf-9a98-2dbb46dbeb87\") " pod="openshift-console/console-57b876f5b8-hf8kx" Jun 05 03:50:29.798448 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:29.798408 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11b7b154-1085-47cf-9a98-2dbb46dbeb87-console-oauth-config\") pod \"console-57b876f5b8-hf8kx\" (UID: \"11b7b154-1085-47cf-9a98-2dbb46dbeb87\") " pod="openshift-console/console-57b876f5b8-hf8kx" Jun 05 03:50:29.798584 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:29.798565 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11b7b154-1085-47cf-9a98-2dbb46dbeb87-console-serving-cert\") pod \"console-57b876f5b8-hf8kx\" (UID: \"11b7b154-1085-47cf-9a98-2dbb46dbeb87\") " pod="openshift-console/console-57b876f5b8-hf8kx" Jun 05 03:50:29.804058 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:29.804037 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpj4s\" (UniqueName: \"kubernetes.io/projected/11b7b154-1085-47cf-9a98-2dbb46dbeb87-kube-api-access-qpj4s\") pod \"console-57b876f5b8-hf8kx\" (UID: \"11b7b154-1085-47cf-9a98-2dbb46dbeb87\") " pod="openshift-console/console-57b876f5b8-hf8kx" Jun 05 03:50:29.915545 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:29.915419 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57b876f5b8-hf8kx" Jun 05 03:50:30.048582 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:30.048557 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57b876f5b8-hf8kx"] Jun 05 03:50:30.050950 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:50:30.050916 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11b7b154_1085_47cf_9a98_2dbb46dbeb87.slice/crio-934884afbe1d27e44ad645b8e2cc7c534c075b6159b29192d6991a98490c5295 WatchSource:0}: Error finding container 934884afbe1d27e44ad645b8e2cc7c534c075b6159b29192d6991a98490c5295: Status 404 returned error can't find the container with id 934884afbe1d27e44ad645b8e2cc7c534c075b6159b29192d6991a98490c5295 Jun 05 03:50:30.761405 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:30.761366 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57b876f5b8-hf8kx" event={"ID":"11b7b154-1085-47cf-9a98-2dbb46dbeb87","Type":"ContainerStarted","Data":"c7e19ef9e5422186a264c5d517e1319bd892af2621960f4ff97b760fc6d14a14"} Jun 05 03:50:30.761814 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:30.761450 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57b876f5b8-hf8kx" event={"ID":"11b7b154-1085-47cf-9a98-2dbb46dbeb87","Type":"ContainerStarted","Data":"934884afbe1d27e44ad645b8e2cc7c534c075b6159b29192d6991a98490c5295"} Jun 05 03:50:30.778078 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:30.778029 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57b876f5b8-hf8kx" podStartSLOduration=1.778012093 podStartE2EDuration="1.778012093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:50:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:50:30.776696256 +0000 UTC m=+430.046472577" watchObservedRunningTime="2026-06-05 03:50:30.778012093 +0000 UTC m=+430.047788464" Jun 05 03:50:39.915916 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:39.915799 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57b876f5b8-hf8kx" Jun 05 03:50:39.915916 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:39.915877 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57b876f5b8-hf8kx" Jun 05 03:50:39.920608 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:39.920584 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57b876f5b8-hf8kx" Jun 05 03:50:40.806067 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:40.806041 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57b876f5b8-hf8kx" Jun 05 03:50:40.848008 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:50:40.847975 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8cf6976f-r85k5"] Jun 05 03:51:05.874329 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:05.874285 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8cf6976f-r85k5" podUID="d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f" containerName="console" containerID="cri-o://719845be34ea844b5da99b00113e2d9e366d330d9f745294b2d95d93a2320db6" gracePeriod=15 Jun 05 03:51:06.117849 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:06.117826 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8cf6976f-r85k5" Jun 05 03:51:06.200349 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:06.200268 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-console-serving-cert\") pod \"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f\" (UID: \"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f\") " Jun 05 03:51:06.200349 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:06.200300 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nx5tw\" (UniqueName: \"kubernetes.io/projected/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-kube-api-access-nx5tw\") pod \"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f\" (UID: \"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f\") " Jun 05 03:51:06.200349 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:06.200336 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-console-config\") pod \"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f\" (UID: \"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f\") " Jun 05 03:51:06.200602 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:06.200372 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-console-oauth-config\") pod \"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f\" (UID: \"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f\") " Jun 05 03:51:06.200640 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:06.200597 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-oauth-serving-cert\") pod \"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f\" (UID: \"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f\") " Jun 05 03:51:06.200691 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:06.200644 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-service-ca\") pod \"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f\" (UID: \"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f\") " Jun 05 03:51:06.200691 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:06.200684 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-trusted-ca-bundle\") pod \"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f\" (UID: \"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f\") " Jun 05 03:51:06.200868 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:06.200846 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-console-config" (OuterVolumeSpecName: "console-config") pod "d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f" (UID: "d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:51:06.200979 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:06.200962 2548 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-console-config\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:51:06.201116 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:06.201064 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-service-ca" (OuterVolumeSpecName: "service-ca") pod "d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f" (UID: "d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:51:06.201184 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:06.201124 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f" (UID: "d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:51:06.201224 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:06.201193 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f" (UID: "d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:51:06.202604 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:06.202581 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f" (UID: "d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 03:51:06.203033 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:06.203017 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f" (UID: "d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 03:51:06.203033 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:06.203022 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-kube-api-access-nx5tw" (OuterVolumeSpecName: "kube-api-access-nx5tw") pod "d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f" (UID: "d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f"). InnerVolumeSpecName "kube-api-access-nx5tw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:51:06.301701 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:06.301670 2548 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-console-oauth-config\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:51:06.301701 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:06.301694 2548 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-oauth-serving-cert\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:51:06.301701 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:06.301703 2548 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-service-ca\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:51:06.301701 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:06.301711 2548 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-trusted-ca-bundle\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:51:06.301958 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:06.301720 2548 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-console-serving-cert\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:51:06.301958 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:06.301728 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nx5tw\" (UniqueName: \"kubernetes.io/projected/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f-kube-api-access-nx5tw\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:51:06.905951 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:06.905910 2548 generic.go:356] "Generic (PLEG): container finished" podID="d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f" containerID="719845be34ea844b5da99b00113e2d9e366d330d9f745294b2d95d93a2320db6" exitCode=0 Jun 05 03:51:06.906340 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:06.905981 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8cf6976f-r85k5" Jun 05 03:51:06.906340 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:06.905999 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8cf6976f-r85k5" event={"ID":"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f","Type":"ContainerDied","Data":"719845be34ea844b5da99b00113e2d9e366d330d9f745294b2d95d93a2320db6"} Jun 05 03:51:06.906340 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:06.906081 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8cf6976f-r85k5" event={"ID":"d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f","Type":"ContainerDied","Data":"143ab033d423ceac74a4288e6ffcb36347143ab0ffaf02ef4d820ad5ea9de979"} Jun 05 03:51:06.906340 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:06.906103 2548 scope.go:117] "RemoveContainer" containerID="719845be34ea844b5da99b00113e2d9e366d330d9f745294b2d95d93a2320db6" Jun 05 03:51:06.915532 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:06.915516 2548 scope.go:117] "RemoveContainer" containerID="719845be34ea844b5da99b00113e2d9e366d330d9f745294b2d95d93a2320db6" Jun 05 03:51:06.915798 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:51:06.915779 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"719845be34ea844b5da99b00113e2d9e366d330d9f745294b2d95d93a2320db6\": container with ID starting with 719845be34ea844b5da99b00113e2d9e366d330d9f745294b2d95d93a2320db6 not found: ID does not exist" containerID="719845be34ea844b5da99b00113e2d9e366d330d9f745294b2d95d93a2320db6" Jun 05 03:51:06.915855 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:06.915807 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"719845be34ea844b5da99b00113e2d9e366d330d9f745294b2d95d93a2320db6"} err="failed to get container status \"719845be34ea844b5da99b00113e2d9e366d330d9f745294b2d95d93a2320db6\": rpc error: code = NotFound desc = could not find container \"719845be34ea844b5da99b00113e2d9e366d330d9f745294b2d95d93a2320db6\": container with ID starting with 719845be34ea844b5da99b00113e2d9e366d330d9f745294b2d95d93a2320db6 not found: ID does not exist" Jun 05 03:51:06.926285 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:06.926264 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8cf6976f-r85k5"] Jun 05 03:51:06.930132 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:06.930110 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8cf6976f-r85k5"] Jun 05 03:51:07.228829 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:07.228749 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f" path="/var/lib/kubelet/pods/d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f/volumes" Jun 05 03:51:33.413869 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:33.413829 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drkqll"] Jun 05 03:51:33.414461 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:33.414299 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f" containerName="console" Jun 05 03:51:33.414461 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:33.414319 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f" containerName="console" Jun 05 03:51:33.414461 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:33.414400 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7a4c1a7-1582-47f3-a88b-ea0ce3b0430f" containerName="console" Jun 05 03:51:33.418847 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:33.418824 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drkqll" Jun 05 03:51:33.421396 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:33.421374 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 03:51:33.422454 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:33.422407 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 03:51:33.422576 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:33.422408 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hsscq\"" Jun 05 03:51:33.426865 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:33.426838 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drkqll"] Jun 05 03:51:33.524307 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:33.524272 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32789a26-4c49-4f0c-b357-dcef37aba8c8-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drkqll\" (UID: \"32789a26-4c49-4f0c-b357-dcef37aba8c8\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drkqll" Jun 05 03:51:33.524513 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:33.524352 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32789a26-4c49-4f0c-b357-dcef37aba8c8-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drkqll\" (UID: \"32789a26-4c49-4f0c-b357-dcef37aba8c8\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drkqll" Jun 05 03:51:33.524513 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:33.524389 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbmnr\" (UniqueName: \"kubernetes.io/projected/32789a26-4c49-4f0c-b357-dcef37aba8c8-kube-api-access-pbmnr\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drkqll\" (UID: \"32789a26-4c49-4f0c-b357-dcef37aba8c8\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drkqll" Jun 05 03:51:33.624878 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:33.624828 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32789a26-4c49-4f0c-b357-dcef37aba8c8-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drkqll\" (UID: \"32789a26-4c49-4f0c-b357-dcef37aba8c8\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drkqll" Jun 05 03:51:33.625039 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:33.624901 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbmnr\" (UniqueName: \"kubernetes.io/projected/32789a26-4c49-4f0c-b357-dcef37aba8c8-kube-api-access-pbmnr\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drkqll\" (UID: \"32789a26-4c49-4f0c-b357-dcef37aba8c8\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drkqll" Jun 05 03:51:33.625039 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:33.624954 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32789a26-4c49-4f0c-b357-dcef37aba8c8-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drkqll\" (UID: \"32789a26-4c49-4f0c-b357-dcef37aba8c8\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drkqll" Jun 05 03:51:33.625313 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:33.625293 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32789a26-4c49-4f0c-b357-dcef37aba8c8-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drkqll\" (UID: \"32789a26-4c49-4f0c-b357-dcef37aba8c8\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drkqll" Jun 05 03:51:33.625350 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:33.625302 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32789a26-4c49-4f0c-b357-dcef37aba8c8-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drkqll\" (UID: \"32789a26-4c49-4f0c-b357-dcef37aba8c8\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drkqll" Jun 05 03:51:33.633075 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:33.633052 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbmnr\" (UniqueName: \"kubernetes.io/projected/32789a26-4c49-4f0c-b357-dcef37aba8c8-kube-api-access-pbmnr\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drkqll\" (UID: \"32789a26-4c49-4f0c-b357-dcef37aba8c8\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drkqll" Jun 05 03:51:33.728983 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:33.728889 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drkqll" Jun 05 03:51:33.857847 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:33.857822 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drkqll"] Jun 05 03:51:33.859897 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:51:33.859874 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32789a26_4c49_4f0c_b357_dcef37aba8c8.slice/crio-24c9e83ad23c67d9f4df3d3fed004454956af9e1b3db4723cc91859c1289bfbd WatchSource:0}: Error finding container 24c9e83ad23c67d9f4df3d3fed004454956af9e1b3db4723cc91859c1289bfbd: Status 404 returned error can't find the container with id 24c9e83ad23c67d9f4df3d3fed004454956af9e1b3db4723cc91859c1289bfbd Jun 05 03:51:34.022912 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:34.022878 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drkqll" event={"ID":"32789a26-4c49-4f0c-b357-dcef37aba8c8","Type":"ContainerStarted","Data":"24c9e83ad23c67d9f4df3d3fed004454956af9e1b3db4723cc91859c1289bfbd"} Jun 05 03:51:40.051740 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:40.051713 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drkqll" event={"ID":"32789a26-4c49-4f0c-b357-dcef37aba8c8","Type":"ContainerStarted","Data":"976dfda8804155a1a457e779a7bd495024f53567adbd9b364427d975300487dc"} Jun 05 03:51:41.057204 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:41.057172 2548 generic.go:356] "Generic (PLEG): container finished" podID="32789a26-4c49-4f0c-b357-dcef37aba8c8" containerID="976dfda8804155a1a457e779a7bd495024f53567adbd9b364427d975300487dc" exitCode=0 Jun 05 03:51:41.057623 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:41.057299 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drkqll" event={"ID":"32789a26-4c49-4f0c-b357-dcef37aba8c8","Type":"ContainerDied","Data":"976dfda8804155a1a457e779a7bd495024f53567adbd9b364427d975300487dc"} Jun 05 03:51:44.075744 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:44.075711 2548 generic.go:356] "Generic (PLEG): container finished" podID="32789a26-4c49-4f0c-b357-dcef37aba8c8" containerID="85e3bc09e02457d1e6124e41ecae8382bc5559d55e97874770a229f471efa285" exitCode=0 Jun 05 03:51:44.076217 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:44.075788 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drkqll" event={"ID":"32789a26-4c49-4f0c-b357-dcef37aba8c8","Type":"ContainerDied","Data":"85e3bc09e02457d1e6124e41ecae8382bc5559d55e97874770a229f471efa285"} Jun 05 03:51:51.110942 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:51.110901 2548 generic.go:356] "Generic (PLEG): container finished" podID="32789a26-4c49-4f0c-b357-dcef37aba8c8" containerID="228084c29bde278a4a4b928b12a04745f8366bd6e22bbfaeacc6caddf753a59c" exitCode=0 Jun 05 03:51:51.111342 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:51.110991 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drkqll" event={"ID":"32789a26-4c49-4f0c-b357-dcef37aba8c8","Type":"ContainerDied","Data":"228084c29bde278a4a4b928b12a04745f8366bd6e22bbfaeacc6caddf753a59c"} Jun 05 03:51:52.239964 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:52.239941 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drkqll" Jun 05 03:51:52.393071 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:52.392989 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32789a26-4c49-4f0c-b357-dcef37aba8c8-util\") pod \"32789a26-4c49-4f0c-b357-dcef37aba8c8\" (UID: \"32789a26-4c49-4f0c-b357-dcef37aba8c8\") " Jun 05 03:51:52.393071 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:52.393043 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32789a26-4c49-4f0c-b357-dcef37aba8c8-bundle\") pod \"32789a26-4c49-4f0c-b357-dcef37aba8c8\" (UID: \"32789a26-4c49-4f0c-b357-dcef37aba8c8\") " Jun 05 03:51:52.393307 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:52.393099 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbmnr\" (UniqueName: \"kubernetes.io/projected/32789a26-4c49-4f0c-b357-dcef37aba8c8-kube-api-access-pbmnr\") pod \"32789a26-4c49-4f0c-b357-dcef37aba8c8\" (UID: \"32789a26-4c49-4f0c-b357-dcef37aba8c8\") " Jun 05 03:51:52.393860 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:52.393832 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32789a26-4c49-4f0c-b357-dcef37aba8c8-bundle" (OuterVolumeSpecName: "bundle") pod "32789a26-4c49-4f0c-b357-dcef37aba8c8" (UID: "32789a26-4c49-4f0c-b357-dcef37aba8c8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:51:52.395938 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:52.395914 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32789a26-4c49-4f0c-b357-dcef37aba8c8-kube-api-access-pbmnr" (OuterVolumeSpecName: "kube-api-access-pbmnr") pod "32789a26-4c49-4f0c-b357-dcef37aba8c8" (UID: "32789a26-4c49-4f0c-b357-dcef37aba8c8"). InnerVolumeSpecName "kube-api-access-pbmnr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:51:52.398711 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:52.398685 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32789a26-4c49-4f0c-b357-dcef37aba8c8-util" (OuterVolumeSpecName: "util") pod "32789a26-4c49-4f0c-b357-dcef37aba8c8" (UID: "32789a26-4c49-4f0c-b357-dcef37aba8c8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:51:52.494520 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:52.494488 2548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32789a26-4c49-4f0c-b357-dcef37aba8c8-bundle\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:51:52.494520 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:52.494515 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbmnr\" (UniqueName: \"kubernetes.io/projected/32789a26-4c49-4f0c-b357-dcef37aba8c8-kube-api-access-pbmnr\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:51:52.494520 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:52.494525 2548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32789a26-4c49-4f0c-b357-dcef37aba8c8-util\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:51:53.119850 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:53.119812 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drkqll" event={"ID":"32789a26-4c49-4f0c-b357-dcef37aba8c8","Type":"ContainerDied","Data":"24c9e83ad23c67d9f4df3d3fed004454956af9e1b3db4723cc91859c1289bfbd"} Jun 05 03:51:53.120007 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:53.119870 2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="24c9e83ad23c67d9f4df3d3fed004454956af9e1b3db4723cc91859c1289bfbd" Jun 05 03:51:53.120007 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:53.119833 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drkqll" Jun 05 03:51:56.087055 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:56.087019 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-26qlt"] Jun 05 03:51:56.087646 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:56.087346 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32789a26-4c49-4f0c-b357-dcef37aba8c8" containerName="util" Jun 05 03:51:56.087646 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:56.087358 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="32789a26-4c49-4f0c-b357-dcef37aba8c8" containerName="util" Jun 05 03:51:56.087646 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:56.087367 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32789a26-4c49-4f0c-b357-dcef37aba8c8" containerName="extract" Jun 05 03:51:56.087646 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:56.087373 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="32789a26-4c49-4f0c-b357-dcef37aba8c8" containerName="extract" Jun 05 03:51:56.087646 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:56.087385 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32789a26-4c49-4f0c-b357-dcef37aba8c8" containerName="pull" Jun 05 03:51:56.087646 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:56.087391 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="32789a26-4c49-4f0c-b357-dcef37aba8c8" containerName="pull" Jun 05 03:51:56.087646 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:56.087463 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="32789a26-4c49-4f0c-b357-dcef37aba8c8" containerName="extract" Jun 05 03:51:56.091566 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:56.091547 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-26qlt" Jun 05 03:51:56.095183 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:56.095156 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 05 03:51:56.095183 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:56.095177 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-nksss\"" Jun 05 03:51:56.095323 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:56.095154 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 05 03:51:56.103374 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:56.103347 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-26qlt"] Jun 05 03:51:56.226310 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:56.226273 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vfll\" (UniqueName: \"kubernetes.io/projected/ece313ff-3d63-4571-a786-fa4bf346a1ee-kube-api-access-8vfll\") pod \"cert-manager-operator-controller-manager-57757f7cfc-26qlt\" (UID: \"ece313ff-3d63-4571-a786-fa4bf346a1ee\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-26qlt" Jun 05 03:51:56.226517 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:56.226336 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ece313ff-3d63-4571-a786-fa4bf346a1ee-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-26qlt\" (UID: \"ece313ff-3d63-4571-a786-fa4bf346a1ee\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-26qlt" Jun 05 03:51:56.326969 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:56.326934 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ece313ff-3d63-4571-a786-fa4bf346a1ee-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-26qlt\" (UID: \"ece313ff-3d63-4571-a786-fa4bf346a1ee\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-26qlt" Jun 05 03:51:56.327123 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:56.326997 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vfll\" (UniqueName: \"kubernetes.io/projected/ece313ff-3d63-4571-a786-fa4bf346a1ee-kube-api-access-8vfll\") pod \"cert-manager-operator-controller-manager-57757f7cfc-26qlt\" (UID: \"ece313ff-3d63-4571-a786-fa4bf346a1ee\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-26qlt" Jun 05 03:51:56.327361 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:56.327342 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ece313ff-3d63-4571-a786-fa4bf346a1ee-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-26qlt\" (UID: \"ece313ff-3d63-4571-a786-fa4bf346a1ee\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-26qlt" Jun 05 03:51:56.334988 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:56.334963 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vfll\" (UniqueName: \"kubernetes.io/projected/ece313ff-3d63-4571-a786-fa4bf346a1ee-kube-api-access-8vfll\") pod \"cert-manager-operator-controller-manager-57757f7cfc-26qlt\" (UID: \"ece313ff-3d63-4571-a786-fa4bf346a1ee\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-26qlt" Jun 05 03:51:56.400482 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:56.400375 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-26qlt" Jun 05 03:51:56.530876 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:56.530846 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-26qlt"] Jun 05 03:51:56.533630 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:51:56.533604 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podece313ff_3d63_4571_a786_fa4bf346a1ee.slice/crio-60c7e37ebf905e97e975acd8dcfe61f85bcb456c2f1865907a481395c054e14b WatchSource:0}: Error finding container 60c7e37ebf905e97e975acd8dcfe61f85bcb456c2f1865907a481395c054e14b: Status 404 returned error can't find the container with id 60c7e37ebf905e97e975acd8dcfe61f85bcb456c2f1865907a481395c054e14b Jun 05 03:51:57.138910 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:57.138870 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-26qlt" event={"ID":"ece313ff-3d63-4571-a786-fa4bf346a1ee","Type":"ContainerStarted","Data":"60c7e37ebf905e97e975acd8dcfe61f85bcb456c2f1865907a481395c054e14b"} Jun 05 03:51:59.151058 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:59.151012 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-26qlt" event={"ID":"ece313ff-3d63-4571-a786-fa4bf346a1ee","Type":"ContainerStarted","Data":"2a023bd0ae3f4431f062825bfdb491492e37e601b67c1a9bb2111eaf56a3d7e7"} Jun 05 03:51:59.195899 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:51:59.195829 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-26qlt" podStartSLOduration=1.152139863 podStartE2EDuration="3.195808858s" totalImagesPullingTime="2.043668995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:51:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:51:59.192516856 +0000 UTC m=+518.462293182" watchObservedRunningTime="2026-06-05 03:51:59.195808858 +0000 UTC m=+518.465585204" Jun 05 03:52:00.771607 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:00.771568 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m2nm"] Jun 05 03:52:00.775392 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:00.775374 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m2nm" Jun 05 03:52:00.777989 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:00.777961 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 03:52:00.779089 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:00.779069 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hsscq\"" Jun 05 03:52:00.779207 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:00.779079 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 03:52:00.784332 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:00.784306 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m2nm"] Jun 05 03:52:00.865943 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:00.865903 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4616ebd-f129-4c71-b466-0ee8349c8e5c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m2nm\" (UID: \"d4616ebd-f129-4c71-b466-0ee8349c8e5c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m2nm" Jun 05 03:52:00.865943 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:00.865948 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gqgr\" (UniqueName: \"kubernetes.io/projected/d4616ebd-f129-4c71-b466-0ee8349c8e5c-kube-api-access-6gqgr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m2nm\" (UID: \"d4616ebd-f129-4c71-b466-0ee8349c8e5c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m2nm" Jun 05 03:52:00.866178 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:00.866017 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4616ebd-f129-4c71-b466-0ee8349c8e5c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m2nm\" (UID: \"d4616ebd-f129-4c71-b466-0ee8349c8e5c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m2nm" Jun 05 03:52:00.967294 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:00.967259 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4616ebd-f129-4c71-b466-0ee8349c8e5c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m2nm\" (UID: \"d4616ebd-f129-4c71-b466-0ee8349c8e5c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m2nm" Jun 05 03:52:00.967294 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:00.967298 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gqgr\" (UniqueName: \"kubernetes.io/projected/d4616ebd-f129-4c71-b466-0ee8349c8e5c-kube-api-access-6gqgr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m2nm\" (UID: \"d4616ebd-f129-4c71-b466-0ee8349c8e5c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m2nm" Jun 05 03:52:00.967525 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:00.967347 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4616ebd-f129-4c71-b466-0ee8349c8e5c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m2nm\" (UID: \"d4616ebd-f129-4c71-b466-0ee8349c8e5c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m2nm" Jun 05 03:52:00.967657 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:00.967638 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4616ebd-f129-4c71-b466-0ee8349c8e5c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m2nm\" (UID: \"d4616ebd-f129-4c71-b466-0ee8349c8e5c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m2nm" Jun 05 03:52:00.967717 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:00.967696 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4616ebd-f129-4c71-b466-0ee8349c8e5c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m2nm\" (UID: \"d4616ebd-f129-4c71-b466-0ee8349c8e5c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m2nm" Jun 05 03:52:00.982605 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:00.982582 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gqgr\" (UniqueName: \"kubernetes.io/projected/d4616ebd-f129-4c71-b466-0ee8349c8e5c-kube-api-access-6gqgr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m2nm\" (UID: \"d4616ebd-f129-4c71-b466-0ee8349c8e5c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m2nm" Jun 05 03:52:01.085140 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:01.085052 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m2nm" Jun 05 03:52:01.215793 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:01.215770 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m2nm"] Jun 05 03:52:01.218098 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:52:01.218068 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4616ebd_f129_4c71_b466_0ee8349c8e5c.slice/crio-053c639496320bc6022e27fcd51d8c66b70ca0a4a14e4d5b5dc02c5d56898e5d WatchSource:0}: Error finding container 053c639496320bc6022e27fcd51d8c66b70ca0a4a14e4d5b5dc02c5d56898e5d: Status 404 returned error can't find the container with id 053c639496320bc6022e27fcd51d8c66b70ca0a4a14e4d5b5dc02c5d56898e5d Jun 05 03:52:02.166201 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:02.166159 2548 generic.go:356] "Generic (PLEG): container finished" podID="d4616ebd-f129-4c71-b466-0ee8349c8e5c" containerID="53ea51806f7ff011e2fd688c96848b44bfa5eb57a12f19adb59d333b9563d139" exitCode=0 Jun 05 03:52:02.166712 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:02.166256 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m2nm" event={"ID":"d4616ebd-f129-4c71-b466-0ee8349c8e5c","Type":"ContainerDied","Data":"53ea51806f7ff011e2fd688c96848b44bfa5eb57a12f19adb59d333b9563d139"} Jun 05 03:52:02.166712 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:02.166299 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m2nm" event={"ID":"d4616ebd-f129-4c71-b466-0ee8349c8e5c","Type":"ContainerStarted","Data":"053c639496320bc6022e27fcd51d8c66b70ca0a4a14e4d5b5dc02c5d56898e5d"} Jun 05 03:52:02.211405 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:02.211377 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-f5zf2"] Jun 05 03:52:02.214677 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:02.214661 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-f5zf2" Jun 05 03:52:02.217132 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:02.217107 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 05 03:52:02.217132 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:02.217127 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 05 03:52:02.217314 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:02.217210 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-fk885\"" Jun 05 03:52:02.224784 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:02.224764 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-f5zf2"] Jun 05 03:52:02.277910 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:02.277877 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25deef27-5766-4b2d-823c-3428117d46e0-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-f5zf2\" (UID: \"25deef27-5766-4b2d-823c-3428117d46e0\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-f5zf2" Jun 05 03:52:02.278077 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:02.277985 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46jtk\" (UniqueName: \"kubernetes.io/projected/25deef27-5766-4b2d-823c-3428117d46e0-kube-api-access-46jtk\") pod \"cert-manager-webhook-7dc76cbb94-f5zf2\" (UID: \"25deef27-5766-4b2d-823c-3428117d46e0\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-f5zf2" Jun 05 03:52:02.379278 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:02.379243 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25deef27-5766-4b2d-823c-3428117d46e0-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-f5zf2\" (UID: \"25deef27-5766-4b2d-823c-3428117d46e0\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-f5zf2" Jun 05 03:52:02.379413 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:02.379300 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46jtk\" (UniqueName: \"kubernetes.io/projected/25deef27-5766-4b2d-823c-3428117d46e0-kube-api-access-46jtk\") pod \"cert-manager-webhook-7dc76cbb94-f5zf2\" (UID: \"25deef27-5766-4b2d-823c-3428117d46e0\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-f5zf2" Jun 05 03:52:02.387541 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:02.387509 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25deef27-5766-4b2d-823c-3428117d46e0-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-f5zf2\" (UID: \"25deef27-5766-4b2d-823c-3428117d46e0\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-f5zf2" Jun 05 03:52:02.387646 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:02.387626 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46jtk\" (UniqueName: \"kubernetes.io/projected/25deef27-5766-4b2d-823c-3428117d46e0-kube-api-access-46jtk\") pod \"cert-manager-webhook-7dc76cbb94-f5zf2\" (UID: \"25deef27-5766-4b2d-823c-3428117d46e0\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-f5zf2" Jun 05 03:52:02.529733 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:02.529654 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-f5zf2" Jun 05 03:52:02.624047 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:02.624014 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-pcq8d"] Jun 05 03:52:02.628361 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:02.628339 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-pcq8d" Jun 05 03:52:02.630672 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:02.630649 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-96l5d\"" Jun 05 03:52:02.637251 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:02.637069 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-pcq8d"] Jun 05 03:52:02.666252 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:02.666228 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-f5zf2"] Jun 05 03:52:02.668367 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:52:02.668335 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25deef27_5766_4b2d_823c_3428117d46e0.slice/crio-4ee44e47693ab78a17563bd5bdd4278721783ec27a3c6b2b5a19dcc87f4794e7 WatchSource:0}: Error finding container 4ee44e47693ab78a17563bd5bdd4278721783ec27a3c6b2b5a19dcc87f4794e7: Status 404 returned error can't find the container with id 4ee44e47693ab78a17563bd5bdd4278721783ec27a3c6b2b5a19dcc87f4794e7 Jun 05 03:52:02.682028 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:02.682005 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58676b76-5eee-4a81-919b-9c1a276ea004-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-pcq8d\" (UID: \"58676b76-5eee-4a81-919b-9c1a276ea004\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-pcq8d" Jun 05 03:52:02.682122 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:02.682036 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s6lg\" (UniqueName: \"kubernetes.io/projected/58676b76-5eee-4a81-919b-9c1a276ea004-kube-api-access-9s6lg\") pod \"cert-manager-cainjector-5d99449ffd-pcq8d\" (UID: \"58676b76-5eee-4a81-919b-9c1a276ea004\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-pcq8d" Jun 05 03:52:02.783340 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:02.783253 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58676b76-5eee-4a81-919b-9c1a276ea004-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-pcq8d\" (UID: \"58676b76-5eee-4a81-919b-9c1a276ea004\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-pcq8d" Jun 05 03:52:02.783340 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:02.783290 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s6lg\" (UniqueName: \"kubernetes.io/projected/58676b76-5eee-4a81-919b-9c1a276ea004-kube-api-access-9s6lg\") pod \"cert-manager-cainjector-5d99449ffd-pcq8d\" (UID: \"58676b76-5eee-4a81-919b-9c1a276ea004\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-pcq8d" Jun 05 03:52:02.790882 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:02.790850 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58676b76-5eee-4a81-919b-9c1a276ea004-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-pcq8d\" (UID: \"58676b76-5eee-4a81-919b-9c1a276ea004\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-pcq8d" Jun 05 03:52:02.791001 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:02.790957 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s6lg\" (UniqueName: \"kubernetes.io/projected/58676b76-5eee-4a81-919b-9c1a276ea004-kube-api-access-9s6lg\") pod \"cert-manager-cainjector-5d99449ffd-pcq8d\" (UID: \"58676b76-5eee-4a81-919b-9c1a276ea004\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-pcq8d" Jun 05 03:52:02.941091 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:02.941054 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-pcq8d" Jun 05 03:52:03.070785 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:03.070713 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-pcq8d"] Jun 05 03:52:03.072799 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:52:03.072771 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58676b76_5eee_4a81_919b_9c1a276ea004.slice/crio-e934625e0bf3383d52146d23bd84efbbf313e7913de9c6114f143c9fad67b9e6 WatchSource:0}: Error finding container e934625e0bf3383d52146d23bd84efbbf313e7913de9c6114f143c9fad67b9e6: Status 404 returned error can't find the container with id e934625e0bf3383d52146d23bd84efbbf313e7913de9c6114f143c9fad67b9e6 Jun 05 03:52:03.171732 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:03.171700 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-f5zf2" event={"ID":"25deef27-5766-4b2d-823c-3428117d46e0","Type":"ContainerStarted","Data":"4ee44e47693ab78a17563bd5bdd4278721783ec27a3c6b2b5a19dcc87f4794e7"} Jun 05 03:52:03.172848 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:03.172827 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-pcq8d" event={"ID":"58676b76-5eee-4a81-919b-9c1a276ea004","Type":"ContainerStarted","Data":"e934625e0bf3383d52146d23bd84efbbf313e7913de9c6114f143c9fad67b9e6"} Jun 05 03:52:06.190993 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:06.190957 2548 generic.go:356] "Generic (PLEG): container finished" podID="d4616ebd-f129-4c71-b466-0ee8349c8e5c" containerID="b2960bdb9ece560c95e2e46eed4ce687266453ec205f67d8c83444ee12cc8e02" exitCode=0 Jun 05 03:52:06.191384 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:06.191044 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m2nm" event={"ID":"d4616ebd-f129-4c71-b466-0ee8349c8e5c","Type":"ContainerDied","Data":"b2960bdb9ece560c95e2e46eed4ce687266453ec205f67d8c83444ee12cc8e02"} Jun 05 03:52:07.200816 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:07.200778 2548 generic.go:356] "Generic (PLEG): container finished" podID="d4616ebd-f129-4c71-b466-0ee8349c8e5c" containerID="a930179af02b7e2be48c60a6fc4026bd7c6657efb79b2011c2e63062eb9f2afb" exitCode=0 Jun 05 03:52:07.201256 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:07.200860 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m2nm" event={"ID":"d4616ebd-f129-4c71-b466-0ee8349c8e5c","Type":"ContainerDied","Data":"a930179af02b7e2be48c60a6fc4026bd7c6657efb79b2011c2e63062eb9f2afb"} Jun 05 03:52:08.206571 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:08.206534 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-f5zf2" event={"ID":"25deef27-5766-4b2d-823c-3428117d46e0","Type":"ContainerStarted","Data":"6b7519833d72325834324097ea4a45b5f033a85794e2eaa9d0a443eaa4c8431e"} Jun 05 03:52:08.207021 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:08.206586 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-f5zf2" Jun 05 03:52:08.208036 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:08.208014 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-pcq8d" event={"ID":"58676b76-5eee-4a81-919b-9c1a276ea004","Type":"ContainerStarted","Data":"7cc68fde02e96fd52ac25f0bac943cb8ee0db1379aec9ecce0e00af0290c578e"} Jun 05 03:52:08.223857 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:08.223802 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-f5zf2" podStartSLOduration=1.5067574719999999 podStartE2EDuration="6.223788705s" totalImagesPullingTime="4.717031233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:52:08.221949077 +0000 UTC m=+527.491725396" watchObservedRunningTime="2026-06-05 03:52:08.223788705 +0000 UTC m=+527.493565025" Jun 05 03:52:08.238693 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:08.238647 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-pcq8d" podStartSLOduration=1.9201977380000002 podStartE2EDuration="6.23862994s" totalImagesPullingTime="4.318432202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:52:08.237853623 +0000 UTC m=+527.507629939" watchObservedRunningTime="2026-06-05 03:52:08.23862994 +0000 UTC m=+527.508406257" Jun 05 03:52:08.348051 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:08.348023 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m2nm" Jun 05 03:52:08.439788 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:08.439754 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4616ebd-f129-4c71-b466-0ee8349c8e5c-util\") pod \"d4616ebd-f129-4c71-b466-0ee8349c8e5c\" (UID: \"d4616ebd-f129-4c71-b466-0ee8349c8e5c\") " Jun 05 03:52:08.439983 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:08.439843 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4616ebd-f129-4c71-b466-0ee8349c8e5c-bundle\") pod \"d4616ebd-f129-4c71-b466-0ee8349c8e5c\" (UID: \"d4616ebd-f129-4c71-b466-0ee8349c8e5c\") " Jun 05 03:52:08.439983 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:08.439864 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gqgr\" (UniqueName: \"kubernetes.io/projected/d4616ebd-f129-4c71-b466-0ee8349c8e5c-kube-api-access-6gqgr\") pod \"d4616ebd-f129-4c71-b466-0ee8349c8e5c\" (UID: \"d4616ebd-f129-4c71-b466-0ee8349c8e5c\") " Jun 05 03:52:08.440255 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:08.440231 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4616ebd-f129-4c71-b466-0ee8349c8e5c-bundle" (OuterVolumeSpecName: "bundle") pod "d4616ebd-f129-4c71-b466-0ee8349c8e5c" (UID: "d4616ebd-f129-4c71-b466-0ee8349c8e5c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:52:08.442091 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:08.442064 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4616ebd-f129-4c71-b466-0ee8349c8e5c-kube-api-access-6gqgr" (OuterVolumeSpecName: "kube-api-access-6gqgr") pod "d4616ebd-f129-4c71-b466-0ee8349c8e5c" (UID: "d4616ebd-f129-4c71-b466-0ee8349c8e5c"). InnerVolumeSpecName "kube-api-access-6gqgr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:52:08.444690 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:08.444651 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4616ebd-f129-4c71-b466-0ee8349c8e5c-util" (OuterVolumeSpecName: "util") pod "d4616ebd-f129-4c71-b466-0ee8349c8e5c" (UID: "d4616ebd-f129-4c71-b466-0ee8349c8e5c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:52:08.540396 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:08.540368 2548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4616ebd-f129-4c71-b466-0ee8349c8e5c-util\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:52:08.540396 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:08.540393 2548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4616ebd-f129-4c71-b466-0ee8349c8e5c-bundle\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:52:08.540586 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:08.540404 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gqgr\" (UniqueName: \"kubernetes.io/projected/d4616ebd-f129-4c71-b466-0ee8349c8e5c-kube-api-access-6gqgr\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:52:09.213906 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:09.213877 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m2nm" Jun 05 03:52:09.214296 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:09.213904 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m2nm" event={"ID":"d4616ebd-f129-4c71-b466-0ee8349c8e5c","Type":"ContainerDied","Data":"053c639496320bc6022e27fcd51d8c66b70ca0a4a14e4d5b5dc02c5d56898e5d"} Jun 05 03:52:09.214296 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:09.213987 2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="053c639496320bc6022e27fcd51d8c66b70ca0a4a14e4d5b5dc02c5d56898e5d" Jun 05 03:52:14.215851 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:14.215815 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-f5zf2" Jun 05 03:52:25.415062 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:25.415020 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc7bxm"] Jun 05 03:52:25.415569 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:25.415529 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4616ebd-f129-4c71-b466-0ee8349c8e5c" containerName="util" Jun 05 03:52:25.415569 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:25.415548 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4616ebd-f129-4c71-b466-0ee8349c8e5c" containerName="util" Jun 05 03:52:25.415569 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:25.415560 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4616ebd-f129-4c71-b466-0ee8349c8e5c" containerName="extract" Jun 05 03:52:25.415569 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:25.415568 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4616ebd-f129-4c71-b466-0ee8349c8e5c" containerName="extract" Jun 05 03:52:25.415773 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:25.415585 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4616ebd-f129-4c71-b466-0ee8349c8e5c" containerName="pull" Jun 05 03:52:25.415773 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:25.415593 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4616ebd-f129-4c71-b466-0ee8349c8e5c" containerName="pull" Jun 05 03:52:25.415773 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:25.415699 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4616ebd-f129-4c71-b466-0ee8349c8e5c" containerName="extract" Jun 05 03:52:25.418523 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:25.418503 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc7bxm" Jun 05 03:52:25.420956 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:25.420925 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 03:52:25.421056 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:25.420954 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hsscq\"" Jun 05 03:52:25.421056 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:25.420925 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 03:52:25.425681 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:25.425531 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc7bxm"] Jun 05 03:52:25.486694 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:25.486664 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/631f7130-d7a5-4921-910d-80e3b07d8d7a-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc7bxm\" (UID: \"631f7130-d7a5-4921-910d-80e3b07d8d7a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc7bxm" Jun 05 03:52:25.486871 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:25.486701 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/631f7130-d7a5-4921-910d-80e3b07d8d7a-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc7bxm\" (UID: \"631f7130-d7a5-4921-910d-80e3b07d8d7a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc7bxm" Jun 05 03:52:25.486871 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:25.486735 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf95v\" (UniqueName: \"kubernetes.io/projected/631f7130-d7a5-4921-910d-80e3b07d8d7a-kube-api-access-jf95v\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc7bxm\" (UID: \"631f7130-d7a5-4921-910d-80e3b07d8d7a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc7bxm" Jun 05 03:52:25.587696 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:25.587652 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/631f7130-d7a5-4921-910d-80e3b07d8d7a-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc7bxm\" (UID: \"631f7130-d7a5-4921-910d-80e3b07d8d7a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc7bxm" Jun 05 03:52:25.587696 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:25.587700 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/631f7130-d7a5-4921-910d-80e3b07d8d7a-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc7bxm\" (UID: \"631f7130-d7a5-4921-910d-80e3b07d8d7a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc7bxm" Jun 05 03:52:25.587899 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:25.587737 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf95v\" (UniqueName: \"kubernetes.io/projected/631f7130-d7a5-4921-910d-80e3b07d8d7a-kube-api-access-jf95v\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc7bxm\" (UID: \"631f7130-d7a5-4921-910d-80e3b07d8d7a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc7bxm" Jun 05 03:52:25.588054 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:25.588032 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/631f7130-d7a5-4921-910d-80e3b07d8d7a-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc7bxm\" (UID: \"631f7130-d7a5-4921-910d-80e3b07d8d7a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc7bxm" Jun 05 03:52:25.588093 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:25.588049 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/631f7130-d7a5-4921-910d-80e3b07d8d7a-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc7bxm\" (UID: \"631f7130-d7a5-4921-910d-80e3b07d8d7a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc7bxm" Jun 05 03:52:25.595951 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:25.595928 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf95v\" (UniqueName: \"kubernetes.io/projected/631f7130-d7a5-4921-910d-80e3b07d8d7a-kube-api-access-jf95v\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc7bxm\" (UID: \"631f7130-d7a5-4921-910d-80e3b07d8d7a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc7bxm" Jun 05 03:52:25.728934 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:25.728854 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc7bxm" Jun 05 03:52:25.859941 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:25.859915 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc7bxm"] Jun 05 03:52:25.861742 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:52:25.861718 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod631f7130_d7a5_4921_910d_80e3b07d8d7a.slice/crio-1efdf88367803d0af0e118016760cd797b834caab9d5eb122e190df4d8d7aec8 WatchSource:0}: Error finding container 1efdf88367803d0af0e118016760cd797b834caab9d5eb122e190df4d8d7aec8: Status 404 returned error can't find the container with id 1efdf88367803d0af0e118016760cd797b834caab9d5eb122e190df4d8d7aec8 Jun 05 03:52:26.289529 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:26.289485 2548 generic.go:356] "Generic (PLEG): container finished" podID="631f7130-d7a5-4921-910d-80e3b07d8d7a" containerID="b0ee121ebf702a4ffa4810c4e84e4d78a76413d4ef4e56d55356a4728b5326fb" exitCode=0 Jun 05 03:52:26.289703 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:26.289573 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc7bxm" event={"ID":"631f7130-d7a5-4921-910d-80e3b07d8d7a","Type":"ContainerDied","Data":"b0ee121ebf702a4ffa4810c4e84e4d78a76413d4ef4e56d55356a4728b5326fb"} Jun 05 03:52:26.289703 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:26.289639 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc7bxm" event={"ID":"631f7130-d7a5-4921-910d-80e3b07d8d7a","Type":"ContainerStarted","Data":"1efdf88367803d0af0e118016760cd797b834caab9d5eb122e190df4d8d7aec8"} Jun 05 03:52:27.296661 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:27.296631 2548 generic.go:356] "Generic (PLEG): container finished" podID="631f7130-d7a5-4921-910d-80e3b07d8d7a" containerID="a93a4096dd9d2b337787bf5760ea36819588fc4ac0b5e55caa73700a85b69bf2" exitCode=0 Jun 05 03:52:27.297059 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:27.296672 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc7bxm" event={"ID":"631f7130-d7a5-4921-910d-80e3b07d8d7a","Type":"ContainerDied","Data":"a93a4096dd9d2b337787bf5760ea36819588fc4ac0b5e55caa73700a85b69bf2"} Jun 05 03:52:28.302818 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:28.302784 2548 generic.go:356] "Generic (PLEG): container finished" podID="631f7130-d7a5-4921-910d-80e3b07d8d7a" containerID="97820b5bd37db1236f1b44cfc49d17b1a22b51df17db99b43308633990d44d10" exitCode=0 Jun 05 03:52:28.303214 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:28.302866 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc7bxm" event={"ID":"631f7130-d7a5-4921-910d-80e3b07d8d7a","Type":"ContainerDied","Data":"97820b5bd37db1236f1b44cfc49d17b1a22b51df17db99b43308633990d44d10"} Jun 05 03:52:29.121137 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:29.121103 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-9ff7b8d94-7fnv6"] Jun 05 03:52:29.124707 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:29.124686 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9ff7b8d94-7fnv6" Jun 05 03:52:29.127523 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:29.127502 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 05 03:52:29.128825 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:29.128807 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-dcvcd\"" Jun 05 03:52:29.128920 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:29.128855 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 05 03:52:29.128920 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:29.128855 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 05 03:52:29.129052 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:29.128807 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 05 03:52:29.129052 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:29.128970 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 05 03:52:29.135950 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:29.135926 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9ff7b8d94-7fnv6"] Jun 05 03:52:29.220751 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:29.220712 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/36317d1a-88da-479c-826a-87b9b503a11f-manager-config\") pod \"lws-controller-manager-9ff7b8d94-7fnv6\" (UID: \"36317d1a-88da-479c-826a-87b9b503a11f\") " pod="openshift-lws-operator/lws-controller-manager-9ff7b8d94-7fnv6" Jun 05 03:52:29.220751 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:29.220750 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w56s\" (UniqueName: \"kubernetes.io/projected/36317d1a-88da-479c-826a-87b9b503a11f-kube-api-access-4w56s\") pod \"lws-controller-manager-9ff7b8d94-7fnv6\" (UID: \"36317d1a-88da-479c-826a-87b9b503a11f\") " pod="openshift-lws-operator/lws-controller-manager-9ff7b8d94-7fnv6" Jun 05 03:52:29.220949 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:29.220841 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/36317d1a-88da-479c-826a-87b9b503a11f-metrics-cert\") pod \"lws-controller-manager-9ff7b8d94-7fnv6\" (UID: \"36317d1a-88da-479c-826a-87b9b503a11f\") " pod="openshift-lws-operator/lws-controller-manager-9ff7b8d94-7fnv6" Jun 05 03:52:29.220949 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:29.220869 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36317d1a-88da-479c-826a-87b9b503a11f-cert\") pod \"lws-controller-manager-9ff7b8d94-7fnv6\" (UID: \"36317d1a-88da-479c-826a-87b9b503a11f\") " pod="openshift-lws-operator/lws-controller-manager-9ff7b8d94-7fnv6" Jun 05 03:52:29.322373 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:29.322335 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/36317d1a-88da-479c-826a-87b9b503a11f-metrics-cert\") pod \"lws-controller-manager-9ff7b8d94-7fnv6\" (UID: \"36317d1a-88da-479c-826a-87b9b503a11f\") " pod="openshift-lws-operator/lws-controller-manager-9ff7b8d94-7fnv6" Jun 05 03:52:29.322733 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:29.322385 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36317d1a-88da-479c-826a-87b9b503a11f-cert\") pod \"lws-controller-manager-9ff7b8d94-7fnv6\" (UID: \"36317d1a-88da-479c-826a-87b9b503a11f\") " pod="openshift-lws-operator/lws-controller-manager-9ff7b8d94-7fnv6" Jun 05 03:52:29.322733 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:29.322492 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/36317d1a-88da-479c-826a-87b9b503a11f-manager-config\") pod \"lws-controller-manager-9ff7b8d94-7fnv6\" (UID: \"36317d1a-88da-479c-826a-87b9b503a11f\") " pod="openshift-lws-operator/lws-controller-manager-9ff7b8d94-7fnv6" Jun 05 03:52:29.322733 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:29.322519 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w56s\" (UniqueName: \"kubernetes.io/projected/36317d1a-88da-479c-826a-87b9b503a11f-kube-api-access-4w56s\") pod \"lws-controller-manager-9ff7b8d94-7fnv6\" (UID: \"36317d1a-88da-479c-826a-87b9b503a11f\") " pod="openshift-lws-operator/lws-controller-manager-9ff7b8d94-7fnv6" Jun 05 03:52:29.323248 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:29.323171 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/36317d1a-88da-479c-826a-87b9b503a11f-manager-config\") pod \"lws-controller-manager-9ff7b8d94-7fnv6\" (UID: \"36317d1a-88da-479c-826a-87b9b503a11f\") " pod="openshift-lws-operator/lws-controller-manager-9ff7b8d94-7fnv6" Jun 05 03:52:29.324993 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:29.324972 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/36317d1a-88da-479c-826a-87b9b503a11f-metrics-cert\") pod \"lws-controller-manager-9ff7b8d94-7fnv6\" (UID: \"36317d1a-88da-479c-826a-87b9b503a11f\") " pod="openshift-lws-operator/lws-controller-manager-9ff7b8d94-7fnv6" Jun 05 03:52:29.325162 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:29.325140 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36317d1a-88da-479c-826a-87b9b503a11f-cert\") pod \"lws-controller-manager-9ff7b8d94-7fnv6\" (UID: \"36317d1a-88da-479c-826a-87b9b503a11f\") " pod="openshift-lws-operator/lws-controller-manager-9ff7b8d94-7fnv6" Jun 05 03:52:29.354840 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:29.354803 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w56s\" (UniqueName: \"kubernetes.io/projected/36317d1a-88da-479c-826a-87b9b503a11f-kube-api-access-4w56s\") pod \"lws-controller-manager-9ff7b8d94-7fnv6\" (UID: \"36317d1a-88da-479c-826a-87b9b503a11f\") " pod="openshift-lws-operator/lws-controller-manager-9ff7b8d94-7fnv6" Jun 05 03:52:29.433889 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:29.433797 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9ff7b8d94-7fnv6" Jun 05 03:52:29.442719 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:29.442698 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc7bxm" Jun 05 03:52:29.524451 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:29.524409 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/631f7130-d7a5-4921-910d-80e3b07d8d7a-bundle\") pod \"631f7130-d7a5-4921-910d-80e3b07d8d7a\" (UID: \"631f7130-d7a5-4921-910d-80e3b07d8d7a\") " Jun 05 03:52:29.524619 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:29.524513 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jf95v\" (UniqueName: \"kubernetes.io/projected/631f7130-d7a5-4921-910d-80e3b07d8d7a-kube-api-access-jf95v\") pod \"631f7130-d7a5-4921-910d-80e3b07d8d7a\" (UID: \"631f7130-d7a5-4921-910d-80e3b07d8d7a\") " Jun 05 03:52:29.524619 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:29.524531 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/631f7130-d7a5-4921-910d-80e3b07d8d7a-util\") pod \"631f7130-d7a5-4921-910d-80e3b07d8d7a\" (UID: \"631f7130-d7a5-4921-910d-80e3b07d8d7a\") " Jun 05 03:52:29.525362 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:29.525278 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/631f7130-d7a5-4921-910d-80e3b07d8d7a-bundle" (OuterVolumeSpecName: "bundle") pod "631f7130-d7a5-4921-910d-80e3b07d8d7a" (UID: "631f7130-d7a5-4921-910d-80e3b07d8d7a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:52:29.527563 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:29.527523 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/631f7130-d7a5-4921-910d-80e3b07d8d7a-kube-api-access-jf95v" (OuterVolumeSpecName: "kube-api-access-jf95v") pod "631f7130-d7a5-4921-910d-80e3b07d8d7a" (UID: "631f7130-d7a5-4921-910d-80e3b07d8d7a"). InnerVolumeSpecName "kube-api-access-jf95v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:52:29.531267 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:29.531238 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/631f7130-d7a5-4921-910d-80e3b07d8d7a-util" (OuterVolumeSpecName: "util") pod "631f7130-d7a5-4921-910d-80e3b07d8d7a" (UID: "631f7130-d7a5-4921-910d-80e3b07d8d7a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:52:29.576525 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:29.576500 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9ff7b8d94-7fnv6"] Jun 05 03:52:29.578268 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:52:29.578240 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36317d1a_88da_479c_826a_87b9b503a11f.slice/crio-82c3b75bf5eb8f8f219ff569c31166179f2bd3a53ed179a5417f641f61673bbc WatchSource:0}: Error finding container 82c3b75bf5eb8f8f219ff569c31166179f2bd3a53ed179a5417f641f61673bbc: Status 404 returned error can't find the container with id 82c3b75bf5eb8f8f219ff569c31166179f2bd3a53ed179a5417f641f61673bbc Jun 05 03:52:29.625322 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:29.625288 2548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/631f7130-d7a5-4921-910d-80e3b07d8d7a-bundle\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:52:29.625322 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:29.625317 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jf95v\" (UniqueName: \"kubernetes.io/projected/631f7130-d7a5-4921-910d-80e3b07d8d7a-kube-api-access-jf95v\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:52:29.625322 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:29.625330 2548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/631f7130-d7a5-4921-910d-80e3b07d8d7a-util\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:52:30.314502 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:30.314458 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9ff7b8d94-7fnv6" event={"ID":"36317d1a-88da-479c-826a-87b9b503a11f","Type":"ContainerStarted","Data":"82c3b75bf5eb8f8f219ff569c31166179f2bd3a53ed179a5417f641f61673bbc"} Jun 05 03:52:30.316370 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:30.316339 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc7bxm" event={"ID":"631f7130-d7a5-4921-910d-80e3b07d8d7a","Type":"ContainerDied","Data":"1efdf88367803d0af0e118016760cd797b834caab9d5eb122e190df4d8d7aec8"} Jun 05 03:52:30.316532 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:30.316381 2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1efdf88367803d0af0e118016760cd797b834caab9d5eb122e190df4d8d7aec8" Jun 05 03:52:30.316532 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:30.316389 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdc7bxm" Jun 05 03:52:32.328596 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:32.328552 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9ff7b8d94-7fnv6" event={"ID":"36317d1a-88da-479c-826a-87b9b503a11f","Type":"ContainerStarted","Data":"7672b3a4fead2230169dba62b521c2d4f8e23a37a65bf3424317009f26610f86"} Jun 05 03:52:32.328989 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:32.328637 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-9ff7b8d94-7fnv6" Jun 05 03:52:32.344565 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:32.344510 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-9ff7b8d94-7fnv6" podStartSLOduration=1.45138459 podStartE2EDuration="3.344491512s" totalImagesPullingTime="1.893106922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:52:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:52:32.343024131 +0000 UTC m=+551.612800460" watchObservedRunningTime="2026-06-05 03:52:32.344491512 +0000 UTC m=+551.614267831" Jun 05 03:52:37.552521 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:37.552474 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-589666b55-4nrml"] Jun 05 03:52:37.553016 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:37.553001 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="631f7130-d7a5-4921-910d-80e3b07d8d7a" containerName="extract" Jun 05 03:52:37.553077 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:37.553019 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="631f7130-d7a5-4921-910d-80e3b07d8d7a" containerName="extract" Jun 05 03:52:37.553077 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:37.553046 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="631f7130-d7a5-4921-910d-80e3b07d8d7a" containerName="util" Jun 05 03:52:37.553077 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:37.553054 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="631f7130-d7a5-4921-910d-80e3b07d8d7a" containerName="util" Jun 05 03:52:37.553077 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:37.553066 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="631f7130-d7a5-4921-910d-80e3b07d8d7a" containerName="pull" Jun 05 03:52:37.553077 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:37.553074 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="631f7130-d7a5-4921-910d-80e3b07d8d7a" containerName="pull" Jun 05 03:52:37.553249 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:37.553154 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="631f7130-d7a5-4921-910d-80e3b07d8d7a" containerName="extract" Jun 05 03:52:37.560892 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:37.560867 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-589666b55-4nrml" Jun 05 03:52:37.563570 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:37.563543 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 05 03:52:37.563704 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:37.563616 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 05 03:52:37.563704 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:37.563674 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wsw82\"" Jun 05 03:52:37.563704 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:37.563677 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 05 03:52:37.564031 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:37.564019 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 05 03:52:37.571606 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:37.571581 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-589666b55-4nrml"] Jun 05 03:52:37.701837 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:37.701799 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8172e642-2dd1-4ca6-b6db-aec42c867b50-tmp\") pod \"opendatahub-operator-controller-manager-589666b55-4nrml\" (UID: \"8172e642-2dd1-4ca6-b6db-aec42c867b50\") " pod="opendatahub/opendatahub-operator-controller-manager-589666b55-4nrml" Jun 05 03:52:37.702182 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:37.701909 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8172e642-2dd1-4ca6-b6db-aec42c867b50-apiservice-cert\") pod \"opendatahub-operator-controller-manager-589666b55-4nrml\" (UID: \"8172e642-2dd1-4ca6-b6db-aec42c867b50\") " pod="opendatahub/opendatahub-operator-controller-manager-589666b55-4nrml" Jun 05 03:52:37.702182 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:37.701940 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8172e642-2dd1-4ca6-b6db-aec42c867b50-webhook-cert\") pod \"opendatahub-operator-controller-manager-589666b55-4nrml\" (UID: \"8172e642-2dd1-4ca6-b6db-aec42c867b50\") " pod="opendatahub/opendatahub-operator-controller-manager-589666b55-4nrml" Jun 05 03:52:37.702182 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:37.702032 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8172e642-2dd1-4ca6-b6db-aec42c867b50-manifests\") pod \"opendatahub-operator-controller-manager-589666b55-4nrml\" (UID: \"8172e642-2dd1-4ca6-b6db-aec42c867b50\") " pod="opendatahub/opendatahub-operator-controller-manager-589666b55-4nrml" Jun 05 03:52:37.702182 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:37.702143 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w47fv\" (UniqueName: \"kubernetes.io/projected/8172e642-2dd1-4ca6-b6db-aec42c867b50-kube-api-access-w47fv\") pod \"opendatahub-operator-controller-manager-589666b55-4nrml\" (UID: \"8172e642-2dd1-4ca6-b6db-aec42c867b50\") " pod="opendatahub/opendatahub-operator-controller-manager-589666b55-4nrml" Jun 05 03:52:37.803705 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:37.803609 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8172e642-2dd1-4ca6-b6db-aec42c867b50-tmp\") pod \"opendatahub-operator-controller-manager-589666b55-4nrml\" (UID: \"8172e642-2dd1-4ca6-b6db-aec42c867b50\") " pod="opendatahub/opendatahub-operator-controller-manager-589666b55-4nrml" Jun 05 03:52:37.803705 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:37.803652 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8172e642-2dd1-4ca6-b6db-aec42c867b50-apiservice-cert\") pod \"opendatahub-operator-controller-manager-589666b55-4nrml\" (UID: \"8172e642-2dd1-4ca6-b6db-aec42c867b50\") " pod="opendatahub/opendatahub-operator-controller-manager-589666b55-4nrml" Jun 05 03:52:37.803705 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:37.803671 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8172e642-2dd1-4ca6-b6db-aec42c867b50-webhook-cert\") pod \"opendatahub-operator-controller-manager-589666b55-4nrml\" (UID: \"8172e642-2dd1-4ca6-b6db-aec42c867b50\") " pod="opendatahub/opendatahub-operator-controller-manager-589666b55-4nrml" Jun 05 03:52:37.803968 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:37.803801 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8172e642-2dd1-4ca6-b6db-aec42c867b50-manifests\") pod \"opendatahub-operator-controller-manager-589666b55-4nrml\" (UID: \"8172e642-2dd1-4ca6-b6db-aec42c867b50\") " pod="opendatahub/opendatahub-operator-controller-manager-589666b55-4nrml" Jun 05 03:52:37.803968 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:37.803846 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w47fv\" (UniqueName: \"kubernetes.io/projected/8172e642-2dd1-4ca6-b6db-aec42c867b50-kube-api-access-w47fv\") pod \"opendatahub-operator-controller-manager-589666b55-4nrml\" (UID: \"8172e642-2dd1-4ca6-b6db-aec42c867b50\") " pod="opendatahub/opendatahub-operator-controller-manager-589666b55-4nrml" Jun 05 03:52:37.804233 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:37.804213 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8172e642-2dd1-4ca6-b6db-aec42c867b50-manifests\") pod \"opendatahub-operator-controller-manager-589666b55-4nrml\" (UID: \"8172e642-2dd1-4ca6-b6db-aec42c867b50\") " pod="opendatahub/opendatahub-operator-controller-manager-589666b55-4nrml" Jun 05 03:52:37.806153 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:37.806123 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8172e642-2dd1-4ca6-b6db-aec42c867b50-tmp\") pod \"opendatahub-operator-controller-manager-589666b55-4nrml\" (UID: \"8172e642-2dd1-4ca6-b6db-aec42c867b50\") " pod="opendatahub/opendatahub-operator-controller-manager-589666b55-4nrml" Jun 05 03:52:37.806370 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:37.806350 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8172e642-2dd1-4ca6-b6db-aec42c867b50-webhook-cert\") pod \"opendatahub-operator-controller-manager-589666b55-4nrml\" (UID: \"8172e642-2dd1-4ca6-b6db-aec42c867b50\") " pod="opendatahub/opendatahub-operator-controller-manager-589666b55-4nrml" Jun 05 03:52:37.806444 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:37.806355 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8172e642-2dd1-4ca6-b6db-aec42c867b50-apiservice-cert\") pod \"opendatahub-operator-controller-manager-589666b55-4nrml\" (UID: \"8172e642-2dd1-4ca6-b6db-aec42c867b50\") " pod="opendatahub/opendatahub-operator-controller-manager-589666b55-4nrml" Jun 05 03:52:37.818155 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:37.818129 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w47fv\" (UniqueName: \"kubernetes.io/projected/8172e642-2dd1-4ca6-b6db-aec42c867b50-kube-api-access-w47fv\") pod \"opendatahub-operator-controller-manager-589666b55-4nrml\" (UID: \"8172e642-2dd1-4ca6-b6db-aec42c867b50\") " pod="opendatahub/opendatahub-operator-controller-manager-589666b55-4nrml" Jun 05 03:52:37.872488 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:37.872446 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-589666b55-4nrml" Jun 05 03:52:38.018181 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:38.018156 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-589666b55-4nrml"] Jun 05 03:52:38.020824 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:52:38.020146 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8172e642_2dd1_4ca6_b6db_aec42c867b50.slice/crio-14722d1a2faa551bb2dc68753b1e04b6e704dbd50d571dce3748457279e60829 WatchSource:0}: Error finding container 14722d1a2faa551bb2dc68753b1e04b6e704dbd50d571dce3748457279e60829: Status 404 returned error can't find the container with id 14722d1a2faa551bb2dc68753b1e04b6e704dbd50d571dce3748457279e60829 Jun 05 03:52:38.359385 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:38.359348 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-589666b55-4nrml" event={"ID":"8172e642-2dd1-4ca6-b6db-aec42c867b50","Type":"ContainerStarted","Data":"14722d1a2faa551bb2dc68753b1e04b6e704dbd50d571dce3748457279e60829"} Jun 05 03:52:41.376902 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:41.376860 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-589666b55-4nrml" event={"ID":"8172e642-2dd1-4ca6-b6db-aec42c867b50","Type":"ContainerStarted","Data":"5012e72ec3920e9459c7d34f02d5186dfb6fc03cd0bdcf8a9cb33c3629ba8ba1"} Jun 05 03:52:42.383703 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:42.383663 2548 generic.go:356] "Generic (PLEG): container finished" podID="8172e642-2dd1-4ca6-b6db-aec42c867b50" containerID="5012e72ec3920e9459c7d34f02d5186dfb6fc03cd0bdcf8a9cb33c3629ba8ba1" exitCode=0 Jun 05 03:52:42.384087 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:42.383753 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-589666b55-4nrml" event={"ID":"8172e642-2dd1-4ca6-b6db-aec42c867b50","Type":"ContainerDied","Data":"5012e72ec3920e9459c7d34f02d5186dfb6fc03cd0bdcf8a9cb33c3629ba8ba1"} Jun 05 03:52:43.337279 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:43.337250 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-9ff7b8d94-7fnv6" Jun 05 03:52:43.391733 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:43.391703 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-589666b55-4nrml" event={"ID":"8172e642-2dd1-4ca6-b6db-aec42c867b50","Type":"ContainerStarted","Data":"4ab8e114876b43f255680b1dd533885a18d433161e9db854b9a3ab37006cc165"} Jun 05 03:52:43.392176 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:43.391824 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-589666b55-4nrml" Jun 05 03:52:43.411970 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:43.411921 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-589666b55-4nrml" podStartSLOduration=2.329615141 podStartE2EDuration="6.411904793s" totalImagesPullingTime="3.085235777s" totalInitContainerRuntime="997.053875ms" isStatefulPod=false podCreationTimestamp="2026-06-05 03:52:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:52:43.410058994 +0000 UTC m=+562.679835313" watchObservedRunningTime="2026-06-05 03:52:43.411904793 +0000 UTC m=+562.681681110" Jun 05 03:52:54.399260 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:54.399231 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-589666b55-4nrml" Jun 05 03:52:58.372879 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:58.372844 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0655bsv"] Jun 05 03:52:58.381479 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:58.381453 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0655bsv" Jun 05 03:52:58.383593 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:58.383570 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0655bsv"] Jun 05 03:52:58.383723 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:58.383665 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 03:52:58.384873 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:58.384852 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hsscq\"" Jun 05 03:52:58.384971 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:58.384933 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 03:52:58.462514 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:58.462485 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed15dae3-0aa8-4043-8e12-ca755e662363-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0655bsv\" (UID: \"ed15dae3-0aa8-4043-8e12-ca755e662363\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0655bsv" Jun 05 03:52:58.462514 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:58.462517 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed15dae3-0aa8-4043-8e12-ca755e662363-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0655bsv\" (UID: \"ed15dae3-0aa8-4043-8e12-ca755e662363\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0655bsv" Jun 05 03:52:58.462730 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:58.462549 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sqbq\" (UniqueName: \"kubernetes.io/projected/ed15dae3-0aa8-4043-8e12-ca755e662363-kube-api-access-7sqbq\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0655bsv\" (UID: \"ed15dae3-0aa8-4043-8e12-ca755e662363\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0655bsv" Jun 05 03:52:58.563886 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:58.563847 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed15dae3-0aa8-4043-8e12-ca755e662363-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0655bsv\" (UID: \"ed15dae3-0aa8-4043-8e12-ca755e662363\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0655bsv" Jun 05 03:52:58.563886 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:58.563885 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed15dae3-0aa8-4043-8e12-ca755e662363-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0655bsv\" (UID: \"ed15dae3-0aa8-4043-8e12-ca755e662363\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0655bsv" Jun 05 03:52:58.564093 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:58.564033 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sqbq\" (UniqueName: \"kubernetes.io/projected/ed15dae3-0aa8-4043-8e12-ca755e662363-kube-api-access-7sqbq\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0655bsv\" (UID: \"ed15dae3-0aa8-4043-8e12-ca755e662363\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0655bsv" Jun 05 03:52:58.564289 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:58.564270 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed15dae3-0aa8-4043-8e12-ca755e662363-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0655bsv\" (UID: \"ed15dae3-0aa8-4043-8e12-ca755e662363\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0655bsv" Jun 05 03:52:58.564328 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:58.564285 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed15dae3-0aa8-4043-8e12-ca755e662363-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0655bsv\" (UID: \"ed15dae3-0aa8-4043-8e12-ca755e662363\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0655bsv" Jun 05 03:52:58.572210 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:58.572177 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sqbq\" (UniqueName: \"kubernetes.io/projected/ed15dae3-0aa8-4043-8e12-ca755e662363-kube-api-access-7sqbq\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0655bsv\" (UID: \"ed15dae3-0aa8-4043-8e12-ca755e662363\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0655bsv" Jun 05 03:52:58.691666 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:58.691581 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0655bsv" Jun 05 03:52:58.877336 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:58.877309 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0655bsv"] Jun 05 03:52:58.880059 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:52:58.880031 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded15dae3_0aa8_4043_8e12_ca755e662363.slice/crio-999eeae7889df30f5634b4391b29a690ee29e55a1a44835b5f9bf3c6f20319cd WatchSource:0}: Error finding container 999eeae7889df30f5634b4391b29a690ee29e55a1a44835b5f9bf3c6f20319cd: Status 404 returned error can't find the container with id 999eeae7889df30f5634b4391b29a690ee29e55a1a44835b5f9bf3c6f20319cd Jun 05 03:52:59.471689 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:59.471652 2548 generic.go:356] "Generic (PLEG): container finished" podID="ed15dae3-0aa8-4043-8e12-ca755e662363" containerID="615b1f32f3be35e6e89328554fa9a04bc1b0292677aea15731b056f1e72490ec" exitCode=0 Jun 05 03:52:59.472044 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:59.471692 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0655bsv" event={"ID":"ed15dae3-0aa8-4043-8e12-ca755e662363","Type":"ContainerDied","Data":"615b1f32f3be35e6e89328554fa9a04bc1b0292677aea15731b056f1e72490ec"} Jun 05 03:52:59.472044 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:52:59.471743 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0655bsv" event={"ID":"ed15dae3-0aa8-4043-8e12-ca755e662363","Type":"ContainerStarted","Data":"999eeae7889df30f5634b4391b29a690ee29e55a1a44835b5f9bf3c6f20319cd"} Jun 05 03:53:00.479366 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:00.479278 2548 generic.go:356] "Generic (PLEG): container finished" podID="ed15dae3-0aa8-4043-8e12-ca755e662363" containerID="5ce0dbacc9feea62c202e1d673443208d4439b19ae22f107523080df2cfe290a" exitCode=0 Jun 05 03:53:00.479366 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:00.479357 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0655bsv" event={"ID":"ed15dae3-0aa8-4043-8e12-ca755e662363","Type":"ContainerDied","Data":"5ce0dbacc9feea62c202e1d673443208d4439b19ae22f107523080df2cfe290a"} Jun 05 03:53:01.486320 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:01.486286 2548 generic.go:356] "Generic (PLEG): container finished" podID="ed15dae3-0aa8-4043-8e12-ca755e662363" containerID="bb5c48ee6f58d66ff7f1ccc6b70e961155bda38773e1ed50895a709ff9d08fcd" exitCode=0 Jun 05 03:53:01.486732 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:01.486331 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0655bsv" event={"ID":"ed15dae3-0aa8-4043-8e12-ca755e662363","Type":"ContainerDied","Data":"bb5c48ee6f58d66ff7f1ccc6b70e961155bda38773e1ed50895a709ff9d08fcd"} Jun 05 03:53:02.619570 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:02.619545 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0655bsv" Jun 05 03:53:02.707096 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:02.707062 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed15dae3-0aa8-4043-8e12-ca755e662363-util\") pod \"ed15dae3-0aa8-4043-8e12-ca755e662363\" (UID: \"ed15dae3-0aa8-4043-8e12-ca755e662363\") " Jun 05 03:53:02.707311 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:02.707165 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed15dae3-0aa8-4043-8e12-ca755e662363-bundle\") pod \"ed15dae3-0aa8-4043-8e12-ca755e662363\" (UID: \"ed15dae3-0aa8-4043-8e12-ca755e662363\") " Jun 05 03:53:02.707311 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:02.707194 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7sqbq\" (UniqueName: \"kubernetes.io/projected/ed15dae3-0aa8-4043-8e12-ca755e662363-kube-api-access-7sqbq\") pod \"ed15dae3-0aa8-4043-8e12-ca755e662363\" (UID: \"ed15dae3-0aa8-4043-8e12-ca755e662363\") " Jun 05 03:53:02.708039 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:02.707954 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed15dae3-0aa8-4043-8e12-ca755e662363-bundle" (OuterVolumeSpecName: "bundle") pod "ed15dae3-0aa8-4043-8e12-ca755e662363" (UID: "ed15dae3-0aa8-4043-8e12-ca755e662363"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:53:02.709473 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:02.709445 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed15dae3-0aa8-4043-8e12-ca755e662363-kube-api-access-7sqbq" (OuterVolumeSpecName: "kube-api-access-7sqbq") pod "ed15dae3-0aa8-4043-8e12-ca755e662363" (UID: "ed15dae3-0aa8-4043-8e12-ca755e662363"). InnerVolumeSpecName "kube-api-access-7sqbq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:53:02.712672 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:02.712652 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed15dae3-0aa8-4043-8e12-ca755e662363-util" (OuterVolumeSpecName: "util") pod "ed15dae3-0aa8-4043-8e12-ca755e662363" (UID: "ed15dae3-0aa8-4043-8e12-ca755e662363"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:53:02.808771 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:02.808729 2548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed15dae3-0aa8-4043-8e12-ca755e662363-util\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:53:02.808771 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:02.808761 2548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed15dae3-0aa8-4043-8e12-ca755e662363-bundle\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:53:02.808771 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:02.808770 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7sqbq\" (UniqueName: \"kubernetes.io/projected/ed15dae3-0aa8-4043-8e12-ca755e662363-kube-api-access-7sqbq\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:53:03.498384 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:03.498286 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0655bsv" Jun 05 03:53:03.498384 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:03.498268 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0655bsv" event={"ID":"ed15dae3-0aa8-4043-8e12-ca755e662363","Type":"ContainerDied","Data":"999eeae7889df30f5634b4391b29a690ee29e55a1a44835b5f9bf3c6f20319cd"} Jun 05 03:53:03.498620 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:03.498423 2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="999eeae7889df30f5634b4391b29a690ee29e55a1a44835b5f9bf3c6f20319cd" Jun 05 03:53:13.100284 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:13.100249 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armxp8"] Jun 05 03:53:13.100724 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:13.100708 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed15dae3-0aa8-4043-8e12-ca755e662363" containerName="pull" Jun 05 03:53:13.100781 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:13.100726 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed15dae3-0aa8-4043-8e12-ca755e662363" containerName="pull" Jun 05 03:53:13.100781 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:13.100738 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed15dae3-0aa8-4043-8e12-ca755e662363" containerName="extract" Jun 05 03:53:13.100781 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:13.100743 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed15dae3-0aa8-4043-8e12-ca755e662363" containerName="extract" Jun 05 03:53:13.100781 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:13.100759 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed15dae3-0aa8-4043-8e12-ca755e662363" containerName="util" Jun 05 03:53:13.100781 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:13.100769 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed15dae3-0aa8-4043-8e12-ca755e662363" containerName="util" Jun 05 03:53:13.100923 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:13.100835 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed15dae3-0aa8-4043-8e12-ca755e662363" containerName="extract" Jun 05 03:53:13.109800 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:13.109775 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armxp8" Jun 05 03:53:13.112483 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:13.112419 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 03:53:13.113476 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:13.113451 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 03:53:13.113691 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:13.113458 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hsscq\"" Jun 05 03:53:13.113784 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:13.113562 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armxp8"] Jun 05 03:53:13.206999 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:13.206961 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77bc9fbf-85f6-4a41-99e5-f7b31c9aa731-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armxp8\" (UID: \"77bc9fbf-85f6-4a41-99e5-f7b31c9aa731\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armxp8" Jun 05 03:53:13.207182 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:13.207035 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zk8b\" (UniqueName: \"kubernetes.io/projected/77bc9fbf-85f6-4a41-99e5-f7b31c9aa731-kube-api-access-5zk8b\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armxp8\" (UID: \"77bc9fbf-85f6-4a41-99e5-f7b31c9aa731\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armxp8" Jun 05 03:53:13.207182 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:13.207066 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77bc9fbf-85f6-4a41-99e5-f7b31c9aa731-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armxp8\" (UID: \"77bc9fbf-85f6-4a41-99e5-f7b31c9aa731\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armxp8" Jun 05 03:53:13.308294 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:13.308245 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zk8b\" (UniqueName: \"kubernetes.io/projected/77bc9fbf-85f6-4a41-99e5-f7b31c9aa731-kube-api-access-5zk8b\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armxp8\" (UID: \"77bc9fbf-85f6-4a41-99e5-f7b31c9aa731\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armxp8" Jun 05 03:53:13.308566 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:13.308413 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77bc9fbf-85f6-4a41-99e5-f7b31c9aa731-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armxp8\" (UID: \"77bc9fbf-85f6-4a41-99e5-f7b31c9aa731\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armxp8" Jun 05 03:53:13.308664 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:13.308621 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77bc9fbf-85f6-4a41-99e5-f7b31c9aa731-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armxp8\" (UID: \"77bc9fbf-85f6-4a41-99e5-f7b31c9aa731\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armxp8" Jun 05 03:53:13.308932 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:13.308911 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77bc9fbf-85f6-4a41-99e5-f7b31c9aa731-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armxp8\" (UID: \"77bc9fbf-85f6-4a41-99e5-f7b31c9aa731\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armxp8" Jun 05 03:53:13.309146 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:13.308916 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77bc9fbf-85f6-4a41-99e5-f7b31c9aa731-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armxp8\" (UID: \"77bc9fbf-85f6-4a41-99e5-f7b31c9aa731\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armxp8" Jun 05 03:53:13.317405 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:13.317379 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zk8b\" (UniqueName: \"kubernetes.io/projected/77bc9fbf-85f6-4a41-99e5-f7b31c9aa731-kube-api-access-5zk8b\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armxp8\" (UID: \"77bc9fbf-85f6-4a41-99e5-f7b31c9aa731\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armxp8" Jun 05 03:53:13.420635 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:13.420551 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armxp8" Jun 05 03:53:13.585597 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:13.585567 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armxp8"] Jun 05 03:53:13.587288 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:53:13.587264 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77bc9fbf_85f6_4a41_99e5_f7b31c9aa731.slice/crio-efdd4b8355e1030032fa0a60551bc25e13f259d9ae999e218936bef248a3711b WatchSource:0}: Error finding container efdd4b8355e1030032fa0a60551bc25e13f259d9ae999e218936bef248a3711b: Status 404 returned error can't find the container with id efdd4b8355e1030032fa0a60551bc25e13f259d9ae999e218936bef248a3711b Jun 05 03:53:13.684496 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:13.684462 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-ccfd96f5-c2fzx"] Jun 05 03:53:13.707248 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:13.705174 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-ccfd96f5-c2fzx" Jun 05 03:53:13.711455 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:13.711014 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 05 03:53:13.711455 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:13.711141 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-ccfd96f5-c2fzx"] Jun 05 03:53:13.711455 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:13.711302 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-stws6\"" Jun 05 03:53:13.812578 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:13.812545 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d9df0f2c-b166-4b43-a272-21a48aeab89a-redirect-config\") pod \"dashboard-redirect-ccfd96f5-c2fzx\" (UID: \"d9df0f2c-b166-4b43-a272-21a48aeab89a\") " pod="opendatahub/dashboard-redirect-ccfd96f5-c2fzx" Jun 05 03:53:13.812762 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:13.812617 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz54m\" (UniqueName: \"kubernetes.io/projected/d9df0f2c-b166-4b43-a272-21a48aeab89a-kube-api-access-pz54m\") pod \"dashboard-redirect-ccfd96f5-c2fzx\" (UID: \"d9df0f2c-b166-4b43-a272-21a48aeab89a\") " pod="opendatahub/dashboard-redirect-ccfd96f5-c2fzx" Jun 05 03:53:13.913542 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:13.913511 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d9df0f2c-b166-4b43-a272-21a48aeab89a-redirect-config\") pod \"dashboard-redirect-ccfd96f5-c2fzx\" (UID: \"d9df0f2c-b166-4b43-a272-21a48aeab89a\") " pod="opendatahub/dashboard-redirect-ccfd96f5-c2fzx" Jun 05 03:53:13.913723 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:13.913613 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz54m\" (UniqueName: \"kubernetes.io/projected/d9df0f2c-b166-4b43-a272-21a48aeab89a-kube-api-access-pz54m\") pod \"dashboard-redirect-ccfd96f5-c2fzx\" (UID: \"d9df0f2c-b166-4b43-a272-21a48aeab89a\") " pod="opendatahub/dashboard-redirect-ccfd96f5-c2fzx" Jun 05 03:53:13.914354 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:13.914331 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d9df0f2c-b166-4b43-a272-21a48aeab89a-redirect-config\") pod \"dashboard-redirect-ccfd96f5-c2fzx\" (UID: \"d9df0f2c-b166-4b43-a272-21a48aeab89a\") " pod="opendatahub/dashboard-redirect-ccfd96f5-c2fzx" Jun 05 03:53:13.924091 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:13.924059 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz54m\" (UniqueName: \"kubernetes.io/projected/d9df0f2c-b166-4b43-a272-21a48aeab89a-kube-api-access-pz54m\") pod \"dashboard-redirect-ccfd96f5-c2fzx\" (UID: \"d9df0f2c-b166-4b43-a272-21a48aeab89a\") " pod="opendatahub/dashboard-redirect-ccfd96f5-c2fzx" Jun 05 03:53:14.023723 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:14.023685 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-ccfd96f5-c2fzx" Jun 05 03:53:14.186412 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:14.186381 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-ccfd96f5-c2fzx"] Jun 05 03:53:14.188130 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:53:14.188098 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9df0f2c_b166_4b43_a272_21a48aeab89a.slice/crio-0448113c6facbda2a09d002fd57936595faa87394a0ed66a61f8234fc2cdb294 WatchSource:0}: Error finding container 0448113c6facbda2a09d002fd57936595faa87394a0ed66a61f8234fc2cdb294: Status 404 returned error can't find the container with id 0448113c6facbda2a09d002fd57936595faa87394a0ed66a61f8234fc2cdb294 Jun 05 03:53:14.557912 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:14.557879 2548 generic.go:356] "Generic (PLEG): container finished" podID="77bc9fbf-85f6-4a41-99e5-f7b31c9aa731" containerID="7e002af717b6add5c00ebe331e6f1a2bc4c9a4e5ba6ec56947a598441cb09868" exitCode=0 Jun 05 03:53:14.558079 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:14.557964 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armxp8" event={"ID":"77bc9fbf-85f6-4a41-99e5-f7b31c9aa731","Type":"ContainerDied","Data":"7e002af717b6add5c00ebe331e6f1a2bc4c9a4e5ba6ec56947a598441cb09868"} Jun 05 03:53:14.558079 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:14.558010 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armxp8" event={"ID":"77bc9fbf-85f6-4a41-99e5-f7b31c9aa731","Type":"ContainerStarted","Data":"efdd4b8355e1030032fa0a60551bc25e13f259d9ae999e218936bef248a3711b"} Jun 05 03:53:14.559225 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:14.559195 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-ccfd96f5-c2fzx" event={"ID":"d9df0f2c-b166-4b43-a272-21a48aeab89a","Type":"ContainerStarted","Data":"0448113c6facbda2a09d002fd57936595faa87394a0ed66a61f8234fc2cdb294"} Jun 05 03:53:15.569012 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:15.568918 2548 generic.go:356] "Generic (PLEG): container finished" podID="77bc9fbf-85f6-4a41-99e5-f7b31c9aa731" containerID="bb19ef3ac5c784e820ca7513217cffbc312129799da2c91e17580518ab3380c8" exitCode=0 Jun 05 03:53:15.569367 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:15.569007 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armxp8" event={"ID":"77bc9fbf-85f6-4a41-99e5-f7b31c9aa731","Type":"ContainerDied","Data":"bb19ef3ac5c784e820ca7513217cffbc312129799da2c91e17580518ab3380c8"} Jun 05 03:53:16.578492 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:16.578463 2548 generic.go:356] "Generic (PLEG): container finished" podID="77bc9fbf-85f6-4a41-99e5-f7b31c9aa731" containerID="62743b2b318dca379ea66d735522b632f169b6382212e82d80205f4d7d175c8a" exitCode=0 Jun 05 03:53:16.578492 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:16.578507 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armxp8" event={"ID":"77bc9fbf-85f6-4a41-99e5-f7b31c9aa731","Type":"ContainerDied","Data":"62743b2b318dca379ea66d735522b632f169b6382212e82d80205f4d7d175c8a"} Jun 05 03:53:17.585080 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:17.585043 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-ccfd96f5-c2fzx" event={"ID":"d9df0f2c-b166-4b43-a272-21a48aeab89a","Type":"ContainerStarted","Data":"1d2223edec7fa46f0d2d5a3c1c0ad4726ffdb454b24c1103698b1c796edcb144"} Jun 05 03:53:17.603774 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:17.603718 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-ccfd96f5-c2fzx" podStartSLOduration=1.727828487 podStartE2EDuration="4.603702487s" totalImagesPullingTime="2.875874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:53:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:53:17.602783261 +0000 UTC m=+596.872559569" watchObservedRunningTime="2026-06-05 03:53:17.603702487 +0000 UTC m=+596.873478838" Jun 05 03:53:17.717671 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:17.717645 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armxp8" Jun 05 03:53:17.849871 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:17.849791 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77bc9fbf-85f6-4a41-99e5-f7b31c9aa731-util\") pod \"77bc9fbf-85f6-4a41-99e5-f7b31c9aa731\" (UID: \"77bc9fbf-85f6-4a41-99e5-f7b31c9aa731\") " Jun 05 03:53:17.849871 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:17.849842 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zk8b\" (UniqueName: \"kubernetes.io/projected/77bc9fbf-85f6-4a41-99e5-f7b31c9aa731-kube-api-access-5zk8b\") pod \"77bc9fbf-85f6-4a41-99e5-f7b31c9aa731\" (UID: \"77bc9fbf-85f6-4a41-99e5-f7b31c9aa731\") " Jun 05 03:53:17.850097 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:17.849885 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77bc9fbf-85f6-4a41-99e5-f7b31c9aa731-bundle\") pod \"77bc9fbf-85f6-4a41-99e5-f7b31c9aa731\" (UID: \"77bc9fbf-85f6-4a41-99e5-f7b31c9aa731\") " Jun 05 03:53:17.850716 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:17.850689 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77bc9fbf-85f6-4a41-99e5-f7b31c9aa731-bundle" (OuterVolumeSpecName: "bundle") pod "77bc9fbf-85f6-4a41-99e5-f7b31c9aa731" (UID: "77bc9fbf-85f6-4a41-99e5-f7b31c9aa731"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:53:17.852070 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:17.852047 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77bc9fbf-85f6-4a41-99e5-f7b31c9aa731-kube-api-access-5zk8b" (OuterVolumeSpecName: "kube-api-access-5zk8b") pod "77bc9fbf-85f6-4a41-99e5-f7b31c9aa731" (UID: "77bc9fbf-85f6-4a41-99e5-f7b31c9aa731"). InnerVolumeSpecName "kube-api-access-5zk8b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:53:17.854992 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:17.854972 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77bc9fbf-85f6-4a41-99e5-f7b31c9aa731-util" (OuterVolumeSpecName: "util") pod "77bc9fbf-85f6-4a41-99e5-f7b31c9aa731" (UID: "77bc9fbf-85f6-4a41-99e5-f7b31c9aa731"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:53:17.951126 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:17.951086 2548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77bc9fbf-85f6-4a41-99e5-f7b31c9aa731-bundle\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:53:17.951126 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:17.951119 2548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77bc9fbf-85f6-4a41-99e5-f7b31c9aa731-util\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:53:17.951126 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:17.951130 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zk8b\" (UniqueName: \"kubernetes.io/projected/77bc9fbf-85f6-4a41-99e5-f7b31c9aa731-kube-api-access-5zk8b\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:53:18.592809 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:18.592778 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armxp8" Jun 05 03:53:18.592809 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:18.592799 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armxp8" event={"ID":"77bc9fbf-85f6-4a41-99e5-f7b31c9aa731","Type":"ContainerDied","Data":"efdd4b8355e1030032fa0a60551bc25e13f259d9ae999e218936bef248a3711b"} Jun 05 03:53:18.593288 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:18.592844 2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="efdd4b8355e1030032fa0a60551bc25e13f259d9ae999e218936bef248a3711b" Jun 05 03:53:21.232630 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:21.232337 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whn2g_9139fc4f-a2c4-4323-aac8-55b73d33aba2/ovn-acl-logging/0.log" Jun 05 03:53:21.232630 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:21.232593 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whn2g_9139fc4f-a2c4-4323-aac8-55b73d33aba2/ovn-acl-logging/0.log" Jun 05 03:53:25.722149 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.722117 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn"] Jun 05 03:53:25.722762 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.722513 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77bc9fbf-85f6-4a41-99e5-f7b31c9aa731" containerName="extract" Jun 05 03:53:25.722762 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.722526 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="77bc9fbf-85f6-4a41-99e5-f7b31c9aa731" containerName="extract" Jun 05 03:53:25.722762 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.722549 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77bc9fbf-85f6-4a41-99e5-f7b31c9aa731" containerName="util" Jun 05 03:53:25.722762 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.722554 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="77bc9fbf-85f6-4a41-99e5-f7b31c9aa731" containerName="util" Jun 05 03:53:25.722762 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.722561 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77bc9fbf-85f6-4a41-99e5-f7b31c9aa731" containerName="pull" Jun 05 03:53:25.722762 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.722566 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="77bc9fbf-85f6-4a41-99e5-f7b31c9aa731" containerName="pull" Jun 05 03:53:25.722762 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.722628 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="77bc9fbf-85f6-4a41-99e5-f7b31c9aa731" containerName="extract" Jun 05 03:53:25.725678 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.725661 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn" Jun 05 03:53:25.728405 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.728370 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 05 03:53:25.728405 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.728383 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-jw8b4\"" Jun 05 03:53:25.728405 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.728373 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 05 03:53:25.728637 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.728500 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 05 03:53:25.736380 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.736360 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn"] Jun 05 03:53:25.819543 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.819505 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f15771d-46f7-4c8b-9129-679f5f66ea6d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ck9hn\" (UID: \"0f15771d-46f7-4c8b-9129-679f5f66ea6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn" Jun 05 03:53:25.819711 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.819553 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f15771d-46f7-4c8b-9129-679f5f66ea6d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ck9hn\" (UID: \"0f15771d-46f7-4c8b-9129-679f5f66ea6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn" Jun 05 03:53:25.819711 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.819599 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f15771d-46f7-4c8b-9129-679f5f66ea6d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ck9hn\" (UID: \"0f15771d-46f7-4c8b-9129-679f5f66ea6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn" Jun 05 03:53:25.819711 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.819634 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f15771d-46f7-4c8b-9129-679f5f66ea6d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ck9hn\" (UID: \"0f15771d-46f7-4c8b-9129-679f5f66ea6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn" Jun 05 03:53:25.819711 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.819653 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f15771d-46f7-4c8b-9129-679f5f66ea6d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ck9hn\" (UID: \"0f15771d-46f7-4c8b-9129-679f5f66ea6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn" Jun 05 03:53:25.819711 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.819669 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f15771d-46f7-4c8b-9129-679f5f66ea6d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ck9hn\" (UID: \"0f15771d-46f7-4c8b-9129-679f5f66ea6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn" Jun 05 03:53:25.819711 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.819697 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f15771d-46f7-4c8b-9129-679f5f66ea6d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ck9hn\" (UID: \"0f15771d-46f7-4c8b-9129-679f5f66ea6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn" Jun 05 03:53:25.819900 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.819762 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f15771d-46f7-4c8b-9129-679f5f66ea6d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ck9hn\" (UID: \"0f15771d-46f7-4c8b-9129-679f5f66ea6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn" Jun 05 03:53:25.819900 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.819798 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtrkw\" (UniqueName: \"kubernetes.io/projected/0f15771d-46f7-4c8b-9129-679f5f66ea6d-kube-api-access-qtrkw\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ck9hn\" (UID: \"0f15771d-46f7-4c8b-9129-679f5f66ea6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn" Jun 05 03:53:25.920409 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.920374 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f15771d-46f7-4c8b-9129-679f5f66ea6d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ck9hn\" (UID: \"0f15771d-46f7-4c8b-9129-679f5f66ea6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn" Jun 05 03:53:25.920409 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.920414 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f15771d-46f7-4c8b-9129-679f5f66ea6d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ck9hn\" (UID: \"0f15771d-46f7-4c8b-9129-679f5f66ea6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn" Jun 05 03:53:25.920668 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.920444 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f15771d-46f7-4c8b-9129-679f5f66ea6d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ck9hn\" (UID: \"0f15771d-46f7-4c8b-9129-679f5f66ea6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn" Jun 05 03:53:25.920668 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.920481 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f15771d-46f7-4c8b-9129-679f5f66ea6d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ck9hn\" (UID: \"0f15771d-46f7-4c8b-9129-679f5f66ea6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn" Jun 05 03:53:25.920668 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.920506 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f15771d-46f7-4c8b-9129-679f5f66ea6d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ck9hn\" (UID: \"0f15771d-46f7-4c8b-9129-679f5f66ea6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn" Jun 05 03:53:25.920668 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.920530 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtrkw\" (UniqueName: \"kubernetes.io/projected/0f15771d-46f7-4c8b-9129-679f5f66ea6d-kube-api-access-qtrkw\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ck9hn\" (UID: \"0f15771d-46f7-4c8b-9129-679f5f66ea6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn" Jun 05 03:53:25.920668 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.920573 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f15771d-46f7-4c8b-9129-679f5f66ea6d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ck9hn\" (UID: \"0f15771d-46f7-4c8b-9129-679f5f66ea6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn" Jun 05 03:53:25.920668 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.920617 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f15771d-46f7-4c8b-9129-679f5f66ea6d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ck9hn\" (UID: \"0f15771d-46f7-4c8b-9129-679f5f66ea6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn" Jun 05 03:53:25.920668 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.920655 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f15771d-46f7-4c8b-9129-679f5f66ea6d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ck9hn\" (UID: \"0f15771d-46f7-4c8b-9129-679f5f66ea6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn" Jun 05 03:53:25.921060 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.920874 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f15771d-46f7-4c8b-9129-679f5f66ea6d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ck9hn\" (UID: \"0f15771d-46f7-4c8b-9129-679f5f66ea6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn" Jun 05 03:53:25.921116 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.921079 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f15771d-46f7-4c8b-9129-679f5f66ea6d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ck9hn\" (UID: \"0f15771d-46f7-4c8b-9129-679f5f66ea6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn" Jun 05 03:53:25.921116 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.921093 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f15771d-46f7-4c8b-9129-679f5f66ea6d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ck9hn\" (UID: \"0f15771d-46f7-4c8b-9129-679f5f66ea6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn" Jun 05 03:53:25.921253 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.921232 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f15771d-46f7-4c8b-9129-679f5f66ea6d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ck9hn\" (UID: \"0f15771d-46f7-4c8b-9129-679f5f66ea6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn" Jun 05 03:53:25.921495 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.921391 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f15771d-46f7-4c8b-9129-679f5f66ea6d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ck9hn\" (UID: \"0f15771d-46f7-4c8b-9129-679f5f66ea6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn" Jun 05 03:53:25.922874 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.922854 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f15771d-46f7-4c8b-9129-679f5f66ea6d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ck9hn\" (UID: \"0f15771d-46f7-4c8b-9129-679f5f66ea6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn" Jun 05 03:53:25.923183 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.923156 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f15771d-46f7-4c8b-9129-679f5f66ea6d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ck9hn\" (UID: \"0f15771d-46f7-4c8b-9129-679f5f66ea6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn" Jun 05 03:53:25.931818 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.931791 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtrkw\" (UniqueName: \"kubernetes.io/projected/0f15771d-46f7-4c8b-9129-679f5f66ea6d-kube-api-access-qtrkw\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ck9hn\" (UID: \"0f15771d-46f7-4c8b-9129-679f5f66ea6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn" Jun 05 03:53:25.932031 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:25.932009 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f15771d-46f7-4c8b-9129-679f5f66ea6d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795ck9hn\" (UID: \"0f15771d-46f7-4c8b-9129-679f5f66ea6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn" Jun 05 03:53:26.037507 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:26.037471 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn" Jun 05 03:53:26.177909 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:26.177876 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn"] Jun 05 03:53:26.178903 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:53:26.178880 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f15771d_46f7_4c8b_9129_679f5f66ea6d.slice/crio-f5879473e170d2008b2e35c78a7603107a14b10c3093e9bb5a372856897e8b37 WatchSource:0}: Error finding container f5879473e170d2008b2e35c78a7603107a14b10c3093e9bb5a372856897e8b37: Status 404 returned error can't find the container with id f5879473e170d2008b2e35c78a7603107a14b10c3093e9bb5a372856897e8b37 Jun 05 03:53:26.634448 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:26.634388 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn" event={"ID":"0f15771d-46f7-4c8b-9129-679f5f66ea6d","Type":"ContainerStarted","Data":"f5879473e170d2008b2e35c78a7603107a14b10c3093e9bb5a372856897e8b37"} Jun 05 03:53:29.036031 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:29.035988 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 05 03:53:29.036333 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:29.036068 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 05 03:53:29.036333 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:29.036097 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 05 03:53:29.653883 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:29.653847 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn" event={"ID":"0f15771d-46f7-4c8b-9129-679f5f66ea6d","Type":"ContainerStarted","Data":"7be86f31f94b81076366438b01b52175c32f9742771eb02e95429c75c0a049cd"} Jun 05 03:53:29.675130 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:29.675070 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn" podStartSLOduration=1.8202337229999999 podStartE2EDuration="4.675054741s" totalImagesPullingTime="2.854821018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:53:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:53:29.674635059 +0000 UTC m=+608.944411378" watchObservedRunningTime="2026-06-05 03:53:29.675054741 +0000 UTC m=+608.944831059" Jun 05 03:53:30.038695 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:30.038665 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn" Jun 05 03:53:30.043780 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:30.043751 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn" Jun 05 03:53:30.664569 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:30.664538 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn" Jun 05 03:53:30.665539 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:30.665524 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795ck9hn" Jun 05 03:53:57.602266 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:57.602184 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zxtgz"] Jun 05 03:53:57.614814 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:57.614788 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zxtgz" Jun 05 03:53:57.615765 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:57.615739 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zxtgz"] Jun 05 03:53:57.617523 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:57.617504 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 05 03:53:57.618559 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:57.618537 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 05 03:53:57.618653 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:57.618537 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-x7fw6\"" Jun 05 03:53:57.708786 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:57.708755 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmghs\" (UniqueName: \"kubernetes.io/projected/32fcce7d-8a33-4328-bae5-6cdfe1a9eaef-kube-api-access-nmghs\") pod \"kuadrant-operator-catalog-zxtgz\" (UID: \"32fcce7d-8a33-4328-bae5-6cdfe1a9eaef\") " pod="kuadrant-system/kuadrant-operator-catalog-zxtgz" Jun 05 03:53:57.810002 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:57.809969 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmghs\" (UniqueName: \"kubernetes.io/projected/32fcce7d-8a33-4328-bae5-6cdfe1a9eaef-kube-api-access-nmghs\") pod \"kuadrant-operator-catalog-zxtgz\" (UID: \"32fcce7d-8a33-4328-bae5-6cdfe1a9eaef\") " pod="kuadrant-system/kuadrant-operator-catalog-zxtgz" Jun 05 03:53:57.817937 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:57.817904 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmghs\" (UniqueName: \"kubernetes.io/projected/32fcce7d-8a33-4328-bae5-6cdfe1a9eaef-kube-api-access-nmghs\") pod \"kuadrant-operator-catalog-zxtgz\" (UID: \"32fcce7d-8a33-4328-bae5-6cdfe1a9eaef\") " pod="kuadrant-system/kuadrant-operator-catalog-zxtgz" Jun 05 03:53:57.926400 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:57.926311 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zxtgz" Jun 05 03:53:57.971798 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:57.971763 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zxtgz"] Jun 05 03:53:58.056558 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:58.056527 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zxtgz"] Jun 05 03:53:58.057969 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:53:58.057933 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32fcce7d_8a33_4328_bae5_6cdfe1a9eaef.slice/crio-a8f69c6ba21a26cd3c150d44f47c1117e7c0a76e117ec67d20b60cb834933cd6 WatchSource:0}: Error finding container a8f69c6ba21a26cd3c150d44f47c1117e7c0a76e117ec67d20b60cb834933cd6: Status 404 returned error can't find the container with id a8f69c6ba21a26cd3c150d44f47c1117e7c0a76e117ec67d20b60cb834933cd6 Jun 05 03:53:58.180265 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:58.180185 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xh7ws"] Jun 05 03:53:58.185091 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:58.185073 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xh7ws" Jun 05 03:53:58.191002 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:58.190975 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xh7ws"] Jun 05 03:53:58.312965 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:58.312923 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mthx4\" (UniqueName: \"kubernetes.io/projected/e059422d-dbe3-4506-a94b-58a380353181-kube-api-access-mthx4\") pod \"kuadrant-operator-catalog-xh7ws\" (UID: \"e059422d-dbe3-4506-a94b-58a380353181\") " pod="kuadrant-system/kuadrant-operator-catalog-xh7ws" Jun 05 03:53:58.413782 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:58.413753 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mthx4\" (UniqueName: \"kubernetes.io/projected/e059422d-dbe3-4506-a94b-58a380353181-kube-api-access-mthx4\") pod \"kuadrant-operator-catalog-xh7ws\" (UID: \"e059422d-dbe3-4506-a94b-58a380353181\") " pod="kuadrant-system/kuadrant-operator-catalog-xh7ws" Jun 05 03:53:58.422117 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:58.422090 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mthx4\" (UniqueName: \"kubernetes.io/projected/e059422d-dbe3-4506-a94b-58a380353181-kube-api-access-mthx4\") pod \"kuadrant-operator-catalog-xh7ws\" (UID: \"e059422d-dbe3-4506-a94b-58a380353181\") " pod="kuadrant-system/kuadrant-operator-catalog-xh7ws" Jun 05 03:53:58.496631 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:58.496547 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xh7ws" Jun 05 03:53:58.717584 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:58.717560 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xh7ws"] Jun 05 03:53:58.798408 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:53:58.798369 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode059422d_dbe3_4506_a94b_58a380353181.slice/crio-dafda281b072a6ea97735ed360226266ce1cf638e8b0ec1db691ebaa7c850e26 WatchSource:0}: Error finding container dafda281b072a6ea97735ed360226266ce1cf638e8b0ec1db691ebaa7c850e26: Status 404 returned error can't find the container with id dafda281b072a6ea97735ed360226266ce1cf638e8b0ec1db691ebaa7c850e26 Jun 05 03:53:58.808479 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:58.808421 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xh7ws" event={"ID":"e059422d-dbe3-4506-a94b-58a380353181","Type":"ContainerStarted","Data":"dafda281b072a6ea97735ed360226266ce1cf638e8b0ec1db691ebaa7c850e26"} Jun 05 03:53:58.810061 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:53:58.810031 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zxtgz" event={"ID":"32fcce7d-8a33-4328-bae5-6cdfe1a9eaef","Type":"ContainerStarted","Data":"a8f69c6ba21a26cd3c150d44f47c1117e7c0a76e117ec67d20b60cb834933cd6"} Jun 05 03:54:00.823047 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:00.823011 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xh7ws" event={"ID":"e059422d-dbe3-4506-a94b-58a380353181","Type":"ContainerStarted","Data":"565b24fe77464932299c7e5381e7a9aa25401da8b46fb4f74bfa268eab867a17"} Jun 05 03:54:00.824552 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:00.824526 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zxtgz" event={"ID":"32fcce7d-8a33-4328-bae5-6cdfe1a9eaef","Type":"ContainerStarted","Data":"516da4433d803c3450d96d4f3bb4fef95cf4559584bb5ccd6fa57dbccef42e11"} Jun 05 03:54:00.824680 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:00.824587 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-zxtgz" podUID="32fcce7d-8a33-4328-bae5-6cdfe1a9eaef" containerName="registry-server" containerID="cri-o://516da4433d803c3450d96d4f3bb4fef95cf4559584bb5ccd6fa57dbccef42e11" gracePeriod=2 Jun 05 03:54:00.839834 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:00.839788 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-xh7ws" podStartSLOduration=1.491590299 podStartE2EDuration="2.839773847s" totalImagesPullingTime="1.348183548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:53:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:54:00.837233605 +0000 UTC m=+640.107009948" watchObservedRunningTime="2026-06-05 03:54:00.839773847 +0000 UTC m=+640.109550165" Jun 05 03:54:00.853195 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:00.853154 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-zxtgz" podStartSLOduration=1.76636374 podStartE2EDuration="3.85314103s" totalImagesPullingTime="2.08677729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:53:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:54:00.851022483 +0000 UTC m=+640.120798802" watchObservedRunningTime="2026-06-05 03:54:00.85314103 +0000 UTC m=+640.122917348" Jun 05 03:54:01.072948 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:01.072924 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zxtgz" Jun 05 03:54:01.140028 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:01.139953 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmghs\" (UniqueName: \"kubernetes.io/projected/32fcce7d-8a33-4328-bae5-6cdfe1a9eaef-kube-api-access-nmghs\") pod \"32fcce7d-8a33-4328-bae5-6cdfe1a9eaef\" (UID: \"32fcce7d-8a33-4328-bae5-6cdfe1a9eaef\") " Jun 05 03:54:01.142232 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:01.142207 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32fcce7d-8a33-4328-bae5-6cdfe1a9eaef-kube-api-access-nmghs" (OuterVolumeSpecName: "kube-api-access-nmghs") pod "32fcce7d-8a33-4328-bae5-6cdfe1a9eaef" (UID: "32fcce7d-8a33-4328-bae5-6cdfe1a9eaef"). InnerVolumeSpecName "kube-api-access-nmghs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:54:01.240811 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:01.240789 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmghs\" (UniqueName: \"kubernetes.io/projected/32fcce7d-8a33-4328-bae5-6cdfe1a9eaef-kube-api-access-nmghs\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:54:01.830948 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:01.830914 2548 generic.go:356] "Generic (PLEG): container finished" podID="32fcce7d-8a33-4328-bae5-6cdfe1a9eaef" containerID="516da4433d803c3450d96d4f3bb4fef95cf4559584bb5ccd6fa57dbccef42e11" exitCode=0 Jun 05 03:54:01.831345 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:01.830956 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zxtgz" Jun 05 03:54:01.831345 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:01.831001 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zxtgz" event={"ID":"32fcce7d-8a33-4328-bae5-6cdfe1a9eaef","Type":"ContainerDied","Data":"516da4433d803c3450d96d4f3bb4fef95cf4559584bb5ccd6fa57dbccef42e11"} Jun 05 03:54:01.831345 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:01.831044 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zxtgz" event={"ID":"32fcce7d-8a33-4328-bae5-6cdfe1a9eaef","Type":"ContainerDied","Data":"a8f69c6ba21a26cd3c150d44f47c1117e7c0a76e117ec67d20b60cb834933cd6"} Jun 05 03:54:01.831345 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:01.831104 2548 scope.go:117] "RemoveContainer" containerID="516da4433d803c3450d96d4f3bb4fef95cf4559584bb5ccd6fa57dbccef42e11" Jun 05 03:54:01.840184 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:01.840167 2548 scope.go:117] "RemoveContainer" containerID="516da4433d803c3450d96d4f3bb4fef95cf4559584bb5ccd6fa57dbccef42e11" Jun 05 03:54:01.840449 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:54:01.840415 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"516da4433d803c3450d96d4f3bb4fef95cf4559584bb5ccd6fa57dbccef42e11\": container with ID starting with 516da4433d803c3450d96d4f3bb4fef95cf4559584bb5ccd6fa57dbccef42e11 not found: ID does not exist" containerID="516da4433d803c3450d96d4f3bb4fef95cf4559584bb5ccd6fa57dbccef42e11" Jun 05 03:54:01.840502 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:01.840461 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"516da4433d803c3450d96d4f3bb4fef95cf4559584bb5ccd6fa57dbccef42e11"} err="failed to get container status \"516da4433d803c3450d96d4f3bb4fef95cf4559584bb5ccd6fa57dbccef42e11\": rpc error: code = NotFound desc = could not find container \"516da4433d803c3450d96d4f3bb4fef95cf4559584bb5ccd6fa57dbccef42e11\": container with ID starting with 516da4433d803c3450d96d4f3bb4fef95cf4559584bb5ccd6fa57dbccef42e11 not found: ID does not exist" Jun 05 03:54:01.847796 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:01.847773 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zxtgz"] Jun 05 03:54:01.851015 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:01.850995 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zxtgz"] Jun 05 03:54:03.229320 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:03.229286 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32fcce7d-8a33-4328-bae5-6cdfe1a9eaef" path="/var/lib/kubelet/pods/32fcce7d-8a33-4328-bae5-6cdfe1a9eaef/volumes" Jun 05 03:54:08.497210 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:08.497179 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-xh7ws" Jun 05 03:54:08.497741 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:08.497250 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-xh7ws" Jun 05 03:54:08.520170 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:08.520137 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-xh7ws" Jun 05 03:54:08.889201 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:08.889174 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-xh7ws" Jun 05 03:54:13.218605 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:13.218571 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759phkhd"] Jun 05 03:54:13.218977 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:13.218964 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32fcce7d-8a33-4328-bae5-6cdfe1a9eaef" containerName="registry-server" Jun 05 03:54:13.219032 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:13.218978 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="32fcce7d-8a33-4328-bae5-6cdfe1a9eaef" containerName="registry-server" Jun 05 03:54:13.219063 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:13.219045 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="32fcce7d-8a33-4328-bae5-6cdfe1a9eaef" containerName="registry-server" Jun 05 03:54:13.222300 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:13.222284 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759phkhd" Jun 05 03:54:13.224814 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:13.224793 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-s4spl\"" Jun 05 03:54:13.231507 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:13.231485 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759phkhd"] Jun 05 03:54:13.354598 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:13.354565 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/01ee2609-c3b9-4cb8-8ab5-46b0577a5952-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759phkhd\" (UID: \"01ee2609-c3b9-4cb8-8ab5-46b0577a5952\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759phkhd" Jun 05 03:54:13.354791 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:13.354610 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/01ee2609-c3b9-4cb8-8ab5-46b0577a5952-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759phkhd\" (UID: \"01ee2609-c3b9-4cb8-8ab5-46b0577a5952\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759phkhd" Jun 05 03:54:13.354791 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:13.354731 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssdht\" (UniqueName: \"kubernetes.io/projected/01ee2609-c3b9-4cb8-8ab5-46b0577a5952-kube-api-access-ssdht\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759phkhd\" (UID: \"01ee2609-c3b9-4cb8-8ab5-46b0577a5952\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759phkhd" Jun 05 03:54:13.456206 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:13.456158 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/01ee2609-c3b9-4cb8-8ab5-46b0577a5952-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759phkhd\" (UID: \"01ee2609-c3b9-4cb8-8ab5-46b0577a5952\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759phkhd" Jun 05 03:54:13.456376 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:13.456221 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/01ee2609-c3b9-4cb8-8ab5-46b0577a5952-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759phkhd\" (UID: \"01ee2609-c3b9-4cb8-8ab5-46b0577a5952\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759phkhd" Jun 05 03:54:13.456376 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:13.456292 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssdht\" (UniqueName: \"kubernetes.io/projected/01ee2609-c3b9-4cb8-8ab5-46b0577a5952-kube-api-access-ssdht\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759phkhd\" (UID: \"01ee2609-c3b9-4cb8-8ab5-46b0577a5952\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759phkhd" Jun 05 03:54:13.456656 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:13.456631 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/01ee2609-c3b9-4cb8-8ab5-46b0577a5952-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759phkhd\" (UID: \"01ee2609-c3b9-4cb8-8ab5-46b0577a5952\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759phkhd" Jun 05 03:54:13.456656 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:13.456646 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/01ee2609-c3b9-4cb8-8ab5-46b0577a5952-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759phkhd\" (UID: \"01ee2609-c3b9-4cb8-8ab5-46b0577a5952\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759phkhd" Jun 05 03:54:13.464295 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:13.464267 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssdht\" (UniqueName: \"kubernetes.io/projected/01ee2609-c3b9-4cb8-8ab5-46b0577a5952-kube-api-access-ssdht\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759phkhd\" (UID: \"01ee2609-c3b9-4cb8-8ab5-46b0577a5952\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759phkhd" Jun 05 03:54:13.533271 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:13.533239 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759phkhd" Jun 05 03:54:13.664204 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:13.664172 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759phkhd"] Jun 05 03:54:13.665503 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:54:13.665472 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01ee2609_c3b9_4cb8_8ab5_46b0577a5952.slice/crio-956b6eae8b0f37e5db6678480b125a04e76c56dfd0537fc0f1c3ad6e6e66714e WatchSource:0}: Error finding container 956b6eae8b0f37e5db6678480b125a04e76c56dfd0537fc0f1c3ad6e6e66714e: Status 404 returned error can't find the container with id 956b6eae8b0f37e5db6678480b125a04e76c56dfd0537fc0f1c3ad6e6e66714e Jun 05 03:54:13.897038 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:13.896955 2548 generic.go:356] "Generic (PLEG): container finished" podID="01ee2609-c3b9-4cb8-8ab5-46b0577a5952" containerID="0ccce6122948f7372bc35529cdbdc53dc0536d50b5c698ed7e92d75c3968afed" exitCode=0 Jun 05 03:54:13.897038 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:13.897012 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759phkhd" event={"ID":"01ee2609-c3b9-4cb8-8ab5-46b0577a5952","Type":"ContainerDied","Data":"0ccce6122948f7372bc35529cdbdc53dc0536d50b5c698ed7e92d75c3968afed"} Jun 05 03:54:13.897201 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:13.897070 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759phkhd" event={"ID":"01ee2609-c3b9-4cb8-8ab5-46b0577a5952","Type":"ContainerStarted","Data":"956b6eae8b0f37e5db6678480b125a04e76c56dfd0537fc0f1c3ad6e6e66714e"} Jun 05 03:54:14.012645 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:14.012610 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1twvlk"] Jun 05 03:54:14.016252 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:14.016233 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1twvlk" Jun 05 03:54:14.023771 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:14.023732 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1twvlk"] Jun 05 03:54:14.164333 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:14.164233 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9e7b56ab-1856-4718-af84-c14bc9240a72-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1twvlk\" (UID: \"9e7b56ab-1856-4718-af84-c14bc9240a72\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1twvlk" Jun 05 03:54:14.164536 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:14.164353 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzkfw\" (UniqueName: \"kubernetes.io/projected/9e7b56ab-1856-4718-af84-c14bc9240a72-kube-api-access-jzkfw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1twvlk\" (UID: \"9e7b56ab-1856-4718-af84-c14bc9240a72\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1twvlk" Jun 05 03:54:14.164536 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:14.164400 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9e7b56ab-1856-4718-af84-c14bc9240a72-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1twvlk\" (UID: \"9e7b56ab-1856-4718-af84-c14bc9240a72\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1twvlk" Jun 05 03:54:14.265368 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:14.265330 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzkfw\" (UniqueName: \"kubernetes.io/projected/9e7b56ab-1856-4718-af84-c14bc9240a72-kube-api-access-jzkfw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1twvlk\" (UID: \"9e7b56ab-1856-4718-af84-c14bc9240a72\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1twvlk" Jun 05 03:54:14.265854 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:14.265373 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9e7b56ab-1856-4718-af84-c14bc9240a72-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1twvlk\" (UID: \"9e7b56ab-1856-4718-af84-c14bc9240a72\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1twvlk" Jun 05 03:54:14.265854 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:14.265504 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9e7b56ab-1856-4718-af84-c14bc9240a72-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1twvlk\" (UID: \"9e7b56ab-1856-4718-af84-c14bc9240a72\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1twvlk" Jun 05 03:54:14.265854 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:14.265798 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9e7b56ab-1856-4718-af84-c14bc9240a72-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1twvlk\" (UID: \"9e7b56ab-1856-4718-af84-c14bc9240a72\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1twvlk" Jun 05 03:54:14.265854 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:14.265824 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9e7b56ab-1856-4718-af84-c14bc9240a72-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1twvlk\" (UID: \"9e7b56ab-1856-4718-af84-c14bc9240a72\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1twvlk" Jun 05 03:54:14.273477 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:14.273450 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzkfw\" (UniqueName: \"kubernetes.io/projected/9e7b56ab-1856-4718-af84-c14bc9240a72-kube-api-access-jzkfw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1twvlk\" (UID: \"9e7b56ab-1856-4718-af84-c14bc9240a72\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1twvlk" Jun 05 03:54:14.328559 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:14.328524 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1twvlk" Jun 05 03:54:14.468405 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:14.468374 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1twvlk"] Jun 05 03:54:14.470148 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:54:14.470119 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e7b56ab_1856_4718_af84_c14bc9240a72.slice/crio-f544d1af1f8d6a270d366bd011d96a165d14f2e4d396904f4916e83b213a58b3 WatchSource:0}: Error finding container f544d1af1f8d6a270d366bd011d96a165d14f2e4d396904f4916e83b213a58b3: Status 404 returned error can't find the container with id f544d1af1f8d6a270d366bd011d96a165d14f2e4d396904f4916e83b213a58b3 Jun 05 03:54:14.615195 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:14.615152 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ws4f4"] Jun 05 03:54:14.618841 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:14.618825 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ws4f4" Jun 05 03:54:14.625644 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:14.625616 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ws4f4"] Jun 05 03:54:14.770786 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:14.770750 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34b1e21e-6f61-4269-83c4-bd3e3978722c-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ws4f4\" (UID: \"34b1e21e-6f61-4269-83c4-bd3e3978722c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ws4f4" Jun 05 03:54:14.770952 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:14.770932 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34b1e21e-6f61-4269-83c4-bd3e3978722c-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ws4f4\" (UID: \"34b1e21e-6f61-4269-83c4-bd3e3978722c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ws4f4" Jun 05 03:54:14.771012 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:14.770976 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x92r\" (UniqueName: \"kubernetes.io/projected/34b1e21e-6f61-4269-83c4-bd3e3978722c-kube-api-access-2x92r\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ws4f4\" (UID: \"34b1e21e-6f61-4269-83c4-bd3e3978722c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ws4f4" Jun 05 03:54:14.871520 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:14.871492 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34b1e21e-6f61-4269-83c4-bd3e3978722c-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ws4f4\" (UID: \"34b1e21e-6f61-4269-83c4-bd3e3978722c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ws4f4" Jun 05 03:54:14.871676 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:14.871582 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34b1e21e-6f61-4269-83c4-bd3e3978722c-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ws4f4\" (UID: \"34b1e21e-6f61-4269-83c4-bd3e3978722c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ws4f4" Jun 05 03:54:14.871676 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:14.871604 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x92r\" (UniqueName: \"kubernetes.io/projected/34b1e21e-6f61-4269-83c4-bd3e3978722c-kube-api-access-2x92r\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ws4f4\" (UID: \"34b1e21e-6f61-4269-83c4-bd3e3978722c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ws4f4" Jun 05 03:54:14.871929 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:14.871901 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34b1e21e-6f61-4269-83c4-bd3e3978722c-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ws4f4\" (UID: \"34b1e21e-6f61-4269-83c4-bd3e3978722c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ws4f4" Jun 05 03:54:14.871993 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:14.871923 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34b1e21e-6f61-4269-83c4-bd3e3978722c-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ws4f4\" (UID: \"34b1e21e-6f61-4269-83c4-bd3e3978722c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ws4f4" Jun 05 03:54:14.880173 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:14.880148 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x92r\" (UniqueName: \"kubernetes.io/projected/34b1e21e-6f61-4269-83c4-bd3e3978722c-kube-api-access-2x92r\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ws4f4\" (UID: \"34b1e21e-6f61-4269-83c4-bd3e3978722c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ws4f4" Jun 05 03:54:14.903955 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:14.903924 2548 generic.go:356] "Generic (PLEG): container finished" podID="9e7b56ab-1856-4718-af84-c14bc9240a72" containerID="b083036b189fb5f0c777c5a0a296f3ec47cdf0abb9bb18beca61d9a2c0066e3c" exitCode=0 Jun 05 03:54:14.904040 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:14.904008 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1twvlk" event={"ID":"9e7b56ab-1856-4718-af84-c14bc9240a72","Type":"ContainerDied","Data":"b083036b189fb5f0c777c5a0a296f3ec47cdf0abb9bb18beca61d9a2c0066e3c"} Jun 05 03:54:14.904103 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:14.904060 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1twvlk" event={"ID":"9e7b56ab-1856-4718-af84-c14bc9240a72","Type":"ContainerStarted","Data":"f544d1af1f8d6a270d366bd011d96a165d14f2e4d396904f4916e83b213a58b3"} Jun 05 03:54:14.906018 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:14.905998 2548 generic.go:356] "Generic (PLEG): container finished" podID="01ee2609-c3b9-4cb8-8ab5-46b0577a5952" containerID="5a970540070167cc2bcc916351dfdd4c5a685fa9fe8789f304e3749005ea4c47" exitCode=0 Jun 05 03:54:14.906105 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:14.906027 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759phkhd" event={"ID":"01ee2609-c3b9-4cb8-8ab5-46b0577a5952","Type":"ContainerDied","Data":"5a970540070167cc2bcc916351dfdd4c5a685fa9fe8789f304e3749005ea4c47"} Jun 05 03:54:14.950923 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:14.950896 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ws4f4" Jun 05 03:54:15.019689 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:15.019661 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wf7b"] Jun 05 03:54:15.023594 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:15.023562 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wf7b" Jun 05 03:54:15.033286 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:15.033263 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wf7b"] Jun 05 03:54:15.111010 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:15.110983 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ws4f4"] Jun 05 03:54:15.112241 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:54:15.112205 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34b1e21e_6f61_4269_83c4_bd3e3978722c.slice/crio-010cba456da7479472a39af16dfa3685a6a971aaf858313253efa8920aca29b3 WatchSource:0}: Error finding container 010cba456da7479472a39af16dfa3685a6a971aaf858313253efa8920aca29b3: Status 404 returned error can't find the container with id 010cba456da7479472a39af16dfa3685a6a971aaf858313253efa8920aca29b3 Jun 05 03:54:15.174700 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:15.174676 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7e9c9f4-e61b-45da-a63b-62600ee518b4-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wf7b\" (UID: \"b7e9c9f4-e61b-45da-a63b-62600ee518b4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wf7b" Jun 05 03:54:15.174775 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:15.174758 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcqzp\" (UniqueName: \"kubernetes.io/projected/b7e9c9f4-e61b-45da-a63b-62600ee518b4-kube-api-access-zcqzp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wf7b\" (UID: \"b7e9c9f4-e61b-45da-a63b-62600ee518b4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wf7b" Jun 05 03:54:15.174817 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:15.174801 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7e9c9f4-e61b-45da-a63b-62600ee518b4-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wf7b\" (UID: \"b7e9c9f4-e61b-45da-a63b-62600ee518b4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wf7b" Jun 05 03:54:15.275879 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:15.275797 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7e9c9f4-e61b-45da-a63b-62600ee518b4-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wf7b\" (UID: \"b7e9c9f4-e61b-45da-a63b-62600ee518b4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wf7b" Jun 05 03:54:15.275879 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:15.275865 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcqzp\" (UniqueName: \"kubernetes.io/projected/b7e9c9f4-e61b-45da-a63b-62600ee518b4-kube-api-access-zcqzp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wf7b\" (UID: \"b7e9c9f4-e61b-45da-a63b-62600ee518b4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wf7b" Jun 05 03:54:15.276249 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:15.275900 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7e9c9f4-e61b-45da-a63b-62600ee518b4-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wf7b\" (UID: \"b7e9c9f4-e61b-45da-a63b-62600ee518b4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wf7b" Jun 05 03:54:15.276249 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:15.276189 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7e9c9f4-e61b-45da-a63b-62600ee518b4-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wf7b\" (UID: \"b7e9c9f4-e61b-45da-a63b-62600ee518b4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wf7b" Jun 05 03:54:15.276316 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:15.276246 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7e9c9f4-e61b-45da-a63b-62600ee518b4-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wf7b\" (UID: \"b7e9c9f4-e61b-45da-a63b-62600ee518b4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wf7b" Jun 05 03:54:15.284083 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:15.284060 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcqzp\" (UniqueName: \"kubernetes.io/projected/b7e9c9f4-e61b-45da-a63b-62600ee518b4-kube-api-access-zcqzp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wf7b\" (UID: \"b7e9c9f4-e61b-45da-a63b-62600ee518b4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wf7b" Jun 05 03:54:15.337918 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:15.337887 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wf7b" Jun 05 03:54:15.472763 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:15.472738 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wf7b"] Jun 05 03:54:15.474516 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:54:15.474492 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7e9c9f4_e61b_45da_a63b_62600ee518b4.slice/crio-7ae039c97584b20cba9eaa6cfe1a957b62649a57661afd59344f7acec273828e WatchSource:0}: Error finding container 7ae039c97584b20cba9eaa6cfe1a957b62649a57661afd59344f7acec273828e: Status 404 returned error can't find the container with id 7ae039c97584b20cba9eaa6cfe1a957b62649a57661afd59344f7acec273828e Jun 05 03:54:15.913350 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:15.913259 2548 generic.go:356] "Generic (PLEG): container finished" podID="01ee2609-c3b9-4cb8-8ab5-46b0577a5952" containerID="8755296875dd2d4712277b0ef93844395a20108d461f392158669b9141b64751" exitCode=0 Jun 05 03:54:15.913524 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:15.913349 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759phkhd" event={"ID":"01ee2609-c3b9-4cb8-8ab5-46b0577a5952","Type":"ContainerDied","Data":"8755296875dd2d4712277b0ef93844395a20108d461f392158669b9141b64751"} Jun 05 03:54:15.915167 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:15.915147 2548 generic.go:356] "Generic (PLEG): container finished" podID="9e7b56ab-1856-4718-af84-c14bc9240a72" containerID="1f52975a7562bfbfb44d149155f1d17478ddf342022262697233a245663de1d5" exitCode=0 Jun 05 03:54:15.915253 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:15.915234 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1twvlk" event={"ID":"9e7b56ab-1856-4718-af84-c14bc9240a72","Type":"ContainerDied","Data":"1f52975a7562bfbfb44d149155f1d17478ddf342022262697233a245663de1d5"} Jun 05 03:54:15.916893 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:15.916874 2548 generic.go:356] "Generic (PLEG): container finished" podID="b7e9c9f4-e61b-45da-a63b-62600ee518b4" containerID="6e3e0b552f03caaad14baeed06598c0029c0d884d796796cc4a439051e918f0a" exitCode=0 Jun 05 03:54:15.916982 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:15.916953 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wf7b" event={"ID":"b7e9c9f4-e61b-45da-a63b-62600ee518b4","Type":"ContainerDied","Data":"6e3e0b552f03caaad14baeed06598c0029c0d884d796796cc4a439051e918f0a"} Jun 05 03:54:15.917040 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:15.916997 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wf7b" event={"ID":"b7e9c9f4-e61b-45da-a63b-62600ee518b4","Type":"ContainerStarted","Data":"7ae039c97584b20cba9eaa6cfe1a957b62649a57661afd59344f7acec273828e"} Jun 05 03:54:15.917383 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:15.917365 2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 03:54:15.918604 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:15.918582 2548 generic.go:356] "Generic (PLEG): container finished" podID="34b1e21e-6f61-4269-83c4-bd3e3978722c" containerID="aaf5dd1a4d7115bb1f3031cc4cf96d5fc56cf70eb7bce19197957db80a50a2cf" exitCode=0 Jun 05 03:54:15.918699 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:15.918662 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ws4f4" event={"ID":"34b1e21e-6f61-4269-83c4-bd3e3978722c","Type":"ContainerDied","Data":"aaf5dd1a4d7115bb1f3031cc4cf96d5fc56cf70eb7bce19197957db80a50a2cf"} Jun 05 03:54:15.918748 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:15.918701 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ws4f4" event={"ID":"34b1e21e-6f61-4269-83c4-bd3e3978722c","Type":"ContainerStarted","Data":"010cba456da7479472a39af16dfa3685a6a971aaf858313253efa8920aca29b3"} Jun 05 03:54:16.928731 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:16.928698 2548 generic.go:356] "Generic (PLEG): container finished" podID="9e7b56ab-1856-4718-af84-c14bc9240a72" containerID="c1bc404d8bc18ede9a84e32ee98140aa779536ec81c8f9e6e25b28eabf6301a3" exitCode=0 Jun 05 03:54:16.929112 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:16.928791 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1twvlk" event={"ID":"9e7b56ab-1856-4718-af84-c14bc9240a72","Type":"ContainerDied","Data":"c1bc404d8bc18ede9a84e32ee98140aa779536ec81c8f9e6e25b28eabf6301a3"} Jun 05 03:54:16.930675 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:16.930652 2548 generic.go:356] "Generic (PLEG): container finished" podID="b7e9c9f4-e61b-45da-a63b-62600ee518b4" containerID="81cf115b23f5f4ab996908b1ea7d97c8855d38c7697079488ed22178a3d274fb" exitCode=0 Jun 05 03:54:16.930788 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:16.930731 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wf7b" event={"ID":"b7e9c9f4-e61b-45da-a63b-62600ee518b4","Type":"ContainerDied","Data":"81cf115b23f5f4ab996908b1ea7d97c8855d38c7697079488ed22178a3d274fb"} Jun 05 03:54:16.932697 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:16.932669 2548 generic.go:356] "Generic (PLEG): container finished" podID="34b1e21e-6f61-4269-83c4-bd3e3978722c" containerID="1f2b23f1581723097591e8fad51cbe28a4ce70a5c22be9367c0f97845ecdb73d" exitCode=0 Jun 05 03:54:16.932775 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:16.932744 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ws4f4" event={"ID":"34b1e21e-6f61-4269-83c4-bd3e3978722c","Type":"ContainerDied","Data":"1f2b23f1581723097591e8fad51cbe28a4ce70a5c22be9367c0f97845ecdb73d"} Jun 05 03:54:17.069522 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:17.069485 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759phkhd" Jun 05 03:54:17.090955 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:17.090745 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/01ee2609-c3b9-4cb8-8ab5-46b0577a5952-util\") pod \"01ee2609-c3b9-4cb8-8ab5-46b0577a5952\" (UID: \"01ee2609-c3b9-4cb8-8ab5-46b0577a5952\") " Jun 05 03:54:17.090955 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:17.090814 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/01ee2609-c3b9-4cb8-8ab5-46b0577a5952-bundle\") pod \"01ee2609-c3b9-4cb8-8ab5-46b0577a5952\" (UID: \"01ee2609-c3b9-4cb8-8ab5-46b0577a5952\") " Jun 05 03:54:17.090955 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:17.090854 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ssdht\" (UniqueName: \"kubernetes.io/projected/01ee2609-c3b9-4cb8-8ab5-46b0577a5952-kube-api-access-ssdht\") pod \"01ee2609-c3b9-4cb8-8ab5-46b0577a5952\" (UID: \"01ee2609-c3b9-4cb8-8ab5-46b0577a5952\") " Jun 05 03:54:17.091327 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:17.091282 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01ee2609-c3b9-4cb8-8ab5-46b0577a5952-bundle" (OuterVolumeSpecName: "bundle") pod "01ee2609-c3b9-4cb8-8ab5-46b0577a5952" (UID: "01ee2609-c3b9-4cb8-8ab5-46b0577a5952"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:54:17.093704 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:17.093674 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01ee2609-c3b9-4cb8-8ab5-46b0577a5952-kube-api-access-ssdht" (OuterVolumeSpecName: "kube-api-access-ssdht") pod "01ee2609-c3b9-4cb8-8ab5-46b0577a5952" (UID: "01ee2609-c3b9-4cb8-8ab5-46b0577a5952"). InnerVolumeSpecName "kube-api-access-ssdht". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:54:17.099276 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:17.099215 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01ee2609-c3b9-4cb8-8ab5-46b0577a5952-util" (OuterVolumeSpecName: "util") pod "01ee2609-c3b9-4cb8-8ab5-46b0577a5952" (UID: "01ee2609-c3b9-4cb8-8ab5-46b0577a5952"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:54:17.191884 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:17.191854 2548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/01ee2609-c3b9-4cb8-8ab5-46b0577a5952-util\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:54:17.191884 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:17.191881 2548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/01ee2609-c3b9-4cb8-8ab5-46b0577a5952-bundle\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:54:17.192083 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:17.191897 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ssdht\" (UniqueName: \"kubernetes.io/projected/01ee2609-c3b9-4cb8-8ab5-46b0577a5952-kube-api-access-ssdht\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:54:17.940527 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:17.940500 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759phkhd" Jun 05 03:54:17.940974 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:17.940531 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759phkhd" event={"ID":"01ee2609-c3b9-4cb8-8ab5-46b0577a5952","Type":"ContainerDied","Data":"956b6eae8b0f37e5db6678480b125a04e76c56dfd0537fc0f1c3ad6e6e66714e"} Jun 05 03:54:17.940974 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:17.940580 2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="956b6eae8b0f37e5db6678480b125a04e76c56dfd0537fc0f1c3ad6e6e66714e" Jun 05 03:54:17.943018 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:17.942992 2548 generic.go:356] "Generic (PLEG): container finished" podID="b7e9c9f4-e61b-45da-a63b-62600ee518b4" containerID="f3a63372ff89636509fc49bde16c3fa5c4a1d959c3269a7066c14b58292957bf" exitCode=0 Jun 05 03:54:17.943363 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:17.943342 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wf7b" event={"ID":"b7e9c9f4-e61b-45da-a63b-62600ee518b4","Type":"ContainerDied","Data":"f3a63372ff89636509fc49bde16c3fa5c4a1d959c3269a7066c14b58292957bf"} Jun 05 03:54:17.945176 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:17.945158 2548 generic.go:356] "Generic (PLEG): container finished" podID="34b1e21e-6f61-4269-83c4-bd3e3978722c" containerID="503cf23d1b0df5bb3c1bea83fdbbc6ffb7bf5485b22f11e49ea0c4f4d802e3bf" exitCode=0 Jun 05 03:54:17.945252 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:17.945223 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ws4f4" event={"ID":"34b1e21e-6f61-4269-83c4-bd3e3978722c","Type":"ContainerDied","Data":"503cf23d1b0df5bb3c1bea83fdbbc6ffb7bf5485b22f11e49ea0c4f4d802e3bf"} Jun 05 03:54:18.084301 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:18.084276 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1twvlk" Jun 05 03:54:18.099516 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:18.099484 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9e7b56ab-1856-4718-af84-c14bc9240a72-util\") pod \"9e7b56ab-1856-4718-af84-c14bc9240a72\" (UID: \"9e7b56ab-1856-4718-af84-c14bc9240a72\") " Jun 05 03:54:18.099652 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:18.099523 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzkfw\" (UniqueName: \"kubernetes.io/projected/9e7b56ab-1856-4718-af84-c14bc9240a72-kube-api-access-jzkfw\") pod \"9e7b56ab-1856-4718-af84-c14bc9240a72\" (UID: \"9e7b56ab-1856-4718-af84-c14bc9240a72\") " Jun 05 03:54:18.099652 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:18.099553 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9e7b56ab-1856-4718-af84-c14bc9240a72-bundle\") pod \"9e7b56ab-1856-4718-af84-c14bc9240a72\" (UID: \"9e7b56ab-1856-4718-af84-c14bc9240a72\") " Jun 05 03:54:18.100119 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:18.100089 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e7b56ab-1856-4718-af84-c14bc9240a72-bundle" (OuterVolumeSpecName: "bundle") pod "9e7b56ab-1856-4718-af84-c14bc9240a72" (UID: "9e7b56ab-1856-4718-af84-c14bc9240a72"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:54:18.102105 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:18.102039 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e7b56ab-1856-4718-af84-c14bc9240a72-kube-api-access-jzkfw" (OuterVolumeSpecName: "kube-api-access-jzkfw") pod "9e7b56ab-1856-4718-af84-c14bc9240a72" (UID: "9e7b56ab-1856-4718-af84-c14bc9240a72"). InnerVolumeSpecName "kube-api-access-jzkfw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:54:18.107088 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:18.107063 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e7b56ab-1856-4718-af84-c14bc9240a72-util" (OuterVolumeSpecName: "util") pod "9e7b56ab-1856-4718-af84-c14bc9240a72" (UID: "9e7b56ab-1856-4718-af84-c14bc9240a72"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:54:18.200692 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:18.200599 2548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9e7b56ab-1856-4718-af84-c14bc9240a72-util\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:54:18.200692 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:18.200631 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzkfw\" (UniqueName: \"kubernetes.io/projected/9e7b56ab-1856-4718-af84-c14bc9240a72-kube-api-access-jzkfw\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:54:18.200692 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:18.200642 2548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9e7b56ab-1856-4718-af84-c14bc9240a72-bundle\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:54:18.953202 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:18.953173 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1twvlk" Jun 05 03:54:18.953680 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:18.953197 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1twvlk" event={"ID":"9e7b56ab-1856-4718-af84-c14bc9240a72","Type":"ContainerDied","Data":"f544d1af1f8d6a270d366bd011d96a165d14f2e4d396904f4916e83b213a58b3"} Jun 05 03:54:18.953680 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:18.953246 2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f544d1af1f8d6a270d366bd011d96a165d14f2e4d396904f4916e83b213a58b3" Jun 05 03:54:19.098081 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.098046 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wf7b" Jun 05 03:54:19.108898 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.108868 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7e9c9f4-e61b-45da-a63b-62600ee518b4-bundle\") pod \"b7e9c9f4-e61b-45da-a63b-62600ee518b4\" (UID: \"b7e9c9f4-e61b-45da-a63b-62600ee518b4\") " Jun 05 03:54:19.109015 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.108958 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zcqzp\" (UniqueName: \"kubernetes.io/projected/b7e9c9f4-e61b-45da-a63b-62600ee518b4-kube-api-access-zcqzp\") pod \"b7e9c9f4-e61b-45da-a63b-62600ee518b4\" (UID: \"b7e9c9f4-e61b-45da-a63b-62600ee518b4\") " Jun 05 03:54:19.109015 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.108990 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7e9c9f4-e61b-45da-a63b-62600ee518b4-util\") pod \"b7e9c9f4-e61b-45da-a63b-62600ee518b4\" (UID: \"b7e9c9f4-e61b-45da-a63b-62600ee518b4\") " Jun 05 03:54:19.109507 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.109484 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7e9c9f4-e61b-45da-a63b-62600ee518b4-bundle" (OuterVolumeSpecName: "bundle") pod "b7e9c9f4-e61b-45da-a63b-62600ee518b4" (UID: "b7e9c9f4-e61b-45da-a63b-62600ee518b4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:54:19.111292 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.111264 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7e9c9f4-e61b-45da-a63b-62600ee518b4-kube-api-access-zcqzp" (OuterVolumeSpecName: "kube-api-access-zcqzp") pod "b7e9c9f4-e61b-45da-a63b-62600ee518b4" (UID: "b7e9c9f4-e61b-45da-a63b-62600ee518b4"). InnerVolumeSpecName "kube-api-access-zcqzp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:54:19.115296 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.115268 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7e9c9f4-e61b-45da-a63b-62600ee518b4-util" (OuterVolumeSpecName: "util") pod "b7e9c9f4-e61b-45da-a63b-62600ee518b4" (UID: "b7e9c9f4-e61b-45da-a63b-62600ee518b4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:54:19.128279 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.128253 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ws4f4" Jun 05 03:54:19.209638 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.209552 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34b1e21e-6f61-4269-83c4-bd3e3978722c-bundle\") pod \"34b1e21e-6f61-4269-83c4-bd3e3978722c\" (UID: \"34b1e21e-6f61-4269-83c4-bd3e3978722c\") " Jun 05 03:54:19.209638 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.209600 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34b1e21e-6f61-4269-83c4-bd3e3978722c-util\") pod \"34b1e21e-6f61-4269-83c4-bd3e3978722c\" (UID: \"34b1e21e-6f61-4269-83c4-bd3e3978722c\") " Jun 05 03:54:19.209823 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.209677 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2x92r\" (UniqueName: \"kubernetes.io/projected/34b1e21e-6f61-4269-83c4-bd3e3978722c-kube-api-access-2x92r\") pod \"34b1e21e-6f61-4269-83c4-bd3e3978722c\" (UID: \"34b1e21e-6f61-4269-83c4-bd3e3978722c\") " Jun 05 03:54:19.209911 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.209894 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zcqzp\" (UniqueName: \"kubernetes.io/projected/b7e9c9f4-e61b-45da-a63b-62600ee518b4-kube-api-access-zcqzp\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:54:19.209959 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.209918 2548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7e9c9f4-e61b-45da-a63b-62600ee518b4-util\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:54:19.209959 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.209933 2548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7e9c9f4-e61b-45da-a63b-62600ee518b4-bundle\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:54:19.210075 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.210048 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34b1e21e-6f61-4269-83c4-bd3e3978722c-bundle" (OuterVolumeSpecName: "bundle") pod "34b1e21e-6f61-4269-83c4-bd3e3978722c" (UID: "34b1e21e-6f61-4269-83c4-bd3e3978722c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:54:19.212014 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.211993 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34b1e21e-6f61-4269-83c4-bd3e3978722c-kube-api-access-2x92r" (OuterVolumeSpecName: "kube-api-access-2x92r") pod "34b1e21e-6f61-4269-83c4-bd3e3978722c" (UID: "34b1e21e-6f61-4269-83c4-bd3e3978722c"). InnerVolumeSpecName "kube-api-access-2x92r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:54:19.214324 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.214300 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34b1e21e-6f61-4269-83c4-bd3e3978722c-util" (OuterVolumeSpecName: "util") pod "34b1e21e-6f61-4269-83c4-bd3e3978722c" (UID: "34b1e21e-6f61-4269-83c4-bd3e3978722c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:54:19.310727 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.310688 2548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34b1e21e-6f61-4269-83c4-bd3e3978722c-bundle\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:54:19.310727 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.310719 2548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34b1e21e-6f61-4269-83c4-bd3e3978722c-util\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:54:19.310727 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.310729 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2x92r\" (UniqueName: \"kubernetes.io/projected/34b1e21e-6f61-4269-83c4-bd3e3978722c-kube-api-access-2x92r\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:54:19.907062 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.907027 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cb7c9c94-rl8kc"] Jun 05 03:54:19.907579 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.907562 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01ee2609-c3b9-4cb8-8ab5-46b0577a5952" containerName="util" Jun 05 03:54:19.907641 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.907581 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="01ee2609-c3b9-4cb8-8ab5-46b0577a5952" containerName="util" Jun 05 03:54:19.907641 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.907596 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e7b56ab-1856-4718-af84-c14bc9240a72" containerName="pull" Jun 05 03:54:19.907641 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.907601 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e7b56ab-1856-4718-af84-c14bc9240a72" containerName="pull" Jun 05 03:54:19.907641 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.907609 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e7b56ab-1856-4718-af84-c14bc9240a72" containerName="util" Jun 05 03:54:19.907641 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.907614 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e7b56ab-1856-4718-af84-c14bc9240a72" containerName="util" Jun 05 03:54:19.907641 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.907623 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01ee2609-c3b9-4cb8-8ab5-46b0577a5952" containerName="pull" Jun 05 03:54:19.907641 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.907628 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="01ee2609-c3b9-4cb8-8ab5-46b0577a5952" containerName="pull" Jun 05 03:54:19.907641 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.907633 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34b1e21e-6f61-4269-83c4-bd3e3978722c" containerName="util" Jun 05 03:54:19.907641 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.907637 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="34b1e21e-6f61-4269-83c4-bd3e3978722c" containerName="util" Jun 05 03:54:19.907641 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.907642 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e7b56ab-1856-4718-af84-c14bc9240a72" containerName="extract" Jun 05 03:54:19.907940 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.907647 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e7b56ab-1856-4718-af84-c14bc9240a72" containerName="extract" Jun 05 03:54:19.907940 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.907658 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01ee2609-c3b9-4cb8-8ab5-46b0577a5952" containerName="extract" Jun 05 03:54:19.907940 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.907663 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="01ee2609-c3b9-4cb8-8ab5-46b0577a5952" containerName="extract" Jun 05 03:54:19.907940 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.907671 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7e9c9f4-e61b-45da-a63b-62600ee518b4" containerName="extract" Jun 05 03:54:19.907940 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.907676 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7e9c9f4-e61b-45da-a63b-62600ee518b4" containerName="extract" Jun 05 03:54:19.907940 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.907680 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34b1e21e-6f61-4269-83c4-bd3e3978722c" containerName="extract" Jun 05 03:54:19.907940 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.907685 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="34b1e21e-6f61-4269-83c4-bd3e3978722c" containerName="extract" Jun 05 03:54:19.907940 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.907693 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7e9c9f4-e61b-45da-a63b-62600ee518b4" containerName="util" Jun 05 03:54:19.907940 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.907698 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7e9c9f4-e61b-45da-a63b-62600ee518b4" containerName="util" Jun 05 03:54:19.907940 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.907703 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34b1e21e-6f61-4269-83c4-bd3e3978722c" containerName="pull" Jun 05 03:54:19.907940 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.907708 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="34b1e21e-6f61-4269-83c4-bd3e3978722c" containerName="pull" Jun 05 03:54:19.907940 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.907715 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7e9c9f4-e61b-45da-a63b-62600ee518b4" containerName="pull" Jun 05 03:54:19.907940 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.907720 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7e9c9f4-e61b-45da-a63b-62600ee518b4" containerName="pull" Jun 05 03:54:19.907940 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.907780 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e7b56ab-1856-4718-af84-c14bc9240a72" containerName="extract" Jun 05 03:54:19.907940 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.907786 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7e9c9f4-e61b-45da-a63b-62600ee518b4" containerName="extract" Jun 05 03:54:19.907940 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.907793 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="01ee2609-c3b9-4cb8-8ab5-46b0577a5952" containerName="extract" Jun 05 03:54:19.907940 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.907798 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="34b1e21e-6f61-4269-83c4-bd3e3978722c" containerName="extract" Jun 05 03:54:19.911013 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.910998 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb7c9c94-rl8kc" Jun 05 03:54:19.923157 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.923126 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cb7c9c94-rl8kc"] Jun 05 03:54:19.960574 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.960536 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wf7b" event={"ID":"b7e9c9f4-e61b-45da-a63b-62600ee518b4","Type":"ContainerDied","Data":"7ae039c97584b20cba9eaa6cfe1a957b62649a57661afd59344f7acec273828e"} Jun 05 03:54:19.961027 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.960596 2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7ae039c97584b20cba9eaa6cfe1a957b62649a57661afd59344f7acec273828e" Jun 05 03:54:19.961027 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.960546 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wf7b" Jun 05 03:54:19.962651 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.962625 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ws4f4" event={"ID":"34b1e21e-6f61-4269-83c4-bd3e3978722c","Type":"ContainerDied","Data":"010cba456da7479472a39af16dfa3685a6a971aaf858313253efa8920aca29b3"} Jun 05 03:54:19.962820 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.962801 2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="010cba456da7479472a39af16dfa3685a6a971aaf858313253efa8920aca29b3" Jun 05 03:54:19.962820 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:19.962642 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ws4f4" Jun 05 03:54:20.017368 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:20.017326 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cn4g\" (UniqueName: \"kubernetes.io/projected/6c3cfaa0-b130-44c7-b056-822f8bf2ce22-kube-api-access-8cn4g\") pod \"console-5cb7c9c94-rl8kc\" (UID: \"6c3cfaa0-b130-44c7-b056-822f8bf2ce22\") " pod="openshift-console/console-5cb7c9c94-rl8kc" Jun 05 03:54:20.017594 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:20.017384 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c3cfaa0-b130-44c7-b056-822f8bf2ce22-oauth-serving-cert\") pod \"console-5cb7c9c94-rl8kc\" (UID: \"6c3cfaa0-b130-44c7-b056-822f8bf2ce22\") " pod="openshift-console/console-5cb7c9c94-rl8kc" Jun 05 03:54:20.017594 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:20.017463 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c3cfaa0-b130-44c7-b056-822f8bf2ce22-console-oauth-config\") pod \"console-5cb7c9c94-rl8kc\" (UID: \"6c3cfaa0-b130-44c7-b056-822f8bf2ce22\") " pod="openshift-console/console-5cb7c9c94-rl8kc" Jun 05 03:54:20.017594 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:20.017522 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c3cfaa0-b130-44c7-b056-822f8bf2ce22-console-serving-cert\") pod \"console-5cb7c9c94-rl8kc\" (UID: \"6c3cfaa0-b130-44c7-b056-822f8bf2ce22\") " pod="openshift-console/console-5cb7c9c94-rl8kc" Jun 05 03:54:20.017594 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:20.017569 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c3cfaa0-b130-44c7-b056-822f8bf2ce22-console-config\") pod \"console-5cb7c9c94-rl8kc\" (UID: \"6c3cfaa0-b130-44c7-b056-822f8bf2ce22\") " pod="openshift-console/console-5cb7c9c94-rl8kc" Jun 05 03:54:20.017594 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:20.017589 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c3cfaa0-b130-44c7-b056-822f8bf2ce22-service-ca\") pod \"console-5cb7c9c94-rl8kc\" (UID: \"6c3cfaa0-b130-44c7-b056-822f8bf2ce22\") " pod="openshift-console/console-5cb7c9c94-rl8kc" Jun 05 03:54:20.017777 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:20.017604 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c3cfaa0-b130-44c7-b056-822f8bf2ce22-trusted-ca-bundle\") pod \"console-5cb7c9c94-rl8kc\" (UID: \"6c3cfaa0-b130-44c7-b056-822f8bf2ce22\") " pod="openshift-console/console-5cb7c9c94-rl8kc" Jun 05 03:54:20.118638 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:20.118591 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cn4g\" (UniqueName: \"kubernetes.io/projected/6c3cfaa0-b130-44c7-b056-822f8bf2ce22-kube-api-access-8cn4g\") pod \"console-5cb7c9c94-rl8kc\" (UID: \"6c3cfaa0-b130-44c7-b056-822f8bf2ce22\") " pod="openshift-console/console-5cb7c9c94-rl8kc" Jun 05 03:54:20.118838 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:20.118662 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c3cfaa0-b130-44c7-b056-822f8bf2ce22-oauth-serving-cert\") pod \"console-5cb7c9c94-rl8kc\" (UID: \"6c3cfaa0-b130-44c7-b056-822f8bf2ce22\") " pod="openshift-console/console-5cb7c9c94-rl8kc" Jun 05 03:54:20.118838 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:20.118689 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c3cfaa0-b130-44c7-b056-822f8bf2ce22-console-oauth-config\") pod \"console-5cb7c9c94-rl8kc\" (UID: \"6c3cfaa0-b130-44c7-b056-822f8bf2ce22\") " pod="openshift-console/console-5cb7c9c94-rl8kc" Jun 05 03:54:20.118838 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:20.118718 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c3cfaa0-b130-44c7-b056-822f8bf2ce22-console-serving-cert\") pod \"console-5cb7c9c94-rl8kc\" (UID: \"6c3cfaa0-b130-44c7-b056-822f8bf2ce22\") " pod="openshift-console/console-5cb7c9c94-rl8kc" Jun 05 03:54:20.118838 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:20.118761 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c3cfaa0-b130-44c7-b056-822f8bf2ce22-console-config\") pod \"console-5cb7c9c94-rl8kc\" (UID: \"6c3cfaa0-b130-44c7-b056-822f8bf2ce22\") " pod="openshift-console/console-5cb7c9c94-rl8kc" Jun 05 03:54:20.118838 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:20.118787 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c3cfaa0-b130-44c7-b056-822f8bf2ce22-service-ca\") pod \"console-5cb7c9c94-rl8kc\" (UID: \"6c3cfaa0-b130-44c7-b056-822f8bf2ce22\") " pod="openshift-console/console-5cb7c9c94-rl8kc" Jun 05 03:54:20.118838 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:20.118809 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c3cfaa0-b130-44c7-b056-822f8bf2ce22-trusted-ca-bundle\") pod \"console-5cb7c9c94-rl8kc\" (UID: \"6c3cfaa0-b130-44c7-b056-822f8bf2ce22\") " pod="openshift-console/console-5cb7c9c94-rl8kc" Jun 05 03:54:20.119382 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:20.119355 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c3cfaa0-b130-44c7-b056-822f8bf2ce22-console-config\") pod \"console-5cb7c9c94-rl8kc\" (UID: \"6c3cfaa0-b130-44c7-b056-822f8bf2ce22\") " pod="openshift-console/console-5cb7c9c94-rl8kc" Jun 05 03:54:20.119540 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:20.119519 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c3cfaa0-b130-44c7-b056-822f8bf2ce22-oauth-serving-cert\") pod \"console-5cb7c9c94-rl8kc\" (UID: \"6c3cfaa0-b130-44c7-b056-822f8bf2ce22\") " pod="openshift-console/console-5cb7c9c94-rl8kc" Jun 05 03:54:20.119540 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:20.119519 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c3cfaa0-b130-44c7-b056-822f8bf2ce22-service-ca\") pod \"console-5cb7c9c94-rl8kc\" (UID: \"6c3cfaa0-b130-44c7-b056-822f8bf2ce22\") " pod="openshift-console/console-5cb7c9c94-rl8kc" Jun 05 03:54:20.119813 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:20.119684 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c3cfaa0-b130-44c7-b056-822f8bf2ce22-trusted-ca-bundle\") pod \"console-5cb7c9c94-rl8kc\" (UID: \"6c3cfaa0-b130-44c7-b056-822f8bf2ce22\") " pod="openshift-console/console-5cb7c9c94-rl8kc" Jun 05 03:54:20.121525 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:20.121504 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c3cfaa0-b130-44c7-b056-822f8bf2ce22-console-serving-cert\") pod \"console-5cb7c9c94-rl8kc\" (UID: \"6c3cfaa0-b130-44c7-b056-822f8bf2ce22\") " pod="openshift-console/console-5cb7c9c94-rl8kc" Jun 05 03:54:20.121609 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:20.121577 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c3cfaa0-b130-44c7-b056-822f8bf2ce22-console-oauth-config\") pod \"console-5cb7c9c94-rl8kc\" (UID: \"6c3cfaa0-b130-44c7-b056-822f8bf2ce22\") " pod="openshift-console/console-5cb7c9c94-rl8kc" Jun 05 03:54:20.126784 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:20.126764 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cn4g\" (UniqueName: \"kubernetes.io/projected/6c3cfaa0-b130-44c7-b056-822f8bf2ce22-kube-api-access-8cn4g\") pod \"console-5cb7c9c94-rl8kc\" (UID: \"6c3cfaa0-b130-44c7-b056-822f8bf2ce22\") " pod="openshift-console/console-5cb7c9c94-rl8kc" Jun 05 03:54:20.220988 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:20.220891 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb7c9c94-rl8kc" Jun 05 03:54:20.380865 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:20.380837 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cb7c9c94-rl8kc"] Jun 05 03:54:20.382128 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:54:20.382104 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c3cfaa0_b130_44c7_b056_822f8bf2ce22.slice/crio-9a4cffa8a2390ead829896471592d7697cea8ce4a2e810c4fa19cbd7be8a9a21 WatchSource:0}: Error finding container 9a4cffa8a2390ead829896471592d7697cea8ce4a2e810c4fa19cbd7be8a9a21: Status 404 returned error can't find the container with id 9a4cffa8a2390ead829896471592d7697cea8ce4a2e810c4fa19cbd7be8a9a21 Jun 05 03:54:20.969488 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:20.969458 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb7c9c94-rl8kc" event={"ID":"6c3cfaa0-b130-44c7-b056-822f8bf2ce22","Type":"ContainerStarted","Data":"4a7f027d905ffe4ef296d78a9f72f92be2cde5c53dfda732be33fa050af358db"} Jun 05 03:54:20.969858 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:20.969508 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb7c9c94-rl8kc" event={"ID":"6c3cfaa0-b130-44c7-b056-822f8bf2ce22","Type":"ContainerStarted","Data":"9a4cffa8a2390ead829896471592d7697cea8ce4a2e810c4fa19cbd7be8a9a21"} Jun 05 03:54:20.989298 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:20.989242 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cb7c9c94-rl8kc" podStartSLOduration=1.98922834 podStartE2EDuration="1.98922834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:54:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:54:20.986406376 +0000 UTC m=+660.256182706" watchObservedRunningTime="2026-06-05 03:54:20.98922834 +0000 UTC m=+660.259004657" Jun 05 03:54:21.216693 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:21.216655 2548 scope.go:117] "RemoveContainer" containerID="f1ff11c974880e315ab021406942ca5b9e6ebad09109229077fa52b93a0481d4" Jun 05 03:54:23.559797 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:23.559763 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-4w5c8"] Jun 05 03:54:23.564654 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:23.564635 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4w5c8" Jun 05 03:54:23.567227 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:23.567209 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-5w2lq\"" Jun 05 03:54:23.577775 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:23.577750 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-4w5c8"] Jun 05 03:54:23.650519 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:23.650491 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-279cc\" (UniqueName: \"kubernetes.io/projected/3ae6a937-ebe8-4460-9de3-c10c6591346b-kube-api-access-279cc\") pod \"authorino-operator-75cc8d5cb7-4w5c8\" (UID: \"3ae6a937-ebe8-4460-9de3-c10c6591346b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-4w5c8" Jun 05 03:54:23.752592 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:23.752547 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-279cc\" (UniqueName: \"kubernetes.io/projected/3ae6a937-ebe8-4460-9de3-c10c6591346b-kube-api-access-279cc\") pod \"authorino-operator-75cc8d5cb7-4w5c8\" (UID: \"3ae6a937-ebe8-4460-9de3-c10c6591346b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-4w5c8" Jun 05 03:54:23.765119 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:23.765085 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-279cc\" (UniqueName: \"kubernetes.io/projected/3ae6a937-ebe8-4460-9de3-c10c6591346b-kube-api-access-279cc\") pod \"authorino-operator-75cc8d5cb7-4w5c8\" (UID: \"3ae6a937-ebe8-4460-9de3-c10c6591346b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-4w5c8" Jun 05 03:54:23.875494 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:23.875385 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4w5c8" Jun 05 03:54:24.011093 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:24.011064 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-4w5c8"] Jun 05 03:54:24.012069 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:54:24.012042 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ae6a937_ebe8_4460_9de3_c10c6591346b.slice/crio-7b41ab1593e864d660c394409ea04476760c09b8841ce4a0f5a8517af3a8d71b WatchSource:0}: Error finding container 7b41ab1593e864d660c394409ea04476760c09b8841ce4a0f5a8517af3a8d71b: Status 404 returned error can't find the container with id 7b41ab1593e864d660c394409ea04476760c09b8841ce4a0f5a8517af3a8d71b Jun 05 03:54:24.995938 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:24.995890 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4w5c8" event={"ID":"3ae6a937-ebe8-4460-9de3-c10c6591346b","Type":"ContainerStarted","Data":"7b41ab1593e864d660c394409ea04476760c09b8841ce4a0f5a8517af3a8d71b"} Jun 05 03:54:27.010718 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:27.010682 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4w5c8" event={"ID":"3ae6a937-ebe8-4460-9de3-c10c6591346b","Type":"ContainerStarted","Data":"c2400ef1369aa5571db85c61721f8b8f170e035f6c52ed6339809339e549a62b"} Jun 05 03:54:27.011126 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:27.010810 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4w5c8" Jun 05 03:54:27.031061 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:27.030998 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4w5c8" podStartSLOduration=1.805634935 podStartE2EDuration="4.030982305s" totalImagesPullingTime="2.22534737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:54:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:54:27.028384701 +0000 UTC m=+666.298161020" watchObservedRunningTime="2026-06-05 03:54:27.030982305 +0000 UTC m=+666.300758622" Jun 05 03:54:30.221611 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:30.221566 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cb7c9c94-rl8kc" Jun 05 03:54:30.222032 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:30.221637 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cb7c9c94-rl8kc" Jun 05 03:54:30.226397 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:30.226373 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cb7c9c94-rl8kc" Jun 05 03:54:31.037892 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:31.037865 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cb7c9c94-rl8kc" Jun 05 03:54:31.087538 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:31.087505 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57b876f5b8-hf8kx"] Jun 05 03:54:32.200900 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:32.200862 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4v5k9"] Jun 05 03:54:32.204543 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:32.204524 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4v5k9" Jun 05 03:54:32.208735 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:32.208712 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-c94xh\"" Jun 05 03:54:32.219038 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:32.219013 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4v5k9"] Jun 05 03:54:32.335065 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:32.335024 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc497252-6a7a-448f-8ce5-07ecadb8d9bd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4v5k9\" (UID: \"cc497252-6a7a-448f-8ce5-07ecadb8d9bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4v5k9" Jun 05 03:54:32.335262 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:32.335224 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blglb\" (UniqueName: \"kubernetes.io/projected/cc497252-6a7a-448f-8ce5-07ecadb8d9bd-kube-api-access-blglb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4v5k9\" (UID: \"cc497252-6a7a-448f-8ce5-07ecadb8d9bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4v5k9" Jun 05 03:54:32.436579 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:32.436533 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc497252-6a7a-448f-8ce5-07ecadb8d9bd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4v5k9\" (UID: \"cc497252-6a7a-448f-8ce5-07ecadb8d9bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4v5k9" Jun 05 03:54:32.436779 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:32.436636 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blglb\" (UniqueName: \"kubernetes.io/projected/cc497252-6a7a-448f-8ce5-07ecadb8d9bd-kube-api-access-blglb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4v5k9\" (UID: \"cc497252-6a7a-448f-8ce5-07ecadb8d9bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4v5k9" Jun 05 03:54:32.436957 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:32.436933 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc497252-6a7a-448f-8ce5-07ecadb8d9bd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4v5k9\" (UID: \"cc497252-6a7a-448f-8ce5-07ecadb8d9bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4v5k9" Jun 05 03:54:32.455485 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:32.455406 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blglb\" (UniqueName: \"kubernetes.io/projected/cc497252-6a7a-448f-8ce5-07ecadb8d9bd-kube-api-access-blglb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4v5k9\" (UID: \"cc497252-6a7a-448f-8ce5-07ecadb8d9bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4v5k9" Jun 05 03:54:32.515368 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:32.515330 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4v5k9" Jun 05 03:54:32.674333 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:32.671834 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4v5k9"] Jun 05 03:54:32.674764 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:54:32.674679 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc497252_6a7a_448f_8ce5_07ecadb8d9bd.slice/crio-e7a6aad150390ceb6d3d55fe52434b3601210b757569324025be0f16dee5aa4f WatchSource:0}: Error finding container e7a6aad150390ceb6d3d55fe52434b3601210b757569324025be0f16dee5aa4f: Status 404 returned error can't find the container with id e7a6aad150390ceb6d3d55fe52434b3601210b757569324025be0f16dee5aa4f Jun 05 03:54:33.046499 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:33.046466 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4v5k9" event={"ID":"cc497252-6a7a-448f-8ce5-07ecadb8d9bd","Type":"ContainerStarted","Data":"e7a6aad150390ceb6d3d55fe52434b3601210b757569324025be0f16dee5aa4f"} Jun 05 03:54:38.018909 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:38.018882 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4w5c8" Jun 05 03:54:38.078118 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:38.078083 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4v5k9" event={"ID":"cc497252-6a7a-448f-8ce5-07ecadb8d9bd","Type":"ContainerStarted","Data":"cf3c6cec4f5eb1fd3e0745b2c16241bb61d51e30ac3b507aae19de98a7ad39b9"} Jun 05 03:54:38.078326 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:38.078144 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4v5k9" Jun 05 03:54:38.096229 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:38.096175 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4v5k9" podStartSLOduration=1.109115338 podStartE2EDuration="6.096158496s" totalImagesPullingTime="4.987043158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:54:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:54:38.09501853 +0000 UTC m=+677.364794860" watchObservedRunningTime="2026-06-05 03:54:38.096158496 +0000 UTC m=+677.365934813" Jun 05 03:54:49.086354 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:49.086320 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4v5k9" Jun 05 03:54:50.303464 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:50.303414 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pk25c"] Jun 05 03:54:50.306544 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:50.306523 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pk25c" Jun 05 03:54:50.318161 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:50.318131 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pk25c"] Jun 05 03:54:50.407010 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:50.406979 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mqx2\" (UniqueName: \"kubernetes.io/projected/48b70903-d6b0-445f-b0e3-438a63bddcdf-kube-api-access-6mqx2\") pod \"kuadrant-operator-controller-manager-55467d9f7-pk25c\" (UID: \"48b70903-d6b0-445f-b0e3-438a63bddcdf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pk25c" Jun 05 03:54:50.407010 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:50.407016 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/48b70903-d6b0-445f-b0e3-438a63bddcdf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-pk25c\" (UID: \"48b70903-d6b0-445f-b0e3-438a63bddcdf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pk25c" Jun 05 03:54:50.508390 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:50.508355 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mqx2\" (UniqueName: \"kubernetes.io/projected/48b70903-d6b0-445f-b0e3-438a63bddcdf-kube-api-access-6mqx2\") pod \"kuadrant-operator-controller-manager-55467d9f7-pk25c\" (UID: \"48b70903-d6b0-445f-b0e3-438a63bddcdf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pk25c" Jun 05 03:54:50.508591 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:50.508399 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/48b70903-d6b0-445f-b0e3-438a63bddcdf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-pk25c\" (UID: \"48b70903-d6b0-445f-b0e3-438a63bddcdf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pk25c" Jun 05 03:54:50.508744 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:50.508726 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/48b70903-d6b0-445f-b0e3-438a63bddcdf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-pk25c\" (UID: \"48b70903-d6b0-445f-b0e3-438a63bddcdf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pk25c" Jun 05 03:54:50.516710 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:50.516688 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mqx2\" (UniqueName: \"kubernetes.io/projected/48b70903-d6b0-445f-b0e3-438a63bddcdf-kube-api-access-6mqx2\") pod \"kuadrant-operator-controller-manager-55467d9f7-pk25c\" (UID: \"48b70903-d6b0-445f-b0e3-438a63bddcdf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pk25c" Jun 05 03:54:50.617883 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:50.617793 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pk25c" Jun 05 03:54:50.719129 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:50.719085 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pk25c"] Jun 05 03:54:50.722266 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:50.722234 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pk25c"] Jun 05 03:54:50.741257 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:50.741217 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2r9b4"] Jun 05 03:54:50.743819 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:50.743800 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2r9b4" Jun 05 03:54:50.759058 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:50.757733 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4v5k9"] Jun 05 03:54:50.759058 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:50.757935 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4v5k9" podUID="cc497252-6a7a-448f-8ce5-07ecadb8d9bd" containerName="manager" containerID="cri-o://cf3c6cec4f5eb1fd3e0745b2c16241bb61d51e30ac3b507aae19de98a7ad39b9" gracePeriod=2 Jun 05 03:54:50.764030 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:50.764004 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2r9b4"] Jun 05 03:54:50.767026 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:50.767003 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4v5k9"] Jun 05 03:54:50.788056 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:54:50.788007 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4v5k9\" is forbidden: User \"system:node:ip-10-0-132-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-53.ec2.internal' and this object" podUID="cc497252-6a7a-448f-8ce5-07ecadb8d9bd" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4v5k9" Jun 05 03:54:50.893288 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:54:50.893245 2548 log.go:32] "RunPodSandbox from runtime service failed" err=< Jun 05 03:54:50.893288 ip-10-0-132-53 kubenswrapper[2548]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-pk25c_kuadrant-system_48b70903-d6b0-445f-b0e3-438a63bddcdf_0(23fdbc622ead5d4ec480dce4e1c2f3ed7b76d47e7cf700e0b3406b4f8cf4f8f5): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-pk25c to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"23fdbc622ead5d4ec480dce4e1c2f3ed7b76d47e7cf700e0b3406b4f8cf4f8f5" Netns:"/var/run/netns/378c5a98-292e-44a1-8b2d-3c3bfd4041f0" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-pk25c;K8S_POD_INFRA_CONTAINER_ID=23fdbc622ead5d4ec480dce4e1c2f3ed7b76d47e7cf700e0b3406b4f8cf4f8f5;K8S_POD_UID=48b70903-d6b0-445f-b0e3-438a63bddcdf" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pk25c] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pk25c/48b70903-d6b0-445f-b0e3-438a63bddcdf:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pk25c 23fdbc622ead5d4ec480dce4e1c2f3ed7b76d47e7cf700e0b3406b4f8cf4f8f5 network default NAD default NAD key default] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pk25c 23fdbc622ead5d4ec480dce4e1c2f3ed7b76d47e7cf700e0b3406b4f8cf4f8f5 network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:85:00:30 [10.133.0.48/23] Jun 05 03:54:50.893288 ip-10-0-132-53 kubenswrapper[2548]: ' Jun 05 03:54:50.893288 ip-10-0-132-53 kubenswrapper[2548]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jun 05 03:54:50.893288 ip-10-0-132-53 kubenswrapper[2548]: > Jun 05 03:54:50.893606 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:54:50.893326 2548 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=< Jun 05 03:54:50.893606 ip-10-0-132-53 kubenswrapper[2548]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-pk25c_kuadrant-system_48b70903-d6b0-445f-b0e3-438a63bddcdf_0(23fdbc622ead5d4ec480dce4e1c2f3ed7b76d47e7cf700e0b3406b4f8cf4f8f5): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-pk25c to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"23fdbc622ead5d4ec480dce4e1c2f3ed7b76d47e7cf700e0b3406b4f8cf4f8f5" Netns:"/var/run/netns/378c5a98-292e-44a1-8b2d-3c3bfd4041f0" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-pk25c;K8S_POD_INFRA_CONTAINER_ID=23fdbc622ead5d4ec480dce4e1c2f3ed7b76d47e7cf700e0b3406b4f8cf4f8f5;K8S_POD_UID=48b70903-d6b0-445f-b0e3-438a63bddcdf" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pk25c] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pk25c/48b70903-d6b0-445f-b0e3-438a63bddcdf:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pk25c 23fdbc622ead5d4ec480dce4e1c2f3ed7b76d47e7cf700e0b3406b4f8cf4f8f5 network default NAD default NAD key default] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pk25c 23fdbc622ead5d4ec480dce4e1c2f3ed7b76d47e7cf700e0b3406b4f8cf4f8f5 network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:85:00:30 [10.133.0.48/23] Jun 05 03:54:50.893606 ip-10-0-132-53 kubenswrapper[2548]: ' Jun 05 03:54:50.893606 ip-10-0-132-53 kubenswrapper[2548]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jun 05 03:54:50.893606 ip-10-0-132-53 kubenswrapper[2548]: > pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pk25c" Jun 05 03:54:50.911729 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:50.911698 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9b2422b-d931-4ad6-b20d-180696c08d34-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-2r9b4\" (UID: \"d9b2422b-d931-4ad6-b20d-180696c08d34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2r9b4" Jun 05 03:54:50.911859 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:50.911823 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsvb6\" (UniqueName: \"kubernetes.io/projected/d9b2422b-d931-4ad6-b20d-180696c08d34-kube-api-access-hsvb6\") pod \"kuadrant-operator-controller-manager-55467d9f7-2r9b4\" (UID: \"d9b2422b-d931-4ad6-b20d-180696c08d34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2r9b4" Jun 05 03:54:50.999552 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:50.999529 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4v5k9" Jun 05 03:54:51.001913 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:54:51.001888 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4v5k9\" is forbidden: User \"system:node:ip-10-0-132-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-53.ec2.internal' and this object" podUID="cc497252-6a7a-448f-8ce5-07ecadb8d9bd" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4v5k9" Jun 05 03:54:51.013350 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:51.013325 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsvb6\" (UniqueName: \"kubernetes.io/projected/d9b2422b-d931-4ad6-b20d-180696c08d34-kube-api-access-hsvb6\") pod \"kuadrant-operator-controller-manager-55467d9f7-2r9b4\" (UID: \"d9b2422b-d931-4ad6-b20d-180696c08d34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2r9b4" Jun 05 03:54:51.013496 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:51.013406 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9b2422b-d931-4ad6-b20d-180696c08d34-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-2r9b4\" (UID: \"d9b2422b-d931-4ad6-b20d-180696c08d34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2r9b4" Jun 05 03:54:51.013778 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:51.013759 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9b2422b-d931-4ad6-b20d-180696c08d34-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-2r9b4\" (UID: \"d9b2422b-d931-4ad6-b20d-180696c08d34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2r9b4" Jun 05 03:54:51.021627 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:51.021606 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsvb6\" (UniqueName: \"kubernetes.io/projected/d9b2422b-d931-4ad6-b20d-180696c08d34-kube-api-access-hsvb6\") pod \"kuadrant-operator-controller-manager-55467d9f7-2r9b4\" (UID: \"d9b2422b-d931-4ad6-b20d-180696c08d34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2r9b4" Jun 05 03:54:51.059731 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:51.059704 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2r9b4" Jun 05 03:54:51.115422 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:51.115394 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc497252-6a7a-448f-8ce5-07ecadb8d9bd-extensions-socket-volume\") pod \"cc497252-6a7a-448f-8ce5-07ecadb8d9bd\" (UID: \"cc497252-6a7a-448f-8ce5-07ecadb8d9bd\") " Jun 05 03:54:51.115636 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:51.115616 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-blglb\" (UniqueName: \"kubernetes.io/projected/cc497252-6a7a-448f-8ce5-07ecadb8d9bd-kube-api-access-blglb\") pod \"cc497252-6a7a-448f-8ce5-07ecadb8d9bd\" (UID: \"cc497252-6a7a-448f-8ce5-07ecadb8d9bd\") " Jun 05 03:54:51.116374 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:51.116308 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc497252-6a7a-448f-8ce5-07ecadb8d9bd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cc497252-6a7a-448f-8ce5-07ecadb8d9bd" (UID: "cc497252-6a7a-448f-8ce5-07ecadb8d9bd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:54:51.117885 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:51.117856 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc497252-6a7a-448f-8ce5-07ecadb8d9bd-kube-api-access-blglb" (OuterVolumeSpecName: "kube-api-access-blglb") pod "cc497252-6a7a-448f-8ce5-07ecadb8d9bd" (UID: "cc497252-6a7a-448f-8ce5-07ecadb8d9bd"). InnerVolumeSpecName "kube-api-access-blglb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:54:51.160262 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:51.159568 2548 generic.go:356] "Generic (PLEG): container finished" podID="cc497252-6a7a-448f-8ce5-07ecadb8d9bd" containerID="cf3c6cec4f5eb1fd3e0745b2c16241bb61d51e30ac3b507aae19de98a7ad39b9" exitCode=0 Jun 05 03:54:51.160262 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:51.159758 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pk25c" Jun 05 03:54:51.160262 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:51.159775 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4v5k9" Jun 05 03:54:51.160262 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:51.159834 2548 scope.go:117] "RemoveContainer" containerID="cf3c6cec4f5eb1fd3e0745b2c16241bb61d51e30ac3b507aae19de98a7ad39b9" Jun 05 03:54:51.162338 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:54:51.162225 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-pk25c\" is forbidden: User \"system:node:ip-10-0-132-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-53.ec2.internal' and this object" podUID="48b70903-d6b0-445f-b0e3-438a63bddcdf" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pk25c" Jun 05 03:54:51.164634 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:54:51.164400 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4v5k9\" is forbidden: User \"system:node:ip-10-0-132-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-53.ec2.internal' and this object" podUID="cc497252-6a7a-448f-8ce5-07ecadb8d9bd" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4v5k9" Jun 05 03:54:51.166469 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:54:51.166418 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4v5k9\" is forbidden: User \"system:node:ip-10-0-132-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-53.ec2.internal' and this object" podUID="cc497252-6a7a-448f-8ce5-07ecadb8d9bd" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4v5k9" Jun 05 03:54:51.168305 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:54:51.168277 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-pk25c\" is forbidden: User \"system:node:ip-10-0-132-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-53.ec2.internal' and this object" podUID="48b70903-d6b0-445f-b0e3-438a63bddcdf" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pk25c" Jun 05 03:54:51.169308 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:51.169286 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pk25c" Jun 05 03:54:51.171420 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:54:51.171392 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-pk25c\" is forbidden: User \"system:node:ip-10-0-132-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-53.ec2.internal' and this object" podUID="48b70903-d6b0-445f-b0e3-438a63bddcdf" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pk25c" Jun 05 03:54:51.172010 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:51.171989 2548 scope.go:117] "RemoveContainer" containerID="cf3c6cec4f5eb1fd3e0745b2c16241bb61d51e30ac3b507aae19de98a7ad39b9" Jun 05 03:54:51.172293 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:54:51.172268 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf3c6cec4f5eb1fd3e0745b2c16241bb61d51e30ac3b507aae19de98a7ad39b9\": container with ID starting with cf3c6cec4f5eb1fd3e0745b2c16241bb61d51e30ac3b507aae19de98a7ad39b9 not found: ID does not exist" containerID="cf3c6cec4f5eb1fd3e0745b2c16241bb61d51e30ac3b507aae19de98a7ad39b9" Jun 05 03:54:51.172361 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:51.172302 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf3c6cec4f5eb1fd3e0745b2c16241bb61d51e30ac3b507aae19de98a7ad39b9"} err="failed to get container status \"cf3c6cec4f5eb1fd3e0745b2c16241bb61d51e30ac3b507aae19de98a7ad39b9\": rpc error: code = NotFound desc = could not find container \"cf3c6cec4f5eb1fd3e0745b2c16241bb61d51e30ac3b507aae19de98a7ad39b9\": container with ID starting with cf3c6cec4f5eb1fd3e0745b2c16241bb61d51e30ac3b507aae19de98a7ad39b9 not found: ID does not exist" Jun 05 03:54:51.173136 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:54:51.173117 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4v5k9\" is forbidden: User \"system:node:ip-10-0-132-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-53.ec2.internal' and this object" podUID="cc497252-6a7a-448f-8ce5-07ecadb8d9bd" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4v5k9" Jun 05 03:54:51.174883 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:54:51.174858 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-pk25c\" is forbidden: User \"system:node:ip-10-0-132-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-53.ec2.internal' and this object" podUID="48b70903-d6b0-445f-b0e3-438a63bddcdf" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pk25c" Jun 05 03:54:51.176602 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:54:51.176581 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4v5k9\" is forbidden: User \"system:node:ip-10-0-132-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-53.ec2.internal' and this object" podUID="cc497252-6a7a-448f-8ce5-07ecadb8d9bd" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4v5k9" Jun 05 03:54:51.193564 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:51.193546 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2r9b4"] Jun 05 03:54:51.194753 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:54:51.194733 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9b2422b_d931_4ad6_b20d_180696c08d34.slice/crio-cb9909d4f5a78a25b2cf4629dbdfef8e23ee25694fd1ea012298a3ef20b7544d WatchSource:0}: Error finding container cb9909d4f5a78a25b2cf4629dbdfef8e23ee25694fd1ea012298a3ef20b7544d: Status 404 returned error can't find the container with id cb9909d4f5a78a25b2cf4629dbdfef8e23ee25694fd1ea012298a3ef20b7544d Jun 05 03:54:51.216780 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:51.216762 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-blglb\" (UniqueName: \"kubernetes.io/projected/cc497252-6a7a-448f-8ce5-07ecadb8d9bd-kube-api-access-blglb\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:54:51.216880 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:51.216782 2548 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc497252-6a7a-448f-8ce5-07ecadb8d9bd-extensions-socket-volume\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:54:51.234536 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:51.234507 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc497252-6a7a-448f-8ce5-07ecadb8d9bd" path="/var/lib/kubelet/pods/cc497252-6a7a-448f-8ce5-07ecadb8d9bd/volumes" Jun 05 03:54:51.236181 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:54:51.236153 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-pk25c\" is forbidden: User \"system:node:ip-10-0-132-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-53.ec2.internal' and this object" podUID="48b70903-d6b0-445f-b0e3-438a63bddcdf" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pk25c" Jun 05 03:54:51.239821 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:54:51.239794 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4v5k9\" is forbidden: User \"system:node:ip-10-0-132-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-53.ec2.internal' and this object" podUID="cc497252-6a7a-448f-8ce5-07ecadb8d9bd" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4v5k9" Jun 05 03:54:51.317269 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:51.317232 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mqx2\" (UniqueName: \"kubernetes.io/projected/48b70903-d6b0-445f-b0e3-438a63bddcdf-kube-api-access-6mqx2\") pod \"48b70903-d6b0-445f-b0e3-438a63bddcdf\" (UID: \"48b70903-d6b0-445f-b0e3-438a63bddcdf\") " Jun 05 03:54:51.317710 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:51.317273 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/48b70903-d6b0-445f-b0e3-438a63bddcdf-extensions-socket-volume\") pod \"48b70903-d6b0-445f-b0e3-438a63bddcdf\" (UID: \"48b70903-d6b0-445f-b0e3-438a63bddcdf\") " Jun 05 03:54:51.317710 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:51.317580 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48b70903-d6b0-445f-b0e3-438a63bddcdf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "48b70903-d6b0-445f-b0e3-438a63bddcdf" (UID: "48b70903-d6b0-445f-b0e3-438a63bddcdf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:54:51.319775 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:51.319752 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48b70903-d6b0-445f-b0e3-438a63bddcdf-kube-api-access-6mqx2" (OuterVolumeSpecName: "kube-api-access-6mqx2") pod "48b70903-d6b0-445f-b0e3-438a63bddcdf" (UID: "48b70903-d6b0-445f-b0e3-438a63bddcdf"). InnerVolumeSpecName "kube-api-access-6mqx2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:54:51.418756 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:51.418673 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mqx2\" (UniqueName: \"kubernetes.io/projected/48b70903-d6b0-445f-b0e3-438a63bddcdf-kube-api-access-6mqx2\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:54:51.418756 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:51.418733 2548 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/48b70903-d6b0-445f-b0e3-438a63bddcdf-extensions-socket-volume\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:54:52.167091 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:52.167058 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2r9b4" event={"ID":"d9b2422b-d931-4ad6-b20d-180696c08d34","Type":"ContainerStarted","Data":"319ab2acfa6677e63efb93f20ea8751c5d39e5d4f33d932fe69e3de37f44a9bd"} Jun 05 03:54:52.167316 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:52.167131 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2r9b4" Jun 05 03:54:52.167316 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:52.167158 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2r9b4" event={"ID":"d9b2422b-d931-4ad6-b20d-180696c08d34","Type":"ContainerStarted","Data":"cb9909d4f5a78a25b2cf4629dbdfef8e23ee25694fd1ea012298a3ef20b7544d"} Jun 05 03:54:52.168032 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:52.168012 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pk25c" Jun 05 03:54:52.191175 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:54:52.191136 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-pk25c\" is forbidden: User \"system:node:ip-10-0-132-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-53.ec2.internal' and this object" podUID="48b70903-d6b0-445f-b0e3-438a63bddcdf" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pk25c" Jun 05 03:54:52.192857 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:52.192821 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2r9b4" podStartSLOduration=2.192807755 podStartE2EDuration="2.192807755s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:54:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:54:52.189178451 +0000 UTC m=+691.458954770" watchObservedRunningTime="2026-06-05 03:54:52.192807755 +0000 UTC m=+691.462584072" Jun 05 03:54:53.231299 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:53.231259 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48b70903-d6b0-445f-b0e3-438a63bddcdf" path="/var/lib/kubelet/pods/48b70903-d6b0-445f-b0e3-438a63bddcdf/volumes" Jun 05 03:54:56.114842 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:56.114793 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-57b876f5b8-hf8kx" podUID="11b7b154-1085-47cf-9a98-2dbb46dbeb87" containerName="console" containerID="cri-o://c7e19ef9e5422186a264c5d517e1319bd892af2621960f4ff97b760fc6d14a14" gracePeriod=15 Jun 05 03:54:56.374682 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:56.374618 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57b876f5b8-hf8kx" Jun 05 03:54:56.464766 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:56.464728 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11b7b154-1085-47cf-9a98-2dbb46dbeb87-console-serving-cert\") pod \"11b7b154-1085-47cf-9a98-2dbb46dbeb87\" (UID: \"11b7b154-1085-47cf-9a98-2dbb46dbeb87\") " Jun 05 03:54:56.464921 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:56.464792 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11b7b154-1085-47cf-9a98-2dbb46dbeb87-trusted-ca-bundle\") pod \"11b7b154-1085-47cf-9a98-2dbb46dbeb87\" (UID: \"11b7b154-1085-47cf-9a98-2dbb46dbeb87\") " Jun 05 03:54:56.464921 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:56.464812 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11b7b154-1085-47cf-9a98-2dbb46dbeb87-oauth-serving-cert\") pod \"11b7b154-1085-47cf-9a98-2dbb46dbeb87\" (UID: \"11b7b154-1085-47cf-9a98-2dbb46dbeb87\") " Jun 05 03:54:56.464921 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:56.464830 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11b7b154-1085-47cf-9a98-2dbb46dbeb87-service-ca\") pod \"11b7b154-1085-47cf-9a98-2dbb46dbeb87\" (UID: \"11b7b154-1085-47cf-9a98-2dbb46dbeb87\") " Jun 05 03:54:56.464921 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:56.464852 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11b7b154-1085-47cf-9a98-2dbb46dbeb87-console-config\") pod \"11b7b154-1085-47cf-9a98-2dbb46dbeb87\" (UID: \"11b7b154-1085-47cf-9a98-2dbb46dbeb87\") " Jun 05 03:54:56.464921 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:56.464877 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11b7b154-1085-47cf-9a98-2dbb46dbeb87-console-oauth-config\") pod \"11b7b154-1085-47cf-9a98-2dbb46dbeb87\" (UID: \"11b7b154-1085-47cf-9a98-2dbb46dbeb87\") " Jun 05 03:54:56.465187 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:56.464955 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpj4s\" (UniqueName: \"kubernetes.io/projected/11b7b154-1085-47cf-9a98-2dbb46dbeb87-kube-api-access-qpj4s\") pod \"11b7b154-1085-47cf-9a98-2dbb46dbeb87\" (UID: \"11b7b154-1085-47cf-9a98-2dbb46dbeb87\") " Jun 05 03:54:56.465295 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:56.465266 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11b7b154-1085-47cf-9a98-2dbb46dbeb87-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "11b7b154-1085-47cf-9a98-2dbb46dbeb87" (UID: "11b7b154-1085-47cf-9a98-2dbb46dbeb87"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:54:56.465357 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:56.465318 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11b7b154-1085-47cf-9a98-2dbb46dbeb87-console-config" (OuterVolumeSpecName: "console-config") pod "11b7b154-1085-47cf-9a98-2dbb46dbeb87" (UID: "11b7b154-1085-47cf-9a98-2dbb46dbeb87"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:54:56.465357 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:56.465329 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11b7b154-1085-47cf-9a98-2dbb46dbeb87-service-ca" (OuterVolumeSpecName: "service-ca") pod "11b7b154-1085-47cf-9a98-2dbb46dbeb87" (UID: "11b7b154-1085-47cf-9a98-2dbb46dbeb87"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:54:56.465357 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:56.465336 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11b7b154-1085-47cf-9a98-2dbb46dbeb87-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "11b7b154-1085-47cf-9a98-2dbb46dbeb87" (UID: "11b7b154-1085-47cf-9a98-2dbb46dbeb87"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:54:56.467266 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:56.467227 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11b7b154-1085-47cf-9a98-2dbb46dbeb87-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "11b7b154-1085-47cf-9a98-2dbb46dbeb87" (UID: "11b7b154-1085-47cf-9a98-2dbb46dbeb87"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 03:54:56.467266 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:56.467247 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11b7b154-1085-47cf-9a98-2dbb46dbeb87-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "11b7b154-1085-47cf-9a98-2dbb46dbeb87" (UID: "11b7b154-1085-47cf-9a98-2dbb46dbeb87"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 03:54:56.467476 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:56.467278 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11b7b154-1085-47cf-9a98-2dbb46dbeb87-kube-api-access-qpj4s" (OuterVolumeSpecName: "kube-api-access-qpj4s") pod "11b7b154-1085-47cf-9a98-2dbb46dbeb87" (UID: "11b7b154-1085-47cf-9a98-2dbb46dbeb87"). InnerVolumeSpecName "kube-api-access-qpj4s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:54:56.566362 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:56.566318 2548 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11b7b154-1085-47cf-9a98-2dbb46dbeb87-trusted-ca-bundle\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:54:56.566362 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:56.566357 2548 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11b7b154-1085-47cf-9a98-2dbb46dbeb87-oauth-serving-cert\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:54:56.566362 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:56.566368 2548 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11b7b154-1085-47cf-9a98-2dbb46dbeb87-service-ca\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:54:56.566362 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:56.566376 2548 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11b7b154-1085-47cf-9a98-2dbb46dbeb87-console-config\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:54:56.566652 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:56.566384 2548 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11b7b154-1085-47cf-9a98-2dbb46dbeb87-console-oauth-config\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:54:56.566652 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:56.566392 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpj4s\" (UniqueName: \"kubernetes.io/projected/11b7b154-1085-47cf-9a98-2dbb46dbeb87-kube-api-access-qpj4s\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:54:56.566652 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:56.566400 2548 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11b7b154-1085-47cf-9a98-2dbb46dbeb87-console-serving-cert\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:54:57.198643 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:57.198605 2548 generic.go:356] "Generic (PLEG): container finished" podID="11b7b154-1085-47cf-9a98-2dbb46dbeb87" containerID="c7e19ef9e5422186a264c5d517e1319bd892af2621960f4ff97b760fc6d14a14" exitCode=0 Jun 05 03:54:57.199026 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:57.198657 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57b876f5b8-hf8kx" Jun 05 03:54:57.199026 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:57.198682 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57b876f5b8-hf8kx" event={"ID":"11b7b154-1085-47cf-9a98-2dbb46dbeb87","Type":"ContainerDied","Data":"c7e19ef9e5422186a264c5d517e1319bd892af2621960f4ff97b760fc6d14a14"} Jun 05 03:54:57.199026 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:57.198757 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57b876f5b8-hf8kx" event={"ID":"11b7b154-1085-47cf-9a98-2dbb46dbeb87","Type":"ContainerDied","Data":"934884afbe1d27e44ad645b8e2cc7c534c075b6159b29192d6991a98490c5295"} Jun 05 03:54:57.199026 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:57.198777 2548 scope.go:117] "RemoveContainer" containerID="c7e19ef9e5422186a264c5d517e1319bd892af2621960f4ff97b760fc6d14a14" Jun 05 03:54:57.208349 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:57.208328 2548 scope.go:117] "RemoveContainer" containerID="c7e19ef9e5422186a264c5d517e1319bd892af2621960f4ff97b760fc6d14a14" Jun 05 03:54:57.208630 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:54:57.208612 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7e19ef9e5422186a264c5d517e1319bd892af2621960f4ff97b760fc6d14a14\": container with ID starting with c7e19ef9e5422186a264c5d517e1319bd892af2621960f4ff97b760fc6d14a14 not found: ID does not exist" containerID="c7e19ef9e5422186a264c5d517e1319bd892af2621960f4ff97b760fc6d14a14" Jun 05 03:54:57.208690 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:57.208638 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7e19ef9e5422186a264c5d517e1319bd892af2621960f4ff97b760fc6d14a14"} err="failed to get container status \"c7e19ef9e5422186a264c5d517e1319bd892af2621960f4ff97b760fc6d14a14\": rpc error: code = NotFound desc = could not find container \"c7e19ef9e5422186a264c5d517e1319bd892af2621960f4ff97b760fc6d14a14\": container with ID starting with c7e19ef9e5422186a264c5d517e1319bd892af2621960f4ff97b760fc6d14a14 not found: ID does not exist" Jun 05 03:54:57.221553 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:57.221528 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57b876f5b8-hf8kx"] Jun 05 03:54:57.229219 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:57.229197 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57b876f5b8-hf8kx"] Jun 05 03:54:59.229211 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:54:59.229178 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11b7b154-1085-47cf-9a98-2dbb46dbeb87" path="/var/lib/kubelet/pods/11b7b154-1085-47cf-9a98-2dbb46dbeb87/volumes" Jun 05 03:55:03.176446 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:03.176407 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2r9b4" Jun 05 03:55:03.425098 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:03.425067 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v2lph"] Jun 05 03:55:03.425469 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:03.425423 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11b7b154-1085-47cf-9a98-2dbb46dbeb87" containerName="console" Jun 05 03:55:03.425469 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:03.425457 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="11b7b154-1085-47cf-9a98-2dbb46dbeb87" containerName="console" Jun 05 03:55:03.425469 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:03.425470 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc497252-6a7a-448f-8ce5-07ecadb8d9bd" containerName="manager" Jun 05 03:55:03.425588 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:03.425475 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc497252-6a7a-448f-8ce5-07ecadb8d9bd" containerName="manager" Jun 05 03:55:03.425588 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:03.425545 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="11b7b154-1085-47cf-9a98-2dbb46dbeb87" containerName="console" Jun 05 03:55:03.425588 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:03.425557 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc497252-6a7a-448f-8ce5-07ecadb8d9bd" containerName="manager" Jun 05 03:55:03.432089 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:03.432028 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v2lph" Jun 05 03:55:03.442657 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:03.442631 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v2lph"] Jun 05 03:55:03.528664 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:03.528634 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/507eae85-d1ee-499b-9f15-bde0b2d3a6e5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-v2lph\" (UID: \"507eae85-d1ee-499b-9f15-bde0b2d3a6e5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v2lph" Jun 05 03:55:03.528821 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:03.528751 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm9db\" (UniqueName: \"kubernetes.io/projected/507eae85-d1ee-499b-9f15-bde0b2d3a6e5-kube-api-access-mm9db\") pod \"kuadrant-operator-controller-manager-86878c769f-v2lph\" (UID: \"507eae85-d1ee-499b-9f15-bde0b2d3a6e5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v2lph" Jun 05 03:55:03.629574 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:03.629539 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/507eae85-d1ee-499b-9f15-bde0b2d3a6e5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-v2lph\" (UID: \"507eae85-d1ee-499b-9f15-bde0b2d3a6e5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v2lph" Jun 05 03:55:03.629741 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:03.629648 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm9db\" (UniqueName: \"kubernetes.io/projected/507eae85-d1ee-499b-9f15-bde0b2d3a6e5-kube-api-access-mm9db\") pod \"kuadrant-operator-controller-manager-86878c769f-v2lph\" (UID: \"507eae85-d1ee-499b-9f15-bde0b2d3a6e5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v2lph" Jun 05 03:55:03.630038 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:03.630021 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/507eae85-d1ee-499b-9f15-bde0b2d3a6e5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-v2lph\" (UID: \"507eae85-d1ee-499b-9f15-bde0b2d3a6e5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v2lph" Jun 05 03:55:03.637753 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:03.637730 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm9db\" (UniqueName: \"kubernetes.io/projected/507eae85-d1ee-499b-9f15-bde0b2d3a6e5-kube-api-access-mm9db\") pod \"kuadrant-operator-controller-manager-86878c769f-v2lph\" (UID: \"507eae85-d1ee-499b-9f15-bde0b2d3a6e5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v2lph" Jun 05 03:55:03.743607 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:03.743507 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v2lph" Jun 05 03:55:03.880496 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:03.880472 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v2lph"] Jun 05 03:55:03.881904 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:55:03.881863 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod507eae85_d1ee_499b_9f15_bde0b2d3a6e5.slice/crio-71d953ad395b2fce0914ae18473ab05eda7b227bbc9f2979a9d81f39f1fbe926 WatchSource:0}: Error finding container 71d953ad395b2fce0914ae18473ab05eda7b227bbc9f2979a9d81f39f1fbe926: Status 404 returned error can't find the container with id 71d953ad395b2fce0914ae18473ab05eda7b227bbc9f2979a9d81f39f1fbe926 Jun 05 03:55:04.247825 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:04.247790 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v2lph" event={"ID":"507eae85-d1ee-499b-9f15-bde0b2d3a6e5","Type":"ContainerStarted","Data":"fb7702d0bf439e3f07a5dafd6fbd49acd8de97a27f3fa36ad224bcd118251506"} Jun 05 03:55:04.248220 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:04.247882 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v2lph" event={"ID":"507eae85-d1ee-499b-9f15-bde0b2d3a6e5","Type":"ContainerStarted","Data":"71d953ad395b2fce0914ae18473ab05eda7b227bbc9f2979a9d81f39f1fbe926"} Jun 05 03:55:04.248220 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:04.247996 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v2lph" Jun 05 03:55:04.268135 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:04.268089 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v2lph" podStartSLOduration=1.268073681 podStartE2EDuration="1.268073681s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:55:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:55:04.265235783 +0000 UTC m=+703.535012102" watchObservedRunningTime="2026-06-05 03:55:04.268073681 +0000 UTC m=+703.537849999" Jun 05 03:55:15.255904 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:15.255872 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v2lph" Jun 05 03:55:15.318001 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:15.317971 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2r9b4"] Jun 05 03:55:15.318221 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:15.318178 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2r9b4" podUID="d9b2422b-d931-4ad6-b20d-180696c08d34" containerName="manager" containerID="cri-o://319ab2acfa6677e63efb93f20ea8751c5d39e5d4f33d932fe69e3de37f44a9bd" gracePeriod=10 Jun 05 03:55:15.580554 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:15.580530 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2r9b4" Jun 05 03:55:15.642076 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:15.642043 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9b2422b-d931-4ad6-b20d-180696c08d34-extensions-socket-volume\") pod \"d9b2422b-d931-4ad6-b20d-180696c08d34\" (UID: \"d9b2422b-d931-4ad6-b20d-180696c08d34\") " Jun 05 03:55:15.642246 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:15.642104 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsvb6\" (UniqueName: \"kubernetes.io/projected/d9b2422b-d931-4ad6-b20d-180696c08d34-kube-api-access-hsvb6\") pod \"d9b2422b-d931-4ad6-b20d-180696c08d34\" (UID: \"d9b2422b-d931-4ad6-b20d-180696c08d34\") " Jun 05 03:55:15.642560 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:15.642529 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9b2422b-d931-4ad6-b20d-180696c08d34-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d9b2422b-d931-4ad6-b20d-180696c08d34" (UID: "d9b2422b-d931-4ad6-b20d-180696c08d34"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:55:15.644329 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:15.644300 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9b2422b-d931-4ad6-b20d-180696c08d34-kube-api-access-hsvb6" (OuterVolumeSpecName: "kube-api-access-hsvb6") pod "d9b2422b-d931-4ad6-b20d-180696c08d34" (UID: "d9b2422b-d931-4ad6-b20d-180696c08d34"). InnerVolumeSpecName "kube-api-access-hsvb6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:55:15.743030 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:15.742998 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsvb6\" (UniqueName: \"kubernetes.io/projected/d9b2422b-d931-4ad6-b20d-180696c08d34-kube-api-access-hsvb6\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:55:15.743030 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:15.743024 2548 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9b2422b-d931-4ad6-b20d-180696c08d34-extensions-socket-volume\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:55:16.321209 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:16.321171 2548 generic.go:356] "Generic (PLEG): container finished" podID="d9b2422b-d931-4ad6-b20d-180696c08d34" containerID="319ab2acfa6677e63efb93f20ea8751c5d39e5d4f33d932fe69e3de37f44a9bd" exitCode=0 Jun 05 03:55:16.321629 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:16.321219 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2r9b4" Jun 05 03:55:16.321629 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:16.321252 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2r9b4" event={"ID":"d9b2422b-d931-4ad6-b20d-180696c08d34","Type":"ContainerDied","Data":"319ab2acfa6677e63efb93f20ea8751c5d39e5d4f33d932fe69e3de37f44a9bd"} Jun 05 03:55:16.321629 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:16.321309 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2r9b4" event={"ID":"d9b2422b-d931-4ad6-b20d-180696c08d34","Type":"ContainerDied","Data":"cb9909d4f5a78a25b2cf4629dbdfef8e23ee25694fd1ea012298a3ef20b7544d"} Jun 05 03:55:16.321629 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:16.321333 2548 scope.go:117] "RemoveContainer" containerID="319ab2acfa6677e63efb93f20ea8751c5d39e5d4f33d932fe69e3de37f44a9bd" Jun 05 03:55:16.331062 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:16.331046 2548 scope.go:117] "RemoveContainer" containerID="319ab2acfa6677e63efb93f20ea8751c5d39e5d4f33d932fe69e3de37f44a9bd" Jun 05 03:55:16.331318 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:55:16.331301 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"319ab2acfa6677e63efb93f20ea8751c5d39e5d4f33d932fe69e3de37f44a9bd\": container with ID starting with 319ab2acfa6677e63efb93f20ea8751c5d39e5d4f33d932fe69e3de37f44a9bd not found: ID does not exist" containerID="319ab2acfa6677e63efb93f20ea8751c5d39e5d4f33d932fe69e3de37f44a9bd" Jun 05 03:55:16.331382 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:16.331329 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"319ab2acfa6677e63efb93f20ea8751c5d39e5d4f33d932fe69e3de37f44a9bd"} err="failed to get container status \"319ab2acfa6677e63efb93f20ea8751c5d39e5d4f33d932fe69e3de37f44a9bd\": rpc error: code = NotFound desc = could not find container \"319ab2acfa6677e63efb93f20ea8751c5d39e5d4f33d932fe69e3de37f44a9bd\": container with ID starting with 319ab2acfa6677e63efb93f20ea8751c5d39e5d4f33d932fe69e3de37f44a9bd not found: ID does not exist" Jun 05 03:55:16.343440 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:16.343406 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2r9b4"] Jun 05 03:55:16.349951 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:16.349928 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2r9b4"] Jun 05 03:55:17.229619 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:17.229583 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9b2422b-d931-4ad6-b20d-180696c08d34" path="/var/lib/kubelet/pods/d9b2422b-d931-4ad6-b20d-180696c08d34/volumes" Jun 05 03:55:34.249975 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:34.249937 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-86k5v"] Jun 05 03:55:34.250521 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:34.250344 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9b2422b-d931-4ad6-b20d-180696c08d34" containerName="manager" Jun 05 03:55:34.250521 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:34.250355 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9b2422b-d931-4ad6-b20d-180696c08d34" containerName="manager" Jun 05 03:55:34.250521 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:34.250417 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9b2422b-d931-4ad6-b20d-180696c08d34" containerName="manager" Jun 05 03:55:34.254658 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:34.254641 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-86k5v" Jun 05 03:55:34.257558 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:34.257531 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 05 03:55:34.257700 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:34.257537 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-s4spl\"" Jun 05 03:55:34.260032 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:34.260005 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-86k5v"] Jun 05 03:55:34.347116 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:34.347077 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-86k5v"] Jun 05 03:55:34.414555 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:34.414525 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/416491ee-9c5d-4a95-bcbe-62a05a471f8a-config-file\") pod \"limitador-limitador-64c94fd64f-86k5v\" (UID: \"416491ee-9c5d-4a95-bcbe-62a05a471f8a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-86k5v" Jun 05 03:55:34.414730 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:34.414633 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvmtk\" (UniqueName: \"kubernetes.io/projected/416491ee-9c5d-4a95-bcbe-62a05a471f8a-kube-api-access-cvmtk\") pod \"limitador-limitador-64c94fd64f-86k5v\" (UID: \"416491ee-9c5d-4a95-bcbe-62a05a471f8a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-86k5v" Jun 05 03:55:34.515772 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:34.515737 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/416491ee-9c5d-4a95-bcbe-62a05a471f8a-config-file\") pod \"limitador-limitador-64c94fd64f-86k5v\" (UID: \"416491ee-9c5d-4a95-bcbe-62a05a471f8a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-86k5v" Jun 05 03:55:34.515939 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:34.515826 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvmtk\" (UniqueName: \"kubernetes.io/projected/416491ee-9c5d-4a95-bcbe-62a05a471f8a-kube-api-access-cvmtk\") pod \"limitador-limitador-64c94fd64f-86k5v\" (UID: \"416491ee-9c5d-4a95-bcbe-62a05a471f8a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-86k5v" Jun 05 03:55:34.516351 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:34.516332 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/416491ee-9c5d-4a95-bcbe-62a05a471f8a-config-file\") pod \"limitador-limitador-64c94fd64f-86k5v\" (UID: \"416491ee-9c5d-4a95-bcbe-62a05a471f8a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-86k5v" Jun 05 03:55:34.524101 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:34.524070 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvmtk\" (UniqueName: \"kubernetes.io/projected/416491ee-9c5d-4a95-bcbe-62a05a471f8a-kube-api-access-cvmtk\") pod \"limitador-limitador-64c94fd64f-86k5v\" (UID: \"416491ee-9c5d-4a95-bcbe-62a05a471f8a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-86k5v" Jun 05 03:55:34.566311 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:34.566276 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-86k5v" Jun 05 03:55:34.702575 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:34.702552 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-86k5v"] Jun 05 03:55:34.704097 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:55:34.704058 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod416491ee_9c5d_4a95_bcbe_62a05a471f8a.slice/crio-81a552f0e00e1103c228175e0957ac33f5df13ffd6ca9cd3e0f91fadf0349608 WatchSource:0}: Error finding container 81a552f0e00e1103c228175e0957ac33f5df13ffd6ca9cd3e0f91fadf0349608: Status 404 returned error can't find the container with id 81a552f0e00e1103c228175e0957ac33f5df13ffd6ca9cd3e0f91fadf0349608 Jun 05 03:55:35.246028 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:35.245991 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-7m8vd"] Jun 05 03:55:35.251224 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:35.251199 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7m8vd" Jun 05 03:55:35.253598 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:35.253574 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-phl5z\"" Jun 05 03:55:35.258878 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:35.258851 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7m8vd"] Jun 05 03:55:35.422668 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:35.422555 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jfhs\" (UniqueName: \"kubernetes.io/projected/a1b63de3-cea1-4efb-86f1-731f502f0edc-kube-api-access-5jfhs\") pod \"authorino-75d556bd77-7m8vd\" (UID: \"a1b63de3-cea1-4efb-86f1-731f502f0edc\") " pod="kuadrant-system/authorino-75d556bd77-7m8vd" Jun 05 03:55:35.431936 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:35.431861 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-86k5v" event={"ID":"416491ee-9c5d-4a95-bcbe-62a05a471f8a","Type":"ContainerStarted","Data":"81a552f0e00e1103c228175e0957ac33f5df13ffd6ca9cd3e0f91fadf0349608"} Jun 05 03:55:35.524251 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:35.524212 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jfhs\" (UniqueName: \"kubernetes.io/projected/a1b63de3-cea1-4efb-86f1-731f502f0edc-kube-api-access-5jfhs\") pod \"authorino-75d556bd77-7m8vd\" (UID: \"a1b63de3-cea1-4efb-86f1-731f502f0edc\") " pod="kuadrant-system/authorino-75d556bd77-7m8vd" Jun 05 03:55:35.534342 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:35.534229 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jfhs\" (UniqueName: \"kubernetes.io/projected/a1b63de3-cea1-4efb-86f1-731f502f0edc-kube-api-access-5jfhs\") pod \"authorino-75d556bd77-7m8vd\" (UID: \"a1b63de3-cea1-4efb-86f1-731f502f0edc\") " pod="kuadrant-system/authorino-75d556bd77-7m8vd" Jun 05 03:55:35.562836 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:35.562781 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7m8vd" Jun 05 03:55:35.749113 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:35.749084 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7m8vd"] Jun 05 03:55:36.440369 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:36.440331 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7m8vd" event={"ID":"a1b63de3-cea1-4efb-86f1-731f502f0edc","Type":"ContainerStarted","Data":"b50818a8876e31353090e2b536135d3936181c708cd3f1345c541d4d5247ecf5"} Jun 05 03:55:38.457522 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:38.457465 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-86k5v" event={"ID":"416491ee-9c5d-4a95-bcbe-62a05a471f8a","Type":"ContainerStarted","Data":"cecc2260135e42d24aef52996ad65f589086b6dc35bc6d07f7410f9bae7c401f"} Jun 05 03:55:38.457981 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:38.457579 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-86k5v" Jun 05 03:55:38.475668 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:38.475609 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-86k5v" podStartSLOduration=1.597965194 podStartE2EDuration="4.475591398s" totalImagesPullingTime="2.877626204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:55:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:55:38.472398909 +0000 UTC m=+737.742175230" watchObservedRunningTime="2026-06-05 03:55:38.475591398 +0000 UTC m=+737.745367737" Jun 05 03:55:40.470751 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:40.470709 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7m8vd" event={"ID":"a1b63de3-cea1-4efb-86f1-731f502f0edc","Type":"ContainerStarted","Data":"d408058b993a3d4fbb76052d435a822410a2862b16f777997b1833cfba3dcf26"} Jun 05 03:55:40.486973 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:40.486912 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-7m8vd" podStartSLOduration=1.571839592 podStartE2EDuration="5.486895974s" totalImagesPullingTime="3.915056382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:55:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:55:40.484559065 +0000 UTC m=+739.754335384" watchObservedRunningTime="2026-06-05 03:55:40.486895974 +0000 UTC m=+739.756672291" Jun 05 03:55:49.047766 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:49.047729 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-86k5v"] Jun 05 03:55:49.048215 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:49.048022 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-86k5v" podUID="416491ee-9c5d-4a95-bcbe-62a05a471f8a" containerName="limitador" containerID="cri-o://cecc2260135e42d24aef52996ad65f589086b6dc35bc6d07f7410f9bae7c401f" gracePeriod=30 Jun 05 03:55:49.048870 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:49.048851 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-86k5v" Jun 05 03:55:49.530796 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:49.530760 2548 generic.go:356] "Generic (PLEG): container finished" podID="416491ee-9c5d-4a95-bcbe-62a05a471f8a" containerID="cecc2260135e42d24aef52996ad65f589086b6dc35bc6d07f7410f9bae7c401f" exitCode=0 Jun 05 03:55:49.530940 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:49.530832 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-86k5v" event={"ID":"416491ee-9c5d-4a95-bcbe-62a05a471f8a","Type":"ContainerDied","Data":"cecc2260135e42d24aef52996ad65f589086b6dc35bc6d07f7410f9bae7c401f"} Jun 05 03:55:49.605974 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:49.605947 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-86k5v" Jun 05 03:55:49.661564 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:49.661476 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvmtk\" (UniqueName: \"kubernetes.io/projected/416491ee-9c5d-4a95-bcbe-62a05a471f8a-kube-api-access-cvmtk\") pod \"416491ee-9c5d-4a95-bcbe-62a05a471f8a\" (UID: \"416491ee-9c5d-4a95-bcbe-62a05a471f8a\") " Jun 05 03:55:49.661564 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:49.661548 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/416491ee-9c5d-4a95-bcbe-62a05a471f8a-config-file\") pod \"416491ee-9c5d-4a95-bcbe-62a05a471f8a\" (UID: \"416491ee-9c5d-4a95-bcbe-62a05a471f8a\") " Jun 05 03:55:49.661902 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:49.661877 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/416491ee-9c5d-4a95-bcbe-62a05a471f8a-config-file" (OuterVolumeSpecName: "config-file") pod "416491ee-9c5d-4a95-bcbe-62a05a471f8a" (UID: "416491ee-9c5d-4a95-bcbe-62a05a471f8a"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:55:49.663779 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:49.663761 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/416491ee-9c5d-4a95-bcbe-62a05a471f8a-kube-api-access-cvmtk" (OuterVolumeSpecName: "kube-api-access-cvmtk") pod "416491ee-9c5d-4a95-bcbe-62a05a471f8a" (UID: "416491ee-9c5d-4a95-bcbe-62a05a471f8a"). InnerVolumeSpecName "kube-api-access-cvmtk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:55:49.762463 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:49.762414 2548 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/416491ee-9c5d-4a95-bcbe-62a05a471f8a-config-file\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:55:49.762463 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:49.762456 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvmtk\" (UniqueName: \"kubernetes.io/projected/416491ee-9c5d-4a95-bcbe-62a05a471f8a-kube-api-access-cvmtk\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:55:50.537862 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:50.537834 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-86k5v" Jun 05 03:55:50.538251 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:50.537872 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-86k5v" event={"ID":"416491ee-9c5d-4a95-bcbe-62a05a471f8a","Type":"ContainerDied","Data":"81a552f0e00e1103c228175e0957ac33f5df13ffd6ca9cd3e0f91fadf0349608"} Jun 05 03:55:50.538251 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:50.537937 2548 scope.go:117] "RemoveContainer" containerID="cecc2260135e42d24aef52996ad65f589086b6dc35bc6d07f7410f9bae7c401f" Jun 05 03:55:50.560108 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:50.560071 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-86k5v"] Jun 05 03:55:50.563767 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:50.563741 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-86k5v"] Jun 05 03:55:50.713884 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:50.713851 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-ltlqz"] Jun 05 03:55:50.714326 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:50.714306 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="416491ee-9c5d-4a95-bcbe-62a05a471f8a" containerName="limitador" Jun 05 03:55:50.714326 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:50.714327 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="416491ee-9c5d-4a95-bcbe-62a05a471f8a" containerName="limitador" Jun 05 03:55:50.714492 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:50.714404 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="416491ee-9c5d-4a95-bcbe-62a05a471f8a" containerName="limitador" Jun 05 03:55:50.718655 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:50.718637 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-ltlqz" Jun 05 03:55:50.721287 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:50.721251 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 05 03:55:50.724473 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:50.724448 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-ltlqz"] Jun 05 03:55:50.772186 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:50.772146 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0758a08b-a60d-497a-ad87-24f233776d75-data\") pod \"postgres-69fb4594cf-ltlqz\" (UID: \"0758a08b-a60d-497a-ad87-24f233776d75\") " pod="opendatahub/postgres-69fb4594cf-ltlqz" Jun 05 03:55:50.772355 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:50.772212 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw7f8\" (UniqueName: \"kubernetes.io/projected/0758a08b-a60d-497a-ad87-24f233776d75-kube-api-access-jw7f8\") pod \"postgres-69fb4594cf-ltlqz\" (UID: \"0758a08b-a60d-497a-ad87-24f233776d75\") " pod="opendatahub/postgres-69fb4594cf-ltlqz" Jun 05 03:55:50.873599 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:50.873502 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw7f8\" (UniqueName: \"kubernetes.io/projected/0758a08b-a60d-497a-ad87-24f233776d75-kube-api-access-jw7f8\") pod \"postgres-69fb4594cf-ltlqz\" (UID: \"0758a08b-a60d-497a-ad87-24f233776d75\") " pod="opendatahub/postgres-69fb4594cf-ltlqz" Jun 05 03:55:50.873774 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:50.873617 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0758a08b-a60d-497a-ad87-24f233776d75-data\") pod \"postgres-69fb4594cf-ltlqz\" (UID: \"0758a08b-a60d-497a-ad87-24f233776d75\") " pod="opendatahub/postgres-69fb4594cf-ltlqz" Jun 05 03:55:50.873978 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:50.873952 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0758a08b-a60d-497a-ad87-24f233776d75-data\") pod \"postgres-69fb4594cf-ltlqz\" (UID: \"0758a08b-a60d-497a-ad87-24f233776d75\") " pod="opendatahub/postgres-69fb4594cf-ltlqz" Jun 05 03:55:50.881408 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:50.881377 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw7f8\" (UniqueName: \"kubernetes.io/projected/0758a08b-a60d-497a-ad87-24f233776d75-kube-api-access-jw7f8\") pod \"postgres-69fb4594cf-ltlqz\" (UID: \"0758a08b-a60d-497a-ad87-24f233776d75\") " pod="opendatahub/postgres-69fb4594cf-ltlqz" Jun 05 03:55:51.033025 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:51.032983 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-ltlqz" Jun 05 03:55:51.169289 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:51.169264 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-ltlqz"] Jun 05 03:55:51.170746 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:55:51.170719 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0758a08b_a60d_497a_ad87_24f233776d75.slice/crio-c38505823a5627f3940c526d14d9ee7f0de89390bb4cd7defa2b57028b097956 WatchSource:0}: Error finding container c38505823a5627f3940c526d14d9ee7f0de89390bb4cd7defa2b57028b097956: Status 404 returned error can't find the container with id c38505823a5627f3940c526d14d9ee7f0de89390bb4cd7defa2b57028b097956 Jun 05 03:55:51.229083 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:51.229046 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="416491ee-9c5d-4a95-bcbe-62a05a471f8a" path="/var/lib/kubelet/pods/416491ee-9c5d-4a95-bcbe-62a05a471f8a/volumes" Jun 05 03:55:51.544203 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:51.544165 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-ltlqz" event={"ID":"0758a08b-a60d-497a-ad87-24f233776d75","Type":"ContainerStarted","Data":"c38505823a5627f3940c526d14d9ee7f0de89390bb4cd7defa2b57028b097956"} Jun 05 03:55:54.564384 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:54.564342 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-ltlqz" event={"ID":"0758a08b-a60d-497a-ad87-24f233776d75","Type":"ContainerStarted","Data":"13c6fcc0ac1ac433cabde12a900157ba6f59e6aa6f8e7b40a927b5930f987c55"} Jun 05 03:55:54.564790 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:54.564606 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-ltlqz" Jun 05 03:55:54.582004 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:55:54.581951 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-ltlqz" podStartSLOduration=1.749734593 podStartE2EDuration="4.581936443s" totalImagesPullingTime="2.83220185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:55:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:55:54.578863198 +0000 UTC m=+753.848639518" watchObservedRunningTime="2026-06-05 03:55:54.581936443 +0000 UTC m=+753.851712761" Jun 05 03:56:00.605112 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:00.605074 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-ltlqz" Jun 05 03:56:01.953907 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:01.953873 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kncxc"] Jun 05 03:56:01.961622 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:01.961601 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kncxc" Jun 05 03:56:01.964733 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:01.964710 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hsscq\"" Jun 05 03:56:01.964862 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:01.964711 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 03:56:01.964862 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:01.964759 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 03:56:01.967418 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:01.967394 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kncxc"] Jun 05 03:56:02.087410 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:02.087373 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl82g\" (UniqueName: \"kubernetes.io/projected/73ba9d88-d681-49f5-aff2-049525fddc52-kube-api-access-vl82g\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kncxc\" (UID: \"73ba9d88-d681-49f5-aff2-049525fddc52\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kncxc" Jun 05 03:56:02.087678 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:02.087457 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73ba9d88-d681-49f5-aff2-049525fddc52-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kncxc\" (UID: \"73ba9d88-d681-49f5-aff2-049525fddc52\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kncxc" Jun 05 03:56:02.087678 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:02.087533 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73ba9d88-d681-49f5-aff2-049525fddc52-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kncxc\" (UID: \"73ba9d88-d681-49f5-aff2-049525fddc52\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kncxc" Jun 05 03:56:02.188521 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:02.188482 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl82g\" (UniqueName: \"kubernetes.io/projected/73ba9d88-d681-49f5-aff2-049525fddc52-kube-api-access-vl82g\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kncxc\" (UID: \"73ba9d88-d681-49f5-aff2-049525fddc52\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kncxc" Jun 05 03:56:02.188702 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:02.188554 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73ba9d88-d681-49f5-aff2-049525fddc52-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kncxc\" (UID: \"73ba9d88-d681-49f5-aff2-049525fddc52\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kncxc" Jun 05 03:56:02.188702 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:02.188589 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73ba9d88-d681-49f5-aff2-049525fddc52-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kncxc\" (UID: \"73ba9d88-d681-49f5-aff2-049525fddc52\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kncxc" Jun 05 03:56:02.189009 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:02.188985 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73ba9d88-d681-49f5-aff2-049525fddc52-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kncxc\" (UID: \"73ba9d88-d681-49f5-aff2-049525fddc52\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kncxc" Jun 05 03:56:02.189111 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:02.189017 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73ba9d88-d681-49f5-aff2-049525fddc52-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kncxc\" (UID: \"73ba9d88-d681-49f5-aff2-049525fddc52\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kncxc" Jun 05 03:56:02.206144 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:02.206078 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl82g\" (UniqueName: \"kubernetes.io/projected/73ba9d88-d681-49f5-aff2-049525fddc52-kube-api-access-vl82g\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kncxc\" (UID: \"73ba9d88-d681-49f5-aff2-049525fddc52\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kncxc" Jun 05 03:56:02.273142 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:02.273104 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kncxc" Jun 05 03:56:02.418249 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:02.418220 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kncxc"] Jun 05 03:56:02.419207 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:56:02.419179 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73ba9d88_d681_49f5_aff2_049525fddc52.slice/crio-8e57486409640b7d068c61499cc5268282a439553c49925233636c53b6804c24 WatchSource:0}: Error finding container 8e57486409640b7d068c61499cc5268282a439553c49925233636c53b6804c24: Status 404 returned error can't find the container with id 8e57486409640b7d068c61499cc5268282a439553c49925233636c53b6804c24 Jun 05 03:56:02.610778 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:02.610746 2548 generic.go:356] "Generic (PLEG): container finished" podID="73ba9d88-d681-49f5-aff2-049525fddc52" containerID="3f9560d548462072422917d2994d5de3d08ba05df827f07c6237c784651448c3" exitCode=0 Jun 05 03:56:02.610954 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:02.610795 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kncxc" event={"ID":"73ba9d88-d681-49f5-aff2-049525fddc52","Type":"ContainerDied","Data":"3f9560d548462072422917d2994d5de3d08ba05df827f07c6237c784651448c3"} Jun 05 03:56:02.610954 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:02.610842 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kncxc" event={"ID":"73ba9d88-d681-49f5-aff2-049525fddc52","Type":"ContainerStarted","Data":"8e57486409640b7d068c61499cc5268282a439553c49925233636c53b6804c24"} Jun 05 03:56:04.624522 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:04.624487 2548 generic.go:356] "Generic (PLEG): container finished" podID="73ba9d88-d681-49f5-aff2-049525fddc52" containerID="3d389bbafd85cd61ea131bbcbf5686db66fe6f2c25bd6f3fc9a647314da48278" exitCode=0 Jun 05 03:56:04.624983 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:04.624573 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kncxc" event={"ID":"73ba9d88-d681-49f5-aff2-049525fddc52","Type":"ContainerDied","Data":"3d389bbafd85cd61ea131bbcbf5686db66fe6f2c25bd6f3fc9a647314da48278"} Jun 05 03:56:05.632605 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:05.632571 2548 generic.go:356] "Generic (PLEG): container finished" podID="73ba9d88-d681-49f5-aff2-049525fddc52" containerID="fdcd0b715cbb28bb96c99cd99ab071d5ff8ecef948566867426a2b53369b00ac" exitCode=0 Jun 05 03:56:05.633100 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:05.632612 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kncxc" event={"ID":"73ba9d88-d681-49f5-aff2-049525fddc52","Type":"ContainerDied","Data":"fdcd0b715cbb28bb96c99cd99ab071d5ff8ecef948566867426a2b53369b00ac"} Jun 05 03:56:06.775576 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:06.775552 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kncxc" Jun 05 03:56:06.934830 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:06.934752 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73ba9d88-d681-49f5-aff2-049525fddc52-bundle\") pod \"73ba9d88-d681-49f5-aff2-049525fddc52\" (UID: \"73ba9d88-d681-49f5-aff2-049525fddc52\") " Jun 05 03:56:06.934982 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:06.934843 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vl82g\" (UniqueName: \"kubernetes.io/projected/73ba9d88-d681-49f5-aff2-049525fddc52-kube-api-access-vl82g\") pod \"73ba9d88-d681-49f5-aff2-049525fddc52\" (UID: \"73ba9d88-d681-49f5-aff2-049525fddc52\") " Jun 05 03:56:06.934982 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:06.934886 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73ba9d88-d681-49f5-aff2-049525fddc52-util\") pod \"73ba9d88-d681-49f5-aff2-049525fddc52\" (UID: \"73ba9d88-d681-49f5-aff2-049525fddc52\") " Jun 05 03:56:06.935346 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:06.935327 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73ba9d88-d681-49f5-aff2-049525fddc52-bundle" (OuterVolumeSpecName: "bundle") pod "73ba9d88-d681-49f5-aff2-049525fddc52" (UID: "73ba9d88-d681-49f5-aff2-049525fddc52"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:56:06.937086 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:06.937059 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73ba9d88-d681-49f5-aff2-049525fddc52-kube-api-access-vl82g" (OuterVolumeSpecName: "kube-api-access-vl82g") pod "73ba9d88-d681-49f5-aff2-049525fddc52" (UID: "73ba9d88-d681-49f5-aff2-049525fddc52"). InnerVolumeSpecName "kube-api-access-vl82g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:56:06.940309 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:06.940287 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73ba9d88-d681-49f5-aff2-049525fddc52-util" (OuterVolumeSpecName: "util") pod "73ba9d88-d681-49f5-aff2-049525fddc52" (UID: "73ba9d88-d681-49f5-aff2-049525fddc52"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:56:07.035702 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:07.035670 2548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73ba9d88-d681-49f5-aff2-049525fddc52-bundle\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:56:07.035702 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:07.035698 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vl82g\" (UniqueName: \"kubernetes.io/projected/73ba9d88-d681-49f5-aff2-049525fddc52-kube-api-access-vl82g\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:56:07.035702 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:07.035708 2548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73ba9d88-d681-49f5-aff2-049525fddc52-util\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:56:07.646292 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:07.646256 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kncxc" Jun 05 03:56:07.646292 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:07.646267 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kncxc" event={"ID":"73ba9d88-d681-49f5-aff2-049525fddc52","Type":"ContainerDied","Data":"8e57486409640b7d068c61499cc5268282a439553c49925233636c53b6804c24"} Jun 05 03:56:07.646536 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:07.646318 2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8e57486409640b7d068c61499cc5268282a439553c49925233636c53b6804c24" Jun 05 03:56:30.219950 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:30.219915 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 03:56:30.220321 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:30.220299 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73ba9d88-d681-49f5-aff2-049525fddc52" containerName="pull" Jun 05 03:56:30.220321 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:30.220309 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="73ba9d88-d681-49f5-aff2-049525fddc52" containerName="pull" Jun 05 03:56:30.220395 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:30.220329 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73ba9d88-d681-49f5-aff2-049525fddc52" containerName="extract" Jun 05 03:56:30.220395 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:30.220334 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="73ba9d88-d681-49f5-aff2-049525fddc52" containerName="extract" Jun 05 03:56:30.220395 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:30.220346 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73ba9d88-d681-49f5-aff2-049525fddc52" containerName="util" Jun 05 03:56:30.220395 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:30.220352 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="73ba9d88-d681-49f5-aff2-049525fddc52" containerName="util" Jun 05 03:56:30.220557 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:30.220409 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="73ba9d88-d681-49f5-aff2-049525fddc52" containerName="extract" Jun 05 03:56:30.224746 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:30.224722 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 03:56:30.227294 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:30.227257 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 05 03:56:30.227399 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:30.227297 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 05 03:56:30.228401 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:30.228384 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-rgd9f\"" Jun 05 03:56:30.228534 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:30.228400 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 05 03:56:30.234484 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:30.234463 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 03:56:30.340869 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:30.340831 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hxk6\" (UniqueName: \"kubernetes.io/projected/15379595-da30-4497-9300-75e34e498901-kube-api-access-2hxk6\") pod \"maas-keycloak-0\" (UID: \"15379595-da30-4497-9300-75e34e498901\") " pod="keycloak-system/maas-keycloak-0" Jun 05 03:56:30.442221 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:30.442182 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hxk6\" (UniqueName: \"kubernetes.io/projected/15379595-da30-4497-9300-75e34e498901-kube-api-access-2hxk6\") pod \"maas-keycloak-0\" (UID: \"15379595-da30-4497-9300-75e34e498901\") " pod="keycloak-system/maas-keycloak-0" Jun 05 03:56:30.450833 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:30.450808 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hxk6\" (UniqueName: \"kubernetes.io/projected/15379595-da30-4497-9300-75e34e498901-kube-api-access-2hxk6\") pod \"maas-keycloak-0\" (UID: \"15379595-da30-4497-9300-75e34e498901\") " pod="keycloak-system/maas-keycloak-0" Jun 05 03:56:30.535505 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:30.535466 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 03:56:30.676353 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:30.676325 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 03:56:30.677267 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:56:30.677225 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15379595_da30_4497_9300_75e34e498901.slice/crio-f36bd55cf58959608e3c3e4702f0b26b6aae6f50bd1939c59b1c885b23c032ab WatchSource:0}: Error finding container f36bd55cf58959608e3c3e4702f0b26b6aae6f50bd1939c59b1c885b23c032ab: Status 404 returned error can't find the container with id f36bd55cf58959608e3c3e4702f0b26b6aae6f50bd1939c59b1c885b23c032ab Jun 05 03:56:30.790264 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:30.790174 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"15379595-da30-4497-9300-75e34e498901","Type":"ContainerStarted","Data":"f36bd55cf58959608e3c3e4702f0b26b6aae6f50bd1939c59b1c885b23c032ab"} Jun 05 03:56:35.830112 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:35.830073 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"15379595-da30-4497-9300-75e34e498901","Type":"ContainerStarted","Data":"736bfc36e832e36c8950378c32a2c3adff740f21d080938ccdab13d75b3b1660"} Jun 05 03:56:35.857403 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:35.857335 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.881936045 podStartE2EDuration="5.8573136s" totalImagesPullingTime="4.975377555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:56:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:56:35.853449786 +0000 UTC m=+795.123226101" watchObservedRunningTime="2026-06-05 03:56:35.8573136 +0000 UTC m=+795.127089921" Jun 05 03:56:36.536517 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:36.536470 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 05 03:56:36.538376 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:36.538341 2548 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="15379595-da30-4497-9300-75e34e498901" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.55:9000/health/started\": dial tcp 10.133.0.55:9000: connect: connection refused" Jun 05 03:56:37.535924 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:37.535883 2548 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="15379595-da30-4497-9300-75e34e498901" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.55:9000/health/started\": dial tcp 10.133.0.55:9000: connect: connection refused" Jun 05 03:56:38.536052 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:38.536007 2548 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="15379595-da30-4497-9300-75e34e498901" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.55:9000/health/started\": dial tcp 10.133.0.55:9000: connect: connection refused" Jun 05 03:56:39.536227 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:39.536155 2548 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="15379595-da30-4497-9300-75e34e498901" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.55:9000/health/started\": dial tcp 10.133.0.55:9000: connect: connection refused" Jun 05 03:56:40.536161 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:40.536115 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 05 03:56:40.536523 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:40.536485 2548 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="15379595-da30-4497-9300-75e34e498901" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.55:9000/health/started\": dial tcp 10.133.0.55:9000: connect: connection refused" Jun 05 03:56:41.536270 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:41.536219 2548 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="15379595-da30-4497-9300-75e34e498901" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.55:9000/health/started\": dial tcp 10.133.0.55:9000: connect: connection refused" Jun 05 03:56:42.535996 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:42.535940 2548 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="15379595-da30-4497-9300-75e34e498901" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.55:9000/health/started\": dial tcp 10.133.0.55:9000: connect: connection refused" Jun 05 03:56:43.536479 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:43.536414 2548 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="15379595-da30-4497-9300-75e34e498901" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.55:9000/health/started\": dial tcp 10.133.0.55:9000: connect: connection refused" Jun 05 03:56:44.536890 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:44.536838 2548 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="15379595-da30-4497-9300-75e34e498901" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.55:9000/health/started\": dial tcp 10.133.0.55:9000: connect: connection refused" Jun 05 03:56:45.536761 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:45.536714 2548 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="15379595-da30-4497-9300-75e34e498901" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.55:9000/health/started\": dial tcp 10.133.0.55:9000: connect: connection refused" Jun 05 03:56:46.536905 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:46.536849 2548 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="15379595-da30-4497-9300-75e34e498901" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.55:9000/health/started\": dial tcp 10.133.0.55:9000: connect: connection refused" Jun 05 03:56:47.536343 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:47.536285 2548 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="15379595-da30-4497-9300-75e34e498901" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.55:9000/health/started\": dial tcp 10.133.0.55:9000: connect: connection refused" Jun 05 03:56:48.536900 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:48.536463 2548 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="15379595-da30-4497-9300-75e34e498901" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.55:9000/health/started\": dial tcp 10.133.0.55:9000: connect: connection refused" Jun 05 03:56:49.668540 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:49.668504 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 05 03:56:49.689931 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:49.689877 2548 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="15379595-da30-4497-9300-75e34e498901" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 03:56:59.675618 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:56:59.675581 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 05 03:57:00.884719 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:00.884687 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-566676c75f-snrw8"] Jun 05 03:57:00.895345 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:00.895310 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-566676c75f-snrw8"] Jun 05 03:57:00.895547 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:00.895449 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-566676c75f-snrw8" Jun 05 03:57:00.897944 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:00.897916 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 05 03:57:00.949511 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:00.949425 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfdl7\" (UniqueName: \"kubernetes.io/projected/2fd116ec-48b1-44ba-8339-600f2cd13aab-kube-api-access-cfdl7\") pod \"authorino-566676c75f-snrw8\" (UID: \"2fd116ec-48b1-44ba-8339-600f2cd13aab\") " pod="kuadrant-system/authorino-566676c75f-snrw8" Jun 05 03:57:00.949725 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:00.949608 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2fd116ec-48b1-44ba-8339-600f2cd13aab-tls-cert\") pod \"authorino-566676c75f-snrw8\" (UID: \"2fd116ec-48b1-44ba-8339-600f2cd13aab\") " pod="kuadrant-system/authorino-566676c75f-snrw8" Jun 05 03:57:01.051042 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:01.051008 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2fd116ec-48b1-44ba-8339-600f2cd13aab-tls-cert\") pod \"authorino-566676c75f-snrw8\" (UID: \"2fd116ec-48b1-44ba-8339-600f2cd13aab\") " pod="kuadrant-system/authorino-566676c75f-snrw8" Jun 05 03:57:01.051213 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:01.051063 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfdl7\" (UniqueName: \"kubernetes.io/projected/2fd116ec-48b1-44ba-8339-600f2cd13aab-kube-api-access-cfdl7\") pod \"authorino-566676c75f-snrw8\" (UID: \"2fd116ec-48b1-44ba-8339-600f2cd13aab\") " pod="kuadrant-system/authorino-566676c75f-snrw8" Jun 05 03:57:01.053784 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:01.053763 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2fd116ec-48b1-44ba-8339-600f2cd13aab-tls-cert\") pod \"authorino-566676c75f-snrw8\" (UID: \"2fd116ec-48b1-44ba-8339-600f2cd13aab\") " pod="kuadrant-system/authorino-566676c75f-snrw8" Jun 05 03:57:01.058539 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:01.058509 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfdl7\" (UniqueName: \"kubernetes.io/projected/2fd116ec-48b1-44ba-8339-600f2cd13aab-kube-api-access-cfdl7\") pod \"authorino-566676c75f-snrw8\" (UID: \"2fd116ec-48b1-44ba-8339-600f2cd13aab\") " pod="kuadrant-system/authorino-566676c75f-snrw8" Jun 05 03:57:01.205094 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:01.205008 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-566676c75f-snrw8" Jun 05 03:57:01.338482 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:01.338452 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-566676c75f-snrw8"] Jun 05 03:57:01.339278 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:57:01.339252 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2fd116ec_48b1_44ba_8339_600f2cd13aab.slice/crio-022749edf04f121ccca0fd318705b72bf7ea92e32210a012502b6033b8298c21 WatchSource:0}: Error finding container 022749edf04f121ccca0fd318705b72bf7ea92e32210a012502b6033b8298c21: Status 404 returned error can't find the container with id 022749edf04f121ccca0fd318705b72bf7ea92e32210a012502b6033b8298c21 Jun 05 03:57:02.030755 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:02.030714 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-566676c75f-snrw8" event={"ID":"2fd116ec-48b1-44ba-8339-600f2cd13aab","Type":"ContainerStarted","Data":"5eff24273c11cc6db7c6bdc081cc79007d83f563312fe54fcaa42f9cf82733cf"} Jun 05 03:57:02.031143 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:02.030764 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-566676c75f-snrw8" event={"ID":"2fd116ec-48b1-44ba-8339-600f2cd13aab","Type":"ContainerStarted","Data":"022749edf04f121ccca0fd318705b72bf7ea92e32210a012502b6033b8298c21"} Jun 05 03:57:02.045421 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:02.045316 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-566676c75f-snrw8" podStartSLOduration=1.591265499 podStartE2EDuration="2.045295469s" totalImagesPullingTime="454.02997ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:57:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:57:02.044118098 +0000 UTC m=+821.313894411" watchObservedRunningTime="2026-06-05 03:57:02.045295469 +0000 UTC m=+821.315071788" Jun 05 03:57:02.069667 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:02.069635 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7m8vd"] Jun 05 03:57:02.069887 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:02.069852 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-7m8vd" podUID="a1b63de3-cea1-4efb-86f1-731f502f0edc" containerName="authorino" containerID="cri-o://d408058b993a3d4fbb76052d435a822410a2862b16f777997b1833cfba3dcf26" gracePeriod=30 Jun 05 03:57:02.348260 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:02.348233 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7m8vd" Jun 05 03:57:02.363748 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:02.363718 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jfhs\" (UniqueName: \"kubernetes.io/projected/a1b63de3-cea1-4efb-86f1-731f502f0edc-kube-api-access-5jfhs\") pod \"a1b63de3-cea1-4efb-86f1-731f502f0edc\" (UID: \"a1b63de3-cea1-4efb-86f1-731f502f0edc\") " Jun 05 03:57:02.366489 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:02.366458 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1b63de3-cea1-4efb-86f1-731f502f0edc-kube-api-access-5jfhs" (OuterVolumeSpecName: "kube-api-access-5jfhs") pod "a1b63de3-cea1-4efb-86f1-731f502f0edc" (UID: "a1b63de3-cea1-4efb-86f1-731f502f0edc"). InnerVolumeSpecName "kube-api-access-5jfhs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:57:02.464888 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:02.464851 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jfhs\" (UniqueName: \"kubernetes.io/projected/a1b63de3-cea1-4efb-86f1-731f502f0edc-kube-api-access-5jfhs\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:57:03.038363 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:03.038327 2548 generic.go:356] "Generic (PLEG): container finished" podID="a1b63de3-cea1-4efb-86f1-731f502f0edc" containerID="d408058b993a3d4fbb76052d435a822410a2862b16f777997b1833cfba3dcf26" exitCode=0 Jun 05 03:57:03.038844 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:03.038374 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7m8vd" Jun 05 03:57:03.038844 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:03.038410 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7m8vd" event={"ID":"a1b63de3-cea1-4efb-86f1-731f502f0edc","Type":"ContainerDied","Data":"d408058b993a3d4fbb76052d435a822410a2862b16f777997b1833cfba3dcf26"} Jun 05 03:57:03.038844 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:03.038472 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7m8vd" event={"ID":"a1b63de3-cea1-4efb-86f1-731f502f0edc","Type":"ContainerDied","Data":"b50818a8876e31353090e2b536135d3936181c708cd3f1345c541d4d5247ecf5"} Jun 05 03:57:03.038844 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:03.038491 2548 scope.go:117] "RemoveContainer" containerID="d408058b993a3d4fbb76052d435a822410a2862b16f777997b1833cfba3dcf26" Jun 05 03:57:03.048093 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:03.048076 2548 scope.go:117] "RemoveContainer" containerID="d408058b993a3d4fbb76052d435a822410a2862b16f777997b1833cfba3dcf26" Jun 05 03:57:03.048348 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:57:03.048331 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d408058b993a3d4fbb76052d435a822410a2862b16f777997b1833cfba3dcf26\": container with ID starting with d408058b993a3d4fbb76052d435a822410a2862b16f777997b1833cfba3dcf26 not found: ID does not exist" containerID="d408058b993a3d4fbb76052d435a822410a2862b16f777997b1833cfba3dcf26" Jun 05 03:57:03.048396 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:03.048357 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d408058b993a3d4fbb76052d435a822410a2862b16f777997b1833cfba3dcf26"} err="failed to get container status \"d408058b993a3d4fbb76052d435a822410a2862b16f777997b1833cfba3dcf26\": rpc error: code = NotFound desc = could not find container \"d408058b993a3d4fbb76052d435a822410a2862b16f777997b1833cfba3dcf26\": container with ID starting with d408058b993a3d4fbb76052d435a822410a2862b16f777997b1833cfba3dcf26 not found: ID does not exist" Jun 05 03:57:03.059491 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:03.059466 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7m8vd"] Jun 05 03:57:03.063246 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:03.063226 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7m8vd"] Jun 05 03:57:03.229903 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:03.229867 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1b63de3-cea1-4efb-86f1-731f502f0edc" path="/var/lib/kubelet/pods/a1b63de3-cea1-4efb-86f1-731f502f0edc/volumes" Jun 05 03:57:37.509008 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:37.508971 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-76xrx"] Jun 05 03:57:37.509416 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:37.509378 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1b63de3-cea1-4efb-86f1-731f502f0edc" containerName="authorino" Jun 05 03:57:37.509416 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:37.509389 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1b63de3-cea1-4efb-86f1-731f502f0edc" containerName="authorino" Jun 05 03:57:37.509518 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:37.509477 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1b63de3-cea1-4efb-86f1-731f502f0edc" containerName="authorino" Jun 05 03:57:37.514193 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:37.514170 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-76xrx" Jun 05 03:57:37.516774 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:37.516754 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-r6m99\"" Jun 05 03:57:37.516774 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:37.516764 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 05 03:57:37.522552 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:37.522411 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-76xrx"] Jun 05 03:57:37.598684 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:37.598652 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g88h\" (UniqueName: \"kubernetes.io/projected/f8a6d6cd-8b11-4c3c-ac29-249f81f30718-kube-api-access-4g88h\") pod \"payload-pre-processing-67d7689b65-76xrx\" (UID: \"f8a6d6cd-8b11-4c3c-ac29-249f81f30718\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-76xrx" Jun 05 03:57:37.699736 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:37.699690 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g88h\" (UniqueName: \"kubernetes.io/projected/f8a6d6cd-8b11-4c3c-ac29-249f81f30718-kube-api-access-4g88h\") pod \"payload-pre-processing-67d7689b65-76xrx\" (UID: \"f8a6d6cd-8b11-4c3c-ac29-249f81f30718\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-76xrx" Jun 05 03:57:37.712264 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:37.712234 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g88h\" (UniqueName: \"kubernetes.io/projected/f8a6d6cd-8b11-4c3c-ac29-249f81f30718-kube-api-access-4g88h\") pod \"payload-pre-processing-67d7689b65-76xrx\" (UID: \"f8a6d6cd-8b11-4c3c-ac29-249f81f30718\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-76xrx" Jun 05 03:57:37.825803 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:37.825720 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-76xrx" Jun 05 03:57:37.968877 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:37.968845 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-76xrx"] Jun 05 03:57:37.970194 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:57:37.970169 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8a6d6cd_8b11_4c3c_ac29_249f81f30718.slice/crio-239311f237dd90eb0393acd3c4ba2fcf2e72122efe7d2147be3aa2d286c06e45 WatchSource:0}: Error finding container 239311f237dd90eb0393acd3c4ba2fcf2e72122efe7d2147be3aa2d286c06e45: Status 404 returned error can't find the container with id 239311f237dd90eb0393acd3c4ba2fcf2e72122efe7d2147be3aa2d286c06e45 Jun 05 03:57:38.242383 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:38.242293 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-76xrx" event={"ID":"f8a6d6cd-8b11-4c3c-ac29-249f81f30718","Type":"ContainerStarted","Data":"239311f237dd90eb0393acd3c4ba2fcf2e72122efe7d2147be3aa2d286c06e45"} Jun 05 03:57:41.262617 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:41.262582 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-76xrx" event={"ID":"f8a6d6cd-8b11-4c3c-ac29-249f81f30718","Type":"ContainerStarted","Data":"f5d2ed5380d73b620c3de3a2fb660b2c7b40d77eee0de2c060756e7bd5bbd39a"} Jun 05 03:57:41.263034 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:41.262715 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-76xrx" Jun 05 03:57:41.278409 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:41.278362 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-76xrx" podStartSLOduration=1.829897699 podStartE2EDuration="4.278347281s" totalImagesPullingTime="2.448449582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:57:41.277354385 +0000 UTC m=+860.547130715" watchObservedRunningTime="2026-06-05 03:57:41.278347281 +0000 UTC m=+860.548123598" Jun 05 03:57:49.416652 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:49.416599 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 03:57:49.417573 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:49.417502 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="15379595-da30-4497-9300-75e34e498901" containerName="keycloak" containerID="cri-o://736bfc36e832e36c8950378c32a2c3adff740f21d080938ccdab13d75b3b1660" gracePeriod=30 Jun 05 03:57:49.673675 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:49.673573 2548 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="15379595-da30-4497-9300-75e34e498901" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 03:57:50.967952 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:50.967925 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 03:57:51.028731 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:51.028687 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hxk6\" (UniqueName: \"kubernetes.io/projected/15379595-da30-4497-9300-75e34e498901-kube-api-access-2hxk6\") pod \"15379595-da30-4497-9300-75e34e498901\" (UID: \"15379595-da30-4497-9300-75e34e498901\") " Jun 05 03:57:51.030988 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:51.030960 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15379595-da30-4497-9300-75e34e498901-kube-api-access-2hxk6" (OuterVolumeSpecName: "kube-api-access-2hxk6") pod "15379595-da30-4497-9300-75e34e498901" (UID: "15379595-da30-4497-9300-75e34e498901"). InnerVolumeSpecName "kube-api-access-2hxk6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:57:51.129791 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:51.129694 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hxk6\" (UniqueName: \"kubernetes.io/projected/15379595-da30-4497-9300-75e34e498901-kube-api-access-2hxk6\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:57:51.321389 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:51.321356 2548 generic.go:356] "Generic (PLEG): container finished" podID="15379595-da30-4497-9300-75e34e498901" containerID="736bfc36e832e36c8950378c32a2c3adff740f21d080938ccdab13d75b3b1660" exitCode=143 Jun 05 03:57:51.321640 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:51.321395 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 03:57:51.321640 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:51.321420 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"15379595-da30-4497-9300-75e34e498901","Type":"ContainerDied","Data":"736bfc36e832e36c8950378c32a2c3adff740f21d080938ccdab13d75b3b1660"} Jun 05 03:57:51.321640 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:51.321498 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"15379595-da30-4497-9300-75e34e498901","Type":"ContainerDied","Data":"f36bd55cf58959608e3c3e4702f0b26b6aae6f50bd1939c59b1c885b23c032ab"} Jun 05 03:57:51.321640 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:51.321522 2548 scope.go:117] "RemoveContainer" containerID="736bfc36e832e36c8950378c32a2c3adff740f21d080938ccdab13d75b3b1660" Jun 05 03:57:51.331962 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:51.331942 2548 scope.go:117] "RemoveContainer" containerID="736bfc36e832e36c8950378c32a2c3adff740f21d080938ccdab13d75b3b1660" Jun 05 03:57:51.332243 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:57:51.332226 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"736bfc36e832e36c8950378c32a2c3adff740f21d080938ccdab13d75b3b1660\": container with ID starting with 736bfc36e832e36c8950378c32a2c3adff740f21d080938ccdab13d75b3b1660 not found: ID does not exist" containerID="736bfc36e832e36c8950378c32a2c3adff740f21d080938ccdab13d75b3b1660" Jun 05 03:57:51.332290 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:51.332252 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"736bfc36e832e36c8950378c32a2c3adff740f21d080938ccdab13d75b3b1660"} err="failed to get container status \"736bfc36e832e36c8950378c32a2c3adff740f21d080938ccdab13d75b3b1660\": rpc error: code = NotFound desc = could not find container \"736bfc36e832e36c8950378c32a2c3adff740f21d080938ccdab13d75b3b1660\": container with ID starting with 736bfc36e832e36c8950378c32a2c3adff740f21d080938ccdab13d75b3b1660 not found: ID does not exist" Jun 05 03:57:51.339418 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:51.339392 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 03:57:51.341803 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:51.341784 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 03:57:51.360378 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:51.360346 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 03:57:51.360807 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:51.360776 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15379595-da30-4497-9300-75e34e498901" containerName="keycloak" Jun 05 03:57:51.360807 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:51.360800 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="15379595-da30-4497-9300-75e34e498901" containerName="keycloak" Jun 05 03:57:51.360980 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:51.360898 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="15379595-da30-4497-9300-75e34e498901" containerName="keycloak" Jun 05 03:57:51.365320 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:51.365302 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 03:57:51.368055 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:51.368030 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 05 03:57:51.368150 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:51.368069 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 05 03:57:51.368150 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:51.368032 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 05 03:57:51.368150 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:51.368034 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 05 03:57:51.368150 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:51.368034 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-rgd9f\"" Jun 05 03:57:51.374388 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:51.374366 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 03:57:51.431272 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:51.431170 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/37c28d15-3552-4836-a05c-78470cb0e245-test-realms\") pod \"maas-keycloak-0\" (UID: \"37c28d15-3552-4836-a05c-78470cb0e245\") " pod="keycloak-system/maas-keycloak-0" Jun 05 03:57:51.431272 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:51.431265 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9jkd\" (UniqueName: \"kubernetes.io/projected/37c28d15-3552-4836-a05c-78470cb0e245-kube-api-access-r9jkd\") pod \"maas-keycloak-0\" (UID: \"37c28d15-3552-4836-a05c-78470cb0e245\") " pod="keycloak-system/maas-keycloak-0" Jun 05 03:57:51.532767 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:51.532730 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/37c28d15-3552-4836-a05c-78470cb0e245-test-realms\") pod \"maas-keycloak-0\" (UID: \"37c28d15-3552-4836-a05c-78470cb0e245\") " pod="keycloak-system/maas-keycloak-0" Jun 05 03:57:51.532949 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:51.532781 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9jkd\" (UniqueName: \"kubernetes.io/projected/37c28d15-3552-4836-a05c-78470cb0e245-kube-api-access-r9jkd\") pod \"maas-keycloak-0\" (UID: \"37c28d15-3552-4836-a05c-78470cb0e245\") " pod="keycloak-system/maas-keycloak-0" Jun 05 03:57:51.533517 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:51.533499 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/37c28d15-3552-4836-a05c-78470cb0e245-test-realms\") pod \"maas-keycloak-0\" (UID: \"37c28d15-3552-4836-a05c-78470cb0e245\") " pod="keycloak-system/maas-keycloak-0" Jun 05 03:57:51.541934 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:51.541906 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9jkd\" (UniqueName: \"kubernetes.io/projected/37c28d15-3552-4836-a05c-78470cb0e245-kube-api-access-r9jkd\") pod \"maas-keycloak-0\" (UID: \"37c28d15-3552-4836-a05c-78470cb0e245\") " pod="keycloak-system/maas-keycloak-0" Jun 05 03:57:51.677813 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:51.677776 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 03:57:51.817824 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:51.817798 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 03:57:51.818933 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:57:51.818908 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37c28d15_3552_4836_a05c_78470cb0e245.slice/crio-f36b10a27046585dda6963676a5985b998557c4e65d3283ad7c91d5db897f80f WatchSource:0}: Error finding container f36b10a27046585dda6963676a5985b998557c4e65d3283ad7c91d5db897f80f: Status 404 returned error can't find the container with id f36b10a27046585dda6963676a5985b998557c4e65d3283ad7c91d5db897f80f Jun 05 03:57:52.270116 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:52.270091 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-76xrx" Jun 05 03:57:52.331773 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:52.331739 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"37c28d15-3552-4836-a05c-78470cb0e245","Type":"ContainerStarted","Data":"cd343eca935ba5219bc3a6ca24a6672b8704a6c2d5bc087247e842ea8e50ef6a"} Jun 05 03:57:52.331950 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:52.331794 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"37c28d15-3552-4836-a05c-78470cb0e245","Type":"ContainerStarted","Data":"f36b10a27046585dda6963676a5985b998557c4e65d3283ad7c91d5db897f80f"} Jun 05 03:57:52.350069 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:52.350019 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.932656449 podStartE2EDuration="1.350004548s" totalImagesPullingTime="417.348099ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:57:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:57:52.349280875 +0000 UTC m=+871.619057195" watchObservedRunningTime="2026-06-05 03:57:52.350004548 +0000 UTC m=+871.619780866" Jun 05 03:57:52.678006 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:52.677966 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 05 03:57:52.679508 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:52.679481 2548 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37c28d15-3552-4836-a05c-78470cb0e245" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.58:9000/health/started\": dial tcp 10.133.0.58:9000: connect: connection refused" Jun 05 03:57:53.232343 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:53.232289 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15379595-da30-4497-9300-75e34e498901" path="/var/lib/kubelet/pods/15379595-da30-4497-9300-75e34e498901/volumes" Jun 05 03:57:53.679169 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:53.679116 2548 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37c28d15-3552-4836-a05c-78470cb0e245" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.58:9000/health/started\": dial tcp 10.133.0.58:9000: connect: connection refused" Jun 05 03:57:54.678358 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:54.678303 2548 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37c28d15-3552-4836-a05c-78470cb0e245" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.58:9000/health/started\": dial tcp 10.133.0.58:9000: connect: connection refused" Jun 05 03:57:55.678482 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:55.678403 2548 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37c28d15-3552-4836-a05c-78470cb0e245" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.58:9000/health/started\": dial tcp 10.133.0.58:9000: connect: connection refused" Jun 05 03:57:56.678740 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:56.678678 2548 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37c28d15-3552-4836-a05c-78470cb0e245" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.58:9000/health/started\": dial tcp 10.133.0.58:9000: connect: connection refused" Jun 05 03:57:57.678854 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:57.678807 2548 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37c28d15-3552-4836-a05c-78470cb0e245" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.58:9000/health/started\": dial tcp 10.133.0.58:9000: connect: connection refused" Jun 05 03:57:58.678864 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:58.678809 2548 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37c28d15-3552-4836-a05c-78470cb0e245" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.58:9000/health/started\": dial tcp 10.133.0.58:9000: connect: connection refused" Jun 05 03:57:59.679319 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:57:59.679260 2548 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37c28d15-3552-4836-a05c-78470cb0e245" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.58:9000/health/started\": dial tcp 10.133.0.58:9000: connect: connection refused" Jun 05 03:58:00.679069 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:00.679014 2548 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37c28d15-3552-4836-a05c-78470cb0e245" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.58:9000/health/started\": dial tcp 10.133.0.58:9000: connect: connection refused" Jun 05 03:58:01.678888 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:01.678837 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 05 03:58:01.679322 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:01.679223 2548 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37c28d15-3552-4836-a05c-78470cb0e245" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.58:9000/health/started\": dial tcp 10.133.0.58:9000: connect: connection refused" Jun 05 03:58:02.678357 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:02.678305 2548 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37c28d15-3552-4836-a05c-78470cb0e245" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.58:9000/health/started\": dial tcp 10.133.0.58:9000: connect: connection refused" Jun 05 03:58:03.678465 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:03.678398 2548 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37c28d15-3552-4836-a05c-78470cb0e245" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.58:9000/health/started\": dial tcp 10.133.0.58:9000: connect: connection refused" Jun 05 03:58:04.678988 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:04.678943 2548 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37c28d15-3552-4836-a05c-78470cb0e245" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.58:9000/health/started\": dial tcp 10.133.0.58:9000: connect: connection refused" Jun 05 03:58:05.769268 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:05.769225 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 05 03:58:05.786484 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:05.786115 2548 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="37c28d15-3552-4836-a05c-78470cb0e245" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 03:58:15.776222 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:15.776184 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 05 03:58:21.273655 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:21.273619 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whn2g_9139fc4f-a2c4-4323-aac8-55b73d33aba2/ovn-acl-logging/0.log" Jun 05 03:58:21.276213 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:21.274848 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whn2g_9139fc4f-a2c4-4323-aac8-55b73d33aba2/ovn-acl-logging/0.log" Jun 05 03:58:27.855846 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:27.855807 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-566676c75f-snrw8"] Jun 05 03:58:27.856658 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:27.856603 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-566676c75f-snrw8" podUID="2fd116ec-48b1-44ba-8339-600f2cd13aab" containerName="authorino" containerID="cri-o://5eff24273c11cc6db7c6bdc081cc79007d83f563312fe54fcaa42f9cf82733cf" gracePeriod=30 Jun 05 03:58:28.120881 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:28.120824 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-566676c75f-snrw8" Jun 05 03:58:28.188862 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:28.188828 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfdl7\" (UniqueName: \"kubernetes.io/projected/2fd116ec-48b1-44ba-8339-600f2cd13aab-kube-api-access-cfdl7\") pod \"2fd116ec-48b1-44ba-8339-600f2cd13aab\" (UID: \"2fd116ec-48b1-44ba-8339-600f2cd13aab\") " Jun 05 03:58:28.189054 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:28.188908 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2fd116ec-48b1-44ba-8339-600f2cd13aab-tls-cert\") pod \"2fd116ec-48b1-44ba-8339-600f2cd13aab\" (UID: \"2fd116ec-48b1-44ba-8339-600f2cd13aab\") " Jun 05 03:58:28.191077 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:28.191055 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fd116ec-48b1-44ba-8339-600f2cd13aab-kube-api-access-cfdl7" (OuterVolumeSpecName: "kube-api-access-cfdl7") pod "2fd116ec-48b1-44ba-8339-600f2cd13aab" (UID: "2fd116ec-48b1-44ba-8339-600f2cd13aab"). InnerVolumeSpecName "kube-api-access-cfdl7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:58:28.199839 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:28.199814 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fd116ec-48b1-44ba-8339-600f2cd13aab-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "2fd116ec-48b1-44ba-8339-600f2cd13aab" (UID: "2fd116ec-48b1-44ba-8339-600f2cd13aab"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 03:58:28.290044 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:28.290007 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfdl7\" (UniqueName: \"kubernetes.io/projected/2fd116ec-48b1-44ba-8339-600f2cd13aab-kube-api-access-cfdl7\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:58:28.290044 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:28.290034 2548 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2fd116ec-48b1-44ba-8339-600f2cd13aab-tls-cert\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 03:58:28.612254 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:28.612217 2548 generic.go:356] "Generic (PLEG): container finished" podID="2fd116ec-48b1-44ba-8339-600f2cd13aab" containerID="5eff24273c11cc6db7c6bdc081cc79007d83f563312fe54fcaa42f9cf82733cf" exitCode=0 Jun 05 03:58:28.612425 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:28.612268 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-566676c75f-snrw8" Jun 05 03:58:28.612425 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:28.612277 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-566676c75f-snrw8" event={"ID":"2fd116ec-48b1-44ba-8339-600f2cd13aab","Type":"ContainerDied","Data":"5eff24273c11cc6db7c6bdc081cc79007d83f563312fe54fcaa42f9cf82733cf"} Jun 05 03:58:28.612425 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:28.612314 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-566676c75f-snrw8" event={"ID":"2fd116ec-48b1-44ba-8339-600f2cd13aab","Type":"ContainerDied","Data":"022749edf04f121ccca0fd318705b72bf7ea92e32210a012502b6033b8298c21"} Jun 05 03:58:28.612425 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:28.612333 2548 scope.go:117] "RemoveContainer" containerID="5eff24273c11cc6db7c6bdc081cc79007d83f563312fe54fcaa42f9cf82733cf" Jun 05 03:58:28.624697 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:28.624674 2548 scope.go:117] "RemoveContainer" containerID="5eff24273c11cc6db7c6bdc081cc79007d83f563312fe54fcaa42f9cf82733cf" Jun 05 03:58:28.624949 ip-10-0-132-53 kubenswrapper[2548]: E0605 03:58:28.624931 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5eff24273c11cc6db7c6bdc081cc79007d83f563312fe54fcaa42f9cf82733cf\": container with ID starting with 5eff24273c11cc6db7c6bdc081cc79007d83f563312fe54fcaa42f9cf82733cf not found: ID does not exist" containerID="5eff24273c11cc6db7c6bdc081cc79007d83f563312fe54fcaa42f9cf82733cf" Jun 05 03:58:28.625016 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:28.624957 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5eff24273c11cc6db7c6bdc081cc79007d83f563312fe54fcaa42f9cf82733cf"} err="failed to get container status \"5eff24273c11cc6db7c6bdc081cc79007d83f563312fe54fcaa42f9cf82733cf\": rpc error: code = NotFound desc = could not find container \"5eff24273c11cc6db7c6bdc081cc79007d83f563312fe54fcaa42f9cf82733cf\": container with ID starting with 5eff24273c11cc6db7c6bdc081cc79007d83f563312fe54fcaa42f9cf82733cf not found: ID does not exist" Jun 05 03:58:28.641996 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:28.641968 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-566676c75f-snrw8"] Jun 05 03:58:28.649738 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:28.649718 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-566676c75f-snrw8"] Jun 05 03:58:29.229506 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:29.229475 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fd116ec-48b1-44ba-8339-600f2cd13aab" path="/var/lib/kubelet/pods/2fd116ec-48b1-44ba-8339-600f2cd13aab/volumes" Jun 05 03:58:34.790980 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:34.790949 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84"] Jun 05 03:58:34.791479 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:34.791370 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fd116ec-48b1-44ba-8339-600f2cd13aab" containerName="authorino" Jun 05 03:58:34.791479 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:34.791381 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fd116ec-48b1-44ba-8339-600f2cd13aab" containerName="authorino" Jun 05 03:58:34.791479 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:34.791477 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fd116ec-48b1-44ba-8339-600f2cd13aab" containerName="authorino" Jun 05 03:58:34.796206 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:34.796189 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84" Jun 05 03:58:34.799995 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:34.799956 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 05 03:58:34.800116 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:34.800067 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hc9ks\"" Jun 05 03:58:34.800420 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:34.800291 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 05 03:58:34.800420 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:34.800304 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 05 03:58:34.804649 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:34.804622 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84"] Jun 05 03:58:34.852406 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:34.852371 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/246c9d2a-6a25-4fa0-8a95-d120a0ab99d8-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84\" (UID: \"246c9d2a-6a25-4fa0-8a95-d120a0ab99d8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84" Jun 05 03:58:34.852591 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:34.852420 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/246c9d2a-6a25-4fa0-8a95-d120a0ab99d8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84\" (UID: \"246c9d2a-6a25-4fa0-8a95-d120a0ab99d8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84" Jun 05 03:58:34.852591 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:34.852517 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/246c9d2a-6a25-4fa0-8a95-d120a0ab99d8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84\" (UID: \"246c9d2a-6a25-4fa0-8a95-d120a0ab99d8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84" Jun 05 03:58:34.852591 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:34.852558 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/246c9d2a-6a25-4fa0-8a95-d120a0ab99d8-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84\" (UID: \"246c9d2a-6a25-4fa0-8a95-d120a0ab99d8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84" Jun 05 03:58:34.852591 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:34.852584 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/246c9d2a-6a25-4fa0-8a95-d120a0ab99d8-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84\" (UID: \"246c9d2a-6a25-4fa0-8a95-d120a0ab99d8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84" Jun 05 03:58:34.852735 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:34.852598 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mnpl\" (UniqueName: \"kubernetes.io/projected/246c9d2a-6a25-4fa0-8a95-d120a0ab99d8-kube-api-access-9mnpl\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84\" (UID: \"246c9d2a-6a25-4fa0-8a95-d120a0ab99d8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84" Jun 05 03:58:34.953756 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:34.953720 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/246c9d2a-6a25-4fa0-8a95-d120a0ab99d8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84\" (UID: \"246c9d2a-6a25-4fa0-8a95-d120a0ab99d8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84" Jun 05 03:58:34.953956 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:34.953793 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/246c9d2a-6a25-4fa0-8a95-d120a0ab99d8-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84\" (UID: \"246c9d2a-6a25-4fa0-8a95-d120a0ab99d8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84" Jun 05 03:58:34.953956 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:34.953835 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/246c9d2a-6a25-4fa0-8a95-d120a0ab99d8-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84\" (UID: \"246c9d2a-6a25-4fa0-8a95-d120a0ab99d8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84" Jun 05 03:58:34.953956 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:34.953859 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mnpl\" (UniqueName: \"kubernetes.io/projected/246c9d2a-6a25-4fa0-8a95-d120a0ab99d8-kube-api-access-9mnpl\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84\" (UID: \"246c9d2a-6a25-4fa0-8a95-d120a0ab99d8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84" Jun 05 03:58:34.953956 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:34.953907 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/246c9d2a-6a25-4fa0-8a95-d120a0ab99d8-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84\" (UID: \"246c9d2a-6a25-4fa0-8a95-d120a0ab99d8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84" Jun 05 03:58:34.953956 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:34.953947 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/246c9d2a-6a25-4fa0-8a95-d120a0ab99d8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84\" (UID: \"246c9d2a-6a25-4fa0-8a95-d120a0ab99d8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84" Jun 05 03:58:34.954292 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:34.954270 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/246c9d2a-6a25-4fa0-8a95-d120a0ab99d8-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84\" (UID: \"246c9d2a-6a25-4fa0-8a95-d120a0ab99d8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84" Jun 05 03:58:34.954380 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:34.954297 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/246c9d2a-6a25-4fa0-8a95-d120a0ab99d8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84\" (UID: \"246c9d2a-6a25-4fa0-8a95-d120a0ab99d8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84" Jun 05 03:58:34.954380 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:34.954337 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/246c9d2a-6a25-4fa0-8a95-d120a0ab99d8-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84\" (UID: \"246c9d2a-6a25-4fa0-8a95-d120a0ab99d8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84" Jun 05 03:58:34.956306 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:34.956284 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/246c9d2a-6a25-4fa0-8a95-d120a0ab99d8-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84\" (UID: \"246c9d2a-6a25-4fa0-8a95-d120a0ab99d8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84" Jun 05 03:58:34.956564 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:34.956548 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/246c9d2a-6a25-4fa0-8a95-d120a0ab99d8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84\" (UID: \"246c9d2a-6a25-4fa0-8a95-d120a0ab99d8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84" Jun 05 03:58:34.961752 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:34.961726 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mnpl\" (UniqueName: \"kubernetes.io/projected/246c9d2a-6a25-4fa0-8a95-d120a0ab99d8-kube-api-access-9mnpl\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84\" (UID: \"246c9d2a-6a25-4fa0-8a95-d120a0ab99d8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84" Jun 05 03:58:35.109587 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:35.109500 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84" Jun 05 03:58:35.251398 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:35.251365 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84"] Jun 05 03:58:35.252083 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:58:35.252056 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod246c9d2a_6a25_4fa0_8a95_d120a0ab99d8.slice/crio-8d7676f52716bf51b848d82d7abcc004af2b86585e2c106c0b35e4a928ff52ad WatchSource:0}: Error finding container 8d7676f52716bf51b848d82d7abcc004af2b86585e2c106c0b35e4a928ff52ad: Status 404 returned error can't find the container with id 8d7676f52716bf51b848d82d7abcc004af2b86585e2c106c0b35e4a928ff52ad Jun 05 03:58:35.659583 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:35.659537 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84" event={"ID":"246c9d2a-6a25-4fa0-8a95-d120a0ab99d8","Type":"ContainerStarted","Data":"8d7676f52716bf51b848d82d7abcc004af2b86585e2c106c0b35e4a928ff52ad"} Jun 05 03:58:39.688642 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:39.688598 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84" event={"ID":"246c9d2a-6a25-4fa0-8a95-d120a0ab99d8","Type":"ContainerStarted","Data":"553f8b158f2b4b698540f91ec8a599adc9a4fafe51e6e1979425a89cc51c4cf3"} Jun 05 03:58:40.695524 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:40.695487 2548 generic.go:356] "Generic (PLEG): container finished" podID="246c9d2a-6a25-4fa0-8a95-d120a0ab99d8" containerID="553f8b158f2b4b698540f91ec8a599adc9a4fafe51e6e1979425a89cc51c4cf3" exitCode=0 Jun 05 03:58:40.695976 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:40.695571 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84" event={"ID":"246c9d2a-6a25-4fa0-8a95-d120a0ab99d8","Type":"ContainerDied","Data":"553f8b158f2b4b698540f91ec8a599adc9a4fafe51e6e1979425a89cc51c4cf3"} Jun 05 03:58:42.709088 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:42.709051 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84" event={"ID":"246c9d2a-6a25-4fa0-8a95-d120a0ab99d8","Type":"ContainerStarted","Data":"e2dcf63ad4354e425f204bc86f441834ac050b127cceec14e501914623fb36c0"} Jun 05 03:58:42.730609 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:42.730559 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84" podStartSLOduration=3.027976581 podStartE2EDuration="8.730544367s" totalImagesPullingTime="4.470025041s" totalInitContainerRuntime="1.232542745s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:58:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:58:42.727550825 +0000 UTC m=+921.997327142" watchObservedRunningTime="2026-06-05 03:58:42.730544367 +0000 UTC m=+922.000320685" Jun 05 03:58:43.695101 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:43.695065 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-rgmsh"] Jun 05 03:58:43.698852 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:43.698831 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rgmsh" Jun 05 03:58:43.701321 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:43.701304 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 05 03:58:43.708906 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:43.708877 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-rgmsh"] Jun 05 03:58:43.836478 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:43.836406 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzlt9\" (UniqueName: \"kubernetes.io/projected/5c9388c8-6c50-4982-9d5c-50ee8f43f57d-kube-api-access-rzlt9\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rgmsh\" (UID: \"5c9388c8-6c50-4982-9d5c-50ee8f43f57d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rgmsh" Jun 05 03:58:43.836941 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:43.836561 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c9388c8-6c50-4982-9d5c-50ee8f43f57d-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rgmsh\" (UID: \"5c9388c8-6c50-4982-9d5c-50ee8f43f57d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rgmsh" Jun 05 03:58:43.836941 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:43.836622 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c9388c8-6c50-4982-9d5c-50ee8f43f57d-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rgmsh\" (UID: \"5c9388c8-6c50-4982-9d5c-50ee8f43f57d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rgmsh" Jun 05 03:58:43.836941 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:43.836693 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c9388c8-6c50-4982-9d5c-50ee8f43f57d-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rgmsh\" (UID: \"5c9388c8-6c50-4982-9d5c-50ee8f43f57d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rgmsh" Jun 05 03:58:43.836941 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:43.836758 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5c9388c8-6c50-4982-9d5c-50ee8f43f57d-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rgmsh\" (UID: \"5c9388c8-6c50-4982-9d5c-50ee8f43f57d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rgmsh" Jun 05 03:58:43.836941 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:43.836825 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c9388c8-6c50-4982-9d5c-50ee8f43f57d-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rgmsh\" (UID: \"5c9388c8-6c50-4982-9d5c-50ee8f43f57d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rgmsh" Jun 05 03:58:43.937453 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:43.937387 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzlt9\" (UniqueName: \"kubernetes.io/projected/5c9388c8-6c50-4982-9d5c-50ee8f43f57d-kube-api-access-rzlt9\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rgmsh\" (UID: \"5c9388c8-6c50-4982-9d5c-50ee8f43f57d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rgmsh" Jun 05 03:58:43.937644 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:43.937477 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c9388c8-6c50-4982-9d5c-50ee8f43f57d-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rgmsh\" (UID: \"5c9388c8-6c50-4982-9d5c-50ee8f43f57d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rgmsh" Jun 05 03:58:43.937644 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:43.937514 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c9388c8-6c50-4982-9d5c-50ee8f43f57d-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rgmsh\" (UID: \"5c9388c8-6c50-4982-9d5c-50ee8f43f57d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rgmsh" Jun 05 03:58:43.937644 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:43.937553 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c9388c8-6c50-4982-9d5c-50ee8f43f57d-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rgmsh\" (UID: \"5c9388c8-6c50-4982-9d5c-50ee8f43f57d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rgmsh" Jun 05 03:58:43.937644 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:43.937591 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5c9388c8-6c50-4982-9d5c-50ee8f43f57d-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rgmsh\" (UID: \"5c9388c8-6c50-4982-9d5c-50ee8f43f57d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rgmsh" Jun 05 03:58:43.937644 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:43.937628 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c9388c8-6c50-4982-9d5c-50ee8f43f57d-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rgmsh\" (UID: \"5c9388c8-6c50-4982-9d5c-50ee8f43f57d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rgmsh" Jun 05 03:58:43.937987 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:43.937965 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c9388c8-6c50-4982-9d5c-50ee8f43f57d-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rgmsh\" (UID: \"5c9388c8-6c50-4982-9d5c-50ee8f43f57d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rgmsh" Jun 05 03:58:43.938052 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:43.938012 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5c9388c8-6c50-4982-9d5c-50ee8f43f57d-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rgmsh\" (UID: \"5c9388c8-6c50-4982-9d5c-50ee8f43f57d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rgmsh" Jun 05 03:58:43.938052 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:43.938020 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c9388c8-6c50-4982-9d5c-50ee8f43f57d-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rgmsh\" (UID: \"5c9388c8-6c50-4982-9d5c-50ee8f43f57d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rgmsh" Jun 05 03:58:43.940065 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:43.940036 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c9388c8-6c50-4982-9d5c-50ee8f43f57d-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rgmsh\" (UID: \"5c9388c8-6c50-4982-9d5c-50ee8f43f57d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rgmsh" Jun 05 03:58:43.940253 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:43.940236 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c9388c8-6c50-4982-9d5c-50ee8f43f57d-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rgmsh\" (UID: \"5c9388c8-6c50-4982-9d5c-50ee8f43f57d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rgmsh" Jun 05 03:58:43.946369 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:43.946319 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzlt9\" (UniqueName: \"kubernetes.io/projected/5c9388c8-6c50-4982-9d5c-50ee8f43f57d-kube-api-access-rzlt9\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-rgmsh\" (UID: \"5c9388c8-6c50-4982-9d5c-50ee8f43f57d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rgmsh" Jun 05 03:58:44.010048 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:44.010008 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rgmsh" Jun 05 03:58:44.153346 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:44.153323 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-rgmsh"] Jun 05 03:58:44.155594 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:58:44.155554 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c9388c8_6c50_4982_9d5c_50ee8f43f57d.slice/crio-353571853ff280d59e7d31183c10154f16d3c065fb6057c5bb5cb84eeeaadb21 WatchSource:0}: Error finding container 353571853ff280d59e7d31183c10154f16d3c065fb6057c5bb5cb84eeeaadb21: Status 404 returned error can't find the container with id 353571853ff280d59e7d31183c10154f16d3c065fb6057c5bb5cb84eeeaadb21 Jun 05 03:58:44.724707 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:44.724669 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rgmsh" event={"ID":"5c9388c8-6c50-4982-9d5c-50ee8f43f57d","Type":"ContainerStarted","Data":"ac7cce4c6c7cc49264de02b3096320cf0bcfc1dc9cfa0ba9ecf254fda4e9deed"} Jun 05 03:58:44.724852 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:44.724732 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rgmsh" event={"ID":"5c9388c8-6c50-4982-9d5c-50ee8f43f57d","Type":"ContainerStarted","Data":"353571853ff280d59e7d31183c10154f16d3c065fb6057c5bb5cb84eeeaadb21"} Jun 05 03:58:45.110240 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:45.110201 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84" Jun 05 03:58:45.110730 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:45.110272 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84" Jun 05 03:58:45.123134 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:45.123104 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84" Jun 05 03:58:45.742066 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:45.742037 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84" Jun 05 03:58:55.200233 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:55.200198 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5"] Jun 05 03:58:55.221303 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:55.221264 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5"] Jun 05 03:58:55.221492 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:55.221459 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5" Jun 05 03:58:55.224009 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:55.223983 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 05 03:58:55.352563 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:55.352509 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00dc694c-5d3c-4f9f-86ea-414d8fdbe473-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5\" (UID: \"00dc694c-5d3c-4f9f-86ea-414d8fdbe473\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5" Jun 05 03:58:55.352563 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:55.352570 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkh9p\" (UniqueName: \"kubernetes.io/projected/00dc694c-5d3c-4f9f-86ea-414d8fdbe473-kube-api-access-fkh9p\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5\" (UID: \"00dc694c-5d3c-4f9f-86ea-414d8fdbe473\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5" Jun 05 03:58:55.352835 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:55.352664 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00dc694c-5d3c-4f9f-86ea-414d8fdbe473-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5\" (UID: \"00dc694c-5d3c-4f9f-86ea-414d8fdbe473\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5" Jun 05 03:58:55.352835 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:55.352704 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/00dc694c-5d3c-4f9f-86ea-414d8fdbe473-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5\" (UID: \"00dc694c-5d3c-4f9f-86ea-414d8fdbe473\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5" Jun 05 03:58:55.352835 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:55.352732 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00dc694c-5d3c-4f9f-86ea-414d8fdbe473-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5\" (UID: \"00dc694c-5d3c-4f9f-86ea-414d8fdbe473\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5" Jun 05 03:58:55.352835 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:55.352798 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00dc694c-5d3c-4f9f-86ea-414d8fdbe473-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5\" (UID: \"00dc694c-5d3c-4f9f-86ea-414d8fdbe473\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5" Jun 05 03:58:55.454038 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:55.453942 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00dc694c-5d3c-4f9f-86ea-414d8fdbe473-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5\" (UID: \"00dc694c-5d3c-4f9f-86ea-414d8fdbe473\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5" Jun 05 03:58:55.454038 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:55.453989 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkh9p\" (UniqueName: \"kubernetes.io/projected/00dc694c-5d3c-4f9f-86ea-414d8fdbe473-kube-api-access-fkh9p\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5\" (UID: \"00dc694c-5d3c-4f9f-86ea-414d8fdbe473\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5" Jun 05 03:58:55.454038 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:55.454038 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00dc694c-5d3c-4f9f-86ea-414d8fdbe473-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5\" (UID: \"00dc694c-5d3c-4f9f-86ea-414d8fdbe473\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5" Jun 05 03:58:55.454315 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:55.454066 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/00dc694c-5d3c-4f9f-86ea-414d8fdbe473-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5\" (UID: \"00dc694c-5d3c-4f9f-86ea-414d8fdbe473\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5" Jun 05 03:58:55.454315 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:55.454084 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00dc694c-5d3c-4f9f-86ea-414d8fdbe473-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5\" (UID: \"00dc694c-5d3c-4f9f-86ea-414d8fdbe473\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5" Jun 05 03:58:55.454315 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:55.454228 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00dc694c-5d3c-4f9f-86ea-414d8fdbe473-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5\" (UID: \"00dc694c-5d3c-4f9f-86ea-414d8fdbe473\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5" Jun 05 03:58:55.454525 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:55.454410 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00dc694c-5d3c-4f9f-86ea-414d8fdbe473-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5\" (UID: \"00dc694c-5d3c-4f9f-86ea-414d8fdbe473\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5" Jun 05 03:58:55.454585 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:55.454530 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/00dc694c-5d3c-4f9f-86ea-414d8fdbe473-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5\" (UID: \"00dc694c-5d3c-4f9f-86ea-414d8fdbe473\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5" Jun 05 03:58:55.454648 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:55.454631 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00dc694c-5d3c-4f9f-86ea-414d8fdbe473-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5\" (UID: \"00dc694c-5d3c-4f9f-86ea-414d8fdbe473\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5" Jun 05 03:58:55.456497 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:55.456479 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00dc694c-5d3c-4f9f-86ea-414d8fdbe473-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5\" (UID: \"00dc694c-5d3c-4f9f-86ea-414d8fdbe473\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5" Jun 05 03:58:55.456762 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:55.456745 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00dc694c-5d3c-4f9f-86ea-414d8fdbe473-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5\" (UID: \"00dc694c-5d3c-4f9f-86ea-414d8fdbe473\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5" Jun 05 03:58:55.461696 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:55.461665 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkh9p\" (UniqueName: \"kubernetes.io/projected/00dc694c-5d3c-4f9f-86ea-414d8fdbe473-kube-api-access-fkh9p\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5\" (UID: \"00dc694c-5d3c-4f9f-86ea-414d8fdbe473\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5" Jun 05 03:58:55.534408 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:55.534372 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5" Jun 05 03:58:55.678488 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:55.678457 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5"] Jun 05 03:58:55.678721 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:58:55.678698 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00dc694c_5d3c_4f9f_86ea_414d8fdbe473.slice/crio-dca5707587dd5b79d03e23f16ce0419a84cb3a15258d6d645a1a743830a6145f WatchSource:0}: Error finding container dca5707587dd5b79d03e23f16ce0419a84cb3a15258d6d645a1a743830a6145f: Status 404 returned error can't find the container with id dca5707587dd5b79d03e23f16ce0419a84cb3a15258d6d645a1a743830a6145f Jun 05 03:58:55.793077 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:55.793038 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5" event={"ID":"00dc694c-5d3c-4f9f-86ea-414d8fdbe473","Type":"ContainerStarted","Data":"3a7404d70cc741d02307781f83fe42d0456baf37aa7dec7bf494443a6f6edddb"} Jun 05 03:58:55.793299 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:58:55.793105 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5" event={"ID":"00dc694c-5d3c-4f9f-86ea-414d8fdbe473","Type":"ContainerStarted","Data":"dca5707587dd5b79d03e23f16ce0419a84cb3a15258d6d645a1a743830a6145f"} Jun 05 03:59:13.201115 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:13.201082 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n"] Jun 05 03:59:13.204843 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:13.204824 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n" Jun 05 03:59:13.207263 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:13.207244 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 05 03:59:13.212064 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:13.211705 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c970c5e1-dcbb-410b-a562-c22caa0e8ea4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n\" (UID: \"c970c5e1-dcbb-410b-a562-c22caa0e8ea4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n" Jun 05 03:59:13.212064 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:13.211761 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c970c5e1-dcbb-410b-a562-c22caa0e8ea4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n\" (UID: \"c970c5e1-dcbb-410b-a562-c22caa0e8ea4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n" Jun 05 03:59:13.212064 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:13.211830 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c970c5e1-dcbb-410b-a562-c22caa0e8ea4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n\" (UID: \"c970c5e1-dcbb-410b-a562-c22caa0e8ea4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n" Jun 05 03:59:13.212064 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:13.211868 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c970c5e1-dcbb-410b-a562-c22caa0e8ea4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n\" (UID: \"c970c5e1-dcbb-410b-a562-c22caa0e8ea4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n" Jun 05 03:59:13.212064 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:13.211953 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c970c5e1-dcbb-410b-a562-c22caa0e8ea4-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n\" (UID: \"c970c5e1-dcbb-410b-a562-c22caa0e8ea4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n" Jun 05 03:59:13.212064 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:13.211993 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t75jt\" (UniqueName: \"kubernetes.io/projected/c970c5e1-dcbb-410b-a562-c22caa0e8ea4-kube-api-access-t75jt\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n\" (UID: \"c970c5e1-dcbb-410b-a562-c22caa0e8ea4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n" Jun 05 03:59:13.213420 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:13.213396 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n"] Jun 05 03:59:13.313009 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:13.312974 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c970c5e1-dcbb-410b-a562-c22caa0e8ea4-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n\" (UID: \"c970c5e1-dcbb-410b-a562-c22caa0e8ea4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n" Jun 05 03:59:13.313210 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:13.313015 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t75jt\" (UniqueName: \"kubernetes.io/projected/c970c5e1-dcbb-410b-a562-c22caa0e8ea4-kube-api-access-t75jt\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n\" (UID: \"c970c5e1-dcbb-410b-a562-c22caa0e8ea4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n" Jun 05 03:59:13.313210 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:13.313057 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c970c5e1-dcbb-410b-a562-c22caa0e8ea4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n\" (UID: \"c970c5e1-dcbb-410b-a562-c22caa0e8ea4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n" Jun 05 03:59:13.313210 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:13.313080 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c970c5e1-dcbb-410b-a562-c22caa0e8ea4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n\" (UID: \"c970c5e1-dcbb-410b-a562-c22caa0e8ea4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n" Jun 05 03:59:13.313210 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:13.313105 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c970c5e1-dcbb-410b-a562-c22caa0e8ea4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n\" (UID: \"c970c5e1-dcbb-410b-a562-c22caa0e8ea4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n" Jun 05 03:59:13.313210 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:13.313124 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c970c5e1-dcbb-410b-a562-c22caa0e8ea4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n\" (UID: \"c970c5e1-dcbb-410b-a562-c22caa0e8ea4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n" Jun 05 03:59:13.313513 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:13.313495 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c970c5e1-dcbb-410b-a562-c22caa0e8ea4-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n\" (UID: \"c970c5e1-dcbb-410b-a562-c22caa0e8ea4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n" Jun 05 03:59:13.313603 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:13.313573 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c970c5e1-dcbb-410b-a562-c22caa0e8ea4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n\" (UID: \"c970c5e1-dcbb-410b-a562-c22caa0e8ea4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n" Jun 05 03:59:13.313733 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:13.313616 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c970c5e1-dcbb-410b-a562-c22caa0e8ea4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n\" (UID: \"c970c5e1-dcbb-410b-a562-c22caa0e8ea4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n" Jun 05 03:59:13.315545 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:13.315525 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c970c5e1-dcbb-410b-a562-c22caa0e8ea4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n\" (UID: \"c970c5e1-dcbb-410b-a562-c22caa0e8ea4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n" Jun 05 03:59:13.315821 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:13.315799 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c970c5e1-dcbb-410b-a562-c22caa0e8ea4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n\" (UID: \"c970c5e1-dcbb-410b-a562-c22caa0e8ea4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n" Jun 05 03:59:13.321856 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:13.321835 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t75jt\" (UniqueName: \"kubernetes.io/projected/c970c5e1-dcbb-410b-a562-c22caa0e8ea4-kube-api-access-t75jt\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n\" (UID: \"c970c5e1-dcbb-410b-a562-c22caa0e8ea4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n" Jun 05 03:59:13.517499 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:13.517457 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n" Jun 05 03:59:13.658702 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:13.658668 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n"] Jun 05 03:59:13.659223 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:59:13.659198 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc970c5e1_dcbb_410b_a562_c22caa0e8ea4.slice/crio-f64f0057184c4350398af18ef553a95b82834bfb7945adde8ddaf9e34a737a15 WatchSource:0}: Error finding container f64f0057184c4350398af18ef553a95b82834bfb7945adde8ddaf9e34a737a15: Status 404 returned error can't find the container with id f64f0057184c4350398af18ef553a95b82834bfb7945adde8ddaf9e34a737a15 Jun 05 03:59:13.900761 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:13.900659 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n" event={"ID":"c970c5e1-dcbb-410b-a562-c22caa0e8ea4","Type":"ContainerStarted","Data":"109e6e02bf0d20290e1c02b562513be03437fc00ef9dc4133e058d41af91b9ba"} Jun 05 03:59:13.900761 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:13.900730 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n" event={"ID":"c970c5e1-dcbb-410b-a562-c22caa0e8ea4","Type":"ContainerStarted","Data":"f64f0057184c4350398af18ef553a95b82834bfb7945adde8ddaf9e34a737a15"} Jun 05 03:59:17.101953 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:17.101921 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw"] Jun 05 03:59:17.106976 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:17.106956 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw" Jun 05 03:59:17.109684 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:17.109662 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 05 03:59:17.118845 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:17.118816 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw"] Jun 05 03:59:17.148774 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:17.148739 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4fbf32a0-f5e4-4d42-b40c-707176d61dd7-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw\" (UID: \"4fbf32a0-f5e4-4d42-b40c-707176d61dd7\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw" Jun 05 03:59:17.148922 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:17.148788 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4fbf32a0-f5e4-4d42-b40c-707176d61dd7-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw\" (UID: \"4fbf32a0-f5e4-4d42-b40c-707176d61dd7\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw" Jun 05 03:59:17.148922 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:17.148850 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4fbf32a0-f5e4-4d42-b40c-707176d61dd7-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw\" (UID: \"4fbf32a0-f5e4-4d42-b40c-707176d61dd7\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw" Jun 05 03:59:17.148922 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:17.148899 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4fbf32a0-f5e4-4d42-b40c-707176d61dd7-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw\" (UID: \"4fbf32a0-f5e4-4d42-b40c-707176d61dd7\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw" Jun 05 03:59:17.149030 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:17.148958 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fbf32a0-f5e4-4d42-b40c-707176d61dd7-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw\" (UID: \"4fbf32a0-f5e4-4d42-b40c-707176d61dd7\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw" Jun 05 03:59:17.149030 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:17.148977 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzq5x\" (UniqueName: \"kubernetes.io/projected/4fbf32a0-f5e4-4d42-b40c-707176d61dd7-kube-api-access-bzq5x\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw\" (UID: \"4fbf32a0-f5e4-4d42-b40c-707176d61dd7\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw" Jun 05 03:59:17.249901 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:17.249866 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4fbf32a0-f5e4-4d42-b40c-707176d61dd7-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw\" (UID: \"4fbf32a0-f5e4-4d42-b40c-707176d61dd7\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw" Jun 05 03:59:17.250091 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:17.249910 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4fbf32a0-f5e4-4d42-b40c-707176d61dd7-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw\" (UID: \"4fbf32a0-f5e4-4d42-b40c-707176d61dd7\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw" Jun 05 03:59:17.250091 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:17.249934 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4fbf32a0-f5e4-4d42-b40c-707176d61dd7-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw\" (UID: \"4fbf32a0-f5e4-4d42-b40c-707176d61dd7\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw" Jun 05 03:59:17.250091 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:17.249968 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4fbf32a0-f5e4-4d42-b40c-707176d61dd7-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw\" (UID: \"4fbf32a0-f5e4-4d42-b40c-707176d61dd7\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw" Jun 05 03:59:17.250091 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:17.250058 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fbf32a0-f5e4-4d42-b40c-707176d61dd7-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw\" (UID: \"4fbf32a0-f5e4-4d42-b40c-707176d61dd7\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw" Jun 05 03:59:17.250091 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:17.250085 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzq5x\" (UniqueName: \"kubernetes.io/projected/4fbf32a0-f5e4-4d42-b40c-707176d61dd7-kube-api-access-bzq5x\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw\" (UID: \"4fbf32a0-f5e4-4d42-b40c-707176d61dd7\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw" Jun 05 03:59:17.250337 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:17.250238 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4fbf32a0-f5e4-4d42-b40c-707176d61dd7-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw\" (UID: \"4fbf32a0-f5e4-4d42-b40c-707176d61dd7\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw" Jun 05 03:59:17.250337 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:17.250303 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4fbf32a0-f5e4-4d42-b40c-707176d61dd7-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw\" (UID: \"4fbf32a0-f5e4-4d42-b40c-707176d61dd7\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw" Jun 05 03:59:17.250471 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:17.250336 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4fbf32a0-f5e4-4d42-b40c-707176d61dd7-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw\" (UID: \"4fbf32a0-f5e4-4d42-b40c-707176d61dd7\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw" Jun 05 03:59:17.252543 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:17.252520 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4fbf32a0-f5e4-4d42-b40c-707176d61dd7-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw\" (UID: \"4fbf32a0-f5e4-4d42-b40c-707176d61dd7\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw" Jun 05 03:59:17.252652 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:17.252635 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fbf32a0-f5e4-4d42-b40c-707176d61dd7-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw\" (UID: \"4fbf32a0-f5e4-4d42-b40c-707176d61dd7\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw" Jun 05 03:59:17.262180 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:17.262155 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzq5x\" (UniqueName: \"kubernetes.io/projected/4fbf32a0-f5e4-4d42-b40c-707176d61dd7-kube-api-access-bzq5x\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw\" (UID: \"4fbf32a0-f5e4-4d42-b40c-707176d61dd7\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw" Jun 05 03:59:17.419910 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:17.419818 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw" Jun 05 03:59:17.558713 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:17.558680 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw"] Jun 05 03:59:17.559213 ip-10-0-132-53 kubenswrapper[2548]: W0605 03:59:17.559181 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fbf32a0_f5e4_4d42_b40c_707176d61dd7.slice/crio-fcf9272405a7a25dc0c2bf80e3829ddbcac57c353d3c0ba36db639ddc6e1269c WatchSource:0}: Error finding container fcf9272405a7a25dc0c2bf80e3829ddbcac57c353d3c0ba36db639ddc6e1269c: Status 404 returned error can't find the container with id fcf9272405a7a25dc0c2bf80e3829ddbcac57c353d3c0ba36db639ddc6e1269c Jun 05 03:59:17.925658 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:17.925617 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw" event={"ID":"4fbf32a0-f5e4-4d42-b40c-707176d61dd7","Type":"ContainerStarted","Data":"519aa3df0bbcbaba24686a6bdf3205edf2e659f8ae3571578eb91fba06dbfd5d"} Jun 05 03:59:17.925849 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:17.925678 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw" event={"ID":"4fbf32a0-f5e4-4d42-b40c-707176d61dd7","Type":"ContainerStarted","Data":"fcf9272405a7a25dc0c2bf80e3829ddbcac57c353d3c0ba36db639ddc6e1269c"} Jun 05 03:59:19.938728 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:19.938693 2548 generic.go:356] "Generic (PLEG): container finished" podID="00dc694c-5d3c-4f9f-86ea-414d8fdbe473" containerID="3a7404d70cc741d02307781f83fe42d0456baf37aa7dec7bf494443a6f6edddb" exitCode=0 Jun 05 03:59:19.939107 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:19.938766 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5" event={"ID":"00dc694c-5d3c-4f9f-86ea-414d8fdbe473","Type":"ContainerDied","Data":"3a7404d70cc741d02307781f83fe42d0456baf37aa7dec7bf494443a6f6edddb"} Jun 05 03:59:19.939399 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:19.939384 2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 03:59:20.947705 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:20.947615 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5" event={"ID":"00dc694c-5d3c-4f9f-86ea-414d8fdbe473","Type":"ContainerStarted","Data":"a18ce8c291dde0e95a2d186255327aaeefbd704e12a991e56023718b74e0e9e9"} Jun 05 03:59:20.968386 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:20.968338 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5" podStartSLOduration=2.447196982 podStartE2EDuration="25.968323954s" totalImagesPullingTime="211.817952ms" totalInitContainerRuntime="23.30930902s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:58:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:59:20.966871207 +0000 UTC m=+960.236647526" watchObservedRunningTime="2026-06-05 03:59:20.968323954 +0000 UTC m=+960.238100324" Jun 05 03:59:25.535230 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:25.535187 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5" Jun 05 03:59:25.535687 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:25.535264 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5" Jun 05 03:59:25.547882 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:25.547853 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5" Jun 05 03:59:25.989308 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:25.989217 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5" Jun 05 03:59:37.044376 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:37.044334 2548 generic.go:356] "Generic (PLEG): container finished" podID="5c9388c8-6c50-4982-9d5c-50ee8f43f57d" containerID="ac7cce4c6c7cc49264de02b3096320cf0bcfc1dc9cfa0ba9ecf254fda4e9deed" exitCode=0 Jun 05 03:59:37.044761 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:37.044400 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rgmsh" event={"ID":"5c9388c8-6c50-4982-9d5c-50ee8f43f57d","Type":"ContainerDied","Data":"ac7cce4c6c7cc49264de02b3096320cf0bcfc1dc9cfa0ba9ecf254fda4e9deed"} Jun 05 03:59:38.053150 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:38.053119 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rgmsh" event={"ID":"5c9388c8-6c50-4982-9d5c-50ee8f43f57d","Type":"ContainerStarted","Data":"718a2753d1c46ac03e224f9ccac49f413d97694427adaa6f9d09b95f3e396866"} Jun 05 03:59:38.073592 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:38.073538 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rgmsh" podStartSLOduration=2.87669391 podStartE2EDuration="55.073521869s" totalImagesPullingTime="174.586133ms" totalInitContainerRuntime="52.022241826s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:58:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:59:38.070663162 +0000 UTC m=+977.340439491" watchObservedRunningTime="2026-06-05 03:59:38.073521869 +0000 UTC m=+977.343298186" Jun 05 03:59:44.011164 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:44.011064 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rgmsh" Jun 05 03:59:44.011164 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:44.011145 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rgmsh" Jun 05 03:59:44.024495 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:44.024465 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rgmsh" Jun 05 03:59:44.106455 ip-10-0-132-53 kubenswrapper[2548]: I0605 03:59:44.106387 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-rgmsh" Jun 05 04:00:08.252580 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:00:08.252547 2548 generic.go:356] "Generic (PLEG): container finished" podID="c970c5e1-dcbb-410b-a562-c22caa0e8ea4" containerID="109e6e02bf0d20290e1c02b562513be03437fc00ef9dc4133e058d41af91b9ba" exitCode=0 Jun 05 04:00:08.253043 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:00:08.252624 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n" event={"ID":"c970c5e1-dcbb-410b-a562-c22caa0e8ea4","Type":"ContainerDied","Data":"109e6e02bf0d20290e1c02b562513be03437fc00ef9dc4133e058d41af91b9ba"} Jun 05 04:00:16.310733 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:00:16.310695 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n" event={"ID":"c970c5e1-dcbb-410b-a562-c22caa0e8ea4","Type":"ContainerStarted","Data":"cb6b88ecf8c05dbc4d91c8071e7f3196fc60c0dc9752cb201199ea8d087f9047"} Jun 05 04:00:16.332190 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:00:16.332130 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n" podStartSLOduration=1.9934117759999999 podStartE2EDuration="1m3.332112597s" totalImagesPullingTime="7.061680789s" totalInitContainerRuntime="54.277020032s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 04:00:16.328792569 +0000 UTC m=+1015.598568910" watchObservedRunningTime="2026-06-05 04:00:16.332112597 +0000 UTC m=+1015.601888930" Jun 05 04:00:23.518206 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:00:23.518172 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n" Jun 05 04:00:23.518690 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:00:23.518231 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n" Jun 05 04:00:23.530569 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:00:23.530547 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n" Jun 05 04:00:24.375944 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:00:24.375917 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n" Jun 05 04:00:36.449705 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:00:36.449668 2548 generic.go:356] "Generic (PLEG): container finished" podID="4fbf32a0-f5e4-4d42-b40c-707176d61dd7" containerID="519aa3df0bbcbaba24686a6bdf3205edf2e659f8ae3571578eb91fba06dbfd5d" exitCode=0 Jun 05 04:00:36.450108 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:00:36.449716 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw" event={"ID":"4fbf32a0-f5e4-4d42-b40c-707176d61dd7","Type":"ContainerDied","Data":"519aa3df0bbcbaba24686a6bdf3205edf2e659f8ae3571578eb91fba06dbfd5d"} Jun 05 04:00:43.494877 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:00:43.494838 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw" event={"ID":"4fbf32a0-f5e4-4d42-b40c-707176d61dd7","Type":"ContainerStarted","Data":"377ce286eca0e92b1e0abb736455ef596a3e2de36888df021e31f94ff144fbb7"} Jun 05 04:00:43.513772 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:00:43.513724 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw" podStartSLOduration=1.837284651 podStartE2EDuration="1m26.513710143s" totalImagesPullingTime="6.426838543s" totalInitContainerRuntime="1m18.249586949s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:59:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 04:00:43.512258231 +0000 UTC m=+1042.782034549" watchObservedRunningTime="2026-06-05 04:00:43.513710143 +0000 UTC m=+1042.783486460" Jun 05 04:00:47.420534 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:00:47.420489 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw" Jun 05 04:00:47.421113 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:00:47.420573 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw" Jun 05 04:00:47.433152 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:00:47.433126 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw" Jun 05 04:00:47.531607 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:00:47.531579 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw" Jun 05 04:03:21.318810 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:03:21.318704 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whn2g_9139fc4f-a2c4-4323-aac8-55b73d33aba2/ovn-acl-logging/0.log" Jun 05 04:03:21.322923 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:03:21.321225 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whn2g_9139fc4f-a2c4-4323-aac8-55b73d33aba2/ovn-acl-logging/0.log" Jun 05 04:08:21.369956 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:08:21.369836 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whn2g_9139fc4f-a2c4-4323-aac8-55b73d33aba2/ovn-acl-logging/0.log" Jun 05 04:08:21.373073 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:08:21.372284 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whn2g_9139fc4f-a2c4-4323-aac8-55b73d33aba2/ovn-acl-logging/0.log" Jun 05 04:13:19.769057 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:13:19.769017 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v2lph"] Jun 05 04:13:19.769539 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:13:19.769223 2548 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v2lph" podUID="507eae85-d1ee-499b-9f15-bde0b2d3a6e5" containerName="manager" containerID="cri-o://fb7702d0bf439e3f07a5dafd6fbd49acd8de97a27f3fa36ad224bcd118251506" gracePeriod=10 Jun 05 04:13:20.227809 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:13:20.227778 2548 generic.go:356] "Generic (PLEG): container finished" podID="507eae85-d1ee-499b-9f15-bde0b2d3a6e5" containerID="fb7702d0bf439e3f07a5dafd6fbd49acd8de97a27f3fa36ad224bcd118251506" exitCode=0 Jun 05 04:13:20.227973 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:13:20.227854 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v2lph" event={"ID":"507eae85-d1ee-499b-9f15-bde0b2d3a6e5","Type":"ContainerDied","Data":"fb7702d0bf439e3f07a5dafd6fbd49acd8de97a27f3fa36ad224bcd118251506"} Jun 05 04:13:20.839420 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:13:20.839394 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v2lph" Jun 05 04:13:20.899398 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:13:20.899365 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mm9db\" (UniqueName: \"kubernetes.io/projected/507eae85-d1ee-499b-9f15-bde0b2d3a6e5-kube-api-access-mm9db\") pod \"507eae85-d1ee-499b-9f15-bde0b2d3a6e5\" (UID: \"507eae85-d1ee-499b-9f15-bde0b2d3a6e5\") " Jun 05 04:13:20.899621 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:13:20.899406 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/507eae85-d1ee-499b-9f15-bde0b2d3a6e5-extensions-socket-volume\") pod \"507eae85-d1ee-499b-9f15-bde0b2d3a6e5\" (UID: \"507eae85-d1ee-499b-9f15-bde0b2d3a6e5\") " Jun 05 04:13:20.899860 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:13:20.899838 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/507eae85-d1ee-499b-9f15-bde0b2d3a6e5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "507eae85-d1ee-499b-9f15-bde0b2d3a6e5" (UID: "507eae85-d1ee-499b-9f15-bde0b2d3a6e5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 04:13:20.901674 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:13:20.901656 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/507eae85-d1ee-499b-9f15-bde0b2d3a6e5-kube-api-access-mm9db" (OuterVolumeSpecName: "kube-api-access-mm9db") pod "507eae85-d1ee-499b-9f15-bde0b2d3a6e5" (UID: "507eae85-d1ee-499b-9f15-bde0b2d3a6e5"). InnerVolumeSpecName "kube-api-access-mm9db". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 04:13:21.001078 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:13:21.000994 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mm9db\" (UniqueName: \"kubernetes.io/projected/507eae85-d1ee-499b-9f15-bde0b2d3a6e5-kube-api-access-mm9db\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 04:13:21.001078 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:13:21.001033 2548 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/507eae85-d1ee-499b-9f15-bde0b2d3a6e5-extensions-socket-volume\") on node \"ip-10-0-132-53.ec2.internal\" DevicePath \"\"" Jun 05 04:13:21.234874 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:13:21.234845 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v2lph" Jun 05 04:13:21.235073 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:13:21.234875 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v2lph" event={"ID":"507eae85-d1ee-499b-9f15-bde0b2d3a6e5","Type":"ContainerDied","Data":"71d953ad395b2fce0914ae18473ab05eda7b227bbc9f2979a9d81f39f1fbe926"} Jun 05 04:13:21.235073 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:13:21.234942 2548 scope.go:117] "RemoveContainer" containerID="fb7702d0bf439e3f07a5dafd6fbd49acd8de97a27f3fa36ad224bcd118251506" Jun 05 04:13:21.255885 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:13:21.255861 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v2lph"] Jun 05 04:13:21.259739 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:13:21.259711 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v2lph"] Jun 05 04:13:21.412161 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:13:21.412033 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whn2g_9139fc4f-a2c4-4323-aac8-55b73d33aba2/ovn-acl-logging/0.log" Jun 05 04:13:21.421608 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:13:21.415841 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whn2g_9139fc4f-a2c4-4323-aac8-55b73d33aba2/ovn-acl-logging/0.log" Jun 05 04:13:23.228856 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:13:23.228823 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="507eae85-d1ee-499b-9f15-bde0b2d3a6e5" path="/var/lib/kubelet/pods/507eae85-d1ee-499b-9f15-bde0b2d3a6e5/volumes" Jun 05 04:14:25.903385 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:14:25.903351 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n4db9"] Jun 05 04:14:25.903876 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:14:25.903800 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="507eae85-d1ee-499b-9f15-bde0b2d3a6e5" containerName="manager" Jun 05 04:14:25.903876 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:14:25.903813 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="507eae85-d1ee-499b-9f15-bde0b2d3a6e5" containerName="manager" Jun 05 04:14:25.903952 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:14:25.903889 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="507eae85-d1ee-499b-9f15-bde0b2d3a6e5" containerName="manager" Jun 05 04:14:25.906948 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:14:25.906929 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n4db9" Jun 05 04:14:25.909558 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:14:25.909537 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-c94xh\"" Jun 05 04:14:25.921045 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:14:25.921021 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n4db9"] Jun 05 04:14:25.944122 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:14:25.944085 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20966bbb-e1f3-4cd4-afa8-3799a54c3ab6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-n4db9\" (UID: \"20966bbb-e1f3-4cd4-afa8-3799a54c3ab6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n4db9" Jun 05 04:14:25.944284 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:14:25.944210 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqmpj\" (UniqueName: \"kubernetes.io/projected/20966bbb-e1f3-4cd4-afa8-3799a54c3ab6-kube-api-access-hqmpj\") pod \"kuadrant-operator-controller-manager-86878c769f-n4db9\" (UID: \"20966bbb-e1f3-4cd4-afa8-3799a54c3ab6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n4db9" Jun 05 04:14:26.045287 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:14:26.045242 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20966bbb-e1f3-4cd4-afa8-3799a54c3ab6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-n4db9\" (UID: \"20966bbb-e1f3-4cd4-afa8-3799a54c3ab6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n4db9" Jun 05 04:14:26.045508 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:14:26.045362 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqmpj\" (UniqueName: \"kubernetes.io/projected/20966bbb-e1f3-4cd4-afa8-3799a54c3ab6-kube-api-access-hqmpj\") pod \"kuadrant-operator-controller-manager-86878c769f-n4db9\" (UID: \"20966bbb-e1f3-4cd4-afa8-3799a54c3ab6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n4db9" Jun 05 04:14:26.045669 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:14:26.045649 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20966bbb-e1f3-4cd4-afa8-3799a54c3ab6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-n4db9\" (UID: \"20966bbb-e1f3-4cd4-afa8-3799a54c3ab6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n4db9" Jun 05 04:14:26.053597 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:14:26.053569 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqmpj\" (UniqueName: \"kubernetes.io/projected/20966bbb-e1f3-4cd4-afa8-3799a54c3ab6-kube-api-access-hqmpj\") pod \"kuadrant-operator-controller-manager-86878c769f-n4db9\" (UID: \"20966bbb-e1f3-4cd4-afa8-3799a54c3ab6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n4db9" Jun 05 04:14:26.217908 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:14:26.217827 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n4db9" Jun 05 04:14:26.368552 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:14:26.368468 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n4db9"] Jun 05 04:14:26.653486 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:14:26.653417 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n4db9" event={"ID":"20966bbb-e1f3-4cd4-afa8-3799a54c3ab6","Type":"ContainerStarted","Data":"4f46d61ef8678e79065e2ab2be1c7c9e100e82f8de6680c8f23532338d343817"} Jun 05 04:14:26.653673 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:14:26.653539 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n4db9" event={"ID":"20966bbb-e1f3-4cd4-afa8-3799a54c3ab6","Type":"ContainerStarted","Data":"947b53ece13025fa8ec50ddef142387df0c11c1d9d490bafc62cb614783f1862"} Jun 05 04:14:26.653722 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:14:26.653688 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n4db9" Jun 05 04:14:26.672398 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:14:26.672347 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n4db9" podStartSLOduration=1.6723321420000001 podStartE2EDuration="1.672332142s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 04:14:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 04:14:26.670206697 +0000 UTC m=+1865.939983018" watchObservedRunningTime="2026-06-05 04:14:26.672332142 +0000 UTC m=+1865.942108536" Jun 05 04:14:37.661882 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:14:37.661843 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n4db9" Jun 05 04:18:21.454802 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:18:21.454678 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whn2g_9139fc4f-a2c4-4323-aac8-55b73d33aba2/ovn-acl-logging/0.log" Jun 05 04:18:21.460599 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:18:21.460578 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whn2g_9139fc4f-a2c4-4323-aac8-55b73d33aba2/ovn-acl-logging/0.log" Jun 05 04:23:21.497001 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:23:21.496879 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whn2g_9139fc4f-a2c4-4323-aac8-55b73d33aba2/ovn-acl-logging/0.log" Jun 05 04:23:21.505336 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:23:21.505317 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whn2g_9139fc4f-a2c4-4323-aac8-55b73d33aba2/ovn-acl-logging/0.log" Jun 05 04:24:30.997005 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:30.996976 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-ccfd96f5-c2fzx_d9df0f2c-b166-4b43-a272-21a48aeab89a/nginx/0.log" Jun 05 04:24:32.193654 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:32.193627 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-589666b55-4nrml_8172e642-2dd1-4ca6-b6db-aec42c867b50/copy-manifests/0.log" Jun 05 04:24:32.200114 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:32.200092 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-589666b55-4nrml_8172e642-2dd1-4ca6-b6db-aec42c867b50/manager/0.log" Jun 05 04:24:32.562864 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:32.562834 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-ltlqz_0758a08b-a60d-497a-ad87-24f233776d75/postgres/0.log" Jun 05 04:24:33.356706 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:33.356668 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759phkhd_01ee2609-c3b9-4cb8-8ab5-46b0577a5952/util/0.log" Jun 05 04:24:33.362560 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:33.362531 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759phkhd_01ee2609-c3b9-4cb8-8ab5-46b0577a5952/pull/0.log" Jun 05 04:24:33.367930 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:33.367893 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759phkhd_01ee2609-c3b9-4cb8-8ab5-46b0577a5952/extract/0.log" Jun 05 04:24:33.480815 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:33.480788 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ws4f4_34b1e21e-6f61-4269-83c4-bd3e3978722c/util/0.log" Jun 05 04:24:33.487843 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:33.487810 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ws4f4_34b1e21e-6f61-4269-83c4-bd3e3978722c/pull/0.log" Jun 05 04:24:33.494369 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:33.494345 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ws4f4_34b1e21e-6f61-4269-83c4-bd3e3978722c/extract/0.log" Jun 05 04:24:33.610814 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:33.610731 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wf7b_b7e9c9f4-e61b-45da-a63b-62600ee518b4/util/0.log" Jun 05 04:24:33.617555 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:33.617530 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wf7b_b7e9c9f4-e61b-45da-a63b-62600ee518b4/pull/0.log" Jun 05 04:24:33.624186 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:33.624167 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wf7b_b7e9c9f4-e61b-45da-a63b-62600ee518b4/extract/0.log" Jun 05 04:24:33.738421 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:33.738392 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1twvlk_9e7b56ab-1856-4718-af84-c14bc9240a72/extract/0.log" Jun 05 04:24:33.744285 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:33.744256 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1twvlk_9e7b56ab-1856-4718-af84-c14bc9240a72/util/0.log" Jun 05 04:24:33.750176 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:33.750158 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1twvlk_9e7b56ab-1856-4718-af84-c14bc9240a72/pull/0.log" Jun 05 04:24:34.001879 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:34.001855 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-4w5c8_3ae6a937-ebe8-4460-9de3-c10c6591346b/manager/0.log" Jun 05 04:24:34.333980 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:34.333900 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-xh7ws_e059422d-dbe3-4506-a94b-58a380353181/registry-server/0.log" Jun 05 04:24:34.457595 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:34.457568 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-n4db9_20966bbb-e1f3-4cd4-afa8-3799a54c3ab6/manager/0.log" Jun 05 04:24:35.046986 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:35.046953 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795ck9hn_0f15771d-46f7-4c8b-9129-679f5f66ea6d/istio-proxy/0.log" Jun 05 04:24:35.633098 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:35.633068 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-76xrx_f8a6d6cd-8b11-4c3c-ac29-249f81f30718/payload-pre-processing/0.log" Jun 05 04:24:36.213677 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:36.213650 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84_246c9d2a-6a25-4fa0-8a95-d120a0ab99d8/storage-initializer/0.log" Jun 05 04:24:36.220710 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:36.220688 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-jqp84_246c9d2a-6a25-4fa0-8a95-d120a0ab99d8/main/0.log" Jun 05 04:24:36.334757 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:36.334724 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-rgmsh_5c9388c8-6c50-4982-9d5c-50ee8f43f57d/storage-initializer/0.log" Jun 05 04:24:36.341081 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:36.341059 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-rgmsh_5c9388c8-6c50-4982-9d5c-50ee8f43f57d/main/0.log" Jun 05 04:24:36.453897 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:36.453869 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5_00dc694c-5d3c-4f9f-86ea-414d8fdbe473/storage-initializer/0.log" Jun 05 04:24:36.460806 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:36.460774 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-gkkw5_00dc694c-5d3c-4f9f-86ea-414d8fdbe473/main/0.log" Jun 05 04:24:36.574759 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:36.574731 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n_c970c5e1-dcbb-410b-a562-c22caa0e8ea4/storage-initializer/0.log" Jun 05 04:24:36.582044 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:36.582021 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8hb8n_c970c5e1-dcbb-410b-a562-c22caa0e8ea4/main/0.log" Jun 05 04:24:36.697956 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:36.697927 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw_4fbf32a0-f5e4-4d42-b40c-707176d61dd7/storage-initializer/0.log" Jun 05 04:24:36.704892 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:36.704872 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-pn8fw_4fbf32a0-f5e4-4d42-b40c-707176d61dd7/main/0.log" Jun 05 04:24:44.243055 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:44.243011 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-q9df4_8e00145e-4995-452b-998a-fbf922eb164b/global-pull-secret-syncer/0.log" Jun 05 04:24:44.318546 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:44.318513 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-w4d7w_f52355f5-a3a3-41a7-a7b4-1cc79455252c/konnectivity-agent/0.log" Jun 05 04:24:44.364548 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:44.364521 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-53.ec2.internal_0c9f235f3ca1afcafebb0bbf5be2792c/haproxy/0.log" Jun 05 04:24:48.945616 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:48.945587 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759phkhd_01ee2609-c3b9-4cb8-8ab5-46b0577a5952/extract/0.log" Jun 05 04:24:48.967364 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:48.967336 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759phkhd_01ee2609-c3b9-4cb8-8ab5-46b0577a5952/util/0.log" Jun 05 04:24:48.991603 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:48.991567 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759phkhd_01ee2609-c3b9-4cb8-8ab5-46b0577a5952/pull/0.log" Jun 05 04:24:49.026000 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:49.025969 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ws4f4_34b1e21e-6f61-4269-83c4-bd3e3978722c/extract/0.log" Jun 05 04:24:49.047660 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:49.047632 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ws4f4_34b1e21e-6f61-4269-83c4-bd3e3978722c/util/0.log" Jun 05 04:24:49.101368 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:49.101342 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ws4f4_34b1e21e-6f61-4269-83c4-bd3e3978722c/pull/0.log" Jun 05 04:24:49.152357 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:49.152331 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wf7b_b7e9c9f4-e61b-45da-a63b-62600ee518b4/extract/0.log" Jun 05 04:24:49.213157 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:49.213067 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wf7b_b7e9c9f4-e61b-45da-a63b-62600ee518b4/util/0.log" Jun 05 04:24:49.249181 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:49.249150 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wf7b_b7e9c9f4-e61b-45da-a63b-62600ee518b4/pull/0.log" Jun 05 04:24:49.279174 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:49.279144 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1twvlk_9e7b56ab-1856-4718-af84-c14bc9240a72/extract/0.log" Jun 05 04:24:49.305150 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:49.305120 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1twvlk_9e7b56ab-1856-4718-af84-c14bc9240a72/util/0.log" Jun 05 04:24:49.330665 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:49.330638 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1twvlk_9e7b56ab-1856-4718-af84-c14bc9240a72/pull/0.log" Jun 05 04:24:49.720047 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:49.720020 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-4w5c8_3ae6a937-ebe8-4460-9de3-c10c6591346b/manager/0.log" Jun 05 04:24:49.816705 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:49.816677 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-xh7ws_e059422d-dbe3-4506-a94b-58a380353181/registry-server/0.log" Jun 05 04:24:49.870402 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:49.870357 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-n4db9_20966bbb-e1f3-4cd4-afa8-3799a54c3ab6/manager/0.log" Jun 05 04:24:51.737637 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:51.737601 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-7ttbz_3b670160-bbf2-4468-98ee-55269506ff2a/cluster-monitoring-operator/0.log" Jun 05 04:24:51.765113 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:51.765058 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-rhvn7_2e130185-59d5-46eb-bbfb-f740c3894b05/kube-state-metrics/0.log" Jun 05 04:24:51.783438 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:51.783410 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-rhvn7_2e130185-59d5-46eb-bbfb-f740c3894b05/kube-rbac-proxy-main/0.log" Jun 05 04:24:51.805600 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:51.805566 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-rhvn7_2e130185-59d5-46eb-bbfb-f740c3894b05/kube-rbac-proxy-self/0.log" Jun 05 04:24:51.863389 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:51.863363 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-j7jlr_017698ba-3b2c-46b9-a785-5a265bf1a8cf/monitoring-plugin/0.log" Jun 05 04:24:52.056156 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:52.056132 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vmq99_011753a9-698b-4e4d-abcf-269e73889cfa/node-exporter/0.log" Jun 05 04:24:52.078525 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:52.078494 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vmq99_011753a9-698b-4e4d-abcf-269e73889cfa/kube-rbac-proxy/0.log" Jun 05 04:24:52.099877 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:52.099851 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vmq99_011753a9-698b-4e4d-abcf-269e73889cfa/init-textfile/0.log" Jun 05 04:24:52.130961 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:52.130930 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-5np9q_27a8954a-c8dc-4cd9-a91d-281190eddf66/kube-rbac-proxy-main/0.log" Jun 05 04:24:52.153807 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:52.153779 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-5np9q_27a8954a-c8dc-4cd9-a91d-281190eddf66/kube-rbac-proxy-self/0.log" Jun 05 04:24:52.174731 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:52.174707 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-5np9q_27a8954a-c8dc-4cd9-a91d-281190eddf66/openshift-state-metrics/0.log" Jun 05 04:24:52.453277 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:52.453207 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-tmr4t_7719f289-6261-4f89-80c9-adb944978d2e/prometheus-operator-admission-webhook/0.log" Jun 05 04:24:52.497533 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:52.497504 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fd4495777-qr497_71737de7-5dbb-416e-8cd4-7ae72a3fdbbd/telemeter-client/0.log" Jun 05 04:24:52.520282 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:52.520256 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fd4495777-qr497_71737de7-5dbb-416e-8cd4-7ae72a3fdbbd/reload/0.log" Jun 05 04:24:52.541288 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:52.541266 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fd4495777-qr497_71737de7-5dbb-416e-8cd4-7ae72a3fdbbd/kube-rbac-proxy/0.log" Jun 05 04:24:52.572650 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:52.572626 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5db4d7fd7b-jqkbt_5209f51a-e87c-4932-b39f-b82ba646919b/thanos-query/0.log" Jun 05 04:24:52.601873 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:52.601844 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5db4d7fd7b-jqkbt_5209f51a-e87c-4932-b39f-b82ba646919b/kube-rbac-proxy-web/0.log" Jun 05 04:24:52.624568 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:52.624546 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5db4d7fd7b-jqkbt_5209f51a-e87c-4932-b39f-b82ba646919b/kube-rbac-proxy/0.log" Jun 05 04:24:52.652025 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:52.651996 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5db4d7fd7b-jqkbt_5209f51a-e87c-4932-b39f-b82ba646919b/prom-label-proxy/0.log" Jun 05 04:24:52.674375 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:52.674300 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5db4d7fd7b-jqkbt_5209f51a-e87c-4932-b39f-b82ba646919b/kube-rbac-proxy-rules/0.log" Jun 05 04:24:52.695299 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:52.695272 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5db4d7fd7b-jqkbt_5209f51a-e87c-4932-b39f-b82ba646919b/kube-rbac-proxy-metrics/0.log" Jun 05 04:24:55.401115 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:55.401081 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5cb7c9c94-rl8kc_6c3cfaa0-b130-44c7-b056-822f8bf2ce22/console/0.log" Jun 05 04:24:55.431338 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:55.431306 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-d8kvd_aa942ee0-0354-4c2f-928a-f23c4ed20aed/download-server/0.log" Jun 05 04:24:56.153676 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:56.153647 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-6tcdh_458ec980-45f2-4f75-933c-d383b83e09e5/volume-data-source-validator/0.log" Jun 05 04:24:56.929187 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:56.929149 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2zf9s/perf-node-gather-daemonset-b2nkz"] Jun 05 04:24:56.933020 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:56.932997 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-b2nkz" Jun 05 04:24:56.935247 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:56.935227 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2zf9s\"/\"default-dockercfg-gdlcz\"" Jun 05 04:24:56.935361 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:56.935275 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2zf9s\"/\"openshift-service-ca.crt\"" Jun 05 04:24:56.936409 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:56.936388 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2zf9s\"/\"kube-root-ca.crt\"" Jun 05 04:24:56.940273 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:56.940252 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2zf9s/perf-node-gather-daemonset-b2nkz"] Jun 05 04:24:57.073819 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:57.073780 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3613b261-00d1-43c2-bc63-e11412c2172d-sys\") pod \"perf-node-gather-daemonset-b2nkz\" (UID: \"3613b261-00d1-43c2-bc63-e11412c2172d\") " pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-b2nkz" Jun 05 04:24:57.074001 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:57.073825 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4qgh\" (UniqueName: \"kubernetes.io/projected/3613b261-00d1-43c2-bc63-e11412c2172d-kube-api-access-l4qgh\") pod \"perf-node-gather-daemonset-b2nkz\" (UID: \"3613b261-00d1-43c2-bc63-e11412c2172d\") " pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-b2nkz" Jun 05 04:24:57.074001 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:57.073976 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3613b261-00d1-43c2-bc63-e11412c2172d-podres\") pod \"perf-node-gather-daemonset-b2nkz\" (UID: \"3613b261-00d1-43c2-bc63-e11412c2172d\") " pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-b2nkz" Jun 05 04:24:57.074089 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:57.074012 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3613b261-00d1-43c2-bc63-e11412c2172d-lib-modules\") pod \"perf-node-gather-daemonset-b2nkz\" (UID: \"3613b261-00d1-43c2-bc63-e11412c2172d\") " pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-b2nkz" Jun 05 04:24:57.074089 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:57.074061 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3613b261-00d1-43c2-bc63-e11412c2172d-proc\") pod \"perf-node-gather-daemonset-b2nkz\" (UID: \"3613b261-00d1-43c2-bc63-e11412c2172d\") " pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-b2nkz" Jun 05 04:24:57.175259 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:57.175218 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3613b261-00d1-43c2-bc63-e11412c2172d-podres\") pod \"perf-node-gather-daemonset-b2nkz\" (UID: \"3613b261-00d1-43c2-bc63-e11412c2172d\") " pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-b2nkz" Jun 05 04:24:57.175259 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:57.175257 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3613b261-00d1-43c2-bc63-e11412c2172d-lib-modules\") pod \"perf-node-gather-daemonset-b2nkz\" (UID: \"3613b261-00d1-43c2-bc63-e11412c2172d\") " pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-b2nkz" Jun 05 04:24:57.175483 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:57.175287 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3613b261-00d1-43c2-bc63-e11412c2172d-proc\") pod \"perf-node-gather-daemonset-b2nkz\" (UID: \"3613b261-00d1-43c2-bc63-e11412c2172d\") " pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-b2nkz" Jun 05 04:24:57.175483 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:57.175328 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3613b261-00d1-43c2-bc63-e11412c2172d-sys\") pod \"perf-node-gather-daemonset-b2nkz\" (UID: \"3613b261-00d1-43c2-bc63-e11412c2172d\") " pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-b2nkz" Jun 05 04:24:57.175483 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:57.175352 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4qgh\" (UniqueName: \"kubernetes.io/projected/3613b261-00d1-43c2-bc63-e11412c2172d-kube-api-access-l4qgh\") pod \"perf-node-gather-daemonset-b2nkz\" (UID: \"3613b261-00d1-43c2-bc63-e11412c2172d\") " pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-b2nkz" Jun 05 04:24:57.175483 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:57.175421 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3613b261-00d1-43c2-bc63-e11412c2172d-lib-modules\") pod \"perf-node-gather-daemonset-b2nkz\" (UID: \"3613b261-00d1-43c2-bc63-e11412c2172d\") " pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-b2nkz" Jun 05 04:24:57.175483 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:57.175421 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3613b261-00d1-43c2-bc63-e11412c2172d-podres\") pod \"perf-node-gather-daemonset-b2nkz\" (UID: \"3613b261-00d1-43c2-bc63-e11412c2172d\") " pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-b2nkz" Jun 05 04:24:57.175483 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:57.175473 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3613b261-00d1-43c2-bc63-e11412c2172d-proc\") pod \"perf-node-gather-daemonset-b2nkz\" (UID: \"3613b261-00d1-43c2-bc63-e11412c2172d\") " pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-b2nkz" Jun 05 04:24:57.175694 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:57.175485 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3613b261-00d1-43c2-bc63-e11412c2172d-sys\") pod \"perf-node-gather-daemonset-b2nkz\" (UID: \"3613b261-00d1-43c2-bc63-e11412c2172d\") " pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-b2nkz" Jun 05 04:24:57.183892 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:57.183832 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4qgh\" (UniqueName: \"kubernetes.io/projected/3613b261-00d1-43c2-bc63-e11412c2172d-kube-api-access-l4qgh\") pod \"perf-node-gather-daemonset-b2nkz\" (UID: \"3613b261-00d1-43c2-bc63-e11412c2172d\") " pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-b2nkz" Jun 05 04:24:57.245148 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:57.245105 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-b2nkz" Jun 05 04:24:57.379334 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:57.379301 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mhbhg_f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce/dns/0.log" Jun 05 04:24:57.387949 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:57.387921 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2zf9s/perf-node-gather-daemonset-b2nkz"] Jun 05 04:24:57.391659 ip-10-0-132-53 kubenswrapper[2548]: W0605 04:24:57.391631 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3613b261_00d1_43c2_bc63_e11412c2172d.slice/crio-e7accda88b0a2b92e7038b5561d640c86a5a3e89340c5c3ea92eb0529023c780 WatchSource:0}: Error finding container e7accda88b0a2b92e7038b5561d640c86a5a3e89340c5c3ea92eb0529023c780: Status 404 returned error can't find the container with id e7accda88b0a2b92e7038b5561d640c86a5a3e89340c5c3ea92eb0529023c780 Jun 05 04:24:57.401801 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:57.401781 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mhbhg_f65d17ee-42c8-4aaf-a90b-8b7e8a1e37ce/kube-rbac-proxy/0.log" Jun 05 04:24:57.521649 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:57.521622 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nfv6x_5986d90f-3a60-4e38-b15f-cc0c69c89abf/dns-node-resolver/0.log" Jun 05 04:24:57.557013 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:57.556978 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-b2nkz" event={"ID":"3613b261-00d1-43c2-bc63-e11412c2172d","Type":"ContainerStarted","Data":"cd47e0e85e17d9ed3bd63c4ce0f1c8fb743b58d40a9042b25a93bcdd654b3518"} Jun 05 04:24:57.557193 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:57.557038 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-b2nkz" event={"ID":"3613b261-00d1-43c2-bc63-e11412c2172d","Type":"ContainerStarted","Data":"e7accda88b0a2b92e7038b5561d640c86a5a3e89340c5c3ea92eb0529023c780"} Jun 05 04:24:57.557193 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:57.557059 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-b2nkz" Jun 05 04:24:57.574402 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:57.574353 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-b2nkz" podStartSLOduration=1.574336336 podStartE2EDuration="1.574336336s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 04:24:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 04:24:57.571484315 +0000 UTC m=+2496.841260632" watchObservedRunningTime="2026-06-05 04:24:57.574336336 +0000 UTC m=+2496.844112653" Jun 05 04:24:58.049746 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:58.049719 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6855569764-bpwhz_240a9603-97bc-4acb-9553-2ddbc0aa231f/registry/0.log" Jun 05 04:24:58.093607 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:58.093579 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dtx66_eb3edaa5-bb4c-4a42-9388-0ecb2db9c42e/node-ca/0.log" Jun 05 04:24:59.088881 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:59.088847 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795ck9hn_0f15771d-46f7-4c8b-9129-679f5f66ea6d/istio-proxy/0.log" Jun 05 04:24:59.330664 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:24:59.330634 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-76xrx_f8a6d6cd-8b11-4c3c-ac29-249f81f30718/payload-pre-processing/0.log" Jun 05 04:25:00.020844 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:00.020815 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5lqng_d85ffe46-0e4f-4c48-bcf1-f56d2f0fb4ef/serve-healthcheck-canary/0.log" Jun 05 04:25:00.578676 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:00.578649 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-k2rfr_1e8c8c99-1a56-4948-9760-df876ce368b4/insights-operator/0.log" Jun 05 04:25:00.580875 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:00.580856 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-k2rfr_1e8c8c99-1a56-4948-9760-df876ce368b4/insights-operator/1.log" Jun 05 04:25:00.671591 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:00.671562 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5gfdx_e912d5e2-2eaa-4bad-9af9-8ecbf3463c17/kube-rbac-proxy/0.log" Jun 05 04:25:00.690916 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:00.690887 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5gfdx_e912d5e2-2eaa-4bad-9af9-8ecbf3463c17/exporter/0.log" Jun 05 04:25:00.711663 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:00.711631 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5gfdx_e912d5e2-2eaa-4bad-9af9-8ecbf3463c17/extractor/0.log" Jun 05 04:25:02.924982 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:02.924953 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-ccfd96f5-c2fzx_d9df0f2c-b166-4b43-a272-21a48aeab89a/nginx/0.log" Jun 05 04:25:03.281344 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:03.281316 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-589666b55-4nrml_8172e642-2dd1-4ca6-b6db-aec42c867b50/manager/0.log" Jun 05 04:25:03.304014 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:03.303989 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-589666b55-4nrml_8172e642-2dd1-4ca6-b6db-aec42c867b50/copy-manifests/0.log" Jun 05 04:25:03.503761 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:03.503733 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-ltlqz_0758a08b-a60d-497a-ad87-24f233776d75/postgres/0.log" Jun 05 04:25:03.573975 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:03.573896 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2zf9s/perf-node-gather-daemonset-b2nkz" Jun 05 04:25:04.966625 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:04.966595 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-9ff7b8d94-7fnv6_36317d1a-88da-479c-826a-87b9b503a11f/manager/0.log" Jun 05 04:25:09.618587 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:09.618561 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795ck9hn_0f15771d-46f7-4c8b-9129-679f5f66ea6d/istio-proxy/0.log" Jun 05 04:25:09.815740 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:09.815708 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-76xrx_f8a6d6cd-8b11-4c3c-ac29-249f81f30718/payload-pre-processing/0.log" Jun 05 04:25:10.976187 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:10.976151 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-dwvgc_c99614d1-0e51-4cda-b1c0-51b5b8a2fa88/kube-storage-version-migrator-operator/1.log" Jun 05 04:25:10.976890 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:10.976872 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-dwvgc_c99614d1-0e51-4cda-b1c0-51b5b8a2fa88/kube-storage-version-migrator-operator/0.log" Jun 05 04:25:11.038152 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:11.038117 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795ck9hn_0f15771d-46f7-4c8b-9129-679f5f66ea6d/istio-proxy/0.log" Jun 05 04:25:11.253369 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:11.253340 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-76xrx_f8a6d6cd-8b11-4c3c-ac29-249f81f30718/payload-pre-processing/0.log" Jun 05 04:25:12.194588 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:12.194558 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8lg5x_0707e72d-344a-483e-910d-fa1ccfc535db/kube-multus/0.log" Jun 05 04:25:12.222548 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:12.222516 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cpmtr_84e6b26c-cb84-463b-ab01-0bac0e2c8096/kube-multus-additional-cni-plugins/0.log" Jun 05 04:25:12.244704 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:12.244676 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cpmtr_84e6b26c-cb84-463b-ab01-0bac0e2c8096/egress-router-binary-copy/0.log" Jun 05 04:25:12.264560 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:12.264536 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cpmtr_84e6b26c-cb84-463b-ab01-0bac0e2c8096/cni-plugins/0.log" Jun 05 04:25:12.285377 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:12.285349 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cpmtr_84e6b26c-cb84-463b-ab01-0bac0e2c8096/bond-cni-plugin/0.log" Jun 05 04:25:12.306794 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:12.306766 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cpmtr_84e6b26c-cb84-463b-ab01-0bac0e2c8096/routeoverride-cni/0.log" Jun 05 04:25:12.327297 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:12.327272 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cpmtr_84e6b26c-cb84-463b-ab01-0bac0e2c8096/whereabouts-cni-bincopy/0.log" Jun 05 04:25:12.347676 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:12.347641 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cpmtr_84e6b26c-cb84-463b-ab01-0bac0e2c8096/whereabouts-cni/0.log" Jun 05 04:25:12.788357 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:12.788323 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7fqv9_f15442b9-7c90-4861-8089-8084f3784bf6/network-metrics-daemon/0.log" Jun 05 04:25:12.807559 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:12.807519 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7fqv9_f15442b9-7c90-4861-8089-8084f3784bf6/kube-rbac-proxy/0.log" Jun 05 04:25:12.896706 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:12.896670 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795ck9hn_0f15771d-46f7-4c8b-9129-679f5f66ea6d/istio-proxy/0.log" Jun 05 04:25:13.091258 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:13.091171 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-76xrx_f8a6d6cd-8b11-4c3c-ac29-249f81f30718/payload-pre-processing/0.log" Jun 05 04:25:14.194628 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:14.194584 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whn2g_9139fc4f-a2c4-4323-aac8-55b73d33aba2/ovn-controller/0.log" Jun 05 04:25:14.210692 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:14.210663 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whn2g_9139fc4f-a2c4-4323-aac8-55b73d33aba2/ovn-acl-logging/1.log" Jun 05 04:25:14.210692 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:14.210673 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whn2g_9139fc4f-a2c4-4323-aac8-55b73d33aba2/ovn-acl-logging/0.log" Jun 05 04:25:14.231053 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:14.231013 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whn2g_9139fc4f-a2c4-4323-aac8-55b73d33aba2/kube-rbac-proxy-node/0.log" Jun 05 04:25:14.251397 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:14.251369 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whn2g_9139fc4f-a2c4-4323-aac8-55b73d33aba2/kube-rbac-proxy-ovn-metrics/0.log" Jun 05 04:25:14.269292 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:14.269269 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whn2g_9139fc4f-a2c4-4323-aac8-55b73d33aba2/northd/0.log" Jun 05 04:25:14.289624 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:14.289590 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whn2g_9139fc4f-a2c4-4323-aac8-55b73d33aba2/nbdb/0.log" Jun 05 04:25:14.311830 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:14.311802 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whn2g_9139fc4f-a2c4-4323-aac8-55b73d33aba2/sbdb/0.log" Jun 05 04:25:14.358638 ip-10-0-132-53 kubenswrapper[2548]: I0605 04:25:14.358600 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whn2g_9139fc4f-a2c4-4323-aac8-55b73d33aba2/ovnkube-controller/0.log"