Jun 13 01:10:48.025220 ip-10-0-140-236 systemd[1]: Starting Kubernetes Kubelet... Jun 13 01:10:48.389284 ip-10-0-140-236 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 01:10:48.389284 ip-10-0-140-236 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 13 01:10:48.389284 ip-10-0-140-236 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 01:10:48.389284 ip-10-0-140-236 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 13 01:10:48.389284 ip-10-0-140-236 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 01:10:48.390870 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.390786 2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 13 01:10:48.394133 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394119 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 01:10:48.394133 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394133 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 01:10:48.394197 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394136 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 01:10:48.394197 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394140 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 01:10:48.394197 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394143 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 01:10:48.394197 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394147 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 01:10:48.394197 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394150 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 01:10:48.394197 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394153 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 01:10:48.394197 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394156 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 01:10:48.394197 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394159 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 01:10:48.394197 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394162 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 01:10:48.394197 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394164 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 01:10:48.394197 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394167 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 01:10:48.394197 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394169 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 01:10:48.394197 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394172 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 01:10:48.394197 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394175 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 01:10:48.394197 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394177 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 01:10:48.394197 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394180 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 01:10:48.394197 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394182 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 01:10:48.394197 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394185 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 01:10:48.394197 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394195 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 01:10:48.394197 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394197 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 01:10:48.394700 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394200 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 01:10:48.394700 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394203 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 01:10:48.394700 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394206 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 01:10:48.394700 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394209 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 01:10:48.394700 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394212 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 01:10:48.394700 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394215 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 01:10:48.394700 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394217 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 01:10:48.394700 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394221 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 01:10:48.394700 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394225 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 01:10:48.394700 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394228 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 01:10:48.394700 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394231 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 01:10:48.394700 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394234 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 01:10:48.394700 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394237 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 01:10:48.394700 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394239 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 01:10:48.394700 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394242 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 01:10:48.394700 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394245 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 01:10:48.394700 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394248 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 01:10:48.394700 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394251 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 01:10:48.394700 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394254 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 01:10:48.395179 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394257 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 01:10:48.395179 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394260 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 01:10:48.395179 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394262 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 01:10:48.395179 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394265 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 01:10:48.395179 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394268 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 01:10:48.395179 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394271 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 01:10:48.395179 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394275 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 01:10:48.395179 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394277 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 01:10:48.395179 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394280 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 01:10:48.395179 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394282 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 01:10:48.395179 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394286 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 01:10:48.395179 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394288 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 01:10:48.395179 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394291 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 01:10:48.395179 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394293 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 01:10:48.395179 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394297 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 01:10:48.395179 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394300 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 01:10:48.395179 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394302 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 01:10:48.395179 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394305 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 01:10:48.395179 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394307 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 01:10:48.395632 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394311 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 01:10:48.395632 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394313 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 01:10:48.395632 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394316 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 01:10:48.395632 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394318 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 01:10:48.395632 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394321 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 01:10:48.395632 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394323 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 01:10:48.395632 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394325 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 01:10:48.395632 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394328 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 01:10:48.395632 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394330 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 01:10:48.395632 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394333 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 01:10:48.395632 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394336 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 01:10:48.395632 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394339 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 01:10:48.395632 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394341 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 01:10:48.395632 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394344 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 01:10:48.395632 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394346 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 01:10:48.395632 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394349 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 01:10:48.395632 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394351 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 01:10:48.395632 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394354 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 01:10:48.395632 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394356 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 01:10:48.395632 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394359 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 01:10:48.396130 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394361 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 01:10:48.396130 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394364 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 01:10:48.396130 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394367 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 01:10:48.396130 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394369 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 01:10:48.396130 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394373 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 01:10:48.396130 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394376 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 01:10:48.396130 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394378 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 01:10:48.396130 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394383 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 13 01:10:48.396130 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394386 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 01:10:48.396130 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394388 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 01:10:48.396130 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394391 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 01:10:48.396130 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394394 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 01:10:48.396130 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394396 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 01:10:48.396130 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394401 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 01:10:48.396130 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394404 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 01:10:48.396130 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394407 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 01:10:48.396130 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394409 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 01:10:48.396130 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394412 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 01:10:48.396130 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.394415 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 01:10:48.396600 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395085 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 01:10:48.396600 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395092 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 01:10:48.396600 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395095 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 01:10:48.396600 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395098 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 01:10:48.396600 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395101 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 01:10:48.396600 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395104 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 01:10:48.396600 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395107 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 01:10:48.396600 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395110 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 01:10:48.396600 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395112 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 01:10:48.396600 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395115 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 01:10:48.396600 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395118 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 01:10:48.396600 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395121 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 01:10:48.396600 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395123 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 01:10:48.396600 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395126 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 01:10:48.396600 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395128 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 01:10:48.396600 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395131 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 01:10:48.396600 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395134 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 01:10:48.396600 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395136 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 01:10:48.396600 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395139 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 01:10:48.397124 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395142 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 01:10:48.397124 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395145 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 01:10:48.397124 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395148 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 01:10:48.397124 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395150 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 01:10:48.397124 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395153 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 01:10:48.397124 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395156 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 01:10:48.397124 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395158 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 01:10:48.397124 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395161 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 01:10:48.397124 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395164 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 01:10:48.397124 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395166 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 01:10:48.397124 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395169 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 01:10:48.397124 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395172 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 01:10:48.397124 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395174 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 01:10:48.397124 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395177 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 01:10:48.397124 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395179 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 01:10:48.397124 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395182 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 01:10:48.397124 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395185 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 01:10:48.397124 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395187 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 01:10:48.397124 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395190 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 01:10:48.397590 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395196 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 01:10:48.397590 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395200 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 01:10:48.397590 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395203 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 01:10:48.397590 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395206 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 01:10:48.397590 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395209 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 01:10:48.397590 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395212 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 01:10:48.397590 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395215 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 01:10:48.397590 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395218 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 13 01:10:48.397590 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395221 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 01:10:48.397590 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395223 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 01:10:48.397590 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395226 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 01:10:48.397590 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395229 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 01:10:48.397590 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395232 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 01:10:48.397590 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395235 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 01:10:48.397590 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395238 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 01:10:48.397590 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395240 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 01:10:48.397590 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395243 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 01:10:48.397590 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395245 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 01:10:48.397590 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395248 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 01:10:48.397590 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395250 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 01:10:48.398088 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395253 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 01:10:48.398088 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395256 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 01:10:48.398088 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395260 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 01:10:48.398088 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395263 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 01:10:48.398088 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395267 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 01:10:48.398088 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395269 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 01:10:48.398088 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395272 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 01:10:48.398088 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395275 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 01:10:48.398088 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395277 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 01:10:48.398088 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395279 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 01:10:48.398088 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395282 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 01:10:48.398088 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395284 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 01:10:48.398088 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395287 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 01:10:48.398088 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395291 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 01:10:48.398088 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395294 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 01:10:48.398088 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395297 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 01:10:48.398088 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395299 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 01:10:48.398088 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395302 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 01:10:48.398088 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395305 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 01:10:48.398543 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395308 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 01:10:48.398543 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395311 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 01:10:48.398543 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395314 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 01:10:48.398543 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395316 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 01:10:48.398543 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395319 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 01:10:48.398543 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395323 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 01:10:48.398543 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395325 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 01:10:48.398543 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395328 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 01:10:48.398543 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395330 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 01:10:48.398543 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395333 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 01:10:48.398543 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395336 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 01:10:48.398543 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395338 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 01:10:48.398543 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395341 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 01:10:48.398543 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395343 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 01:10:48.398543 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395346 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 01:10:48.398543 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395348 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 01:10:48.398543 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395351 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 01:10:48.398543 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395353 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 01:10:48.398543 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395356 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 01:10:48.399021 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395359 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 01:10:48.399021 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395361 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 01:10:48.399021 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395364 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 01:10:48.399021 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395702 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 01:10:48.399021 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395708 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 01:10:48.399021 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395711 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 01:10:48.399021 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395715 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 01:10:48.399021 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395718 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 01:10:48.399021 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395721 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 01:10:48.399021 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395723 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 01:10:48.399021 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395726 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 01:10:48.399021 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395729 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 01:10:48.399021 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395732 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 01:10:48.399021 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395735 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 01:10:48.399021 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395741 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 01:10:48.399021 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395744 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 01:10:48.399021 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395747 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 01:10:48.399021 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395749 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 01:10:48.399021 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395752 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 01:10:48.399021 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395755 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 01:10:48.399500 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395757 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 01:10:48.399500 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395760 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 01:10:48.399500 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395763 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 01:10:48.399500 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395765 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 01:10:48.399500 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395768 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 01:10:48.399500 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395771 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 01:10:48.399500 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395773 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 01:10:48.399500 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395777 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 01:10:48.399500 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395781 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 01:10:48.399500 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395784 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 01:10:48.399500 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395787 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 01:10:48.399500 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395790 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 01:10:48.399500 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395792 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 01:10:48.399500 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395795 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 01:10:48.399500 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395798 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 01:10:48.399500 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395800 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 01:10:48.399500 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395803 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 01:10:48.399500 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395805 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 01:10:48.399500 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395808 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 01:10:48.399953 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395811 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 01:10:48.399953 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395821 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 01:10:48.399953 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395823 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 01:10:48.399953 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395826 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 01:10:48.399953 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395829 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 01:10:48.399953 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395831 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 01:10:48.399953 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395834 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 01:10:48.399953 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395838 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 01:10:48.399953 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395841 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 01:10:48.399953 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395843 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 01:10:48.399953 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395846 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 01:10:48.399953 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395849 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 01:10:48.399953 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395852 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 01:10:48.399953 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395854 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 01:10:48.399953 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395857 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 01:10:48.399953 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395860 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 01:10:48.399953 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395863 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 01:10:48.399953 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395865 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 01:10:48.399953 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395868 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 01:10:48.399953 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395870 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 01:10:48.400432 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395873 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 01:10:48.400432 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395875 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 01:10:48.400432 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395878 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 01:10:48.400432 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395880 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 01:10:48.400432 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395883 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 01:10:48.400432 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395886 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 01:10:48.400432 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395888 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 01:10:48.400432 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395891 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 01:10:48.400432 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395893 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 01:10:48.400432 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395896 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 01:10:48.400432 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395898 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 01:10:48.400432 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395901 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 01:10:48.400432 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395904 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 01:10:48.400432 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395907 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 01:10:48.400432 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395917 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 01:10:48.400432 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395920 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 01:10:48.400432 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395922 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 01:10:48.400432 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395925 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 01:10:48.400432 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395927 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 01:10:48.400432 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395932 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 01:10:48.400936 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395935 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 01:10:48.400936 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395937 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 01:10:48.400936 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395955 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 01:10:48.400936 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395958 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 01:10:48.400936 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395961 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 01:10:48.400936 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395964 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 01:10:48.400936 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395966 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 01:10:48.400936 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395969 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 01:10:48.400936 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395972 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 01:10:48.400936 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395974 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 01:10:48.400936 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395983 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 01:10:48.400936 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395986 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 01:10:48.400936 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395989 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 01:10:48.400936 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395991 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 01:10:48.400936 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395994 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 01:10:48.400936 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.395998 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 01:10:48.400936 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396001 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 01:10:48.400936 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396004 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 13 01:10:48.400936 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396007 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 01:10:48.400936 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396010 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 01:10:48.401430 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396013 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 01:10:48.401430 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396016 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 01:10:48.401430 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396018 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 01:10:48.401430 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396079 2573 flags.go:64] FLAG: --address="0.0.0.0" Jun 13 01:10:48.401430 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396086 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 13 01:10:48.401430 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396095 2573 flags.go:64] FLAG: --anonymous-auth="true" Jun 13 01:10:48.401430 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396102 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 13 01:10:48.401430 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396109 2573 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 13 01:10:48.401430 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396114 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 13 01:10:48.401430 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396120 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 13 01:10:48.401430 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396128 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 13 01:10:48.401430 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396133 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 13 01:10:48.401430 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396136 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 13 01:10:48.401430 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396140 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 13 01:10:48.401430 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396144 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 13 01:10:48.401430 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396147 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 13 01:10:48.401430 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396150 2573 flags.go:64] FLAG: --cgroup-root="" Jun 13 01:10:48.401430 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396153 2573 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 13 01:10:48.401430 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396156 2573 flags.go:64] FLAG: --client-ca-file="" Jun 13 01:10:48.401430 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396158 2573 flags.go:64] FLAG: --cloud-provider="external" Jun 13 01:10:48.401430 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396161 2573 flags.go:64] FLAG: --cluster-dns="[]" Jun 13 01:10:48.401430 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396168 2573 flags.go:64] FLAG: --cluster-domain="" Jun 13 01:10:48.401430 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396171 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 13 01:10:48.401430 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396175 2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 13 01:10:48.402011 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396178 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 13 01:10:48.402011 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396181 2573 flags.go:64] FLAG: --container-log-max-files="5" Jun 13 01:10:48.402011 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396185 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 13 01:10:48.402011 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396188 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 13 01:10:48.402011 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396192 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 13 01:10:48.402011 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396195 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 13 01:10:48.402011 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396198 2573 flags.go:64] FLAG: --contention-profiling="false" Jun 13 01:10:48.402011 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396201 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 13 01:10:48.402011 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396204 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 13 01:10:48.402011 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396207 2573 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 13 01:10:48.402011 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396210 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 13 01:10:48.402011 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396214 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 13 01:10:48.402011 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396217 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 13 01:10:48.402011 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396220 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 13 01:10:48.402011 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396223 2573 flags.go:64] FLAG: --enable-load-reader="false" Jun 13 01:10:48.402011 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396226 2573 flags.go:64] FLAG: --enable-server="true" Jun 13 01:10:48.402011 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396230 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 13 01:10:48.402011 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396237 2573 flags.go:64] FLAG: --event-burst="100" Jun 13 01:10:48.402011 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396240 2573 flags.go:64] FLAG: --event-qps="50" Jun 13 01:10:48.402011 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396245 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 13 01:10:48.402011 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396247 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 13 01:10:48.402011 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396251 2573 flags.go:64] FLAG: --eviction-hard="" Jun 13 01:10:48.402011 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396255 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 13 01:10:48.402011 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396258 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 13 01:10:48.402577 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396261 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 13 01:10:48.402577 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396263 2573 flags.go:64] FLAG: --eviction-soft="" Jun 13 01:10:48.402577 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396266 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 13 01:10:48.402577 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396269 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 13 01:10:48.402577 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396272 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 13 01:10:48.402577 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396275 2573 flags.go:64] FLAG: --experimental-mounter-path="" Jun 13 01:10:48.402577 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396278 2573 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 13 01:10:48.402577 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396281 2573 flags.go:64] FLAG: --fail-swap-on="true" Jun 13 01:10:48.402577 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396284 2573 flags.go:64] FLAG: --feature-gates="" Jun 13 01:10:48.402577 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396287 2573 flags.go:64] FLAG: --file-check-frequency="20s" Jun 13 01:10:48.402577 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396290 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 13 01:10:48.402577 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396295 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 13 01:10:48.402577 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396298 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 13 01:10:48.402577 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396301 2573 flags.go:64] FLAG: --healthz-port="10248" Jun 13 01:10:48.402577 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396304 2573 flags.go:64] FLAG: --help="false" Jun 13 01:10:48.402577 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396307 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-140-236.ec2.internal" Jun 13 01:10:48.402577 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396310 2573 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 13 01:10:48.402577 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396313 2573 flags.go:64] FLAG: --http-check-frequency="20s" Jun 13 01:10:48.402577 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396316 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 13 01:10:48.402577 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396319 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 13 01:10:48.402577 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396322 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 13 01:10:48.402577 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396325 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 13 01:10:48.402577 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396328 2573 flags.go:64] FLAG: --image-service-endpoint="" Jun 13 01:10:48.403175 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396331 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 13 01:10:48.403175 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396334 2573 flags.go:64] FLAG: --kube-api-burst="100" Jun 13 01:10:48.403175 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396337 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 13 01:10:48.403175 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396340 2573 flags.go:64] FLAG: --kube-api-qps="50" Jun 13 01:10:48.403175 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396344 2573 flags.go:64] FLAG: --kube-reserved="" Jun 13 01:10:48.403175 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396347 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 13 01:10:48.403175 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396350 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 13 01:10:48.403175 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396353 2573 flags.go:64] FLAG: --kubelet-cgroups="" Jun 13 01:10:48.403175 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396356 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 13 01:10:48.403175 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396359 2573 flags.go:64] FLAG: --lock-file="" Jun 13 01:10:48.403175 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396362 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 13 01:10:48.403175 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396365 2573 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 13 01:10:48.403175 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396368 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 13 01:10:48.403175 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396373 2573 flags.go:64] FLAG: --log-json-split-stream="false" Jun 13 01:10:48.403175 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396376 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 13 01:10:48.403175 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396379 2573 flags.go:64] FLAG: --log-text-split-stream="false" Jun 13 01:10:48.403175 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396381 2573 flags.go:64] FLAG: --logging-format="text" Jun 13 01:10:48.403175 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396384 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 13 01:10:48.403175 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396387 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 13 01:10:48.403175 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396390 2573 flags.go:64] FLAG: --manifest-url="" Jun 13 01:10:48.403175 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396394 2573 flags.go:64] FLAG: --manifest-url-header="" Jun 13 01:10:48.403175 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396398 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 13 01:10:48.403175 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396401 2573 flags.go:64] FLAG: --max-open-files="1000000" Jun 13 01:10:48.403175 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396405 2573 flags.go:64] FLAG: --max-pods="110" Jun 13 01:10:48.403175 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396408 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 13 01:10:48.403806 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396411 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 13 01:10:48.403806 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396414 2573 flags.go:64] FLAG: --memory-manager-policy="None" Jun 13 01:10:48.403806 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396416 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 13 01:10:48.403806 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396419 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 13 01:10:48.403806 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396422 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 13 01:10:48.403806 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396425 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 13 01:10:48.403806 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396432 2573 flags.go:64] FLAG: --node-status-max-images="50" Jun 13 01:10:48.403806 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396435 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 13 01:10:48.403806 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396438 2573 flags.go:64] FLAG: --oom-score-adj="-999" Jun 13 01:10:48.403806 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396441 2573 flags.go:64] FLAG: --pod-cidr="" Jun 13 01:10:48.403806 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396444 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 13 01:10:48.403806 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396449 2573 flags.go:64] FLAG: --pod-manifest-path="" Jun 13 01:10:48.403806 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396454 2573 flags.go:64] FLAG: --pod-max-pids="-1" Jun 13 01:10:48.403806 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396457 2573 flags.go:64] FLAG: --pods-per-core="0" Jun 13 01:10:48.403806 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396460 2573 flags.go:64] FLAG: --port="10250" Jun 13 01:10:48.403806 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396463 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 13 01:10:48.403806 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396466 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e1bfe2768f5f3a1b" Jun 13 01:10:48.403806 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396469 2573 flags.go:64] FLAG: --qos-reserved="" Jun 13 01:10:48.403806 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396472 2573 flags.go:64] FLAG: --read-only-port="10255" Jun 13 01:10:48.403806 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396475 2573 flags.go:64] FLAG: --register-node="true" Jun 13 01:10:48.403806 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396478 2573 flags.go:64] FLAG: --register-with-taints="" Jun 13 01:10:48.403806 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396481 2573 flags.go:64] FLAG: --registry-burst="10" Jun 13 01:10:48.403806 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396484 2573 flags.go:64] FLAG: --registry-qps="5" Jun 13 01:10:48.403806 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396487 2573 flags.go:64] FLAG: --reserved-cpus="" Jun 13 01:10:48.404408 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396490 2573 flags.go:64] FLAG: --reserved-memory="" Jun 13 01:10:48.404408 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396493 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 13 01:10:48.404408 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396496 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 13 01:10:48.404408 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396501 2573 flags.go:64] FLAG: --rotate-certificates="false" Jun 13 01:10:48.404408 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396504 2573 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 13 01:10:48.404408 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396507 2573 flags.go:64] FLAG: --runonce="false" Jun 13 01:10:48.404408 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396509 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 13 01:10:48.404408 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396512 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 13 01:10:48.404408 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396515 2573 flags.go:64] FLAG: --seccomp-default="false" Jun 13 01:10:48.404408 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396518 2573 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 13 01:10:48.404408 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396521 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 13 01:10:48.404408 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396524 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 13 01:10:48.404408 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396527 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 13 01:10:48.404408 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396530 2573 flags.go:64] FLAG: --storage-driver-password="root" Jun 13 01:10:48.404408 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396533 2573 flags.go:64] FLAG: --storage-driver-secure="false" Jun 13 01:10:48.404408 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396536 2573 flags.go:64] FLAG: --storage-driver-table="stats" Jun 13 01:10:48.404408 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396538 2573 flags.go:64] FLAG: --storage-driver-user="root" Jun 13 01:10:48.404408 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396541 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 13 01:10:48.404408 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396544 2573 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 13 01:10:48.404408 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396547 2573 flags.go:64] FLAG: --system-cgroups="" Jun 13 01:10:48.404408 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396551 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 13 01:10:48.404408 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396557 2573 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 13 01:10:48.404408 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396560 2573 flags.go:64] FLAG: --tls-cert-file="" Jun 13 01:10:48.404408 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396562 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 13 01:10:48.404408 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396588 2573 flags.go:64] FLAG: --tls-min-version="" Jun 13 01:10:48.405060 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396591 2573 flags.go:64] FLAG: --tls-private-key-file="" Jun 13 01:10:48.405060 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396594 2573 flags.go:64] FLAG: --topology-manager-policy="none" Jun 13 01:10:48.405060 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396597 2573 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 13 01:10:48.405060 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396600 2573 flags.go:64] FLAG: --topology-manager-scope="container" Jun 13 01:10:48.405060 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396603 2573 flags.go:64] FLAG: --v="2" Jun 13 01:10:48.405060 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396607 2573 flags.go:64] FLAG: --version="false" Jun 13 01:10:48.405060 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396613 2573 flags.go:64] FLAG: --vmodule="" Jun 13 01:10:48.405060 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396617 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 13 01:10:48.405060 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.396620 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 13 01:10:48.405060 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396727 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 01:10:48.405060 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396732 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 01:10:48.405060 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396736 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 01:10:48.405060 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396738 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 01:10:48.405060 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396741 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 01:10:48.405060 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396744 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 01:10:48.405060 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396746 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 01:10:48.405060 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396750 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 01:10:48.405060 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396752 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 01:10:48.405060 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396755 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 01:10:48.405060 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396758 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 01:10:48.405060 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396760 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 01:10:48.405060 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396763 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 01:10:48.405603 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396766 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 01:10:48.405603 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396768 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 01:10:48.405603 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396771 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 01:10:48.405603 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396774 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 01:10:48.405603 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396776 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 01:10:48.405603 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396780 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 01:10:48.405603 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396782 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 01:10:48.405603 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396785 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 01:10:48.405603 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396788 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 01:10:48.405603 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396790 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 01:10:48.405603 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396793 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 13 01:10:48.405603 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396796 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 01:10:48.405603 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396798 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 01:10:48.405603 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396801 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 01:10:48.405603 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396803 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 01:10:48.405603 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396806 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 01:10:48.405603 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396808 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 01:10:48.405603 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396811 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 01:10:48.405603 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396814 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 01:10:48.405603 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396816 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 01:10:48.406101 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396820 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 01:10:48.406101 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396823 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 01:10:48.406101 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396825 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 01:10:48.406101 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396828 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 01:10:48.406101 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396830 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 01:10:48.406101 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396833 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 01:10:48.406101 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396836 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 01:10:48.406101 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396838 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 01:10:48.406101 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396840 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 01:10:48.406101 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396843 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 01:10:48.406101 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396845 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 01:10:48.406101 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396848 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 01:10:48.406101 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396851 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 01:10:48.406101 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396853 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 01:10:48.406101 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396856 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 01:10:48.406101 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396859 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 01:10:48.406101 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396863 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 01:10:48.406101 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396866 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 01:10:48.406101 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396870 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 01:10:48.406593 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396873 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 01:10:48.406593 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396876 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 01:10:48.406593 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396878 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 01:10:48.406593 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396881 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 01:10:48.406593 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396884 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 01:10:48.406593 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396886 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 01:10:48.406593 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396889 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 01:10:48.406593 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396891 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 01:10:48.406593 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396894 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 01:10:48.406593 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396897 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 01:10:48.406593 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396899 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 01:10:48.406593 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396902 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 01:10:48.406593 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396905 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 01:10:48.406593 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396909 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 01:10:48.406593 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396912 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 01:10:48.406593 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396915 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 01:10:48.406593 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396917 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 01:10:48.406593 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396920 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 01:10:48.406593 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396923 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 01:10:48.407071 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396925 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 01:10:48.407071 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396928 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 01:10:48.407071 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396930 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 01:10:48.407071 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396933 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 01:10:48.407071 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396935 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 01:10:48.407071 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396938 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 01:10:48.407071 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396953 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 01:10:48.407071 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396956 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 01:10:48.407071 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396959 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 01:10:48.407071 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396962 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 01:10:48.407071 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396965 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 01:10:48.407071 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396967 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 01:10:48.407071 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396970 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 01:10:48.407071 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396980 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 01:10:48.407071 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396983 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 01:10:48.407071 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396986 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 01:10:48.407071 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396989 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 01:10:48.407071 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396992 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 01:10:48.407071 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396995 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 01:10:48.407533 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.396998 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 01:10:48.407533 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.397000 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 01:10:48.407533 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.397003 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 01:10:48.407533 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.397006 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 01:10:48.407533 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.397008 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 01:10:48.407533 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.397011 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 01:10:48.407533 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.397014 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 01:10:48.407533 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.397018 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 01:10:48.407533 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.397021 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 01:10:48.407533 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.397623 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 01:10:48.407533 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.403748 2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 13 01:10:48.407533 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.403761 2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 13 01:10:48.407533 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.404463 2573 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 13 01:10:48.407533 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.404471 2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 13 01:10:48.407533 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404532 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 01:10:48.407903 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404538 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 01:10:48.407903 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404541 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 01:10:48.407903 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404545 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 01:10:48.407903 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404548 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 01:10:48.407903 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404552 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 01:10:48.407903 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404555 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 01:10:48.407903 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404558 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 01:10:48.407903 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404560 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 01:10:48.407903 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404563 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 13 01:10:48.407903 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404566 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 01:10:48.407903 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404569 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 01:10:48.407903 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404573 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 01:10:48.407903 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404576 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 01:10:48.407903 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404578 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 01:10:48.407903 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404581 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 01:10:48.407903 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404584 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 01:10:48.407903 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404586 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 01:10:48.407903 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404590 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 01:10:48.407903 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404592 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 01:10:48.407903 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404595 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 01:10:48.408433 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404597 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 01:10:48.408433 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404600 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 01:10:48.408433 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404602 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 01:10:48.408433 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404605 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 01:10:48.408433 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404608 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 01:10:48.408433 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404610 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 01:10:48.408433 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404613 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 01:10:48.408433 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404615 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 01:10:48.408433 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404619 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 01:10:48.408433 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404622 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 01:10:48.408433 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404624 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 01:10:48.408433 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404627 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 01:10:48.408433 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404630 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 01:10:48.408433 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404632 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 01:10:48.408433 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404635 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 01:10:48.408433 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404637 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 01:10:48.408433 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404640 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 01:10:48.408433 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404642 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 01:10:48.408433 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404645 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 01:10:48.408433 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404647 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 01:10:48.408919 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404650 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 01:10:48.408919 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404652 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 01:10:48.408919 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404655 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 01:10:48.408919 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404658 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 01:10:48.408919 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404661 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 01:10:48.408919 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404664 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 01:10:48.408919 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404666 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 01:10:48.408919 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404669 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 01:10:48.408919 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404671 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 01:10:48.408919 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404674 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 01:10:48.408919 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404677 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 01:10:48.408919 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404679 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 01:10:48.408919 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404682 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 01:10:48.408919 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404685 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 01:10:48.408919 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404687 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 01:10:48.408919 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404690 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 01:10:48.408919 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404692 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 01:10:48.408919 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404695 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 01:10:48.408919 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404698 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 01:10:48.409401 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404700 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 01:10:48.409401 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404703 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 01:10:48.409401 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404707 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 01:10:48.409401 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404710 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 01:10:48.409401 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404712 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 01:10:48.409401 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404715 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 01:10:48.409401 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404718 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 01:10:48.409401 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404720 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 01:10:48.409401 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404723 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 01:10:48.409401 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404726 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 01:10:48.409401 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404728 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 01:10:48.409401 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404731 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 01:10:48.409401 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404733 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 01:10:48.409401 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404736 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 01:10:48.409401 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404739 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 01:10:48.409401 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404741 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 01:10:48.409401 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404744 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 01:10:48.409401 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404746 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 01:10:48.409401 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404749 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 01:10:48.409401 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404752 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 01:10:48.409868 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404756 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 01:10:48.409868 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404760 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 01:10:48.409868 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404763 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 01:10:48.409868 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404766 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 01:10:48.409868 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404769 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 01:10:48.409868 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404773 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 01:10:48.409868 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404776 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 01:10:48.409868 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404779 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 01:10:48.409868 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404782 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 01:10:48.409868 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404785 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 01:10:48.409868 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404788 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 01:10:48.409868 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404791 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 01:10:48.409868 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404793 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 01:10:48.409868 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404797 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 01:10:48.409868 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404801 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 01:10:48.409868 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404805 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 01:10:48.409868 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404808 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 01:10:48.409868 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404811 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 01:10:48.410306 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404814 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 01:10:48.410306 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.404818 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 01:10:48.410306 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404967 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 01:10:48.410306 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404973 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 01:10:48.410306 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404976 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 01:10:48.410306 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404979 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 01:10:48.410306 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404982 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 01:10:48.410306 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404985 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 01:10:48.410306 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404987 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 01:10:48.410306 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404990 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 01:10:48.410306 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404993 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 01:10:48.410306 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404995 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 01:10:48.410306 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.404998 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 01:10:48.410306 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405002 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 01:10:48.410306 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405005 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 13 01:10:48.410680 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405007 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 01:10:48.410680 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405010 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 01:10:48.410680 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405013 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 01:10:48.410680 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405015 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 01:10:48.410680 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405018 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 01:10:48.410680 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405021 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 01:10:48.410680 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405025 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 01:10:48.410680 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405027 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 01:10:48.410680 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405030 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 01:10:48.410680 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405032 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 01:10:48.410680 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405035 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 01:10:48.410680 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405037 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 01:10:48.410680 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405040 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 01:10:48.410680 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405043 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 01:10:48.410680 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405046 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 01:10:48.410680 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405048 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 01:10:48.410680 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405051 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 01:10:48.410680 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405053 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 01:10:48.410680 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405056 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 01:10:48.411160 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405059 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 01:10:48.411160 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405061 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 01:10:48.411160 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405064 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 01:10:48.411160 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405067 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 01:10:48.411160 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405069 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 01:10:48.411160 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405072 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 01:10:48.411160 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405075 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 01:10:48.411160 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405077 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 01:10:48.411160 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405080 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 01:10:48.411160 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405082 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 01:10:48.411160 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405085 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 01:10:48.411160 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405087 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 01:10:48.411160 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405091 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 01:10:48.411160 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405093 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 01:10:48.411160 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405095 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 01:10:48.411160 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405098 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 01:10:48.411160 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405100 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 01:10:48.411160 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405103 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 01:10:48.411160 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405105 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 01:10:48.411160 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405108 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 01:10:48.411636 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405110 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 01:10:48.411636 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405113 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 01:10:48.411636 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405115 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 01:10:48.411636 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405118 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 01:10:48.411636 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405120 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 01:10:48.411636 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405123 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 01:10:48.411636 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405126 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 01:10:48.411636 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405130 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 01:10:48.411636 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405133 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 01:10:48.411636 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405136 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 01:10:48.411636 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405139 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 01:10:48.411636 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405142 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 01:10:48.411636 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405145 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 01:10:48.411636 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405147 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 01:10:48.411636 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405150 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 01:10:48.411636 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405152 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 01:10:48.411636 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405155 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 01:10:48.411636 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405158 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 01:10:48.411636 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405160 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 01:10:48.411636 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405163 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 01:10:48.412156 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405165 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 01:10:48.412156 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405168 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 01:10:48.412156 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405170 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 01:10:48.412156 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405173 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 01:10:48.412156 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405175 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 01:10:48.412156 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405178 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 01:10:48.412156 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405180 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 01:10:48.412156 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405183 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 01:10:48.412156 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405185 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 01:10:48.412156 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405188 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 01:10:48.412156 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405190 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 01:10:48.412156 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405193 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 01:10:48.412156 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405195 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 01:10:48.412156 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405198 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 01:10:48.412156 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405200 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 01:10:48.412156 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405203 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 01:10:48.412156 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405205 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 01:10:48.412156 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405208 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 01:10:48.412156 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405212 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 01:10:48.412595 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405215 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 01:10:48.412595 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405218 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 01:10:48.412595 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405220 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 01:10:48.412595 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405223 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 01:10:48.412595 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405226 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 01:10:48.412595 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405228 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 01:10:48.412595 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405231 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 01:10:48.412595 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:48.405233 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 01:10:48.412595 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.405238 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 01:10:48.412595 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.405341 2573 server.go:962] "Client rotation is on, will bootstrap in background" Jun 13 01:10:48.412595 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.407145 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 13 01:10:48.412595 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.408194 2573 server.go:1019] "Starting client certificate rotation" Jun 13 01:10:48.412595 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.408294 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 13 01:10:48.412595 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.408331 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 13 01:10:48.412929 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.410865 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 13 01:10:48.416814 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.416786 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 13 01:10:48.425525 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.425509 2573 log.go:25] "Validated CRI v1 runtime API" Jun 13 01:10:48.428970 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.428953 2573 log.go:25] "Validated CRI v1 image API" Jun 13 01:10:48.430626 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.430612 2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 13 01:10:48.432890 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.432874 2573 fs.go:135] Filesystem UUIDs: map[1aade14a-6189-4065-ab91-1f7c36efef0a:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a5e1f351-23a1-4ccc-9da7-e899655069ac:/dev/nvme0n1p3] Jun 13 01:10:48.432958 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.432891 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 13 01:10:48.437673 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.437569 2573 manager.go:216] Machine: {Timestamp:2026-06-13 01:10:48.436525907 +0000 UTC m=+0.302541120 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099918 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f4c350604eede6b215b6e9dee4622 SystemUUID:ec2f4c35-0604-eede-6b21-5b6e9dee4622 BootID:ad205280-d8f6-4f1c-9937-860c4e07feb5 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ee:a6:57:59:ed Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ee:a6:57:59:ed Speed:0 Mtu:9001} {Name:ovs-system MacAddress:aa:a8:31:44:e2:87 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 13 01:10:48.437673 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.437670 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 13 01:10:48.437772 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.437739 2573 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 13 01:10:48.440300 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.440274 2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 13 01:10:48.440425 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.440304 2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-236.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 13 01:10:48.440915 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.440906 2573 topology_manager.go:138] "Creating topology manager with none policy" Jun 13 01:10:48.440964 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.440918 2573 container_manager_linux.go:309] "Creating device plugin manager" Jun 13 01:10:48.440964 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.440925 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 13 01:10:48.441506 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.441495 2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 13 01:10:48.441736 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.441717 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 13 01:10:48.442611 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.442599 2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 13 01:10:48.444987 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.444975 2573 state_mem.go:36] "Initialized new in-memory state store" Jun 13 01:10:48.445105 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.445096 2573 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 13 01:10:48.445138 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.445126 2573 kubelet.go:486] "Attempting to sync node with API server" Jun 13 01:10:48.445188 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.445141 2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 13 01:10:48.445188 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.445162 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 13 01:10:48.445188 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.445174 2573 kubelet.go:398] "Adding apiserver pod source" Jun 13 01:10:48.445188 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.445187 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 13 01:10:48.445645 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.445619 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 13 01:10:48.445645 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.445648 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 13 01:10:48.447408 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.447392 2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 13 01:10:48.448736 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.448722 2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 13 01:10:48.448790 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.448752 2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 13 01:10:48.448893 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.448883 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 13 01:10:48.448921 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.448897 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 13 01:10:48.448921 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.448904 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 13 01:10:48.448921 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.448909 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 13 01:10:48.448921 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.448917 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 13 01:10:48.448921 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.448923 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 13 01:10:48.449615 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.449605 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 13 01:10:48.449615 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.449614 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 13 01:10:48.449679 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.449620 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 13 01:10:48.449679 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.449626 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 13 01:10:48.449679 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.449640 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 13 01:10:48.449679 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.449648 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 13 01:10:48.450259 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.450250 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 13 01:10:48.450259 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.450259 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 13 01:10:48.453273 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.453260 2573 server.go:1268] "Started kubelet" Jun 13 01:10:48.453388 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.453356 2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 13 01:10:48.453461 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.453400 2573 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 13 01:10:48.453461 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.453357 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 13 01:10:48.454099 ip-10-0-140-236 systemd[1]: Started Kubernetes Kubelet. Jun 13 01:10:48.457598 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.457574 2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 13 01:10:48.459582 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.459559 2573 server.go:310] "Adding debug handlers to kubelet server" Jun 13 01:10:48.460076 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:48.460052 2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 13 01:10:48.461686 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.461670 2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-236.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 13 01:10:48.461804 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:48.461787 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-236.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 13 01:10:48.461903 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:48.461889 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 13 01:10:48.462854 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:48.462038 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-236.ec2.internal.18b87ec79ed2c1b0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-236.ec2.internal,UID:ip-10-0-140-236.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-236.ec2.internal,},FirstTimestamp:2026-06-13 01:10:48.45323512 +0000 UTC m=+0.319250386,LastTimestamp:2026-06-13 01:10:48.45323512 +0000 UTC m=+0.319250386,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-236.ec2.internal,}" Jun 13 01:10:48.464213 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.464198 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 13 01:10:48.464256 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.464213 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 13 01:10:48.464373 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:48.464348 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-236.ec2.internal\" not found" Jun 13 01:10:48.464716 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.464701 2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 13 01:10:48.464838 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.464827 2573 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 13 01:10:48.464987 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.464977 2573 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 13 01:10:48.465154 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.465141 2573 reconstruct.go:97] "Volume reconstruction finished" Jun 13 01:10:48.465154 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.465151 2573 reconciler.go:29] "Reconciler: start to sync state" Jun 13 01:10:48.465267 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.465160 2573 factory.go:153] Registering CRI-O factory Jun 13 01:10:48.465267 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.465176 2573 factory.go:223] Registration of the crio container factory successfully Jun 13 01:10:48.465267 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.465220 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 13 01:10:48.465267 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.465227 2573 factory.go:55] Registering systemd factory Jun 13 01:10:48.465267 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.465233 2573 factory.go:223] Registration of the systemd container factory successfully Jun 13 01:10:48.465267 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.465249 2573 factory.go:103] Registering Raw factory Jun 13 01:10:48.465267 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.465261 2573 manager.go:1196] Started watching for new ooms in manager Jun 13 01:10:48.465635 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.465577 2573 manager.go:349] Starting recovery of all containers Jun 13 01:10:48.475179 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.474886 2573 manager.go:354] Recovery completed Jun 13 01:10:48.475871 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:48.475851 2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-236.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 13 01:10:48.475871 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:48.475851 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 13 01:10:48.476447 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:48.476432 2573 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 13 01:10:48.479607 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.479593 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 01:10:48.481476 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.481455 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasSufficientMemory" Jun 13 01:10:48.481543 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.481488 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 01:10:48.481543 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.481498 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasSufficientPID" Jun 13 01:10:48.482025 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.482009 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 13 01:10:48.482025 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.482022 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 13 01:10:48.482149 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.482025 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 01:10:48.482149 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.482064 2573 state_mem.go:36] "Initialized new in-memory state store" Jun 13 01:10:48.482659 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.482647 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasSufficientMemory" Jun 13 01:10:48.482709 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.482676 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 01:10:48.482709 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.482687 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasSufficientPID" Jun 13 01:10:48.483158 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.483148 2573 policy_none.go:49] "None policy: Start" Jun 13 01:10:48.483192 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.483164 2573 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 13 01:10:48.483192 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.483174 2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 13 01:10:48.484039 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.484028 2573 policy_none.go:47] "Start" Jun 13 01:10:48.489915 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.489896 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l2x7v" Jun 13 01:10:48.491059 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:48.490998 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-236.ec2.internal.18b87ec7a081b036 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-236.ec2.internal,UID:ip-10-0-140-236.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-236.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-236.ec2.internal,},FirstTimestamp:2026-06-13 01:10:48.481476662 +0000 UTC m=+0.347491875,LastTimestamp:2026-06-13 01:10:48.481476662 +0000 UTC m=+0.347491875,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-236.ec2.internal,}" Jun 13 01:10:48.498187 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.498162 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l2x7v" Jun 13 01:10:48.500713 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:48.500629 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-236.ec2.internal.18b87ec7a081ef6d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-236.ec2.internal,UID:ip-10-0-140-236.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-236.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-236.ec2.internal,},FirstTimestamp:2026-06-13 01:10:48.481492845 +0000 UTC m=+0.347508059,LastTimestamp:2026-06-13 01:10:48.481492845 +0000 UTC m=+0.347508059,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-236.ec2.internal,}" Jun 13 01:10:48.519266 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.519251 2573 manager.go:337] "Starting Device Plugin manager" Jun 13 01:10:48.532249 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:48.519288 2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 13 01:10:48.532249 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.519301 2573 server.go:87] "Starting device plugin registration server" Jun 13 01:10:48.532249 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.519542 2573 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 13 01:10:48.532249 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.519555 2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 13 01:10:48.532249 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.519651 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 13 01:10:48.532249 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.519741 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 13 01:10:48.532249 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.519751 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 13 01:10:48.532249 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:48.520399 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 13 01:10:48.532249 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:48.520445 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-236.ec2.internal\" not found" Jun 13 01:10:48.532249 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.531414 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 13 01:10:48.532625 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.532613 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 13 01:10:48.532658 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.532646 2573 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 13 01:10:48.532691 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.532667 2573 kubelet.go:2448] "Starting kubelet main sync loop" Jun 13 01:10:48.532727 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:48.532695 2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 13 01:10:48.534806 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.534790 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 01:10:48.620591 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.620564 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 01:10:48.621735 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.621716 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasSufficientMemory" Jun 13 01:10:48.621813 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.621748 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 01:10:48.621813 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.621759 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasSufficientPID" Jun 13 01:10:48.621813 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.621783 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-236.ec2.internal" Jun 13 01:10:48.633476 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.633459 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-236.ec2.internal" Jun 13 01:10:48.633526 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:48.633483 2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-236.ec2.internal\": node \"ip-10-0-140-236.ec2.internal\" not found" Jun 13 01:10:48.633559 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.633532 2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-236.ec2.internal"] Jun 13 01:10:48.633599 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.633589 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 01:10:48.635295 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.635282 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasSufficientMemory" Jun 13 01:10:48.635358 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.635305 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 01:10:48.635358 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.635316 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasSufficientPID" Jun 13 01:10:48.636377 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.636366 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 01:10:48.636502 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.636487 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal" Jun 13 01:10:48.636538 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.636518 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 01:10:48.636991 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.636974 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasSufficientMemory" Jun 13 01:10:48.637079 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.637004 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 01:10:48.637079 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.636976 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasSufficientMemory" Jun 13 01:10:48.637079 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.637019 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasSufficientPID" Jun 13 01:10:48.637079 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.637031 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 01:10:48.637079 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.637046 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasSufficientPID" Jun 13 01:10:48.638166 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.638148 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-236.ec2.internal" Jun 13 01:10:48.638266 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.638179 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 01:10:48.638800 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.638785 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasSufficientMemory" Jun 13 01:10:48.638884 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.638808 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 01:10:48.638884 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.638817 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasSufficientPID" Jun 13 01:10:48.663159 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:48.663135 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-236.ec2.internal\" not found" Jun 13 01:10:48.666349 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.666332 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/18b59a78da48c34835482e0de0261337-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal\" (UID: \"18b59a78da48c34835482e0de0261337\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal" Jun 13 01:10:48.666415 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.666357 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/18b59a78da48c34835482e0de0261337-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal\" (UID: \"18b59a78da48c34835482e0de0261337\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal" Jun 13 01:10:48.666415 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.666376 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aeada42337847de1ed566b0c344a17a2-config\") pod \"kube-apiserver-proxy-ip-10-0-140-236.ec2.internal\" (UID: \"aeada42337847de1ed566b0c344a17a2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-236.ec2.internal" Jun 13 01:10:48.668475 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:48.668461 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-236.ec2.internal\" not found" node="ip-10-0-140-236.ec2.internal" Jun 13 01:10:48.672832 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:48.672818 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-236.ec2.internal\" not found" node="ip-10-0-140-236.ec2.internal" Jun 13 01:10:48.763852 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:48.763824 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-236.ec2.internal\" not found" Jun 13 01:10:48.767107 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.767090 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/18b59a78da48c34835482e0de0261337-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal\" (UID: \"18b59a78da48c34835482e0de0261337\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal" Jun 13 01:10:48.767165 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.767115 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/18b59a78da48c34835482e0de0261337-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal\" (UID: \"18b59a78da48c34835482e0de0261337\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal" Jun 13 01:10:48.767165 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.767131 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aeada42337847de1ed566b0c344a17a2-config\") pod \"kube-apiserver-proxy-ip-10-0-140-236.ec2.internal\" (UID: \"aeada42337847de1ed566b0c344a17a2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-236.ec2.internal" Jun 13 01:10:48.767238 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.767167 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aeada42337847de1ed566b0c344a17a2-config\") pod \"kube-apiserver-proxy-ip-10-0-140-236.ec2.internal\" (UID: \"aeada42337847de1ed566b0c344a17a2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-236.ec2.internal" Jun 13 01:10:48.767238 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.767191 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/18b59a78da48c34835482e0de0261337-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal\" (UID: \"18b59a78da48c34835482e0de0261337\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal" Jun 13 01:10:48.767238 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.767204 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/18b59a78da48c34835482e0de0261337-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal\" (UID: \"18b59a78da48c34835482e0de0261337\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal" Jun 13 01:10:48.864314 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:48.864271 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-236.ec2.internal\" not found" Jun 13 01:10:48.965072 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:48.964999 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-236.ec2.internal\" not found" Jun 13 01:10:48.970186 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.970174 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal" Jun 13 01:10:48.976031 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:48.976013 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-236.ec2.internal" Jun 13 01:10:49.065387 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:49.065356 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-236.ec2.internal\" not found" Jun 13 01:10:49.165790 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:49.165759 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-236.ec2.internal\" not found" Jun 13 01:10:49.266205 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:49.266150 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-236.ec2.internal\" not found" Jun 13 01:10:49.323077 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:49.323058 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 01:10:49.367082 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:49.367060 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-236.ec2.internal\" not found" Jun 13 01:10:49.408366 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:49.408346 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 13 01:10:49.408894 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:49.408478 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 13 01:10:49.408894 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:49.408511 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 13 01:10:49.457993 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:49.457975 2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 01:10:49.465233 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:49.465212 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 13 01:10:49.465316 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:49.465216 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal" Jun 13 01:10:49.489130 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:49.489108 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 13 01:10:49.494595 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:49.494582 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 13 01:10:49.495931 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:49.495918 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-236.ec2.internal" Jun 13 01:10:49.502009 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:49.501986 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-12 01:05:48 +0000 UTC" deadline="2028-03-03 09:03:22.017316858 +0000 UTC" Jun 13 01:10:49.502063 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:49.502010 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15103h52m32.515309761s" Jun 13 01:10:49.505788 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:49.505775 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 13 01:10:49.517243 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:49.517206 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-smzxr" Jun 13 01:10:49.525908 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:49.525893 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-smzxr" Jun 13 01:10:49.551342 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:49.551316 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeada42337847de1ed566b0c344a17a2.slice/crio-1a47de69663026a0f5171a5d872da3db1611ab7b9343c6708fa45accb6f6aa24 WatchSource:0}: Error finding container 1a47de69663026a0f5171a5d872da3db1611ab7b9343c6708fa45accb6f6aa24: Status 404 returned error can't find the container with id 1a47de69663026a0f5171a5d872da3db1611ab7b9343c6708fa45accb6f6aa24 Jun 13 01:10:49.551833 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:49.551805 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18b59a78da48c34835482e0de0261337.slice/crio-5cb0347f27f01d9d8e4d5e957679db347e10b83d242999249e4a30764439b7eb WatchSource:0}: Error finding container 5cb0347f27f01d9d8e4d5e957679db347e10b83d242999249e4a30764439b7eb: Status 404 returned error can't find the container with id 5cb0347f27f01d9d8e4d5e957679db347e10b83d242999249e4a30764439b7eb Jun 13 01:10:49.555684 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:49.555669 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 01:10:49.620483 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:49.620464 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 01:10:50.445859 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.445830 2573 apiserver.go:52] "Watching apiserver" Jun 13 01:10:50.456666 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.456565 2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 13 01:10:50.456925 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.456894 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-x9nxz","openshift-ovn-kubernetes/ovnkube-node-9jdpp","kube-system/global-pull-secret-syncer-4gzc9","kube-system/konnectivity-agent-t5qq4","kube-system/kube-apiserver-proxy-ip-10-0-140-236.ec2.internal","openshift-cluster-node-tuning-operator/tuned-mccj2","openshift-dns/node-resolver-hlh72","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal","openshift-multus/multus-wbsfg","openshift-network-operator/iptables-alerter-grg5q","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhbpv","openshift-image-registry/node-ca-4v55b","openshift-multus/multus-additional-cni-plugins-chd2f","openshift-multus/network-metrics-daemon-t4b8x"] Jun 13 01:10:50.459444 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.459327 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hlh72" Jun 13 01:10:50.461551 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.461529 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhbpv" Jun 13 01:10:50.461873 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.461853 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 13 01:10:50.462039 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.462017 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 13 01:10:50.462306 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.462287 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7tlx4\"" Jun 13 01:10:50.464488 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.464005 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 13 01:10:50.464488 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.464137 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 13 01:10:50.464488 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.464322 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 13 01:10:50.464488 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.464367 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7j64s\"" Jun 13 01:10:50.464712 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.464505 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4b8x" Jun 13 01:10:50.464712 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:50.464565 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4b8x" podUID="323114ca-ff76-4dbd-90b9-8d1c80ebea04" Jun 13 01:10:50.466116 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.466095 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t5qq4" Jun 13 01:10:50.468598 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.468264 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 13 01:10:50.468598 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.468317 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cbtkt\"" Jun 13 01:10:50.468598 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.468377 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4v55b" Jun 13 01:10:50.469089 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.468898 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 13 01:10:50.470573 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.470415 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 13 01:10:50.470573 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.470532 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 13 01:10:50.470732 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.470699 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.471168 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.471150 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 13 01:10:50.471255 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.471171 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qxs79\"" Jun 13 01:10:50.473006 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.472930 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.473170 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.473153 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 13 01:10:50.473528 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.473509 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-g2djh\"" Jun 13 01:10:50.473653 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.473594 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 13 01:10:50.475267 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.475247 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-chd2f" Jun 13 01:10:50.475419 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.475402 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 13 01:10:50.475546 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.475522 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 13 01:10:50.475633 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.475559 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 13 01:10:50.476241 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.476212 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0f57e152-5740-40a8-bc29-bcbcadff6f50-agent-certs\") pod \"konnectivity-agent-t5qq4\" (UID: \"0f57e152-5740-40a8-bc29-bcbcadff6f50\") " pod="kube-system/konnectivity-agent-t5qq4" Jun 13 01:10:50.476338 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.476246 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e3b95ba8-aef1-4bf8-8184-e861882847a7-device-dir\") pod \"aws-ebs-csi-driver-node-nhbpv\" (UID: \"e3b95ba8-aef1-4bf8-8184-e861882847a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhbpv" Jun 13 01:10:50.476338 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.476273 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsmkj\" (UniqueName: \"kubernetes.io/projected/e3b95ba8-aef1-4bf8-8184-e861882847a7-kube-api-access-rsmkj\") pod \"aws-ebs-csi-driver-node-nhbpv\" (UID: \"e3b95ba8-aef1-4bf8-8184-e861882847a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhbpv" Jun 13 01:10:50.476338 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.476299 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/323114ca-ff76-4dbd-90b9-8d1c80ebea04-metrics-certs\") pod \"network-metrics-daemon-t4b8x\" (UID: \"323114ca-ff76-4dbd-90b9-8d1c80ebea04\") " pod="openshift-multus/network-metrics-daemon-t4b8x" Jun 13 01:10:50.476338 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.476325 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsc2l\" (UniqueName: \"kubernetes.io/projected/323114ca-ff76-4dbd-90b9-8d1c80ebea04-kube-api-access-lsc2l\") pod \"network-metrics-daemon-t4b8x\" (UID: \"323114ca-ff76-4dbd-90b9-8d1c80ebea04\") " pod="openshift-multus/network-metrics-daemon-t4b8x" Jun 13 01:10:50.476632 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.476349 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0f57e152-5740-40a8-bc29-bcbcadff6f50-konnectivity-ca\") pod \"konnectivity-agent-t5qq4\" (UID: \"0f57e152-5740-40a8-bc29-bcbcadff6f50\") " pod="kube-system/konnectivity-agent-t5qq4" Jun 13 01:10:50.476632 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.476373 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0f5e173-0662-47cd-9792-f07b01ab5eaf-tmp-dir\") pod \"node-resolver-hlh72\" (UID: \"e0f5e173-0662-47cd-9792-f07b01ab5eaf\") " pod="openshift-dns/node-resolver-hlh72" Jun 13 01:10:50.476632 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.476394 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e3b95ba8-aef1-4bf8-8184-e861882847a7-sys-fs\") pod \"aws-ebs-csi-driver-node-nhbpv\" (UID: \"e3b95ba8-aef1-4bf8-8184-e861882847a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhbpv" Jun 13 01:10:50.476632 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.476417 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e0f5e173-0662-47cd-9792-f07b01ab5eaf-hosts-file\") pod \"node-resolver-hlh72\" (UID: \"e0f5e173-0662-47cd-9792-f07b01ab5eaf\") " pod="openshift-dns/node-resolver-hlh72" Jun 13 01:10:50.476632 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.476440 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59ksw\" (UniqueName: \"kubernetes.io/projected/e0f5e173-0662-47cd-9792-f07b01ab5eaf-kube-api-access-59ksw\") pod \"node-resolver-hlh72\" (UID: \"e0f5e173-0662-47cd-9792-f07b01ab5eaf\") " pod="openshift-dns/node-resolver-hlh72" Jun 13 01:10:50.476632 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.476463 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e3b95ba8-aef1-4bf8-8184-e861882847a7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nhbpv\" (UID: \"e3b95ba8-aef1-4bf8-8184-e861882847a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhbpv" Jun 13 01:10:50.476632 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.476488 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e3b95ba8-aef1-4bf8-8184-e861882847a7-socket-dir\") pod \"aws-ebs-csi-driver-node-nhbpv\" (UID: \"e3b95ba8-aef1-4bf8-8184-e861882847a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhbpv" Jun 13 01:10:50.476632 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.476513 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e3b95ba8-aef1-4bf8-8184-e861882847a7-registration-dir\") pod \"aws-ebs-csi-driver-node-nhbpv\" (UID: \"e3b95ba8-aef1-4bf8-8184-e861882847a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhbpv" Jun 13 01:10:50.476632 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.476536 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e3b95ba8-aef1-4bf8-8184-e861882847a7-etc-selinux\") pod \"aws-ebs-csi-driver-node-nhbpv\" (UID: \"e3b95ba8-aef1-4bf8-8184-e861882847a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhbpv" Jun 13 01:10:50.477112 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.476863 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qkx9r\"" Jun 13 01:10:50.477112 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.476863 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 13 01:10:50.477463 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.477442 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 13 01:10:50.477954 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.477919 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kqrb2\"" Jun 13 01:10:50.478274 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.478251 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 13 01:10:50.478567 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.478549 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.481557 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.480863 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 13 01:10:50.481557 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.480982 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-swn2n\"" Jun 13 01:10:50.481557 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.481081 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-grg5q" Jun 13 01:10:50.482143 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.482123 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 13 01:10:50.482739 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.482417 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 13 01:10:50.482739 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.482535 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 13 01:10:50.482958 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.482924 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 13 01:10:50.483184 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.483167 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 13 01:10:50.486441 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.485835 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9nxz" Jun 13 01:10:50.486441 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:50.486197 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9nxz" podUID="fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9" Jun 13 01:10:50.486827 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.486805 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 13 01:10:50.488857 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.487040 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 13 01:10:50.488857 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.487282 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cmpgt\"" Jun 13 01:10:50.488857 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.487438 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 13 01:10:50.488857 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.487490 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gzc9" Jun 13 01:10:50.488857 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:50.487579 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4gzc9" podUID="113d88ff-ddd6-40b7-9c71-a00ce41a6c7d" Jun 13 01:10:50.528670 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.528628 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-12 01:05:49 +0000 UTC" deadline="2027-12-30 00:07:41.41525946 +0000 UTC" Jun 13 01:10:50.528670 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.528670 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13558h56m50.886593376s" Jun 13 01:10:50.538031 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.537995 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal" event={"ID":"18b59a78da48c34835482e0de0261337","Type":"ContainerStarted","Data":"5cb0347f27f01d9d8e4d5e957679db347e10b83d242999249e4a30764439b7eb"} Jun 13 01:10:50.539462 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.539440 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-236.ec2.internal" event={"ID":"aeada42337847de1ed566b0c344a17a2","Type":"ContainerStarted","Data":"1a47de69663026a0f5171a5d872da3db1611ab7b9343c6708fa45accb6f6aa24"} Jun 13 01:10:50.566745 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.566728 2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 13 01:10:50.577737 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.577708 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kdz6\" (UniqueName: \"kubernetes.io/projected/9281997e-d152-4b6a-ae85-9c590da00f3d-kube-api-access-8kdz6\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.577824 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.577745 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e0f5e173-0662-47cd-9792-f07b01ab5eaf-hosts-file\") pod \"node-resolver-hlh72\" (UID: \"e0f5e173-0662-47cd-9792-f07b01ab5eaf\") " pod="openshift-dns/node-resolver-hlh72" Jun 13 01:10:50.577824 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.577765 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e3b95ba8-aef1-4bf8-8184-e861882847a7-socket-dir\") pod \"aws-ebs-csi-driver-node-nhbpv\" (UID: \"e3b95ba8-aef1-4bf8-8184-e861882847a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhbpv" Jun 13 01:10:50.577824 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.577791 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8284579-c698-4ff6-930c-de63ccccc8bd-cnibin\") pod \"multus-additional-cni-plugins-chd2f\" (UID: \"f8284579-c698-4ff6-930c-de63ccccc8bd\") " pod="openshift-multus/multus-additional-cni-plugins-chd2f" Jun 13 01:10:50.577824 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.577808 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f8284579-c698-4ff6-930c-de63ccccc8bd-os-release\") pod \"multus-additional-cni-plugins-chd2f\" (UID: \"f8284579-c698-4ff6-930c-de63ccccc8bd\") " pod="openshift-multus/multus-additional-cni-plugins-chd2f" Jun 13 01:10:50.578075 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.577837 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e3b95ba8-aef1-4bf8-8184-e861882847a7-device-dir\") pod \"aws-ebs-csi-driver-node-nhbpv\" (UID: \"e3b95ba8-aef1-4bf8-8184-e861882847a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhbpv" Jun 13 01:10:50.578075 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.577856 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsmkj\" (UniqueName: \"kubernetes.io/projected/e3b95ba8-aef1-4bf8-8184-e861882847a7-kube-api-access-rsmkj\") pod \"aws-ebs-csi-driver-node-nhbpv\" (UID: \"e3b95ba8-aef1-4bf8-8184-e861882847a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhbpv" Jun 13 01:10:50.578075 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.577913 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-host-cni-bin\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.578075 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.577928 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e0f5e173-0662-47cd-9792-f07b01ab5eaf-hosts-file\") pod \"node-resolver-hlh72\" (UID: \"e0f5e173-0662-47cd-9792-f07b01ab5eaf\") " pod="openshift-dns/node-resolver-hlh72" Jun 13 01:10:50.578075 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.577940 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e3b95ba8-aef1-4bf8-8184-e861882847a7-device-dir\") pod \"aws-ebs-csi-driver-node-nhbpv\" (UID: \"e3b95ba8-aef1-4bf8-8184-e861882847a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhbpv" Jun 13 01:10:50.578075 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.577991 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.578075 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.578004 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e3b95ba8-aef1-4bf8-8184-e861882847a7-socket-dir\") pod \"aws-ebs-csi-driver-node-nhbpv\" (UID: \"e3b95ba8-aef1-4bf8-8184-e861882847a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhbpv" Jun 13 01:10:50.578075 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.578052 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-host-run-netns\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.578391 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.578080 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6109025b-0598-4cbf-b841-200e35db36cf-ovnkube-script-lib\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.578391 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.578109 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drj7t\" (UniqueName: \"kubernetes.io/projected/6109025b-0598-4cbf-b841-200e35db36cf-kube-api-access-drj7t\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.578391 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.578131 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-system-cni-dir\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.578391 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.578167 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-multus-cni-dir\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.578391 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.578207 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2bbd1a29-323d-47bd-aac0-af7873d30922-host\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.578391 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.578233 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bbd1a29-323d-47bd-aac0-af7873d30922-tmp\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.578391 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.578255 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8v66\" (UniqueName: \"kubernetes.io/projected/2bbd1a29-323d-47bd-aac0-af7873d30922-kube-api-access-k8v66\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.578391 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.578342 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-run-ovn\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.578686 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.578395 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8284579-c698-4ff6-930c-de63ccccc8bd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-chd2f\" (UID: \"f8284579-c698-4ff6-930c-de63ccccc8bd\") " pod="openshift-multus/multus-additional-cni-plugins-chd2f" Jun 13 01:10:50.578686 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.578419 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2bbd1a29-323d-47bd-aac0-af7873d30922-var-lib-kubelet\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.578686 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.578442 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e3b95ba8-aef1-4bf8-8184-e861882847a7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nhbpv\" (UID: \"e3b95ba8-aef1-4bf8-8184-e861882847a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhbpv" Jun 13 01:10:50.578686 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.578456 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e3b95ba8-aef1-4bf8-8184-e861882847a7-etc-selinux\") pod \"aws-ebs-csi-driver-node-nhbpv\" (UID: \"e3b95ba8-aef1-4bf8-8184-e861882847a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhbpv" Jun 13 01:10:50.578686 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.578471 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2bbd1a29-323d-47bd-aac0-af7873d30922-etc-sysconfig\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.578686 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.578493 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-os-release\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.578686 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.578532 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-host-run-k8s-cni-cncf-io\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.578686 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.578539 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e3b95ba8-aef1-4bf8-8184-e861882847a7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nhbpv\" (UID: \"e3b95ba8-aef1-4bf8-8184-e861882847a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhbpv" Jun 13 01:10:50.578686 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.578555 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-host-var-lib-cni-bin\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.578686 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.578579 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8284579-c698-4ff6-930c-de63ccccc8bd-system-cni-dir\") pod \"multus-additional-cni-plugins-chd2f\" (UID: \"f8284579-c698-4ff6-930c-de63ccccc8bd\") " pod="openshift-multus/multus-additional-cni-plugins-chd2f" Jun 13 01:10:50.578686 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.578597 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e3b95ba8-aef1-4bf8-8184-e861882847a7-etc-selinux\") pod \"aws-ebs-csi-driver-node-nhbpv\" (UID: \"e3b95ba8-aef1-4bf8-8184-e861882847a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhbpv" Jun 13 01:10:50.578686 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.578601 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2bbd1a29-323d-47bd-aac0-af7873d30922-etc-modprobe-d\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.578686 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.578665 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2bbd1a29-323d-47bd-aac0-af7873d30922-etc-sysctl-conf\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.578686 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.578691 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2bbd1a29-323d-47bd-aac0-af7873d30922-run\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.579160 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.578716 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgktf\" (UniqueName: \"kubernetes.io/projected/44ec5afd-c967-421a-8c09-f5fe4cc5af74-kube-api-access-rgktf\") pod \"iptables-alerter-grg5q\" (UID: \"44ec5afd-c967-421a-8c09-f5fe4cc5af74\") " pod="openshift-network-operator/iptables-alerter-grg5q" Jun 13 01:10:50.579160 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.578741 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8284579-c698-4ff6-930c-de63ccccc8bd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-chd2f\" (UID: \"f8284579-c698-4ff6-930c-de63ccccc8bd\") " pod="openshift-multus/multus-additional-cni-plugins-chd2f" Jun 13 01:10:50.579160 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.578765 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-host-run-netns\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.579160 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.578787 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-log-socket\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.579160 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.578810 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/44ec5afd-c967-421a-8c09-f5fe4cc5af74-iptables-alerter-script\") pod \"iptables-alerter-grg5q\" (UID: \"44ec5afd-c967-421a-8c09-f5fe4cc5af74\") " pod="openshift-network-operator/iptables-alerter-grg5q" Jun 13 01:10:50.579160 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.578834 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/113d88ff-ddd6-40b7-9c71-a00ce41a6c7d-original-pull-secret\") pod \"global-pull-secret-syncer-4gzc9\" (UID: \"113d88ff-ddd6-40b7-9c71-a00ce41a6c7d\") " pod="kube-system/global-pull-secret-syncer-4gzc9" Jun 13 01:10:50.579160 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.578856 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-host-run-multus-certs\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.579160 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.578895 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0f57e152-5740-40a8-bc29-bcbcadff6f50-konnectivity-ca\") pod \"konnectivity-agent-t5qq4\" (UID: \"0f57e152-5740-40a8-bc29-bcbcadff6f50\") " pod="kube-system/konnectivity-agent-t5qq4" Jun 13 01:10:50.579160 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.578923 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2bbd1a29-323d-47bd-aac0-af7873d30922-etc-tuned\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.579160 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.578965 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-systemd-units\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.579160 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.578992 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/45611778-f77e-4cab-b564-ffb69bd4a695-serviceca\") pod \"node-ca-4v55b\" (UID: \"45611778-f77e-4cab-b564-ffb69bd4a695\") " pod="openshift-image-registry/node-ca-4v55b" Jun 13 01:10:50.579160 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.579017 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2bjq\" (UniqueName: \"kubernetes.io/projected/45611778-f77e-4cab-b564-ffb69bd4a695-kube-api-access-b2bjq\") pod \"node-ca-4v55b\" (UID: \"45611778-f77e-4cab-b564-ffb69bd4a695\") " pod="openshift-image-registry/node-ca-4v55b" Jun 13 01:10:50.579160 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.579045 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-cnibin\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.579160 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.579067 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44ec5afd-c967-421a-8c09-f5fe4cc5af74-host-slash\") pod \"iptables-alerter-grg5q\" (UID: \"44ec5afd-c967-421a-8c09-f5fe4cc5af74\") " pod="openshift-network-operator/iptables-alerter-grg5q" Jun 13 01:10:50.579160 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.579102 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-hostroot\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.579160 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.579123 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-etc-kubernetes\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.579824 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.579149 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8284579-c698-4ff6-930c-de63ccccc8bd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-chd2f\" (UID: \"f8284579-c698-4ff6-930c-de63ccccc8bd\") " pod="openshift-multus/multus-additional-cni-plugins-chd2f" Jun 13 01:10:50.579824 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.579170 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6109025b-0598-4cbf-b841-200e35db36cf-ovnkube-config\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.579824 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.579220 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6109025b-0598-4cbf-b841-200e35db36cf-env-overrides\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.579824 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.579256 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/113d88ff-ddd6-40b7-9c71-a00ce41a6c7d-kubelet-config\") pod \"global-pull-secret-syncer-4gzc9\" (UID: \"113d88ff-ddd6-40b7-9c71-a00ce41a6c7d\") " pod="kube-system/global-pull-secret-syncer-4gzc9" Jun 13 01:10:50.579824 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.579283 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-host-var-lib-kubelet\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.579824 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.579315 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-multus-conf-dir\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.579824 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.579339 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsc2l\" (UniqueName: \"kubernetes.io/projected/323114ca-ff76-4dbd-90b9-8d1c80ebea04-kube-api-access-lsc2l\") pod \"network-metrics-daemon-t4b8x\" (UID: \"323114ca-ff76-4dbd-90b9-8d1c80ebea04\") " pod="openshift-multus/network-metrics-daemon-t4b8x" Jun 13 01:10:50.579824 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.579362 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-host-kubelet\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.579824 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.579385 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-host-run-ovn-kubernetes\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.579824 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.579412 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-host-cni-netd\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.579824 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.579437 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0f57e152-5740-40a8-bc29-bcbcadff6f50-konnectivity-ca\") pod \"konnectivity-agent-t5qq4\" (UID: \"0f57e152-5740-40a8-bc29-bcbcadff6f50\") " pod="kube-system/konnectivity-agent-t5qq4" Jun 13 01:10:50.579824 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.579449 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9281997e-d152-4b6a-ae85-9c590da00f3d-multus-daemon-config\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.579824 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.579475 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bbd1a29-323d-47bd-aac0-af7873d30922-sys\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.579824 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.579514 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6109025b-0598-4cbf-b841-200e35db36cf-ovn-node-metrics-cert\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.579824 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.579538 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/45611778-f77e-4cab-b564-ffb69bd4a695-host\") pod \"node-ca-4v55b\" (UID: \"45611778-f77e-4cab-b564-ffb69bd4a695\") " pod="openshift-image-registry/node-ca-4v55b" Jun 13 01:10:50.579824 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.579560 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-multus-socket-dir-parent\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.580583 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.579593 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8284579-c698-4ff6-930c-de63ccccc8bd-cni-binary-copy\") pod \"multus-additional-cni-plugins-chd2f\" (UID: \"f8284579-c698-4ff6-930c-de63ccccc8bd\") " pod="openshift-multus/multus-additional-cni-plugins-chd2f" Jun 13 01:10:50.580583 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.579612 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-etc-openvswitch\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.580583 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.579627 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-node-log\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.580583 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.579644 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59ksw\" (UniqueName: \"kubernetes.io/projected/e0f5e173-0662-47cd-9792-f07b01ab5eaf-kube-api-access-59ksw\") pod \"node-resolver-hlh72\" (UID: \"e0f5e173-0662-47cd-9792-f07b01ab5eaf\") " pod="openshift-dns/node-resolver-hlh72" Jun 13 01:10:50.580583 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.579697 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e3b95ba8-aef1-4bf8-8184-e861882847a7-registration-dir\") pod \"aws-ebs-csi-driver-node-nhbpv\" (UID: \"e3b95ba8-aef1-4bf8-8184-e861882847a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhbpv" Jun 13 01:10:50.580583 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.579747 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e3b95ba8-aef1-4bf8-8184-e861882847a7-registration-dir\") pod \"aws-ebs-csi-driver-node-nhbpv\" (UID: \"e3b95ba8-aef1-4bf8-8184-e861882847a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhbpv" Jun 13 01:10:50.580583 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.579765 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2bbd1a29-323d-47bd-aac0-af7873d30922-lib-modules\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.580583 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.579816 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-host-slash\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.580583 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.579868 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0f57e152-5740-40a8-bc29-bcbcadff6f50-agent-certs\") pod \"konnectivity-agent-t5qq4\" (UID: \"0f57e152-5740-40a8-bc29-bcbcadff6f50\") " pod="kube-system/konnectivity-agent-t5qq4" Jun 13 01:10:50.580583 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.579912 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2bbd1a29-323d-47bd-aac0-af7873d30922-etc-kubernetes\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.580583 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.579938 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2bbd1a29-323d-47bd-aac0-af7873d30922-etc-sysctl-d\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.580583 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.580001 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/113d88ff-ddd6-40b7-9c71-a00ce41a6c7d-dbus\") pod \"global-pull-secret-syncer-4gzc9\" (UID: \"113d88ff-ddd6-40b7-9c71-a00ce41a6c7d\") " pod="kube-system/global-pull-secret-syncer-4gzc9" Jun 13 01:10:50.580583 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.580030 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9281997e-d152-4b6a-ae85-9c590da00f3d-cni-binary-copy\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.580583 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.580063 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lswn\" (UniqueName: \"kubernetes.io/projected/f8284579-c698-4ff6-930c-de63ccccc8bd-kube-api-access-7lswn\") pod \"multus-additional-cni-plugins-chd2f\" (UID: \"f8284579-c698-4ff6-930c-de63ccccc8bd\") " pod="openshift-multus/multus-additional-cni-plugins-chd2f" Jun 13 01:10:50.580583 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.580094 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vqqd\" (UniqueName: \"kubernetes.io/projected/fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9-kube-api-access-2vqqd\") pod \"network-check-target-x9nxz\" (UID: \"fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9\") " pod="openshift-network-diagnostics/network-check-target-x9nxz" Jun 13 01:10:50.580583 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.580121 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/323114ca-ff76-4dbd-90b9-8d1c80ebea04-metrics-certs\") pod \"network-metrics-daemon-t4b8x\" (UID: \"323114ca-ff76-4dbd-90b9-8d1c80ebea04\") " pod="openshift-multus/network-metrics-daemon-t4b8x" Jun 13 01:10:50.581233 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.580144 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-run-systemd\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.581233 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.580166 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-run-openvswitch\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.581233 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.580201 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-host-var-lib-cni-multus\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.581233 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:50.580256 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:10:50.581233 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.580255 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 13 01:10:50.581233 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.580265 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0f5e173-0662-47cd-9792-f07b01ab5eaf-tmp-dir\") pod \"node-resolver-hlh72\" (UID: \"e0f5e173-0662-47cd-9792-f07b01ab5eaf\") " pod="openshift-dns/node-resolver-hlh72" Jun 13 01:10:50.581233 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.580349 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e3b95ba8-aef1-4bf8-8184-e861882847a7-sys-fs\") pod \"aws-ebs-csi-driver-node-nhbpv\" (UID: \"e3b95ba8-aef1-4bf8-8184-e861882847a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhbpv" Jun 13 01:10:50.581233 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:50.580394 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/323114ca-ff76-4dbd-90b9-8d1c80ebea04-metrics-certs podName:323114ca-ff76-4dbd-90b9-8d1c80ebea04 nodeName:}" failed. No retries permitted until 2026-06-13 01:10:51.080361739 +0000 UTC m=+2.946376952 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/323114ca-ff76-4dbd-90b9-8d1c80ebea04-metrics-certs") pod "network-metrics-daemon-t4b8x" (UID: "323114ca-ff76-4dbd-90b9-8d1c80ebea04") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:10:50.581233 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.580412 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2bbd1a29-323d-47bd-aac0-af7873d30922-etc-systemd\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.581233 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.580405 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e3b95ba8-aef1-4bf8-8184-e861882847a7-sys-fs\") pod \"aws-ebs-csi-driver-node-nhbpv\" (UID: \"e3b95ba8-aef1-4bf8-8184-e861882847a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhbpv" Jun 13 01:10:50.581233 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.580451 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-var-lib-openvswitch\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.581233 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.580581 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0f5e173-0662-47cd-9792-f07b01ab5eaf-tmp-dir\") pod \"node-resolver-hlh72\" (UID: \"e0f5e173-0662-47cd-9792-f07b01ab5eaf\") " pod="openshift-dns/node-resolver-hlh72" Jun 13 01:10:50.583193 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.583176 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0f57e152-5740-40a8-bc29-bcbcadff6f50-agent-certs\") pod \"konnectivity-agent-t5qq4\" (UID: \"0f57e152-5740-40a8-bc29-bcbcadff6f50\") " pod="kube-system/konnectivity-agent-t5qq4" Jun 13 01:10:50.590465 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.590441 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsmkj\" (UniqueName: \"kubernetes.io/projected/e3b95ba8-aef1-4bf8-8184-e861882847a7-kube-api-access-rsmkj\") pod \"aws-ebs-csi-driver-node-nhbpv\" (UID: \"e3b95ba8-aef1-4bf8-8184-e861882847a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhbpv" Jun 13 01:10:50.590990 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.590971 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59ksw\" (UniqueName: \"kubernetes.io/projected/e0f5e173-0662-47cd-9792-f07b01ab5eaf-kube-api-access-59ksw\") pod \"node-resolver-hlh72\" (UID: \"e0f5e173-0662-47cd-9792-f07b01ab5eaf\") " pod="openshift-dns/node-resolver-hlh72" Jun 13 01:10:50.591359 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.591337 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsc2l\" (UniqueName: \"kubernetes.io/projected/323114ca-ff76-4dbd-90b9-8d1c80ebea04-kube-api-access-lsc2l\") pod \"network-metrics-daemon-t4b8x\" (UID: \"323114ca-ff76-4dbd-90b9-8d1c80ebea04\") " pod="openshift-multus/network-metrics-daemon-t4b8x" Jun 13 01:10:50.681560 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.681482 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-host-cni-bin\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.681560 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.681551 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.681766 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.681585 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-host-run-netns\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.681766 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.681608 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6109025b-0598-4cbf-b841-200e35db36cf-ovnkube-script-lib\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.681766 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.681672 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drj7t\" (UniqueName: \"kubernetes.io/projected/6109025b-0598-4cbf-b841-200e35db36cf-kube-api-access-drj7t\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.681766 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.681705 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-system-cni-dir\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.681766 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.681733 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-multus-cni-dir\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.681766 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.681759 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2bbd1a29-323d-47bd-aac0-af7873d30922-host\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.682046 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.681781 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bbd1a29-323d-47bd-aac0-af7873d30922-tmp\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.682046 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.681812 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8v66\" (UniqueName: \"kubernetes.io/projected/2bbd1a29-323d-47bd-aac0-af7873d30922-kube-api-access-k8v66\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.682046 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.681841 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-run-ovn\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.682046 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.681871 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8284579-c698-4ff6-930c-de63ccccc8bd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-chd2f\" (UID: \"f8284579-c698-4ff6-930c-de63ccccc8bd\") " pod="openshift-multus/multus-additional-cni-plugins-chd2f" Jun 13 01:10:50.682046 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.681899 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2bbd1a29-323d-47bd-aac0-af7873d30922-var-lib-kubelet\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.682046 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.681923 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2bbd1a29-323d-47bd-aac0-af7873d30922-etc-sysconfig\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.682046 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.681966 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-os-release\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.682046 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.681997 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-host-run-k8s-cni-cncf-io\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.682046 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.682028 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-host-var-lib-cni-bin\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.682427 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.682055 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8284579-c698-4ff6-930c-de63ccccc8bd-system-cni-dir\") pod \"multus-additional-cni-plugins-chd2f\" (UID: \"f8284579-c698-4ff6-930c-de63ccccc8bd\") " pod="openshift-multus/multus-additional-cni-plugins-chd2f" Jun 13 01:10:50.682427 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.682079 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2bbd1a29-323d-47bd-aac0-af7873d30922-etc-modprobe-d\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.682427 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.682106 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2bbd1a29-323d-47bd-aac0-af7873d30922-etc-sysctl-conf\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.682427 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.682132 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2bbd1a29-323d-47bd-aac0-af7873d30922-run\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.682427 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.682175 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgktf\" (UniqueName: \"kubernetes.io/projected/44ec5afd-c967-421a-8c09-f5fe4cc5af74-kube-api-access-rgktf\") pod \"iptables-alerter-grg5q\" (UID: \"44ec5afd-c967-421a-8c09-f5fe4cc5af74\") " pod="openshift-network-operator/iptables-alerter-grg5q" Jun 13 01:10:50.682427 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.682205 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8284579-c698-4ff6-930c-de63ccccc8bd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-chd2f\" (UID: \"f8284579-c698-4ff6-930c-de63ccccc8bd\") " pod="openshift-multus/multus-additional-cni-plugins-chd2f" Jun 13 01:10:50.682427 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.682230 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-host-run-netns\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.682427 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.682259 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-log-socket\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.682427 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.682319 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/44ec5afd-c967-421a-8c09-f5fe4cc5af74-iptables-alerter-script\") pod \"iptables-alerter-grg5q\" (UID: \"44ec5afd-c967-421a-8c09-f5fe4cc5af74\") " pod="openshift-network-operator/iptables-alerter-grg5q" Jun 13 01:10:50.682427 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.682349 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/113d88ff-ddd6-40b7-9c71-a00ce41a6c7d-original-pull-secret\") pod \"global-pull-secret-syncer-4gzc9\" (UID: \"113d88ff-ddd6-40b7-9c71-a00ce41a6c7d\") " pod="kube-system/global-pull-secret-syncer-4gzc9" Jun 13 01:10:50.682427 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.682380 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-host-run-multus-certs\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.682427 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.682406 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2bbd1a29-323d-47bd-aac0-af7873d30922-etc-tuned\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.682934 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.682435 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-systemd-units\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.682934 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.682464 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/45611778-f77e-4cab-b564-ffb69bd4a695-serviceca\") pod \"node-ca-4v55b\" (UID: \"45611778-f77e-4cab-b564-ffb69bd4a695\") " pod="openshift-image-registry/node-ca-4v55b" Jun 13 01:10:50.682934 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.682495 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2bjq\" (UniqueName: \"kubernetes.io/projected/45611778-f77e-4cab-b564-ffb69bd4a695-kube-api-access-b2bjq\") pod \"node-ca-4v55b\" (UID: \"45611778-f77e-4cab-b564-ffb69bd4a695\") " pod="openshift-image-registry/node-ca-4v55b" Jun 13 01:10:50.682934 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.682520 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-cnibin\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.682934 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.682581 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44ec5afd-c967-421a-8c09-f5fe4cc5af74-host-slash\") pod \"iptables-alerter-grg5q\" (UID: \"44ec5afd-c967-421a-8c09-f5fe4cc5af74\") " pod="openshift-network-operator/iptables-alerter-grg5q" Jun 13 01:10:50.682934 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.682604 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-hostroot\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.682934 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.682636 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-etc-kubernetes\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.682934 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.682667 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8284579-c698-4ff6-930c-de63ccccc8bd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-chd2f\" (UID: \"f8284579-c698-4ff6-930c-de63ccccc8bd\") " pod="openshift-multus/multus-additional-cni-plugins-chd2f" Jun 13 01:10:50.682934 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.682697 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6109025b-0598-4cbf-b841-200e35db36cf-ovnkube-config\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.682934 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.682748 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6109025b-0598-4cbf-b841-200e35db36cf-env-overrides\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.682934 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.682773 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/113d88ff-ddd6-40b7-9c71-a00ce41a6c7d-kubelet-config\") pod \"global-pull-secret-syncer-4gzc9\" (UID: \"113d88ff-ddd6-40b7-9c71-a00ce41a6c7d\") " pod="kube-system/global-pull-secret-syncer-4gzc9" Jun 13 01:10:50.682934 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.682802 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-host-var-lib-kubelet\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.682934 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.682830 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-multus-conf-dir\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.682934 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.682861 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-host-kubelet\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.682934 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.682889 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-host-run-ovn-kubernetes\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.682934 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.682912 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-host-cni-netd\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.683584 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.682940 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9281997e-d152-4b6a-ae85-9c590da00f3d-multus-daemon-config\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.683584 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.683004 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bbd1a29-323d-47bd-aac0-af7873d30922-sys\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.683584 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.683033 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6109025b-0598-4cbf-b841-200e35db36cf-ovn-node-metrics-cert\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.683702 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.683662 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-run-ovn\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.683702 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.683662 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-host-cni-bin\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.683771 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.683702 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/45611778-f77e-4cab-b564-ffb69bd4a695-host\") pod \"node-ca-4v55b\" (UID: \"45611778-f77e-4cab-b564-ffb69bd4a695\") " pod="openshift-image-registry/node-ca-4v55b" Jun 13 01:10:50.683771 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.683742 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-multus-socket-dir-parent\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.683841 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.683784 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8284579-c698-4ff6-930c-de63ccccc8bd-cni-binary-copy\") pod \"multus-additional-cni-plugins-chd2f\" (UID: \"f8284579-c698-4ff6-930c-de63ccccc8bd\") " pod="openshift-multus/multus-additional-cni-plugins-chd2f" Jun 13 01:10:50.683841 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.683814 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-etc-openvswitch\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.683916 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.683811 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/45611778-f77e-4cab-b564-ffb69bd4a695-host\") pod \"node-ca-4v55b\" (UID: \"45611778-f77e-4cab-b564-ffb69bd4a695\") " pod="openshift-image-registry/node-ca-4v55b" Jun 13 01:10:50.683916 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.683745 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-host-run-netns\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.683916 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.683883 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8284579-c698-4ff6-930c-de63ccccc8bd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-chd2f\" (UID: \"f8284579-c698-4ff6-930c-de63ccccc8bd\") " pod="openshift-multus/multus-additional-cni-plugins-chd2f" Jun 13 01:10:50.683916 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.683847 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-node-log\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.683916 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.683901 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-multus-socket-dir-parent\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.684153 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.683913 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-host-run-netns\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.684153 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.683927 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2bbd1a29-323d-47bd-aac0-af7873d30922-lib-modules\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.684153 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.683938 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8284579-c698-4ff6-930c-de63ccccc8bd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-chd2f\" (UID: \"f8284579-c698-4ff6-930c-de63ccccc8bd\") " pod="openshift-multus/multus-additional-cni-plugins-chd2f" Jun 13 01:10:50.684153 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.683968 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.684153 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.683990 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-host-slash\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.684153 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.684028 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-host-slash\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.684153 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.684030 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2bbd1a29-323d-47bd-aac0-af7873d30922-etc-kubernetes\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.684153 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.684054 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2bbd1a29-323d-47bd-aac0-af7873d30922-lib-modules\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.684153 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.684078 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2bbd1a29-323d-47bd-aac0-af7873d30922-etc-kubernetes\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.684153 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.684081 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2bbd1a29-323d-47bd-aac0-af7873d30922-etc-sysctl-d\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.684556 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.684514 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/113d88ff-ddd6-40b7-9c71-a00ce41a6c7d-dbus\") pod \"global-pull-secret-syncer-4gzc9\" (UID: \"113d88ff-ddd6-40b7-9c71-a00ce41a6c7d\") " pod="kube-system/global-pull-secret-syncer-4gzc9" Jun 13 01:10:50.684556 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.684528 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-etc-kubernetes\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.684651 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.684566 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2bbd1a29-323d-47bd-aac0-af7873d30922-etc-sysctl-d\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.684651 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.684577 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2bbd1a29-323d-47bd-aac0-af7873d30922-etc-sysconfig\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.684651 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.684598 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-etc-openvswitch\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.684847 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.684662 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-node-log\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.684847 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.684689 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8284579-c698-4ff6-930c-de63ccccc8bd-cni-binary-copy\") pod \"multus-additional-cni-plugins-chd2f\" (UID: \"f8284579-c698-4ff6-930c-de63ccccc8bd\") " pod="openshift-multus/multus-additional-cni-plugins-chd2f" Jun 13 01:10:50.684847 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.684723 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2bbd1a29-323d-47bd-aac0-af7873d30922-var-lib-kubelet\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.684847 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.684801 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-host-run-k8s-cni-cncf-io\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.684847 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.684817 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44ec5afd-c967-421a-8c09-f5fe4cc5af74-host-slash\") pod \"iptables-alerter-grg5q\" (UID: \"44ec5afd-c967-421a-8c09-f5fe4cc5af74\") " pod="openshift-network-operator/iptables-alerter-grg5q" Jun 13 01:10:50.685100 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.684882 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bbd1a29-323d-47bd-aac0-af7873d30922-sys\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.685100 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.684980 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/45611778-f77e-4cab-b564-ffb69bd4a695-serviceca\") pod \"node-ca-4v55b\" (UID: \"45611778-f77e-4cab-b564-ffb69bd4a695\") " pod="openshift-image-registry/node-ca-4v55b" Jun 13 01:10:50.685100 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.685052 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-multus-cni-dir\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.685100 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.685059 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/113d88ff-ddd6-40b7-9c71-a00ce41a6c7d-dbus\") pod \"global-pull-secret-syncer-4gzc9\" (UID: \"113d88ff-ddd6-40b7-9c71-a00ce41a6c7d\") " pod="kube-system/global-pull-secret-syncer-4gzc9" Jun 13 01:10:50.685100 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.685092 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-host-cni-netd\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.685334 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.685108 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6109025b-0598-4cbf-b841-200e35db36cf-ovnkube-script-lib\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.685334 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.685122 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-host-kubelet\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.685334 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.685167 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-cnibin\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.685334 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:50.685197 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 01:10:50.685334 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.685204 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-host-run-ovn-kubernetes\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.685334 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.685212 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6109025b-0598-4cbf-b841-200e35db36cf-ovnkube-config\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.685334 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:50.685251 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/113d88ff-ddd6-40b7-9c71-a00ce41a6c7d-original-pull-secret podName:113d88ff-ddd6-40b7-9c71-a00ce41a6c7d nodeName:}" failed. No retries permitted until 2026-06-13 01:10:51.185234226 +0000 UTC m=+3.051249426 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/113d88ff-ddd6-40b7-9c71-a00ce41a6c7d-original-pull-secret") pod "global-pull-secret-syncer-4gzc9" (UID: "113d88ff-ddd6-40b7-9c71-a00ce41a6c7d") : object "kube-system"/"original-pull-secret" not registered Jun 13 01:10:50.685334 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.685250 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-system-cni-dir\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.685334 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.685277 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-systemd-units\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.685334 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.685288 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6109025b-0598-4cbf-b841-200e35db36cf-env-overrides\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.685334 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.685293 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-host-run-multus-certs\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.685871 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.685656 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8284579-c698-4ff6-930c-de63ccccc8bd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-chd2f\" (UID: \"f8284579-c698-4ff6-930c-de63ccccc8bd\") " pod="openshift-multus/multus-additional-cni-plugins-chd2f" Jun 13 01:10:50.685871 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.685716 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/113d88ff-ddd6-40b7-9c71-a00ce41a6c7d-kubelet-config\") pod \"global-pull-secret-syncer-4gzc9\" (UID: \"113d88ff-ddd6-40b7-9c71-a00ce41a6c7d\") " pod="kube-system/global-pull-secret-syncer-4gzc9" Jun 13 01:10:50.685871 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.685772 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9281997e-d152-4b6a-ae85-9c590da00f3d-multus-daemon-config\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.685871 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.685787 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-host-var-lib-kubelet\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.685871 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.685822 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-multus-conf-dir\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.685871 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.685825 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8284579-c698-4ff6-930c-de63ccccc8bd-system-cni-dir\") pod \"multus-additional-cni-plugins-chd2f\" (UID: \"f8284579-c698-4ff6-930c-de63ccccc8bd\") " pod="openshift-multus/multus-additional-cni-plugins-chd2f" Jun 13 01:10:50.685871 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.685822 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-hostroot\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.685871 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.685838 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2bbd1a29-323d-47bd-aac0-af7873d30922-etc-sysctl-conf\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.685871 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.685869 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2bbd1a29-323d-47bd-aac0-af7873d30922-run\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.686315 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.685869 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-host-var-lib-cni-bin\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.686315 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.685911 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2bbd1a29-323d-47bd-aac0-af7873d30922-host\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.686315 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.685919 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-log-socket\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.686315 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.685919 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2bbd1a29-323d-47bd-aac0-af7873d30922-etc-modprobe-d\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.686315 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.686047 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9281997e-d152-4b6a-ae85-9c590da00f3d-cni-binary-copy\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.686315 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.686063 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-os-release\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.686315 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.686077 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lswn\" (UniqueName: \"kubernetes.io/projected/f8284579-c698-4ff6-930c-de63ccccc8bd-kube-api-access-7lswn\") pod \"multus-additional-cni-plugins-chd2f\" (UID: \"f8284579-c698-4ff6-930c-de63ccccc8bd\") " pod="openshift-multus/multus-additional-cni-plugins-chd2f" Jun 13 01:10:50.686315 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.686125 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vqqd\" (UniqueName: \"kubernetes.io/projected/fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9-kube-api-access-2vqqd\") pod \"network-check-target-x9nxz\" (UID: \"fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9\") " pod="openshift-network-diagnostics/network-check-target-x9nxz" Jun 13 01:10:50.686315 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.686164 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-run-systemd\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.686315 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.686189 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-run-openvswitch\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.686315 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.686241 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-host-var-lib-cni-multus\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.686315 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.686269 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2bbd1a29-323d-47bd-aac0-af7873d30922-etc-systemd\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.686315 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.686291 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-var-lib-openvswitch\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.686315 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.686315 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kdz6\" (UniqueName: \"kubernetes.io/projected/9281997e-d152-4b6a-ae85-9c590da00f3d-kube-api-access-8kdz6\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.687033 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.686340 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8284579-c698-4ff6-930c-de63ccccc8bd-cnibin\") pod \"multus-additional-cni-plugins-chd2f\" (UID: \"f8284579-c698-4ff6-930c-de63ccccc8bd\") " pod="openshift-multus/multus-additional-cni-plugins-chd2f" Jun 13 01:10:50.687033 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.686363 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f8284579-c698-4ff6-930c-de63ccccc8bd-os-release\") pod \"multus-additional-cni-plugins-chd2f\" (UID: \"f8284579-c698-4ff6-930c-de63ccccc8bd\") " pod="openshift-multus/multus-additional-cni-plugins-chd2f" Jun 13 01:10:50.687033 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.686374 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-run-openvswitch\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.687033 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.686425 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/44ec5afd-c967-421a-8c09-f5fe4cc5af74-iptables-alerter-script\") pod \"iptables-alerter-grg5q\" (UID: \"44ec5afd-c967-421a-8c09-f5fe4cc5af74\") " pod="openshift-network-operator/iptables-alerter-grg5q" Jun 13 01:10:50.687033 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.686430 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-run-systemd\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.687033 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.686446 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f8284579-c698-4ff6-930c-de63ccccc8bd-os-release\") pod \"multus-additional-cni-plugins-chd2f\" (UID: \"f8284579-c698-4ff6-930c-de63ccccc8bd\") " pod="openshift-multus/multus-additional-cni-plugins-chd2f" Jun 13 01:10:50.687033 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.686470 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6109025b-0598-4cbf-b841-200e35db36cf-var-lib-openvswitch\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.687033 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.686509 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9281997e-d152-4b6a-ae85-9c590da00f3d-host-var-lib-cni-multus\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.687033 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.686555 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2bbd1a29-323d-47bd-aac0-af7873d30922-etc-systemd\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.687033 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.686573 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8284579-c698-4ff6-930c-de63ccccc8bd-cnibin\") pod \"multus-additional-cni-plugins-chd2f\" (UID: \"f8284579-c698-4ff6-930c-de63ccccc8bd\") " pod="openshift-multus/multus-additional-cni-plugins-chd2f" Jun 13 01:10:50.687033 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.686630 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9281997e-d152-4b6a-ae85-9c590da00f3d-cni-binary-copy\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.687526 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.687426 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6109025b-0598-4cbf-b841-200e35db36cf-ovn-node-metrics-cert\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.687634 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.687617 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bbd1a29-323d-47bd-aac0-af7873d30922-tmp\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.687716 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.687659 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2bbd1a29-323d-47bd-aac0-af7873d30922-etc-tuned\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.694960 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:50.694927 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 01:10:50.695069 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:50.694972 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 01:10:50.695069 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:50.694985 2573 projected.go:196] Error preparing data for projected volume kube-api-access-2vqqd for pod openshift-network-diagnostics/network-check-target-x9nxz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:10:50.695069 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:50.695063 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9-kube-api-access-2vqqd podName:fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9 nodeName:}" failed. No retries permitted until 2026-06-13 01:10:51.195046788 +0000 UTC m=+3.061062002 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2vqqd" (UniqueName: "kubernetes.io/projected/fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9-kube-api-access-2vqqd") pod "network-check-target-x9nxz" (UID: "fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:10:50.696462 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.696376 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8v66\" (UniqueName: \"kubernetes.io/projected/2bbd1a29-323d-47bd-aac0-af7873d30922-kube-api-access-k8v66\") pod \"tuned-mccj2\" (UID: \"2bbd1a29-323d-47bd-aac0-af7873d30922\") " pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.696462 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.696404 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lswn\" (UniqueName: \"kubernetes.io/projected/f8284579-c698-4ff6-930c-de63ccccc8bd-kube-api-access-7lswn\") pod \"multus-additional-cni-plugins-chd2f\" (UID: \"f8284579-c698-4ff6-930c-de63ccccc8bd\") " pod="openshift-multus/multus-additional-cni-plugins-chd2f" Jun 13 01:10:50.696891 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.696869 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgktf\" (UniqueName: \"kubernetes.io/projected/44ec5afd-c967-421a-8c09-f5fe4cc5af74-kube-api-access-rgktf\") pod \"iptables-alerter-grg5q\" (UID: \"44ec5afd-c967-421a-8c09-f5fe4cc5af74\") " pod="openshift-network-operator/iptables-alerter-grg5q" Jun 13 01:10:50.697899 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.697875 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2bjq\" (UniqueName: \"kubernetes.io/projected/45611778-f77e-4cab-b564-ffb69bd4a695-kube-api-access-b2bjq\") pod \"node-ca-4v55b\" (UID: \"45611778-f77e-4cab-b564-ffb69bd4a695\") " pod="openshift-image-registry/node-ca-4v55b" Jun 13 01:10:50.698595 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.698575 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kdz6\" (UniqueName: \"kubernetes.io/projected/9281997e-d152-4b6a-ae85-9c590da00f3d-kube-api-access-8kdz6\") pod \"multus-wbsfg\" (UID: \"9281997e-d152-4b6a-ae85-9c590da00f3d\") " pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.698898 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.698882 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drj7t\" (UniqueName: \"kubernetes.io/projected/6109025b-0598-4cbf-b841-200e35db36cf-kube-api-access-drj7t\") pod \"ovnkube-node-9jdpp\" (UID: \"6109025b-0598-4cbf-b841-200e35db36cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.772873 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.772843 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hlh72" Jun 13 01:10:50.781126 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.781105 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhbpv" Jun 13 01:10:50.789633 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.789614 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t5qq4" Jun 13 01:10:50.798016 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.797994 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4v55b" Jun 13 01:10:50.804698 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.804681 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mccj2" Jun 13 01:10:50.811252 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.811233 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wbsfg" Jun 13 01:10:50.817882 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.817863 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-chd2f" Jun 13 01:10:50.825615 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.825599 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:10:50.831144 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.831125 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-grg5q" Jun 13 01:10:50.947883 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:50.947805 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 01:10:51.089050 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:51.089013 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/323114ca-ff76-4dbd-90b9-8d1c80ebea04-metrics-certs\") pod \"network-metrics-daemon-t4b8x\" (UID: \"323114ca-ff76-4dbd-90b9-8d1c80ebea04\") " pod="openshift-multus/network-metrics-daemon-t4b8x" Jun 13 01:10:51.089239 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:51.089146 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:10:51.089239 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:51.089221 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/323114ca-ff76-4dbd-90b9-8d1c80ebea04-metrics-certs podName:323114ca-ff76-4dbd-90b9-8d1c80ebea04 nodeName:}" failed. No retries permitted until 2026-06-13 01:10:52.089202107 +0000 UTC m=+3.955217332 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/323114ca-ff76-4dbd-90b9-8d1c80ebea04-metrics-certs") pod "network-metrics-daemon-t4b8x" (UID: "323114ca-ff76-4dbd-90b9-8d1c80ebea04") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:10:51.189839 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:51.189735 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/113d88ff-ddd6-40b7-9c71-a00ce41a6c7d-original-pull-secret\") pod \"global-pull-secret-syncer-4gzc9\" (UID: \"113d88ff-ddd6-40b7-9c71-a00ce41a6c7d\") " pod="kube-system/global-pull-secret-syncer-4gzc9" Jun 13 01:10:51.190020 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:51.189885 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 01:10:51.190020 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:51.189977 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/113d88ff-ddd6-40b7-9c71-a00ce41a6c7d-original-pull-secret podName:113d88ff-ddd6-40b7-9c71-a00ce41a6c7d nodeName:}" failed. No retries permitted until 2026-06-13 01:10:52.189939653 +0000 UTC m=+4.055954872 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/113d88ff-ddd6-40b7-9c71-a00ce41a6c7d-original-pull-secret") pod "global-pull-secret-syncer-4gzc9" (UID: "113d88ff-ddd6-40b7-9c71-a00ce41a6c7d") : object "kube-system"/"original-pull-secret" not registered Jun 13 01:10:51.290422 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:51.290336 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vqqd\" (UniqueName: \"kubernetes.io/projected/fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9-kube-api-access-2vqqd\") pod \"network-check-target-x9nxz\" (UID: \"fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9\") " pod="openshift-network-diagnostics/network-check-target-x9nxz" Jun 13 01:10:51.290567 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:51.290505 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 01:10:51.290567 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:51.290526 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 01:10:51.290567 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:51.290536 2573 projected.go:196] Error preparing data for projected volume kube-api-access-2vqqd for pod openshift-network-diagnostics/network-check-target-x9nxz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:10:51.290675 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:51.290587 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9-kube-api-access-2vqqd podName:fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9 nodeName:}" failed. No retries permitted until 2026-06-13 01:10:52.290573136 +0000 UTC m=+4.156588336 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vqqd" (UniqueName: "kubernetes.io/projected/fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9-kube-api-access-2vqqd") pod "network-check-target-x9nxz" (UID: "fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:10:51.475984 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:51.475958 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0f5e173_0662_47cd_9792_f07b01ab5eaf.slice/crio-e5d278af12ae1efd66b7d3851bfdc9ddb87c8fe3fd9ac6d703f78b95ce63e439 WatchSource:0}: Error finding container e5d278af12ae1efd66b7d3851bfdc9ddb87c8fe3fd9ac6d703f78b95ce63e439: Status 404 returned error can't find the container with id e5d278af12ae1efd66b7d3851bfdc9ddb87c8fe3fd9ac6d703f78b95ce63e439 Jun 13 01:10:51.482025 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:51.481807 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6109025b_0598_4cbf_b841_200e35db36cf.slice/crio-74d9b304cba5e103af7cac55431a0115b836e47e05379aa61859c67b02ada5c0 WatchSource:0}: Error finding container 74d9b304cba5e103af7cac55431a0115b836e47e05379aa61859c67b02ada5c0: Status 404 returned error can't find the container with id 74d9b304cba5e103af7cac55431a0115b836e47e05379aa61859c67b02ada5c0 Jun 13 01:10:51.483577 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:51.483552 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3b95ba8_aef1_4bf8_8184_e861882847a7.slice/crio-2a29ba23051102e0c26d3bdfaba2437906d8941ddc1e9ba9d5e85a6ef813c71f WatchSource:0}: Error finding container 2a29ba23051102e0c26d3bdfaba2437906d8941ddc1e9ba9d5e85a6ef813c71f: Status 404 returned error can't find the container with id 2a29ba23051102e0c26d3bdfaba2437906d8941ddc1e9ba9d5e85a6ef813c71f Jun 13 01:10:51.485582 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:51.485558 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bbd1a29_323d_47bd_aac0_af7873d30922.slice/crio-291d67e4898a137e30c7b7ac2ed596fa1f22bc05462685323700a5539a2dd389 WatchSource:0}: Error finding container 291d67e4898a137e30c7b7ac2ed596fa1f22bc05462685323700a5539a2dd389: Status 404 returned error can't find the container with id 291d67e4898a137e30c7b7ac2ed596fa1f22bc05462685323700a5539a2dd389 Jun 13 01:10:51.486013 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:51.485991 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44ec5afd_c967_421a_8c09_f5fe4cc5af74.slice/crio-b8dee3bcb85236ac0f703bda6d10b2d17bce6e29663dd27f40cd730a5e6408e3 WatchSource:0}: Error finding container b8dee3bcb85236ac0f703bda6d10b2d17bce6e29663dd27f40cd730a5e6408e3: Status 404 returned error can't find the container with id b8dee3bcb85236ac0f703bda6d10b2d17bce6e29663dd27f40cd730a5e6408e3 Jun 13 01:10:51.508875 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:51.508852 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45611778_f77e_4cab_b564_ffb69bd4a695.slice/crio-5e8e2b1cc589215bb0da62af4b0f95735f7364f47fb3f7f2ecb0e48f116938b4 WatchSource:0}: Error finding container 5e8e2b1cc589215bb0da62af4b0f95735f7364f47fb3f7f2ecb0e48f116938b4: Status 404 returned error can't find the container with id 5e8e2b1cc589215bb0da62af4b0f95735f7364f47fb3f7f2ecb0e48f116938b4 Jun 13 01:10:51.510376 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:51.510351 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f57e152_5740_40a8_bc29_bcbcadff6f50.slice/crio-343e3c6e18a47f98808c96e94638a77184483e01a0eee04532172cf046870a13 WatchSource:0}: Error finding container 343e3c6e18a47f98808c96e94638a77184483e01a0eee04532172cf046870a13: Status 404 returned error can't find the container with id 343e3c6e18a47f98808c96e94638a77184483e01a0eee04532172cf046870a13 Jun 13 01:10:51.511132 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:51.511112 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8284579_c698_4ff6_930c_de63ccccc8bd.slice/crio-070850d37ef209f8a7551e0e95cff58c4d5d7c83df26797ebbc4437e50bb4bbd WatchSource:0}: Error finding container 070850d37ef209f8a7551e0e95cff58c4d5d7c83df26797ebbc4437e50bb4bbd: Status 404 returned error can't find the container with id 070850d37ef209f8a7551e0e95cff58c4d5d7c83df26797ebbc4437e50bb4bbd Jun 13 01:10:51.512918 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:10:51.512847 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9281997e_d152_4b6a_ae85_9c590da00f3d.slice/crio-919138dc99ae73d66c83f1c194f8bb26dbe17fcbe53f97f101731c8e0af5ed59 WatchSource:0}: Error finding container 919138dc99ae73d66c83f1c194f8bb26dbe17fcbe53f97f101731c8e0af5ed59: Status 404 returned error can't find the container with id 919138dc99ae73d66c83f1c194f8bb26dbe17fcbe53f97f101731c8e0af5ed59 Jun 13 01:10:51.529502 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:51.529468 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-12 01:05:49 +0000 UTC" deadline="2028-01-01 09:09:47.220071754 +0000 UTC" Jun 13 01:10:51.529502 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:51.529502 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13615h58m55.690571939s" Jun 13 01:10:51.543361 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:51.543325 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-chd2f" event={"ID":"f8284579-c698-4ff6-930c-de63ccccc8bd","Type":"ContainerStarted","Data":"070850d37ef209f8a7551e0e95cff58c4d5d7c83df26797ebbc4437e50bb4bbd"} Jun 13 01:10:51.544937 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:51.544910 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4v55b" event={"ID":"45611778-f77e-4cab-b564-ffb69bd4a695","Type":"ContainerStarted","Data":"5e8e2b1cc589215bb0da62af4b0f95735f7364f47fb3f7f2ecb0e48f116938b4"} Jun 13 01:10:51.546138 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:51.546119 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-grg5q" event={"ID":"44ec5afd-c967-421a-8c09-f5fe4cc5af74","Type":"ContainerStarted","Data":"b8dee3bcb85236ac0f703bda6d10b2d17bce6e29663dd27f40cd730a5e6408e3"} Jun 13 01:10:51.547119 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:51.547099 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhbpv" event={"ID":"e3b95ba8-aef1-4bf8-8184-e861882847a7","Type":"ContainerStarted","Data":"2a29ba23051102e0c26d3bdfaba2437906d8941ddc1e9ba9d5e85a6ef813c71f"} Jun 13 01:10:51.548130 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:51.548111 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" event={"ID":"6109025b-0598-4cbf-b841-200e35db36cf","Type":"ContainerStarted","Data":"74d9b304cba5e103af7cac55431a0115b836e47e05379aa61859c67b02ada5c0"} Jun 13 01:10:51.550966 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:51.550927 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t5qq4" event={"ID":"0f57e152-5740-40a8-bc29-bcbcadff6f50","Type":"ContainerStarted","Data":"343e3c6e18a47f98808c96e94638a77184483e01a0eee04532172cf046870a13"} Jun 13 01:10:51.554215 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:51.554195 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mccj2" event={"ID":"2bbd1a29-323d-47bd-aac0-af7873d30922","Type":"ContainerStarted","Data":"291d67e4898a137e30c7b7ac2ed596fa1f22bc05462685323700a5539a2dd389"} Jun 13 01:10:51.555503 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:51.555486 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hlh72" event={"ID":"e0f5e173-0662-47cd-9792-f07b01ab5eaf","Type":"ContainerStarted","Data":"e5d278af12ae1efd66b7d3851bfdc9ddb87c8fe3fd9ac6d703f78b95ce63e439"} Jun 13 01:10:51.556305 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:51.556287 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wbsfg" event={"ID":"9281997e-d152-4b6a-ae85-9c590da00f3d","Type":"ContainerStarted","Data":"919138dc99ae73d66c83f1c194f8bb26dbe17fcbe53f97f101731c8e0af5ed59"} Jun 13 01:10:51.637196 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:51.637170 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 01:10:52.097781 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:52.097224 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/323114ca-ff76-4dbd-90b9-8d1c80ebea04-metrics-certs\") pod \"network-metrics-daemon-t4b8x\" (UID: \"323114ca-ff76-4dbd-90b9-8d1c80ebea04\") " pod="openshift-multus/network-metrics-daemon-t4b8x" Jun 13 01:10:52.097781 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:52.097384 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:10:52.097781 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:52.097449 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/323114ca-ff76-4dbd-90b9-8d1c80ebea04-metrics-certs podName:323114ca-ff76-4dbd-90b9-8d1c80ebea04 nodeName:}" failed. No retries permitted until 2026-06-13 01:10:54.097430711 +0000 UTC m=+5.963445910 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/323114ca-ff76-4dbd-90b9-8d1c80ebea04-metrics-certs") pod "network-metrics-daemon-t4b8x" (UID: "323114ca-ff76-4dbd-90b9-8d1c80ebea04") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:10:52.197890 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:52.197852 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/113d88ff-ddd6-40b7-9c71-a00ce41a6c7d-original-pull-secret\") pod \"global-pull-secret-syncer-4gzc9\" (UID: \"113d88ff-ddd6-40b7-9c71-a00ce41a6c7d\") " pod="kube-system/global-pull-secret-syncer-4gzc9" Jun 13 01:10:52.198076 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:52.198020 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 01:10:52.198138 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:52.198083 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/113d88ff-ddd6-40b7-9c71-a00ce41a6c7d-original-pull-secret podName:113d88ff-ddd6-40b7-9c71-a00ce41a6c7d nodeName:}" failed. No retries permitted until 2026-06-13 01:10:54.19806458 +0000 UTC m=+6.064079784 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/113d88ff-ddd6-40b7-9c71-a00ce41a6c7d-original-pull-secret") pod "global-pull-secret-syncer-4gzc9" (UID: "113d88ff-ddd6-40b7-9c71-a00ce41a6c7d") : object "kube-system"/"original-pull-secret" not registered Jun 13 01:10:52.298386 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:52.298348 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vqqd\" (UniqueName: \"kubernetes.io/projected/fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9-kube-api-access-2vqqd\") pod \"network-check-target-x9nxz\" (UID: \"fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9\") " pod="openshift-network-diagnostics/network-check-target-x9nxz" Jun 13 01:10:52.298573 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:52.298555 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 01:10:52.298633 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:52.298584 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 01:10:52.298633 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:52.298597 2573 projected.go:196] Error preparing data for projected volume kube-api-access-2vqqd for pod openshift-network-diagnostics/network-check-target-x9nxz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:10:52.298737 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:52.298654 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9-kube-api-access-2vqqd podName:fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9 nodeName:}" failed. No retries permitted until 2026-06-13 01:10:54.298635676 +0000 UTC m=+6.164650938 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vqqd" (UniqueName: "kubernetes.io/projected/fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9-kube-api-access-2vqqd") pod "network-check-target-x9nxz" (UID: "fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:10:52.538304 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:52.538228 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4b8x" Jun 13 01:10:52.538722 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:52.538408 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4b8x" podUID="323114ca-ff76-4dbd-90b9-8d1c80ebea04" Jun 13 01:10:52.538895 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:52.538875 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gzc9" Jun 13 01:10:52.539037 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:52.539015 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4gzc9" podUID="113d88ff-ddd6-40b7-9c71-a00ce41a6c7d" Jun 13 01:10:52.539115 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:52.539102 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9nxz" Jun 13 01:10:52.539258 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:52.539225 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9nxz" podUID="fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9" Jun 13 01:10:52.569252 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:52.568250 2573 generic.go:356] "Generic (PLEG): container finished" podID="18b59a78da48c34835482e0de0261337" containerID="f4800cbe8ca2518af45927971d908ed919e3bbd5e9adfffe3dde5683b3f54b3f" exitCode=0 Jun 13 01:10:52.569252 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:52.568996 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal" event={"ID":"18b59a78da48c34835482e0de0261337","Type":"ContainerDied","Data":"f4800cbe8ca2518af45927971d908ed919e3bbd5e9adfffe3dde5683b3f54b3f"} Jun 13 01:10:52.583558 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:52.583528 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-236.ec2.internal" event={"ID":"aeada42337847de1ed566b0c344a17a2","Type":"ContainerStarted","Data":"e2dd6125763f28ea35cd07d934e002864b0c8995326e005a13d3d5c85024729e"} Jun 13 01:10:53.593707 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:53.593674 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal" event={"ID":"18b59a78da48c34835482e0de0261337","Type":"ContainerStarted","Data":"3e1670e6e7b56716e14d90c42abcafc03ea5b6b69137cd69545cffe29b3fe63c"} Jun 13 01:10:53.608250 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:53.608196 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-236.ec2.internal" podStartSLOduration=4.608177017 podStartE2EDuration="4.608177017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:10:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:10:52.60477612 +0000 UTC m=+4.470791343" watchObservedRunningTime="2026-06-13 01:10:53.608177017 +0000 UTC m=+5.474192252" Jun 13 01:10:53.609329 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:53.608436 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal" podStartSLOduration=4.608426801 podStartE2EDuration="4.608426801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:10:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:10:53.608329006 +0000 UTC m=+5.474344221" watchObservedRunningTime="2026-06-13 01:10:53.608426801 +0000 UTC m=+5.474442024" Jun 13 01:10:54.115876 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:54.115286 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/323114ca-ff76-4dbd-90b9-8d1c80ebea04-metrics-certs\") pod \"network-metrics-daemon-t4b8x\" (UID: \"323114ca-ff76-4dbd-90b9-8d1c80ebea04\") " pod="openshift-multus/network-metrics-daemon-t4b8x" Jun 13 01:10:54.115876 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:54.115465 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:10:54.115876 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:54.115529 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/323114ca-ff76-4dbd-90b9-8d1c80ebea04-metrics-certs podName:323114ca-ff76-4dbd-90b9-8d1c80ebea04 nodeName:}" failed. No retries permitted until 2026-06-13 01:10:58.115511046 +0000 UTC m=+9.981526247 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/323114ca-ff76-4dbd-90b9-8d1c80ebea04-metrics-certs") pod "network-metrics-daemon-t4b8x" (UID: "323114ca-ff76-4dbd-90b9-8d1c80ebea04") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:10:54.217794 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:54.217244 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/113d88ff-ddd6-40b7-9c71-a00ce41a6c7d-original-pull-secret\") pod \"global-pull-secret-syncer-4gzc9\" (UID: \"113d88ff-ddd6-40b7-9c71-a00ce41a6c7d\") " pod="kube-system/global-pull-secret-syncer-4gzc9" Jun 13 01:10:54.217794 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:54.217396 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 01:10:54.217794 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:54.217459 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/113d88ff-ddd6-40b7-9c71-a00ce41a6c7d-original-pull-secret podName:113d88ff-ddd6-40b7-9c71-a00ce41a6c7d nodeName:}" failed. No retries permitted until 2026-06-13 01:10:58.217437905 +0000 UTC m=+10.083453110 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/113d88ff-ddd6-40b7-9c71-a00ce41a6c7d-original-pull-secret") pod "global-pull-secret-syncer-4gzc9" (UID: "113d88ff-ddd6-40b7-9c71-a00ce41a6c7d") : object "kube-system"/"original-pull-secret" not registered Jun 13 01:10:54.318261 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:54.318199 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vqqd\" (UniqueName: \"kubernetes.io/projected/fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9-kube-api-access-2vqqd\") pod \"network-check-target-x9nxz\" (UID: \"fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9\") " pod="openshift-network-diagnostics/network-check-target-x9nxz" Jun 13 01:10:54.318605 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:54.318463 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 01:10:54.318605 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:54.318491 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 01:10:54.318605 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:54.318505 2573 projected.go:196] Error preparing data for projected volume kube-api-access-2vqqd for pod openshift-network-diagnostics/network-check-target-x9nxz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:10:54.318605 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:54.318564 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9-kube-api-access-2vqqd podName:fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9 nodeName:}" failed. No retries permitted until 2026-06-13 01:10:58.31854688 +0000 UTC m=+10.184562083 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vqqd" (UniqueName: "kubernetes.io/projected/fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9-kube-api-access-2vqqd") pod "network-check-target-x9nxz" (UID: "fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:10:54.533384 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:54.533293 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9nxz" Jun 13 01:10:54.533384 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:54.533315 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gzc9" Jun 13 01:10:54.533586 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:54.533422 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9nxz" podUID="fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9" Jun 13 01:10:54.533781 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:54.533759 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4b8x" Jun 13 01:10:54.533887 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:54.533868 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4gzc9" podUID="113d88ff-ddd6-40b7-9c71-a00ce41a6c7d" Jun 13 01:10:54.534153 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:54.534014 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4b8x" podUID="323114ca-ff76-4dbd-90b9-8d1c80ebea04" Jun 13 01:10:56.532924 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:56.532888 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9nxz" Jun 13 01:10:56.533388 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:56.532897 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4b8x" Jun 13 01:10:56.533388 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:56.533017 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gzc9" Jun 13 01:10:56.533388 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:56.533033 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9nxz" podUID="fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9" Jun 13 01:10:56.533388 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:56.533119 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4gzc9" podUID="113d88ff-ddd6-40b7-9c71-a00ce41a6c7d" Jun 13 01:10:56.533388 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:56.533206 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4b8x" podUID="323114ca-ff76-4dbd-90b9-8d1c80ebea04" Jun 13 01:10:58.150597 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:58.150159 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/323114ca-ff76-4dbd-90b9-8d1c80ebea04-metrics-certs\") pod \"network-metrics-daemon-t4b8x\" (UID: \"323114ca-ff76-4dbd-90b9-8d1c80ebea04\") " pod="openshift-multus/network-metrics-daemon-t4b8x" Jun 13 01:10:58.150597 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:58.150348 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:10:58.150597 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:58.150432 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/323114ca-ff76-4dbd-90b9-8d1c80ebea04-metrics-certs podName:323114ca-ff76-4dbd-90b9-8d1c80ebea04 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:06.150411625 +0000 UTC m=+18.016426842 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/323114ca-ff76-4dbd-90b9-8d1c80ebea04-metrics-certs") pod "network-metrics-daemon-t4b8x" (UID: "323114ca-ff76-4dbd-90b9-8d1c80ebea04") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:10:58.251005 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:58.250799 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/113d88ff-ddd6-40b7-9c71-a00ce41a6c7d-original-pull-secret\") pod \"global-pull-secret-syncer-4gzc9\" (UID: \"113d88ff-ddd6-40b7-9c71-a00ce41a6c7d\") " pod="kube-system/global-pull-secret-syncer-4gzc9" Jun 13 01:10:58.251005 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:58.251008 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 01:10:58.251229 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:58.251078 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/113d88ff-ddd6-40b7-9c71-a00ce41a6c7d-original-pull-secret podName:113d88ff-ddd6-40b7-9c71-a00ce41a6c7d nodeName:}" failed. No retries permitted until 2026-06-13 01:11:06.251058638 +0000 UTC m=+18.117073851 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/113d88ff-ddd6-40b7-9c71-a00ce41a6c7d-original-pull-secret") pod "global-pull-secret-syncer-4gzc9" (UID: "113d88ff-ddd6-40b7-9c71-a00ce41a6c7d") : object "kube-system"/"original-pull-secret" not registered Jun 13 01:10:58.352621 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:58.352196 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vqqd\" (UniqueName: \"kubernetes.io/projected/fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9-kube-api-access-2vqqd\") pod \"network-check-target-x9nxz\" (UID: \"fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9\") " pod="openshift-network-diagnostics/network-check-target-x9nxz" Jun 13 01:10:58.352621 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:58.352371 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 01:10:58.352621 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:58.352392 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 01:10:58.352621 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:58.352403 2573 projected.go:196] Error preparing data for projected volume kube-api-access-2vqqd for pod openshift-network-diagnostics/network-check-target-x9nxz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:10:58.352621 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:58.352460 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9-kube-api-access-2vqqd podName:fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:06.352441077 +0000 UTC m=+18.218456291 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vqqd" (UniqueName: "kubernetes.io/projected/fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9-kube-api-access-2vqqd") pod "network-check-target-x9nxz" (UID: "fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:10:58.537546 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:58.537453 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gzc9" Jun 13 01:10:58.537698 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:58.537564 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4gzc9" podUID="113d88ff-ddd6-40b7-9c71-a00ce41a6c7d" Jun 13 01:10:58.537698 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:58.537598 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4b8x" Jun 13 01:10:58.537698 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:58.537674 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4b8x" podUID="323114ca-ff76-4dbd-90b9-8d1c80ebea04" Jun 13 01:10:58.537869 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:10:58.537714 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9nxz" Jun 13 01:10:58.537869 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:10:58.537816 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9nxz" podUID="fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9" Jun 13 01:11:00.533781 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:00.533744 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gzc9" Jun 13 01:11:00.533781 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:00.533776 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9nxz" Jun 13 01:11:00.534262 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:00.533745 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4b8x" Jun 13 01:11:00.534262 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:00.533883 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4gzc9" podUID="113d88ff-ddd6-40b7-9c71-a00ce41a6c7d" Jun 13 01:11:00.534262 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:00.533994 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4b8x" podUID="323114ca-ff76-4dbd-90b9-8d1c80ebea04" Jun 13 01:11:00.534262 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:00.534082 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9nxz" podUID="fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9" Jun 13 01:11:02.536518 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:02.536489 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4b8x" Jun 13 01:11:02.536991 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:02.536527 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9nxz" Jun 13 01:11:02.536991 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:02.536530 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gzc9" Jun 13 01:11:02.536991 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:02.536613 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4b8x" podUID="323114ca-ff76-4dbd-90b9-8d1c80ebea04" Jun 13 01:11:02.536991 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:02.536714 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9nxz" podUID="fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9" Jun 13 01:11:02.536991 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:02.536804 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4gzc9" podUID="113d88ff-ddd6-40b7-9c71-a00ce41a6c7d" Jun 13 01:11:04.533520 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:04.533491 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gzc9" Jun 13 01:11:04.534074 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:04.533503 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9nxz" Jun 13 01:11:04.534074 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:04.533620 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4gzc9" podUID="113d88ff-ddd6-40b7-9c71-a00ce41a6c7d" Jun 13 01:11:04.534074 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:04.533503 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4b8x" Jun 13 01:11:04.534074 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:04.533662 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9nxz" podUID="fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9" Jun 13 01:11:04.534074 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:04.533804 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4b8x" podUID="323114ca-ff76-4dbd-90b9-8d1c80ebea04" Jun 13 01:11:06.216744 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:06.216706 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/323114ca-ff76-4dbd-90b9-8d1c80ebea04-metrics-certs\") pod \"network-metrics-daemon-t4b8x\" (UID: \"323114ca-ff76-4dbd-90b9-8d1c80ebea04\") " pod="openshift-multus/network-metrics-daemon-t4b8x" Jun 13 01:11:06.217217 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:06.216878 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:11:06.217217 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:06.216960 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/323114ca-ff76-4dbd-90b9-8d1c80ebea04-metrics-certs podName:323114ca-ff76-4dbd-90b9-8d1c80ebea04 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:22.216933274 +0000 UTC m=+34.082948479 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/323114ca-ff76-4dbd-90b9-8d1c80ebea04-metrics-certs") pod "network-metrics-daemon-t4b8x" (UID: "323114ca-ff76-4dbd-90b9-8d1c80ebea04") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:11:06.317784 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:06.317740 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/113d88ff-ddd6-40b7-9c71-a00ce41a6c7d-original-pull-secret\") pod \"global-pull-secret-syncer-4gzc9\" (UID: \"113d88ff-ddd6-40b7-9c71-a00ce41a6c7d\") " pod="kube-system/global-pull-secret-syncer-4gzc9" Jun 13 01:11:06.317963 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:06.317898 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 01:11:06.318021 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:06.317975 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/113d88ff-ddd6-40b7-9c71-a00ce41a6c7d-original-pull-secret podName:113d88ff-ddd6-40b7-9c71-a00ce41a6c7d nodeName:}" failed. No retries permitted until 2026-06-13 01:11:22.31795989 +0000 UTC m=+34.183975110 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/113d88ff-ddd6-40b7-9c71-a00ce41a6c7d-original-pull-secret") pod "global-pull-secret-syncer-4gzc9" (UID: "113d88ff-ddd6-40b7-9c71-a00ce41a6c7d") : object "kube-system"/"original-pull-secret" not registered Jun 13 01:11:06.418771 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:06.418735 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vqqd\" (UniqueName: \"kubernetes.io/projected/fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9-kube-api-access-2vqqd\") pod \"network-check-target-x9nxz\" (UID: \"fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9\") " pod="openshift-network-diagnostics/network-check-target-x9nxz" Jun 13 01:11:06.418940 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:06.418869 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 01:11:06.418940 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:06.418893 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 01:11:06.418940 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:06.418907 2573 projected.go:196] Error preparing data for projected volume kube-api-access-2vqqd for pod openshift-network-diagnostics/network-check-target-x9nxz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:11:06.419098 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:06.418968 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9-kube-api-access-2vqqd podName:fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:22.418955085 +0000 UTC m=+34.284970299 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vqqd" (UniqueName: "kubernetes.io/projected/fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9-kube-api-access-2vqqd") pod "network-check-target-x9nxz" (UID: "fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:11:06.533927 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:06.533847 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9nxz" Jun 13 01:11:06.534088 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:06.533846 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gzc9" Jun 13 01:11:06.534088 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:06.533984 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9nxz" podUID="fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9" Jun 13 01:11:06.534088 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:06.533859 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4b8x" Jun 13 01:11:06.534088 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:06.534065 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4gzc9" podUID="113d88ff-ddd6-40b7-9c71-a00ce41a6c7d" Jun 13 01:11:06.534309 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:06.534157 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4b8x" podUID="323114ca-ff76-4dbd-90b9-8d1c80ebea04" Jun 13 01:11:08.537523 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:08.537194 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gzc9" Jun 13 01:11:08.537523 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:08.537356 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4gzc9" podUID="113d88ff-ddd6-40b7-9c71-a00ce41a6c7d" Jun 13 01:11:08.537523 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:08.537478 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9nxz" Jun 13 01:11:08.538107 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:08.537724 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4b8x" Jun 13 01:11:08.538107 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:08.538060 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9nxz" podUID="fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9" Jun 13 01:11:08.538203 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:08.538161 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4b8x" podUID="323114ca-ff76-4dbd-90b9-8d1c80ebea04" Jun 13 01:11:10.534133 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:10.533886 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4b8x" Jun 13 01:11:10.534785 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:10.533968 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9nxz" Jun 13 01:11:10.534785 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:10.534259 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4b8x" podUID="323114ca-ff76-4dbd-90b9-8d1c80ebea04" Jun 13 01:11:10.534785 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:10.534096 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gzc9" Jun 13 01:11:10.534785 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:10.534350 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9nxz" podUID="fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9" Jun 13 01:11:10.534785 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:10.534392 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4gzc9" podUID="113d88ff-ddd6-40b7-9c71-a00ce41a6c7d" Jun 13 01:11:10.628291 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:10.628251 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wbsfg" event={"ID":"9281997e-d152-4b6a-ae85-9c590da00f3d","Type":"ContainerStarted","Data":"003031d3b1f69248a2b4bf1a36836a5873a4998d420236b2ffb9eab464b59346"} Jun 13 01:11:10.629728 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:10.629706 2573 generic.go:356] "Generic (PLEG): container finished" podID="f8284579-c698-4ff6-930c-de63ccccc8bd" containerID="f809a61e9a1e7295d09f34b2584f5e7625fd4ebf1e3ed5086b86b89bcf202955" exitCode=0 Jun 13 01:11:10.629819 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:10.629788 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-chd2f" event={"ID":"f8284579-c698-4ff6-930c-de63ccccc8bd","Type":"ContainerDied","Data":"f809a61e9a1e7295d09f34b2584f5e7625fd4ebf1e3ed5086b86b89bcf202955"} Jun 13 01:11:10.631090 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:10.631066 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4v55b" event={"ID":"45611778-f77e-4cab-b564-ffb69bd4a695","Type":"ContainerStarted","Data":"17338ca77b2263711c1bfe3a9f6dbb4aee82e993827f92883f6c3975ee908330"} Jun 13 01:11:10.632658 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:10.632636 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhbpv" event={"ID":"e3b95ba8-aef1-4bf8-8184-e861882847a7","Type":"ContainerStarted","Data":"7d94db2bfc7574c1bf623c30565026f3688ec75a8a89ea21fe67978105e93d7b"} Jun 13 01:11:10.634609 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:10.634590 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9jdpp_6109025b-0598-4cbf-b841-200e35db36cf/ovn-acl-logging/0.log" Jun 13 01:11:10.634907 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:10.634888 2573 generic.go:356] "Generic (PLEG): container finished" podID="6109025b-0598-4cbf-b841-200e35db36cf" containerID="26404711d3521a08ad6261aa4a61346c36d43c6c7c998b232b0370ed78bea17f" exitCode=1 Jun 13 01:11:10.635001 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:10.634933 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" event={"ID":"6109025b-0598-4cbf-b841-200e35db36cf","Type":"ContainerStarted","Data":"a5a80e7df371c10f98de59c631d91066097f4621adf8e50133e66b45b8d97725"} Jun 13 01:11:10.635062 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:10.635008 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" event={"ID":"6109025b-0598-4cbf-b841-200e35db36cf","Type":"ContainerStarted","Data":"6b61fa419fd581aa8bccbdc66a13cdab57b89eb8950d96909ac6b0563407b681"} Jun 13 01:11:10.635062 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:10.635042 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" event={"ID":"6109025b-0598-4cbf-b841-200e35db36cf","Type":"ContainerDied","Data":"26404711d3521a08ad6261aa4a61346c36d43c6c7c998b232b0370ed78bea17f"} Jun 13 01:11:10.635167 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:10.635072 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" event={"ID":"6109025b-0598-4cbf-b841-200e35db36cf","Type":"ContainerStarted","Data":"55bf52643f27df6eff7e1f47735deb6ada9dc294ea5766c4914302f3eb0a1251"} Jun 13 01:11:10.636358 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:10.636337 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t5qq4" event={"ID":"0f57e152-5740-40a8-bc29-bcbcadff6f50","Type":"ContainerStarted","Data":"3f5ecaa69cd0ec5fbd4300948efad0aa978401aa5a306218390f47b3f9258d9a"} Jun 13 01:11:10.637764 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:10.637747 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mccj2" event={"ID":"2bbd1a29-323d-47bd-aac0-af7873d30922","Type":"ContainerStarted","Data":"0d63c3c11a510dd1d2a4593ee5de0502b327e8ac2c6817402eb47bfe3872b130"} Jun 13 01:11:10.638982 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:10.638960 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hlh72" event={"ID":"e0f5e173-0662-47cd-9792-f07b01ab5eaf","Type":"ContainerStarted","Data":"3cafd967544d88ca0743eb15fc17b2ba56a16e874d53b697db0f142ddfcd608c"} Jun 13 01:11:10.652903 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:10.652692 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wbsfg" podStartSLOduration=4.032014113 podStartE2EDuration="22.65266692s" totalImagesPullingTime="18.620652807s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:10:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:10.652648785 +0000 UTC m=+22.518664047" watchObservedRunningTime="2026-06-13 01:11:10.65266692 +0000 UTC m=+22.518682123" Jun 13 01:11:10.712253 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:10.711903 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-t5qq4" podStartSLOduration=4.578429258 podStartE2EDuration="22.711884576s" totalImagesPullingTime="18.133455318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:10:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:10.711883557 +0000 UTC m=+22.577898779" watchObservedRunningTime="2026-06-13 01:11:10.711884576 +0000 UTC m=+22.577899798" Jun 13 01:11:10.712403 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:10.712376 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hlh72" podStartSLOduration=4.120101014 podStartE2EDuration="22.712366902s" totalImagesPullingTime="18.592265888s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:10:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:10.695126256 +0000 UTC m=+22.561141477" watchObservedRunningTime="2026-06-13 01:11:10.712366902 +0000 UTC m=+22.578382124" Jun 13 01:11:10.727600 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:10.727556 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4v55b" podStartSLOduration=4.247521138 podStartE2EDuration="22.727537463s" totalImagesPullingTime="18.480016325s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:10:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:10.727213941 +0000 UTC m=+22.593229164" watchObservedRunningTime="2026-06-13 01:11:10.727537463 +0000 UTC m=+22.593552688" Jun 13 01:11:10.977252 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:10.977213 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-t5qq4" Jun 13 01:11:10.977895 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:10.977868 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-t5qq4" Jun 13 01:11:10.999085 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:10.999038 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mccj2" podStartSLOduration=4.432526897 podStartE2EDuration="22.999020607s" totalImagesPullingTime="18.56649371s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:10:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:10.753105726 +0000 UTC m=+22.619120948" watchObservedRunningTime="2026-06-13 01:11:10.999020607 +0000 UTC m=+22.865035831" Jun 13 01:11:11.409224 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:11.409201 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 13 01:11:11.532094 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:11.531992 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-13T01:11:11.409217912Z","UUID":"f3ce81e5-a1a3-475f-83ca-6019c3bb5bcf","Handler":null,"Name":"","Endpoint":""} Jun 13 01:11:11.533668 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:11.533648 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 13 01:11:11.533779 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:11.533685 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 13 01:11:11.643058 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:11.643024 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-grg5q" event={"ID":"44ec5afd-c967-421a-8c09-f5fe4cc5af74","Type":"ContainerStarted","Data":"9b8983a58732269688828f5273ad49c2649d7e189973ebe332d6aac7efdd2f28"} Jun 13 01:11:11.646036 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:11.645739 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhbpv" event={"ID":"e3b95ba8-aef1-4bf8-8184-e861882847a7","Type":"ContainerStarted","Data":"6b923b0b78b30469977b29306a9a930ef4968429a868f27a831d4d391ea13e84"} Jun 13 01:11:11.649746 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:11.649728 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9jdpp_6109025b-0598-4cbf-b841-200e35db36cf/ovn-acl-logging/0.log" Jun 13 01:11:11.650241 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:11.650215 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" event={"ID":"6109025b-0598-4cbf-b841-200e35db36cf","Type":"ContainerStarted","Data":"2672e80ce51be64746127a4aa7c284962ad73646af6195350402963a11107d48"} Jun 13 01:11:11.650350 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:11.650293 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" event={"ID":"6109025b-0598-4cbf-b841-200e35db36cf","Type":"ContainerStarted","Data":"f7a9cccae6d1e76ed35005bdb7f0ea8de6f9c25c5e1302f7670eb524d2ab4744"} Jun 13 01:11:11.658770 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:11.658727 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-grg5q" podStartSLOduration=4.123891268 podStartE2EDuration="22.658711002s" totalImagesPullingTime="18.534819734s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:10:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:11.658461493 +0000 UTC m=+23.524476715" watchObservedRunningTime="2026-06-13 01:11:11.658711002 +0000 UTC m=+23.524726225" Jun 13 01:11:12.533553 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:12.533518 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gzc9" Jun 13 01:11:12.533738 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:12.533518 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4b8x" Jun 13 01:11:12.533738 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:12.533666 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4gzc9" podUID="113d88ff-ddd6-40b7-9c71-a00ce41a6c7d" Jun 13 01:11:12.533738 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:12.533518 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9nxz" Jun 13 01:11:12.533896 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:12.533737 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4b8x" podUID="323114ca-ff76-4dbd-90b9-8d1c80ebea04" Jun 13 01:11:12.533896 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:12.533818 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9nxz" podUID="fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9" Jun 13 01:11:12.652094 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:12.651892 2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 13 01:11:13.656432 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:13.656396 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhbpv" event={"ID":"e3b95ba8-aef1-4bf8-8184-e861882847a7","Type":"ContainerStarted","Data":"1a4911d3621189b561f05845b5f5f28e641ac9fb0ff4bc735e45fac32e2b3c8d"} Jun 13 01:11:13.659606 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:13.659585 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9jdpp_6109025b-0598-4cbf-b841-200e35db36cf/ovn-acl-logging/0.log" Jun 13 01:11:13.660025 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:13.660003 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" event={"ID":"6109025b-0598-4cbf-b841-200e35db36cf","Type":"ContainerStarted","Data":"d6002e1022836ac1b8df2eedb107eed8b5c63ee5552f856999eef3e4299d02f4"} Jun 13 01:11:14.533647 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:14.533617 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gzc9" Jun 13 01:11:14.533823 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:14.533617 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4b8x" Jun 13 01:11:14.533823 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:14.533746 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4gzc9" podUID="113d88ff-ddd6-40b7-9c71-a00ce41a6c7d" Jun 13 01:11:14.533823 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:14.533757 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9nxz" Jun 13 01:11:14.533981 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:14.533849 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4b8x" podUID="323114ca-ff76-4dbd-90b9-8d1c80ebea04" Jun 13 01:11:14.533981 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:14.533930 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9nxz" podUID="fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9" Jun 13 01:11:15.666055 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:15.666022 2573 generic.go:356] "Generic (PLEG): container finished" podID="f8284579-c698-4ff6-930c-de63ccccc8bd" containerID="7352cd4109e89ac3512a0cbb44e6be33aae4b7e5f40490d43a5c59979abe9dec" exitCode=0 Jun 13 01:11:15.666770 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:15.666078 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-chd2f" event={"ID":"f8284579-c698-4ff6-930c-de63ccccc8bd","Type":"ContainerDied","Data":"7352cd4109e89ac3512a0cbb44e6be33aae4b7e5f40490d43a5c59979abe9dec"} Jun 13 01:11:15.669605 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:15.669589 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9jdpp_6109025b-0598-4cbf-b841-200e35db36cf/ovn-acl-logging/0.log" Jun 13 01:11:15.669906 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:15.669889 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" event={"ID":"6109025b-0598-4cbf-b841-200e35db36cf","Type":"ContainerStarted","Data":"a1f6862f2a82c7c77231617bb766e45471537db04c8c9eab77cc16909a9da58c"} Jun 13 01:11:15.670184 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:15.670154 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:11:15.670329 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:15.670277 2573 scope.go:117] "RemoveContainer" containerID="26404711d3521a08ad6261aa4a61346c36d43c6c7c998b232b0370ed78bea17f" Jun 13 01:11:15.685070 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:15.685053 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:11:15.690451 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:15.689126 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhbpv" podStartSLOduration=7.024309829 podStartE2EDuration="27.689109078s" totalImagesPullingTime="20.664799249s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:10:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:13.674816918 +0000 UTC m=+25.540832153" watchObservedRunningTime="2026-06-13 01:11:15.689109078 +0000 UTC m=+27.555124304" Jun 13 01:11:16.533028 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:16.532999 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4b8x" Jun 13 01:11:16.533228 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:16.532999 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gzc9" Jun 13 01:11:16.533228 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:16.533111 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4b8x" podUID="323114ca-ff76-4dbd-90b9-8d1c80ebea04" Jun 13 01:11:16.533228 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:16.533001 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9nxz" Jun 13 01:11:16.533228 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:16.533197 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4gzc9" podUID="113d88ff-ddd6-40b7-9c71-a00ce41a6c7d" Jun 13 01:11:16.533467 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:16.533271 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9nxz" podUID="fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9" Jun 13 01:11:16.676563 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:16.676541 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9jdpp_6109025b-0598-4cbf-b841-200e35db36cf/ovn-acl-logging/0.log" Jun 13 01:11:16.676987 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:16.676875 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" event={"ID":"6109025b-0598-4cbf-b841-200e35db36cf","Type":"ContainerStarted","Data":"f62bcac10aada077a54d9d26854bb8da64a24343bc54ce55ad4d4326a3b98d93"} Jun 13 01:11:16.677218 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:16.677196 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:11:16.677368 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:16.677260 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:11:16.691931 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:16.691913 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:11:16.711722 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:16.711681 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" podStartSLOduration=10.064964645 podStartE2EDuration="28.711667074s" totalImagesPullingTime="18.646702429s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:10:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:16.711488101 +0000 UTC m=+28.577503322" watchObservedRunningTime="2026-06-13 01:11:16.711667074 +0000 UTC m=+28.577682296" Jun 13 01:11:17.120155 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:17.120081 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-t5qq4" Jun 13 01:11:17.120312 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:17.120229 2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 13 01:11:17.120759 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:17.120726 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-t5qq4" Jun 13 01:11:17.122230 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:17.122206 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4gzc9"] Jun 13 01:11:17.122354 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:17.122305 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gzc9" Jun 13 01:11:17.122404 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:17.122391 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4gzc9" podUID="113d88ff-ddd6-40b7-9c71-a00ce41a6c7d" Jun 13 01:11:17.125085 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:17.125061 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x9nxz"] Jun 13 01:11:17.125183 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:17.125141 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9nxz" Jun 13 01:11:17.125229 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:17.125209 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9nxz" podUID="fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9" Jun 13 01:11:17.134325 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:17.134302 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t4b8x"] Jun 13 01:11:17.134418 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:17.134386 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4b8x" Jun 13 01:11:17.134473 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:17.134454 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4b8x" podUID="323114ca-ff76-4dbd-90b9-8d1c80ebea04" Jun 13 01:11:17.681507 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:17.681472 2573 generic.go:356] "Generic (PLEG): container finished" podID="f8284579-c698-4ff6-930c-de63ccccc8bd" containerID="400bfeadae72bd21f3a92ccaa9df96bc84241daf07501ccf96469bdada6b1199" exitCode=0 Jun 13 01:11:17.682024 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:17.681556 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-chd2f" event={"ID":"f8284579-c698-4ff6-930c-de63ccccc8bd","Type":"ContainerDied","Data":"400bfeadae72bd21f3a92ccaa9df96bc84241daf07501ccf96469bdada6b1199"} Jun 13 01:11:18.533838 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:18.533809 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gzc9" Jun 13 01:11:18.534015 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:18.533888 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4gzc9" podUID="113d88ff-ddd6-40b7-9c71-a00ce41a6c7d" Jun 13 01:11:18.534015 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:18.533994 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4b8x" Jun 13 01:11:18.534149 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:18.534126 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4b8x" podUID="323114ca-ff76-4dbd-90b9-8d1c80ebea04" Jun 13 01:11:19.533247 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:19.533098 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9nxz" Jun 13 01:11:19.533659 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:19.533349 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9nxz" podUID="fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9" Jun 13 01:11:19.688649 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:19.688618 2573 generic.go:356] "Generic (PLEG): container finished" podID="f8284579-c698-4ff6-930c-de63ccccc8bd" containerID="598ce5384995c3eec97118d28c81941b182afc3647c3c4f3a44dc0cbc998a9e3" exitCode=0 Jun 13 01:11:19.688770 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:19.688693 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-chd2f" event={"ID":"f8284579-c698-4ff6-930c-de63ccccc8bd","Type":"ContainerDied","Data":"598ce5384995c3eec97118d28c81941b182afc3647c3c4f3a44dc0cbc998a9e3"} Jun 13 01:11:20.533349 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:20.533308 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gzc9" Jun 13 01:11:20.534011 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:20.533439 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4gzc9" podUID="113d88ff-ddd6-40b7-9c71-a00ce41a6c7d" Jun 13 01:11:20.534011 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:20.533493 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4b8x" Jun 13 01:11:20.534011 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:20.533619 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4b8x" podUID="323114ca-ff76-4dbd-90b9-8d1c80ebea04" Jun 13 01:11:21.532898 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:21.532867 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9nxz" Jun 13 01:11:21.533076 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:21.533009 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9nxz" podUID="fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9" Jun 13 01:11:22.241689 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:22.241651 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/323114ca-ff76-4dbd-90b9-8d1c80ebea04-metrics-certs\") pod \"network-metrics-daemon-t4b8x\" (UID: \"323114ca-ff76-4dbd-90b9-8d1c80ebea04\") " pod="openshift-multus/network-metrics-daemon-t4b8x" Jun 13 01:11:22.242145 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:22.241833 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:11:22.242145 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:22.241912 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/323114ca-ff76-4dbd-90b9-8d1c80ebea04-metrics-certs podName:323114ca-ff76-4dbd-90b9-8d1c80ebea04 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:54.241890854 +0000 UTC m=+66.107906056 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/323114ca-ff76-4dbd-90b9-8d1c80ebea04-metrics-certs") pod "network-metrics-daemon-t4b8x" (UID: "323114ca-ff76-4dbd-90b9-8d1c80ebea04") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:11:22.342960 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:22.342919 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/113d88ff-ddd6-40b7-9c71-a00ce41a6c7d-original-pull-secret\") pod \"global-pull-secret-syncer-4gzc9\" (UID: \"113d88ff-ddd6-40b7-9c71-a00ce41a6c7d\") " pod="kube-system/global-pull-secret-syncer-4gzc9" Jun 13 01:11:22.343096 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:22.343064 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 01:11:22.343148 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:22.343136 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/113d88ff-ddd6-40b7-9c71-a00ce41a6c7d-original-pull-secret podName:113d88ff-ddd6-40b7-9c71-a00ce41a6c7d nodeName:}" failed. No retries permitted until 2026-06-13 01:11:54.343121067 +0000 UTC m=+66.209136266 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/113d88ff-ddd6-40b7-9c71-a00ce41a6c7d-original-pull-secret") pod "global-pull-secret-syncer-4gzc9" (UID: "113d88ff-ddd6-40b7-9c71-a00ce41a6c7d") : object "kube-system"/"original-pull-secret" not registered Jun 13 01:11:22.444017 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:22.443984 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vqqd\" (UniqueName: \"kubernetes.io/projected/fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9-kube-api-access-2vqqd\") pod \"network-check-target-x9nxz\" (UID: \"fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9\") " pod="openshift-network-diagnostics/network-check-target-x9nxz" Jun 13 01:11:22.444186 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:22.444158 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 01:11:22.444186 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:22.444177 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 01:11:22.444186 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:22.444187 2573 projected.go:196] Error preparing data for projected volume kube-api-access-2vqqd for pod openshift-network-diagnostics/network-check-target-x9nxz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:11:22.444314 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:22.444235 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9-kube-api-access-2vqqd podName:fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:54.444222264 +0000 UTC m=+66.310237464 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vqqd" (UniqueName: "kubernetes.io/projected/fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9-kube-api-access-2vqqd") pod "network-check-target-x9nxz" (UID: "fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:11:22.533735 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:22.533642 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4b8x" Jun 13 01:11:22.533735 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:22.533681 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gzc9" Jun 13 01:11:22.533965 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:22.533781 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4b8x" podUID="323114ca-ff76-4dbd-90b9-8d1c80ebea04" Jun 13 01:11:22.533965 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:22.533911 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4gzc9" podUID="113d88ff-ddd6-40b7-9c71-a00ce41a6c7d" Jun 13 01:11:22.992427 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:22.992401 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeReady" Jun 13 01:11:22.992687 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:22.992541 2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 13 01:11:23.026557 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.026531 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6ff5965f98-2ltfx"] Jun 13 01:11:23.035109 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.035088 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:11:23.037530 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.037508 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 13 01:11:23.037631 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.037612 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 13 01:11:23.037698 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.037612 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mqb2w\"" Jun 13 01:11:23.037801 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.037777 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 13 01:11:23.040991 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.040969 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-76n9p"] Jun 13 01:11:23.043527 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.043498 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 13 01:11:23.049215 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.049198 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6ff5965f98-2ltfx"] Jun 13 01:11:23.049305 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.049233 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qtfxw"] Jun 13 01:11:23.049361 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.049319 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-76n9p" Jun 13 01:11:23.051972 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.051930 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 13 01:11:23.052057 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.052009 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hswsv\"" Jun 13 01:11:23.052057 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.051955 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 13 01:11:23.056476 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.056321 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qtfxw" Jun 13 01:11:23.056839 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.056783 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-76n9p"] Jun 13 01:11:23.058714 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.058688 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 13 01:11:23.059340 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.059089 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 13 01:11:23.059340 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.059160 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 13 01:11:23.059725 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.059708 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qsm9c\"" Jun 13 01:11:23.063869 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.063827 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qtfxw"] Jun 13 01:11:23.149046 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.149013 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a3350408-8867-4ba4-8fec-37d9e005eb39-config-volume\") pod \"dns-default-76n9p\" (UID: \"a3350408-8867-4ba4-8fec-37d9e005eb39\") " pod="openshift-dns/dns-default-76n9p" Jun 13 01:11:23.149046 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.149053 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85b53893-9a6d-407b-b03d-19de5c6d06e5-trusted-ca\") pod \"image-registry-6ff5965f98-2ltfx\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:11:23.149278 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.149077 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3350408-8867-4ba4-8fec-37d9e005eb39-metrics-tls\") pod \"dns-default-76n9p\" (UID: \"a3350408-8867-4ba4-8fec-37d9e005eb39\") " pod="openshift-dns/dns-default-76n9p" Jun 13 01:11:23.149278 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.149128 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-tls\") pod \"image-registry-6ff5965f98-2ltfx\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:11:23.149278 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.149220 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85b53893-9a6d-407b-b03d-19de5c6d06e5-image-registry-private-configuration\") pod \"image-registry-6ff5965f98-2ltfx\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:11:23.149278 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.149242 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85b53893-9a6d-407b-b03d-19de5c6d06e5-ca-trust-extracted\") pod \"image-registry-6ff5965f98-2ltfx\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:11:23.149278 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.149260 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-bound-sa-token\") pod \"image-registry-6ff5965f98-2ltfx\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:11:23.149278 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.149276 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl5qx\" (UniqueName: \"kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-kube-api-access-fl5qx\") pod \"image-registry-6ff5965f98-2ltfx\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:11:23.149570 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.149293 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn855\" (UniqueName: \"kubernetes.io/projected/a3350408-8867-4ba4-8fec-37d9e005eb39-kube-api-access-cn855\") pod \"dns-default-76n9p\" (UID: \"a3350408-8867-4ba4-8fec-37d9e005eb39\") " pod="openshift-dns/dns-default-76n9p" Jun 13 01:11:23.149570 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.149382 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-certificates\") pod \"image-registry-6ff5965f98-2ltfx\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:11:23.149570 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.149431 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85b53893-9a6d-407b-b03d-19de5c6d06e5-installation-pull-secrets\") pod \"image-registry-6ff5965f98-2ltfx\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:11:23.149570 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.149452 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3350408-8867-4ba4-8fec-37d9e005eb39-tmp-dir\") pod \"dns-default-76n9p\" (UID: \"a3350408-8867-4ba4-8fec-37d9e005eb39\") " pod="openshift-dns/dns-default-76n9p" Jun 13 01:11:23.188760 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.188724 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-t5qq4_0f57e152-5740-40a8-bc29-bcbcadff6f50/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:23.250818 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.250751 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85b53893-9a6d-407b-b03d-19de5c6d06e5-image-registry-private-configuration\") pod \"image-registry-6ff5965f98-2ltfx\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:11:23.250818 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.250783 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85b53893-9a6d-407b-b03d-19de5c6d06e5-ca-trust-extracted\") pod \"image-registry-6ff5965f98-2ltfx\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:11:23.250818 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.250801 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-bound-sa-token\") pod \"image-registry-6ff5965f98-2ltfx\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:11:23.250818 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.250816 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl5qx\" (UniqueName: \"kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-kube-api-access-fl5qx\") pod \"image-registry-6ff5965f98-2ltfx\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:11:23.251452 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.250837 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn855\" (UniqueName: \"kubernetes.io/projected/a3350408-8867-4ba4-8fec-37d9e005eb39-kube-api-access-cn855\") pod \"dns-default-76n9p\" (UID: \"a3350408-8867-4ba4-8fec-37d9e005eb39\") " pod="openshift-dns/dns-default-76n9p" Jun 13 01:11:23.251452 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.250970 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab5efd87-9312-47f5-8521-d918f3f16571-cert\") pod \"ingress-canary-qtfxw\" (UID: \"ab5efd87-9312-47f5-8521-d918f3f16571\") " pod="openshift-ingress-canary/ingress-canary-qtfxw" Jun 13 01:11:23.251452 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.251016 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-certificates\") pod \"image-registry-6ff5965f98-2ltfx\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:11:23.251589 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.251455 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85b53893-9a6d-407b-b03d-19de5c6d06e5-installation-pull-secrets\") pod \"image-registry-6ff5965f98-2ltfx\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:11:23.251589 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.251506 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3350408-8867-4ba4-8fec-37d9e005eb39-tmp-dir\") pod \"dns-default-76n9p\" (UID: \"a3350408-8867-4ba4-8fec-37d9e005eb39\") " pod="openshift-dns/dns-default-76n9p" Jun 13 01:11:23.251589 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.251545 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a3350408-8867-4ba4-8fec-37d9e005eb39-config-volume\") pod \"dns-default-76n9p\" (UID: \"a3350408-8867-4ba4-8fec-37d9e005eb39\") " pod="openshift-dns/dns-default-76n9p" Jun 13 01:11:23.251589 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.251576 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdj2h\" (UniqueName: \"kubernetes.io/projected/ab5efd87-9312-47f5-8521-d918f3f16571-kube-api-access-gdj2h\") pod \"ingress-canary-qtfxw\" (UID: \"ab5efd87-9312-47f5-8521-d918f3f16571\") " pod="openshift-ingress-canary/ingress-canary-qtfxw" Jun 13 01:11:23.251715 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.251611 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85b53893-9a6d-407b-b03d-19de5c6d06e5-trusted-ca\") pod \"image-registry-6ff5965f98-2ltfx\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:11:23.251715 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.251641 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3350408-8867-4ba4-8fec-37d9e005eb39-metrics-tls\") pod \"dns-default-76n9p\" (UID: \"a3350408-8867-4ba4-8fec-37d9e005eb39\") " pod="openshift-dns/dns-default-76n9p" Jun 13 01:11:23.251715 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.251674 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-tls\") pod \"image-registry-6ff5965f98-2ltfx\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:11:23.251801 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:23.251793 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 01:11:23.251833 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:23.251807 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ff5965f98-2ltfx: secret "image-registry-tls" not found Jun 13 01:11:23.251886 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:23.251875 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-tls podName:85b53893-9a6d-407b-b03d-19de5c6d06e5 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:23.751856074 +0000 UTC m=+35.617871288 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-tls") pod "image-registry-6ff5965f98-2ltfx" (UID: "85b53893-9a6d-407b-b03d-19de5c6d06e5") : secret "image-registry-tls" not found Jun 13 01:11:23.253292 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.252105 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-certificates\") pod \"image-registry-6ff5965f98-2ltfx\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:11:23.253292 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.252981 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85b53893-9a6d-407b-b03d-19de5c6d06e5-ca-trust-extracted\") pod \"image-registry-6ff5965f98-2ltfx\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:11:23.253472 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.253361 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a3350408-8867-4ba4-8fec-37d9e005eb39-config-volume\") pod \"dns-default-76n9p\" (UID: \"a3350408-8867-4ba4-8fec-37d9e005eb39\") " pod="openshift-dns/dns-default-76n9p" Jun 13 01:11:23.253472 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:23.253452 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 01:11:23.253607 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:23.253592 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3350408-8867-4ba4-8fec-37d9e005eb39-metrics-tls podName:a3350408-8867-4ba4-8fec-37d9e005eb39 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:23.753576318 +0000 UTC m=+35.619591531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3350408-8867-4ba4-8fec-37d9e005eb39-metrics-tls") pod "dns-default-76n9p" (UID: "a3350408-8867-4ba4-8fec-37d9e005eb39") : secret "dns-default-metrics-tls" not found Jun 13 01:11:23.253866 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.253843 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3350408-8867-4ba4-8fec-37d9e005eb39-tmp-dir\") pod \"dns-default-76n9p\" (UID: \"a3350408-8867-4ba4-8fec-37d9e005eb39\") " pod="openshift-dns/dns-default-76n9p" Jun 13 01:11:23.256971 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.256775 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85b53893-9a6d-407b-b03d-19de5c6d06e5-trusted-ca\") pod \"image-registry-6ff5965f98-2ltfx\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:11:23.257798 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.257770 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85b53893-9a6d-407b-b03d-19de5c6d06e5-installation-pull-secrets\") pod \"image-registry-6ff5965f98-2ltfx\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:11:23.259249 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.259222 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85b53893-9a6d-407b-b03d-19de5c6d06e5-image-registry-private-configuration\") pod \"image-registry-6ff5965f98-2ltfx\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:11:23.260188 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.260140 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-bound-sa-token\") pod \"image-registry-6ff5965f98-2ltfx\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:11:23.260816 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.260797 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl5qx\" (UniqueName: \"kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-kube-api-access-fl5qx\") pod \"image-registry-6ff5965f98-2ltfx\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:11:23.261041 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.261016 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn855\" (UniqueName: \"kubernetes.io/projected/a3350408-8867-4ba4-8fec-37d9e005eb39-kube-api-access-cn855\") pod \"dns-default-76n9p\" (UID: \"a3350408-8867-4ba4-8fec-37d9e005eb39\") " pod="openshift-dns/dns-default-76n9p" Jun 13 01:11:23.275196 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.275174 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-t5qq4_0f57e152-5740-40a8-bc29-bcbcadff6f50/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:23.353228 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.353199 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab5efd87-9312-47f5-8521-d918f3f16571-cert\") pod \"ingress-canary-qtfxw\" (UID: \"ab5efd87-9312-47f5-8521-d918f3f16571\") " pod="openshift-ingress-canary/ingress-canary-qtfxw" Jun 13 01:11:23.353375 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.353252 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdj2h\" (UniqueName: \"kubernetes.io/projected/ab5efd87-9312-47f5-8521-d918f3f16571-kube-api-access-gdj2h\") pod \"ingress-canary-qtfxw\" (UID: \"ab5efd87-9312-47f5-8521-d918f3f16571\") " pod="openshift-ingress-canary/ingress-canary-qtfxw" Jun 13 01:11:23.355712 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.355688 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab5efd87-9312-47f5-8521-d918f3f16571-cert\") pod \"ingress-canary-qtfxw\" (UID: \"ab5efd87-9312-47f5-8521-d918f3f16571\") " pod="openshift-ingress-canary/ingress-canary-qtfxw" Jun 13 01:11:23.361959 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.361922 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdj2h\" (UniqueName: \"kubernetes.io/projected/ab5efd87-9312-47f5-8521-d918f3f16571-kube-api-access-gdj2h\") pod \"ingress-canary-qtfxw\" (UID: \"ab5efd87-9312-47f5-8521-d918f3f16571\") " pod="openshift-ingress-canary/ingress-canary-qtfxw" Jun 13 01:11:23.368710 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.368692 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qtfxw" Jun 13 01:11:23.532913 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.532844 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9nxz" Jun 13 01:11:23.535660 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.535510 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 13 01:11:23.535660 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.535554 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 13 01:11:23.535660 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.535564 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-78kc5\"" Jun 13 01:11:23.755632 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.755595 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3350408-8867-4ba4-8fec-37d9e005eb39-metrics-tls\") pod \"dns-default-76n9p\" (UID: \"a3350408-8867-4ba4-8fec-37d9e005eb39\") " pod="openshift-dns/dns-default-76n9p" Jun 13 01:11:23.755810 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.755641 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-tls\") pod \"image-registry-6ff5965f98-2ltfx\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:11:23.755810 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:23.755757 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 01:11:23.755810 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:23.755783 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 01:11:23.755810 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:23.755796 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ff5965f98-2ltfx: secret "image-registry-tls" not found Jun 13 01:11:23.756049 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:23.755832 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3350408-8867-4ba4-8fec-37d9e005eb39-metrics-tls podName:a3350408-8867-4ba4-8fec-37d9e005eb39 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:24.755812804 +0000 UTC m=+36.621828004 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3350408-8867-4ba4-8fec-37d9e005eb39-metrics-tls") pod "dns-default-76n9p" (UID: "a3350408-8867-4ba4-8fec-37d9e005eb39") : secret "dns-default-metrics-tls" not found Jun 13 01:11:23.756049 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:23.755860 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-tls podName:85b53893-9a6d-407b-b03d-19de5c6d06e5 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:24.75584946 +0000 UTC m=+36.621864670 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-tls") pod "image-registry-6ff5965f98-2ltfx" (UID: "85b53893-9a6d-407b-b03d-19de5c6d06e5") : secret "image-registry-tls" not found Jun 13 01:11:23.939778 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:23.939566 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qtfxw"] Jun 13 01:11:23.942854 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:11:23.942828 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab5efd87_9312_47f5_8521_d918f3f16571.slice/crio-c217179fe86cb2db4e7530dab0b74f025587cad9b8f9890f4c8aef5fe194cd5c WatchSource:0}: Error finding container c217179fe86cb2db4e7530dab0b74f025587cad9b8f9890f4c8aef5fe194cd5c: Status 404 returned error can't find the container with id c217179fe86cb2db4e7530dab0b74f025587cad9b8f9890f4c8aef5fe194cd5c Jun 13 01:11:24.533237 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:24.533202 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gzc9" Jun 13 01:11:24.533237 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:24.533240 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4b8x" Jun 13 01:11:24.536156 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:24.536129 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 13 01:11:24.536156 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:24.536152 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 13 01:11:24.536331 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:24.536155 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-86b5g\"" Jun 13 01:11:24.542366 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:24.541444 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-t5qq4_0f57e152-5740-40a8-bc29-bcbcadff6f50/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:24.596296 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:24.596263 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-t5qq4_0f57e152-5740-40a8-bc29-bcbcadff6f50/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:24.704534 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:24.704502 2573 generic.go:356] "Generic (PLEG): container finished" podID="f8284579-c698-4ff6-930c-de63ccccc8bd" containerID="8afb521007d54c62d6f8d94167b690e1c82ff743ae219b80be46134b67a7bd94" exitCode=0 Jun 13 01:11:24.704702 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:24.704586 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-chd2f" event={"ID":"f8284579-c698-4ff6-930c-de63ccccc8bd","Type":"ContainerDied","Data":"8afb521007d54c62d6f8d94167b690e1c82ff743ae219b80be46134b67a7bd94"} Jun 13 01:11:24.705984 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:24.705962 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qtfxw" event={"ID":"ab5efd87-9312-47f5-8521-d918f3f16571","Type":"ContainerStarted","Data":"c217179fe86cb2db4e7530dab0b74f025587cad9b8f9890f4c8aef5fe194cd5c"} Jun 13 01:11:24.764123 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:24.764079 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3350408-8867-4ba4-8fec-37d9e005eb39-metrics-tls\") pod \"dns-default-76n9p\" (UID: \"a3350408-8867-4ba4-8fec-37d9e005eb39\") " pod="openshift-dns/dns-default-76n9p" Jun 13 01:11:24.764123 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:24.764114 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-tls\") pod \"image-registry-6ff5965f98-2ltfx\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:11:24.764283 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:24.764230 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 01:11:24.764283 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:24.764255 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 01:11:24.764283 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:24.764266 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ff5965f98-2ltfx: secret "image-registry-tls" not found Jun 13 01:11:24.764472 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:24.764306 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3350408-8867-4ba4-8fec-37d9e005eb39-metrics-tls podName:a3350408-8867-4ba4-8fec-37d9e005eb39 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:26.764285939 +0000 UTC m=+38.630301151 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3350408-8867-4ba4-8fec-37d9e005eb39-metrics-tls") pod "dns-default-76n9p" (UID: "a3350408-8867-4ba4-8fec-37d9e005eb39") : secret "dns-default-metrics-tls" not found Jun 13 01:11:24.764472 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:24.764323 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-tls podName:85b53893-9a6d-407b-b03d-19de5c6d06e5 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:26.764315524 +0000 UTC m=+38.630330724 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-tls") pod "image-registry-6ff5965f98-2ltfx" (UID: "85b53893-9a6d-407b-b03d-19de5c6d06e5") : secret "image-registry-tls" not found Jun 13 01:11:25.709437 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:25.709228 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qtfxw" event={"ID":"ab5efd87-9312-47f5-8521-d918f3f16571","Type":"ContainerStarted","Data":"388597c336e510668565390cca6b1d5d149a6a33424b4cb605db97ac20445482"} Jun 13 01:11:25.712120 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:25.712099 2573 generic.go:356] "Generic (PLEG): container finished" podID="f8284579-c698-4ff6-930c-de63ccccc8bd" containerID="41513c228ddcb179f58f10c518c8f6af64c277be70ae5cc04c1ec88b1c685e91" exitCode=0 Jun 13 01:11:25.712219 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:25.712134 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-chd2f" event={"ID":"f8284579-c698-4ff6-930c-de63ccccc8bd","Type":"ContainerDied","Data":"41513c228ddcb179f58f10c518c8f6af64c277be70ae5cc04c1ec88b1c685e91"} Jun 13 01:11:25.727569 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:25.727526 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qtfxw" podStartSLOduration=1.18109729 podStartE2EDuration="2.727509175s" totalImagesPullingTime="1.546411885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:11:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:25.727436253 +0000 UTC m=+37.593451479" watchObservedRunningTime="2026-06-13 01:11:25.727509175 +0000 UTC m=+37.593524396" Jun 13 01:11:26.717977 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:26.717921 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-chd2f" event={"ID":"f8284579-c698-4ff6-930c-de63ccccc8bd","Type":"ContainerStarted","Data":"ed70b59ea0ade5c4ac978e620c3501c1ba38882650644e23fd1eea5518955727"} Jun 13 01:11:26.741873 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:26.741826 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-chd2f" podStartSLOduration=9.538189221 podStartE2EDuration="38.741813659s" totalImagesPullingTime="29.203624438s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:10:48 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:26.740643636 +0000 UTC m=+38.606658858" watchObservedRunningTime="2026-06-13 01:11:26.741813659 +0000 UTC m=+38.607828881" Jun 13 01:11:26.778145 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:26.778126 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3350408-8867-4ba4-8fec-37d9e005eb39-metrics-tls\") pod \"dns-default-76n9p\" (UID: \"a3350408-8867-4ba4-8fec-37d9e005eb39\") " pod="openshift-dns/dns-default-76n9p" Jun 13 01:11:26.778224 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:26.778161 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-tls\") pod \"image-registry-6ff5965f98-2ltfx\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:11:26.778291 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:26.778257 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 01:11:26.778339 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:26.778315 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 01:11:26.778339 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:26.778335 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ff5965f98-2ltfx: secret "image-registry-tls" not found Jun 13 01:11:26.778439 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:26.778336 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3350408-8867-4ba4-8fec-37d9e005eb39-metrics-tls podName:a3350408-8867-4ba4-8fec-37d9e005eb39 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:30.778315965 +0000 UTC m=+42.644331174 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3350408-8867-4ba4-8fec-37d9e005eb39-metrics-tls") pod "dns-default-76n9p" (UID: "a3350408-8867-4ba4-8fec-37d9e005eb39") : secret "dns-default-metrics-tls" not found Jun 13 01:11:26.778439 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:26.778414 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-tls podName:85b53893-9a6d-407b-b03d-19de5c6d06e5 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:30.778396799 +0000 UTC m=+42.644412005 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-tls") pod "image-registry-6ff5965f98-2ltfx" (UID: "85b53893-9a6d-407b-b03d-19de5c6d06e5") : secret "image-registry-tls" not found Jun 13 01:11:26.863862 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:26.863805 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-t5qq4_0f57e152-5740-40a8-bc29-bcbcadff6f50/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:26.934451 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:26.934426 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-t5qq4_0f57e152-5740-40a8-bc29-bcbcadff6f50/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:27.705691 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:27.705661 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-t5qq4_0f57e152-5740-40a8-bc29-bcbcadff6f50/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:27.805731 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:27.805693 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-t5qq4_0f57e152-5740-40a8-bc29-bcbcadff6f50/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:30.806850 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:30.806813 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3350408-8867-4ba4-8fec-37d9e005eb39-metrics-tls\") pod \"dns-default-76n9p\" (UID: \"a3350408-8867-4ba4-8fec-37d9e005eb39\") " pod="openshift-dns/dns-default-76n9p" Jun 13 01:11:30.806850 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:30.806850 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-tls\") pod \"image-registry-6ff5965f98-2ltfx\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:11:30.807392 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:30.806996 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 01:11:30.807392 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:30.807011 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 01:11:30.807392 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:30.807086 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3350408-8867-4ba4-8fec-37d9e005eb39-metrics-tls podName:a3350408-8867-4ba4-8fec-37d9e005eb39 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:38.807065567 +0000 UTC m=+50.673080768 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3350408-8867-4ba4-8fec-37d9e005eb39-metrics-tls") pod "dns-default-76n9p" (UID: "a3350408-8867-4ba4-8fec-37d9e005eb39") : secret "dns-default-metrics-tls" not found Jun 13 01:11:30.807392 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:30.807020 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ff5965f98-2ltfx: secret "image-registry-tls" not found Jun 13 01:11:30.807392 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:30.807147 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-tls podName:85b53893-9a6d-407b-b03d-19de5c6d06e5 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:38.807134527 +0000 UTC m=+50.673149726 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-tls") pod "image-registry-6ff5965f98-2ltfx" (UID: "85b53893-9a6d-407b-b03d-19de5c6d06e5") : secret "image-registry-tls" not found Jun 13 01:11:38.864496 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:38.864455 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3350408-8867-4ba4-8fec-37d9e005eb39-metrics-tls\") pod \"dns-default-76n9p\" (UID: \"a3350408-8867-4ba4-8fec-37d9e005eb39\") " pod="openshift-dns/dns-default-76n9p" Jun 13 01:11:38.864974 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:38.864502 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-tls\") pod \"image-registry-6ff5965f98-2ltfx\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:11:38.864974 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:38.864618 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 01:11:38.864974 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:38.864631 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 01:11:38.864974 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:38.864642 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ff5965f98-2ltfx: secret "image-registry-tls" not found Jun 13 01:11:38.864974 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:38.864701 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3350408-8867-4ba4-8fec-37d9e005eb39-metrics-tls podName:a3350408-8867-4ba4-8fec-37d9e005eb39 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:54.864683887 +0000 UTC m=+66.730699095 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3350408-8867-4ba4-8fec-37d9e005eb39-metrics-tls") pod "dns-default-76n9p" (UID: "a3350408-8867-4ba4-8fec-37d9e005eb39") : secret "dns-default-metrics-tls" not found Jun 13 01:11:38.864974 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:38.864717 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-tls podName:85b53893-9a6d-407b-b03d-19de5c6d06e5 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:54.864711502 +0000 UTC m=+66.730726702 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-tls") pod "image-registry-6ff5965f98-2ltfx" (UID: "85b53893-9a6d-407b-b03d-19de5c6d06e5") : secret "image-registry-tls" not found Jun 13 01:11:48.696247 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:48.696217 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9jdpp" Jun 13 01:11:54.271270 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:54.271216 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/323114ca-ff76-4dbd-90b9-8d1c80ebea04-metrics-certs\") pod \"network-metrics-daemon-t4b8x\" (UID: \"323114ca-ff76-4dbd-90b9-8d1c80ebea04\") " pod="openshift-multus/network-metrics-daemon-t4b8x" Jun 13 01:11:54.274183 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:54.274159 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 13 01:11:54.282304 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:54.282286 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 13 01:11:54.282359 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:54.282344 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/323114ca-ff76-4dbd-90b9-8d1c80ebea04-metrics-certs podName:323114ca-ff76-4dbd-90b9-8d1c80ebea04 nodeName:}" failed. No retries permitted until 2026-06-13 01:12:58.282328734 +0000 UTC m=+130.148343937 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/323114ca-ff76-4dbd-90b9-8d1c80ebea04-metrics-certs") pod "network-metrics-daemon-t4b8x" (UID: "323114ca-ff76-4dbd-90b9-8d1c80ebea04") : secret "metrics-daemon-secret" not found Jun 13 01:11:54.372081 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:54.372047 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/113d88ff-ddd6-40b7-9c71-a00ce41a6c7d-original-pull-secret\") pod \"global-pull-secret-syncer-4gzc9\" (UID: \"113d88ff-ddd6-40b7-9c71-a00ce41a6c7d\") " pod="kube-system/global-pull-secret-syncer-4gzc9" Jun 13 01:11:54.374606 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:54.374588 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 13 01:11:54.386358 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:54.386335 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/113d88ff-ddd6-40b7-9c71-a00ce41a6c7d-original-pull-secret\") pod \"global-pull-secret-syncer-4gzc9\" (UID: \"113d88ff-ddd6-40b7-9c71-a00ce41a6c7d\") " pod="kube-system/global-pull-secret-syncer-4gzc9" Jun 13 01:11:54.472533 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:54.472504 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vqqd\" (UniqueName: \"kubernetes.io/projected/fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9-kube-api-access-2vqqd\") pod \"network-check-target-x9nxz\" (UID: \"fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9\") " pod="openshift-network-diagnostics/network-check-target-x9nxz" Jun 13 01:11:54.475334 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:54.475317 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 13 01:11:54.486241 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:54.486223 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 13 01:11:54.496949 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:54.496924 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vqqd\" (UniqueName: \"kubernetes.io/projected/fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9-kube-api-access-2vqqd\") pod \"network-check-target-x9nxz\" (UID: \"fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9\") " pod="openshift-network-diagnostics/network-check-target-x9nxz" Jun 13 01:11:54.545550 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:54.545483 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gzc9" Jun 13 01:11:54.663682 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:54.663653 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4gzc9"] Jun 13 01:11:54.666969 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:11:54.666928 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod113d88ff_ddd6_40b7_9c71_a00ce41a6c7d.slice/crio-0306f1c0968c36d09412642144c7dd9c5c4661e7ab4e5683b76c85a0d03646f0 WatchSource:0}: Error finding container 0306f1c0968c36d09412642144c7dd9c5c4661e7ab4e5683b76c85a0d03646f0: Status 404 returned error can't find the container with id 0306f1c0968c36d09412642144c7dd9c5c4661e7ab4e5683b76c85a0d03646f0 Jun 13 01:11:54.746076 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:54.746050 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-78kc5\"" Jun 13 01:11:54.754215 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:54.754189 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9nxz" Jun 13 01:11:54.783262 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:54.783232 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4gzc9" event={"ID":"113d88ff-ddd6-40b7-9c71-a00ce41a6c7d","Type":"ContainerStarted","Data":"0306f1c0968c36d09412642144c7dd9c5c4661e7ab4e5683b76c85a0d03646f0"} Jun 13 01:11:54.870332 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:54.870304 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x9nxz"] Jun 13 01:11:54.873226 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:11:54.873204 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd2a3898_b804_4c4b_9cdf_8ac49f61e3b9.slice/crio-b838344eae7d3c3088423e950bba235964c7dab8c2b953c58e9530cdb1a77c19 WatchSource:0}: Error finding container b838344eae7d3c3088423e950bba235964c7dab8c2b953c58e9530cdb1a77c19: Status 404 returned error can't find the container with id b838344eae7d3c3088423e950bba235964c7dab8c2b953c58e9530cdb1a77c19 Jun 13 01:11:54.875270 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:54.875247 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3350408-8867-4ba4-8fec-37d9e005eb39-metrics-tls\") pod \"dns-default-76n9p\" (UID: \"a3350408-8867-4ba4-8fec-37d9e005eb39\") " pod="openshift-dns/dns-default-76n9p" Jun 13 01:11:54.875359 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:54.875278 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-tls\") pod \"image-registry-6ff5965f98-2ltfx\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:11:54.875402 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:54.875389 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 01:11:54.875453 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:54.875437 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3350408-8867-4ba4-8fec-37d9e005eb39-metrics-tls podName:a3350408-8867-4ba4-8fec-37d9e005eb39 nodeName:}" failed. No retries permitted until 2026-06-13 01:12:26.875423934 +0000 UTC m=+98.741439138 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3350408-8867-4ba4-8fec-37d9e005eb39-metrics-tls") pod "dns-default-76n9p" (UID: "a3350408-8867-4ba4-8fec-37d9e005eb39") : secret "dns-default-metrics-tls" not found Jun 13 01:11:54.875453 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:54.875394 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 01:11:54.875557 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:54.875458 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ff5965f98-2ltfx: secret "image-registry-tls" not found Jun 13 01:11:54.875557 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:11:54.875486 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-tls podName:85b53893-9a6d-407b-b03d-19de5c6d06e5 nodeName:}" failed. No retries permitted until 2026-06-13 01:12:26.875477077 +0000 UTC m=+98.741492278 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-tls") pod "image-registry-6ff5965f98-2ltfx" (UID: "85b53893-9a6d-407b-b03d-19de5c6d06e5") : secret "image-registry-tls" not found Jun 13 01:11:55.788182 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:55.788116 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x9nxz" event={"ID":"fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9","Type":"ContainerStarted","Data":"b838344eae7d3c3088423e950bba235964c7dab8c2b953c58e9530cdb1a77c19"} Jun 13 01:11:58.800598 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:58.800558 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x9nxz" event={"ID":"fd2a3898-b804-4c4b-9cdf-8ac49f61e3b9","Type":"ContainerStarted","Data":"c62523f9b837485ca8ffebddd7422f2115ba26681787e7a31bd5e342cc53263e"} Jun 13 01:11:58.801039 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:58.800650 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-x9nxz" Jun 13 01:11:58.816561 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:58.816509 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-x9nxz" podStartSLOduration=66.871706514 podStartE2EDuration="1m9.816491631s" totalImagesPullingTime="2.944785117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:10:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:58.815903078 +0000 UTC m=+70.681918325" watchObservedRunningTime="2026-06-13 01:11:58.816491631 +0000 UTC m=+70.682506852" Jun 13 01:11:59.806511 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:59.806472 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4gzc9" event={"ID":"113d88ff-ddd6-40b7-9c71-a00ce41a6c7d","Type":"ContainerStarted","Data":"143e3d0a59105a0ed33f867d1b9a4971397227ad29d59f998b02b1010746cab7"} Jun 13 01:11:59.822505 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:11:59.822454 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4gzc9" podStartSLOduration=66.197562812 podStartE2EDuration="1m10.822440933s" totalImagesPullingTime="4.624878121s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:10:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:59.821879984 +0000 UTC m=+71.687895206" watchObservedRunningTime="2026-06-13 01:11:59.822440933 +0000 UTC m=+71.688456154" Jun 13 01:12:26.888180 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:12:26.888094 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3350408-8867-4ba4-8fec-37d9e005eb39-metrics-tls\") pod \"dns-default-76n9p\" (UID: \"a3350408-8867-4ba4-8fec-37d9e005eb39\") " pod="openshift-dns/dns-default-76n9p" Jun 13 01:12:26.888180 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:12:26.888133 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-tls\") pod \"image-registry-6ff5965f98-2ltfx\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:12:26.888585 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:12:26.888226 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 01:12:26.888585 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:12:26.888229 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 01:12:26.888585 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:12:26.888289 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3350408-8867-4ba4-8fec-37d9e005eb39-metrics-tls podName:a3350408-8867-4ba4-8fec-37d9e005eb39 nodeName:}" failed. No retries permitted until 2026-06-13 01:13:30.888274984 +0000 UTC m=+162.754290183 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3350408-8867-4ba4-8fec-37d9e005eb39-metrics-tls") pod "dns-default-76n9p" (UID: "a3350408-8867-4ba4-8fec-37d9e005eb39") : secret "dns-default-metrics-tls" not found Jun 13 01:12:26.888585 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:12:26.888237 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ff5965f98-2ltfx: secret "image-registry-tls" not found Jun 13 01:12:26.888585 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:12:26.888364 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-tls podName:85b53893-9a6d-407b-b03d-19de5c6d06e5 nodeName:}" failed. No retries permitted until 2026-06-13 01:13:30.888352633 +0000 UTC m=+162.754367833 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-tls") pod "image-registry-6ff5965f98-2ltfx" (UID: "85b53893-9a6d-407b-b03d-19de5c6d06e5") : secret "image-registry-tls" not found Jun 13 01:12:29.808563 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:12:29.808534 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-x9nxz" Jun 13 01:12:58.303252 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:12:58.303206 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/323114ca-ff76-4dbd-90b9-8d1c80ebea04-metrics-certs\") pod \"network-metrics-daemon-t4b8x\" (UID: \"323114ca-ff76-4dbd-90b9-8d1c80ebea04\") " pod="openshift-multus/network-metrics-daemon-t4b8x" Jun 13 01:12:58.303813 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:12:58.303369 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 13 01:12:58.303813 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:12:58.303471 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/323114ca-ff76-4dbd-90b9-8d1c80ebea04-metrics-certs podName:323114ca-ff76-4dbd-90b9-8d1c80ebea04 nodeName:}" failed. No retries permitted until 2026-06-13 01:15:00.303449288 +0000 UTC m=+252.169464502 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/323114ca-ff76-4dbd-90b9-8d1c80ebea04-metrics-certs") pod "network-metrics-daemon-t4b8x" (UID: "323114ca-ff76-4dbd-90b9-8d1c80ebea04") : secret "metrics-daemon-secret" not found Jun 13 01:13:26.047243 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:13:26.047200 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" podUID="85b53893-9a6d-407b-b03d-19de5c6d06e5" Jun 13 01:13:26.059507 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:13:26.059477 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-76n9p" podUID="a3350408-8867-4ba4-8fec-37d9e005eb39" Jun 13 01:13:27.007220 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:13:27.007190 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-76n9p" Jun 13 01:13:27.007406 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:13:27.007190 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:13:27.551100 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:13:27.551038 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-t4b8x" podUID="323114ca-ff76-4dbd-90b9-8d1c80ebea04" Jun 13 01:13:30.931667 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:13:30.931611 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3350408-8867-4ba4-8fec-37d9e005eb39-metrics-tls\") pod \"dns-default-76n9p\" (UID: \"a3350408-8867-4ba4-8fec-37d9e005eb39\") " pod="openshift-dns/dns-default-76n9p" Jun 13 01:13:30.931667 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:13:30.931675 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-tls\") pod \"image-registry-6ff5965f98-2ltfx\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:13:30.932215 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:13:30.931762 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 01:13:30.932215 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:13:30.931777 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 01:13:30.932215 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:13:30.931799 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ff5965f98-2ltfx: secret "image-registry-tls" not found Jun 13 01:13:30.932215 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:13:30.931833 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3350408-8867-4ba4-8fec-37d9e005eb39-metrics-tls podName:a3350408-8867-4ba4-8fec-37d9e005eb39 nodeName:}" failed. No retries permitted until 2026-06-13 01:15:32.931815987 +0000 UTC m=+284.797831187 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3350408-8867-4ba4-8fec-37d9e005eb39-metrics-tls") pod "dns-default-76n9p" (UID: "a3350408-8867-4ba4-8fec-37d9e005eb39") : secret "dns-default-metrics-tls" not found Jun 13 01:13:30.932215 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:13:30.931853 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-tls podName:85b53893-9a6d-407b-b03d-19de5c6d06e5 nodeName:}" failed. No retries permitted until 2026-06-13 01:15:32.931839168 +0000 UTC m=+284.797854368 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-tls") pod "image-registry-6ff5965f98-2ltfx" (UID: "85b53893-9a6d-407b-b03d-19de5c6d06e5") : secret "image-registry-tls" not found Jun 13 01:13:39.533890 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:13:39.533800 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4b8x" Jun 13 01:14:19.313171 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.313139 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9x5wx"] Jun 13 01:14:19.314879 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.314864 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9x5wx" Jun 13 01:14:19.317354 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.317333 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 13 01:14:19.317559 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.317525 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 13 01:14:19.317669 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.317561 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 13 01:14:19.317669 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.317655 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-dmrkw\"" Jun 13 01:14:19.318557 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.318529 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 13 01:14:19.326475 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.326455 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-n4tj4"] Jun 13 01:14:19.328983 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.328969 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-9k2t8"] Jun 13 01:14:19.329104 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.329087 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-n4tj4" Jun 13 01:14:19.330407 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.330392 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-6jsbc"] Jun 13 01:14:19.330518 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.330503 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9k2t8" Jun 13 01:14:19.333603 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.333577 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 13 01:14:19.333827 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.333809 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 13 01:14:19.334062 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.334044 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 13 01:14:19.334301 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.334283 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2ng5p\"" Jun 13 01:14:19.334557 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.334539 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 13 01:14:19.334762 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.334745 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 13 01:14:19.334869 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.334850 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-n6v88\"" Jun 13 01:14:19.335538 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.335032 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 13 01:14:19.335538 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.335301 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 13 01:14:19.335786 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.335766 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 13 01:14:19.336584 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.336565 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9x5wx"] Jun 13 01:14:19.336709 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.336690 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-6jsbc" Jun 13 01:14:19.336802 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.336789 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-9k2t8"] Jun 13 01:14:19.338781 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.338761 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-6jsbc"] Jun 13 01:14:19.339274 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.339250 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 13 01:14:19.339274 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.339268 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-2tqxc\"" Jun 13 01:14:19.339667 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.339651 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 13 01:14:19.339667 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.339664 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 13 01:14:19.346305 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.346284 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-n4tj4"] Jun 13 01:14:19.413747 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.413726 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-qfrjk"] Jun 13 01:14:19.415349 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.415335 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-qfrjk" Jun 13 01:14:19.417995 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.417975 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 13 01:14:19.418154 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.418135 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-xq86g\"" Jun 13 01:14:19.418235 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.418197 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 13 01:14:19.418830 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.418814 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-9skm6"] Jun 13 01:14:19.420390 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.420375 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-9skm6" Jun 13 01:14:19.422237 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.422220 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7784bb8876-wvjz6"] Jun 13 01:14:19.422895 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.422878 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-96k7r\"" Jun 13 01:14:19.423855 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.423838 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7784bb8876-wvjz6" Jun 13 01:14:19.428597 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.428575 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 13 01:14:19.428770 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.428753 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 13 01:14:19.428922 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.428757 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 13 01:14:19.429120 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.429029 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mt9lz\"" Jun 13 01:14:19.429212 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.429196 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 13 01:14:19.429276 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.429069 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 13 01:14:19.429802 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.429785 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-qfrjk"] Jun 13 01:14:19.432925 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.432910 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 13 01:14:19.438938 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.438915 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-9skm6"] Jun 13 01:14:19.443208 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.443189 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7784bb8876-wvjz6"] Jun 13 01:14:19.450734 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.450714 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv5dt\" (UniqueName: \"kubernetes.io/projected/50fd466c-b2e3-49e0-b60a-c55c4049cd4e-kube-api-access-vv5dt\") pod \"kube-storage-version-migrator-operator-7c578b78fc-9x5wx\" (UID: \"50fd466c-b2e3-49e0-b60a-c55c4049cd4e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9x5wx" Jun 13 01:14:19.450830 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.450764 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/208b1445-3851-419f-8fcc-27aac35ea1e4-config\") pod \"service-ca-operator-7ccbfd59dc-n4tj4\" (UID: \"208b1445-3851-419f-8fcc-27aac35ea1e4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-n4tj4" Jun 13 01:14:19.450830 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.450791 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/15d41019-db02-4ef2-b0e8-88c9cc63aef8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-9k2t8\" (UID: \"15d41019-db02-4ef2-b0e8-88c9cc63aef8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9k2t8" Jun 13 01:14:19.450915 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.450859 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clpj2\" (UniqueName: \"kubernetes.io/projected/d13950cf-613e-41c1-bf53-33ba410bf0fe-kube-api-access-clpj2\") pod \"cluster-samples-operator-9547488fd-6jsbc\" (UID: \"d13950cf-613e-41c1-bf53-33ba410bf0fe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-6jsbc" Jun 13 01:14:19.450915 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.450885 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc4k4\" (UniqueName: \"kubernetes.io/projected/15d41019-db02-4ef2-b0e8-88c9cc63aef8-kube-api-access-zc4k4\") pod \"cluster-monitoring-operator-f9d7df769-9k2t8\" (UID: \"15d41019-db02-4ef2-b0e8-88c9cc63aef8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9k2t8" Jun 13 01:14:19.451003 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.450925 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d13950cf-613e-41c1-bf53-33ba410bf0fe-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-6jsbc\" (UID: \"d13950cf-613e-41c1-bf53-33ba410bf0fe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-6jsbc" Jun 13 01:14:19.451003 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.450964 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/50fd466c-b2e3-49e0-b60a-c55c4049cd4e-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-9x5wx\" (UID: \"50fd466c-b2e3-49e0-b60a-c55c4049cd4e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9x5wx" Jun 13 01:14:19.451003 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.450990 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms6xh\" (UniqueName: \"kubernetes.io/projected/208b1445-3851-419f-8fcc-27aac35ea1e4-kube-api-access-ms6xh\") pod \"service-ca-operator-7ccbfd59dc-n4tj4\" (UID: \"208b1445-3851-419f-8fcc-27aac35ea1e4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-n4tj4" Jun 13 01:14:19.451119 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.451020 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/15d41019-db02-4ef2-b0e8-88c9cc63aef8-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-9k2t8\" (UID: \"15d41019-db02-4ef2-b0e8-88c9cc63aef8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9k2t8" Jun 13 01:14:19.451119 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.451059 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/50fd466c-b2e3-49e0-b60a-c55c4049cd4e-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-9x5wx\" (UID: \"50fd466c-b2e3-49e0-b60a-c55c4049cd4e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9x5wx" Jun 13 01:14:19.451119 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.451074 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/208b1445-3851-419f-8fcc-27aac35ea1e4-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-n4tj4\" (UID: \"208b1445-3851-419f-8fcc-27aac35ea1e4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-n4tj4" Jun 13 01:14:19.516650 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.516632 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-bb7cg"] Jun 13 01:14:19.518255 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.518242 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-bb7cg" Jun 13 01:14:19.521141 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.521120 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 13 01:14:19.521238 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.521210 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 13 01:14:19.521304 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.521268 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 13 01:14:19.521362 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.521315 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-4gg4j\"" Jun 13 01:14:19.521709 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.521693 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 13 01:14:19.527797 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.527781 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 13 01:14:19.531786 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.531769 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-bb7cg"] Jun 13 01:14:19.552332 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.552304 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzxg7\" (UniqueName: \"kubernetes.io/projected/85945bf4-40ee-4de7-8da2-e6b0e27fcb8e-kube-api-access-lzxg7\") pod \"network-check-source-6947749cfc-9skm6\" (UID: \"85945bf4-40ee-4de7-8da2-e6b0e27fcb8e\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-9skm6" Jun 13 01:14:19.552424 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.552357 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkmm8\" (UniqueName: \"kubernetes.io/projected/39a10cfc-561c-4e76-b463-c90fbe10aa0f-kube-api-access-jkmm8\") pod \"volume-data-source-validator-bd4ccd799-qfrjk\" (UID: \"39a10cfc-561c-4e76-b463-c90fbe10aa0f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-qfrjk" Jun 13 01:14:19.552424 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.552401 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ee44e07-c5aa-417a-ae59-c24f0572b921-metrics-certs\") pod \"router-default-7784bb8876-wvjz6\" (UID: \"8ee44e07-c5aa-417a-ae59-c24f0572b921\") " pod="openshift-ingress/router-default-7784bb8876-wvjz6" Jun 13 01:14:19.552523 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.552433 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/50fd466c-b2e3-49e0-b60a-c55c4049cd4e-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-9x5wx\" (UID: \"50fd466c-b2e3-49e0-b60a-c55c4049cd4e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9x5wx" Jun 13 01:14:19.552523 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.552450 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/208b1445-3851-419f-8fcc-27aac35ea1e4-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-n4tj4\" (UID: \"208b1445-3851-419f-8fcc-27aac35ea1e4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-n4tj4" Jun 13 01:14:19.552523 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.552467 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/208b1445-3851-419f-8fcc-27aac35ea1e4-config\") pod \"service-ca-operator-7ccbfd59dc-n4tj4\" (UID: \"208b1445-3851-419f-8fcc-27aac35ea1e4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-n4tj4" Jun 13 01:14:19.552523 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.552483 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ee44e07-c5aa-417a-ae59-c24f0572b921-service-ca-bundle\") pod \"router-default-7784bb8876-wvjz6\" (UID: \"8ee44e07-c5aa-417a-ae59-c24f0572b921\") " pod="openshift-ingress/router-default-7784bb8876-wvjz6" Jun 13 01:14:19.552523 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.552511 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv5dt\" (UniqueName: \"kubernetes.io/projected/50fd466c-b2e3-49e0-b60a-c55c4049cd4e-kube-api-access-vv5dt\") pod \"kube-storage-version-migrator-operator-7c578b78fc-9x5wx\" (UID: \"50fd466c-b2e3-49e0-b60a-c55c4049cd4e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9x5wx" Jun 13 01:14:19.552753 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.552539 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8ee44e07-c5aa-417a-ae59-c24f0572b921-default-certificate\") pod \"router-default-7784bb8876-wvjz6\" (UID: \"8ee44e07-c5aa-417a-ae59-c24f0572b921\") " pod="openshift-ingress/router-default-7784bb8876-wvjz6" Jun 13 01:14:19.552753 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.552574 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/15d41019-db02-4ef2-b0e8-88c9cc63aef8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-9k2t8\" (UID: \"15d41019-db02-4ef2-b0e8-88c9cc63aef8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9k2t8" Jun 13 01:14:19.552753 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:19.552643 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 13 01:14:19.552753 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.552647 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbbrb\" (UniqueName: \"kubernetes.io/projected/8ee44e07-c5aa-417a-ae59-c24f0572b921-kube-api-access-mbbrb\") pod \"router-default-7784bb8876-wvjz6\" (UID: \"8ee44e07-c5aa-417a-ae59-c24f0572b921\") " pod="openshift-ingress/router-default-7784bb8876-wvjz6" Jun 13 01:14:19.552753 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.552675 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clpj2\" (UniqueName: \"kubernetes.io/projected/d13950cf-613e-41c1-bf53-33ba410bf0fe-kube-api-access-clpj2\") pod \"cluster-samples-operator-9547488fd-6jsbc\" (UID: \"d13950cf-613e-41c1-bf53-33ba410bf0fe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-6jsbc" Jun 13 01:14:19.552753 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:19.552691 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15d41019-db02-4ef2-b0e8-88c9cc63aef8-cluster-monitoring-operator-tls podName:15d41019-db02-4ef2-b0e8-88c9cc63aef8 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:20.052674276 +0000 UTC m=+211.918689475 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/15d41019-db02-4ef2-b0e8-88c9cc63aef8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-9k2t8" (UID: "15d41019-db02-4ef2-b0e8-88c9cc63aef8") : secret "cluster-monitoring-operator-tls" not found Jun 13 01:14:19.552753 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.552725 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc4k4\" (UniqueName: \"kubernetes.io/projected/15d41019-db02-4ef2-b0e8-88c9cc63aef8-kube-api-access-zc4k4\") pod \"cluster-monitoring-operator-f9d7df769-9k2t8\" (UID: \"15d41019-db02-4ef2-b0e8-88c9cc63aef8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9k2t8" Jun 13 01:14:19.553127 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.552802 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d13950cf-613e-41c1-bf53-33ba410bf0fe-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-6jsbc\" (UID: \"d13950cf-613e-41c1-bf53-33ba410bf0fe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-6jsbc" Jun 13 01:14:19.553127 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.552841 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/50fd466c-b2e3-49e0-b60a-c55c4049cd4e-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-9x5wx\" (UID: \"50fd466c-b2e3-49e0-b60a-c55c4049cd4e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9x5wx" Jun 13 01:14:19.553127 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.552870 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms6xh\" (UniqueName: \"kubernetes.io/projected/208b1445-3851-419f-8fcc-27aac35ea1e4-kube-api-access-ms6xh\") pod \"service-ca-operator-7ccbfd59dc-n4tj4\" (UID: \"208b1445-3851-419f-8fcc-27aac35ea1e4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-n4tj4" Jun 13 01:14:19.553127 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.552896 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/15d41019-db02-4ef2-b0e8-88c9cc63aef8-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-9k2t8\" (UID: \"15d41019-db02-4ef2-b0e8-88c9cc63aef8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9k2t8" Jun 13 01:14:19.553127 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:19.552926 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 13 01:14:19.553127 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.552978 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8ee44e07-c5aa-417a-ae59-c24f0572b921-stats-auth\") pod \"router-default-7784bb8876-wvjz6\" (UID: \"8ee44e07-c5aa-417a-ae59-c24f0572b921\") " pod="openshift-ingress/router-default-7784bb8876-wvjz6" Jun 13 01:14:19.553127 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:19.552990 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d13950cf-613e-41c1-bf53-33ba410bf0fe-samples-operator-tls podName:d13950cf-613e-41c1-bf53-33ba410bf0fe nodeName:}" failed. No retries permitted until 2026-06-13 01:14:20.052972779 +0000 UTC m=+211.918987979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d13950cf-613e-41c1-bf53-33ba410bf0fe-samples-operator-tls") pod "cluster-samples-operator-9547488fd-6jsbc" (UID: "d13950cf-613e-41c1-bf53-33ba410bf0fe") : secret "samples-operator-tls" not found Jun 13 01:14:19.553127 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.553014 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/50fd466c-b2e3-49e0-b60a-c55c4049cd4e-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-9x5wx\" (UID: \"50fd466c-b2e3-49e0-b60a-c55c4049cd4e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9x5wx" Jun 13 01:14:19.553127 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.553120 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/208b1445-3851-419f-8fcc-27aac35ea1e4-config\") pod \"service-ca-operator-7ccbfd59dc-n4tj4\" (UID: \"208b1445-3851-419f-8fcc-27aac35ea1e4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-n4tj4" Jun 13 01:14:19.553638 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.553590 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/15d41019-db02-4ef2-b0e8-88c9cc63aef8-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-9k2t8\" (UID: \"15d41019-db02-4ef2-b0e8-88c9cc63aef8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9k2t8" Jun 13 01:14:19.554833 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.554809 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/208b1445-3851-419f-8fcc-27aac35ea1e4-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-n4tj4\" (UID: \"208b1445-3851-419f-8fcc-27aac35ea1e4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-n4tj4" Jun 13 01:14:19.555002 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.554984 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/50fd466c-b2e3-49e0-b60a-c55c4049cd4e-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-9x5wx\" (UID: \"50fd466c-b2e3-49e0-b60a-c55c4049cd4e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9x5wx" Jun 13 01:14:19.564299 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.564257 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms6xh\" (UniqueName: \"kubernetes.io/projected/208b1445-3851-419f-8fcc-27aac35ea1e4-kube-api-access-ms6xh\") pod \"service-ca-operator-7ccbfd59dc-n4tj4\" (UID: \"208b1445-3851-419f-8fcc-27aac35ea1e4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-n4tj4" Jun 13 01:14:19.566161 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.566137 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv5dt\" (UniqueName: \"kubernetes.io/projected/50fd466c-b2e3-49e0-b60a-c55c4049cd4e-kube-api-access-vv5dt\") pod \"kube-storage-version-migrator-operator-7c578b78fc-9x5wx\" (UID: \"50fd466c-b2e3-49e0-b60a-c55c4049cd4e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9x5wx" Jun 13 01:14:19.566893 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.566867 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc4k4\" (UniqueName: \"kubernetes.io/projected/15d41019-db02-4ef2-b0e8-88c9cc63aef8-kube-api-access-zc4k4\") pod \"cluster-monitoring-operator-f9d7df769-9k2t8\" (UID: \"15d41019-db02-4ef2-b0e8-88c9cc63aef8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9k2t8" Jun 13 01:14:19.566980 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.566871 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clpj2\" (UniqueName: \"kubernetes.io/projected/d13950cf-613e-41c1-bf53-33ba410bf0fe-kube-api-access-clpj2\") pod \"cluster-samples-operator-9547488fd-6jsbc\" (UID: \"d13950cf-613e-41c1-bf53-33ba410bf0fe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-6jsbc" Jun 13 01:14:19.624273 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.624250 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9x5wx" Jun 13 01:14:19.642730 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.642710 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-n4tj4" Jun 13 01:14:19.654172 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.654149 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f53056e7-0404-4074-bc19-664e206fce89-trusted-ca\") pod \"console-operator-5dbbb5d744-bb7cg\" (UID: \"f53056e7-0404-4074-bc19-664e206fce89\") " pod="openshift-console-operator/console-operator-5dbbb5d744-bb7cg" Jun 13 01:14:19.654281 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.654183 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f53056e7-0404-4074-bc19-664e206fce89-config\") pod \"console-operator-5dbbb5d744-bb7cg\" (UID: \"f53056e7-0404-4074-bc19-664e206fce89\") " pod="openshift-console-operator/console-operator-5dbbb5d744-bb7cg" Jun 13 01:14:19.654281 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.654241 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8ee44e07-c5aa-417a-ae59-c24f0572b921-stats-auth\") pod \"router-default-7784bb8876-wvjz6\" (UID: \"8ee44e07-c5aa-417a-ae59-c24f0572b921\") " pod="openshift-ingress/router-default-7784bb8876-wvjz6" Jun 13 01:14:19.654281 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.654262 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzxg7\" (UniqueName: \"kubernetes.io/projected/85945bf4-40ee-4de7-8da2-e6b0e27fcb8e-kube-api-access-lzxg7\") pod \"network-check-source-6947749cfc-9skm6\" (UID: \"85945bf4-40ee-4de7-8da2-e6b0e27fcb8e\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-9skm6" Jun 13 01:14:19.654449 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.654282 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5b4k\" (UniqueName: \"kubernetes.io/projected/f53056e7-0404-4074-bc19-664e206fce89-kube-api-access-s5b4k\") pod \"console-operator-5dbbb5d744-bb7cg\" (UID: \"f53056e7-0404-4074-bc19-664e206fce89\") " pod="openshift-console-operator/console-operator-5dbbb5d744-bb7cg" Jun 13 01:14:19.654449 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.654346 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkmm8\" (UniqueName: \"kubernetes.io/projected/39a10cfc-561c-4e76-b463-c90fbe10aa0f-kube-api-access-jkmm8\") pod \"volume-data-source-validator-bd4ccd799-qfrjk\" (UID: \"39a10cfc-561c-4e76-b463-c90fbe10aa0f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-qfrjk" Jun 13 01:14:19.654449 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.654377 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ee44e07-c5aa-417a-ae59-c24f0572b921-metrics-certs\") pod \"router-default-7784bb8876-wvjz6\" (UID: \"8ee44e07-c5aa-417a-ae59-c24f0572b921\") " pod="openshift-ingress/router-default-7784bb8876-wvjz6" Jun 13 01:14:19.654449 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.654406 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f53056e7-0404-4074-bc19-664e206fce89-serving-cert\") pod \"console-operator-5dbbb5d744-bb7cg\" (UID: \"f53056e7-0404-4074-bc19-664e206fce89\") " pod="openshift-console-operator/console-operator-5dbbb5d744-bb7cg" Jun 13 01:14:19.654449 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.654429 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ee44e07-c5aa-417a-ae59-c24f0572b921-service-ca-bundle\") pod \"router-default-7784bb8876-wvjz6\" (UID: \"8ee44e07-c5aa-417a-ae59-c24f0572b921\") " pod="openshift-ingress/router-default-7784bb8876-wvjz6" Jun 13 01:14:19.654664 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.654458 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8ee44e07-c5aa-417a-ae59-c24f0572b921-default-certificate\") pod \"router-default-7784bb8876-wvjz6\" (UID: \"8ee44e07-c5aa-417a-ae59-c24f0572b921\") " pod="openshift-ingress/router-default-7784bb8876-wvjz6" Jun 13 01:14:19.654664 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.654534 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbbrb\" (UniqueName: \"kubernetes.io/projected/8ee44e07-c5aa-417a-ae59-c24f0572b921-kube-api-access-mbbrb\") pod \"router-default-7784bb8876-wvjz6\" (UID: \"8ee44e07-c5aa-417a-ae59-c24f0572b921\") " pod="openshift-ingress/router-default-7784bb8876-wvjz6" Jun 13 01:14:19.654664 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:19.654573 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 13 01:14:19.654664 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:19.654657 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ee44e07-c5aa-417a-ae59-c24f0572b921-metrics-certs podName:8ee44e07-c5aa-417a-ae59-c24f0572b921 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:20.154637554 +0000 UTC m=+212.020652766 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ee44e07-c5aa-417a-ae59-c24f0572b921-metrics-certs") pod "router-default-7784bb8876-wvjz6" (UID: "8ee44e07-c5aa-417a-ae59-c24f0572b921") : secret "router-metrics-certs-default" not found Jun 13 01:14:19.654879 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:19.654790 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ee44e07-c5aa-417a-ae59-c24f0572b921-service-ca-bundle podName:8ee44e07-c5aa-417a-ae59-c24f0572b921 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:20.154778057 +0000 UTC m=+212.020793277 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8ee44e07-c5aa-417a-ae59-c24f0572b921-service-ca-bundle") pod "router-default-7784bb8876-wvjz6" (UID: "8ee44e07-c5aa-417a-ae59-c24f0572b921") : configmap references non-existent config key: service-ca.crt Jun 13 01:14:19.656757 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.656737 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8ee44e07-c5aa-417a-ae59-c24f0572b921-stats-auth\") pod \"router-default-7784bb8876-wvjz6\" (UID: \"8ee44e07-c5aa-417a-ae59-c24f0572b921\") " pod="openshift-ingress/router-default-7784bb8876-wvjz6" Jun 13 01:14:19.656851 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.656774 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8ee44e07-c5aa-417a-ae59-c24f0572b921-default-certificate\") pod \"router-default-7784bb8876-wvjz6\" (UID: \"8ee44e07-c5aa-417a-ae59-c24f0572b921\") " pod="openshift-ingress/router-default-7784bb8876-wvjz6" Jun 13 01:14:19.663433 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.663413 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkmm8\" (UniqueName: \"kubernetes.io/projected/39a10cfc-561c-4e76-b463-c90fbe10aa0f-kube-api-access-jkmm8\") pod \"volume-data-source-validator-bd4ccd799-qfrjk\" (UID: \"39a10cfc-561c-4e76-b463-c90fbe10aa0f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-qfrjk" Jun 13 01:14:19.663784 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.663757 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbbrb\" (UniqueName: \"kubernetes.io/projected/8ee44e07-c5aa-417a-ae59-c24f0572b921-kube-api-access-mbbrb\") pod \"router-default-7784bb8876-wvjz6\" (UID: \"8ee44e07-c5aa-417a-ae59-c24f0572b921\") " pod="openshift-ingress/router-default-7784bb8876-wvjz6" Jun 13 01:14:19.663869 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.663847 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzxg7\" (UniqueName: \"kubernetes.io/projected/85945bf4-40ee-4de7-8da2-e6b0e27fcb8e-kube-api-access-lzxg7\") pod \"network-check-source-6947749cfc-9skm6\" (UID: \"85945bf4-40ee-4de7-8da2-e6b0e27fcb8e\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-9skm6" Jun 13 01:14:19.723124 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.723091 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-qfrjk" Jun 13 01:14:19.733550 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.731466 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-9skm6" Jun 13 01:14:19.754647 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.754618 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9x5wx"] Jun 13 01:14:19.754989 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.754973 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5b4k\" (UniqueName: \"kubernetes.io/projected/f53056e7-0404-4074-bc19-664e206fce89-kube-api-access-s5b4k\") pod \"console-operator-5dbbb5d744-bb7cg\" (UID: \"f53056e7-0404-4074-bc19-664e206fce89\") " pod="openshift-console-operator/console-operator-5dbbb5d744-bb7cg" Jun 13 01:14:19.755045 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.755019 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f53056e7-0404-4074-bc19-664e206fce89-serving-cert\") pod \"console-operator-5dbbb5d744-bb7cg\" (UID: \"f53056e7-0404-4074-bc19-664e206fce89\") " pod="openshift-console-operator/console-operator-5dbbb5d744-bb7cg" Jun 13 01:14:19.755345 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.755321 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f53056e7-0404-4074-bc19-664e206fce89-trusted-ca\") pod \"console-operator-5dbbb5d744-bb7cg\" (UID: \"f53056e7-0404-4074-bc19-664e206fce89\") " pod="openshift-console-operator/console-operator-5dbbb5d744-bb7cg" Jun 13 01:14:19.755383 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.755370 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f53056e7-0404-4074-bc19-664e206fce89-config\") pod \"console-operator-5dbbb5d744-bb7cg\" (UID: \"f53056e7-0404-4074-bc19-664e206fce89\") " pod="openshift-console-operator/console-operator-5dbbb5d744-bb7cg" Jun 13 01:14:19.756014 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.755993 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f53056e7-0404-4074-bc19-664e206fce89-config\") pod \"console-operator-5dbbb5d744-bb7cg\" (UID: \"f53056e7-0404-4074-bc19-664e206fce89\") " pod="openshift-console-operator/console-operator-5dbbb5d744-bb7cg" Jun 13 01:14:19.756455 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.756419 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f53056e7-0404-4074-bc19-664e206fce89-trusted-ca\") pod \"console-operator-5dbbb5d744-bb7cg\" (UID: \"f53056e7-0404-4074-bc19-664e206fce89\") " pod="openshift-console-operator/console-operator-5dbbb5d744-bb7cg" Jun 13 01:14:19.756717 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:14:19.756623 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50fd466c_b2e3_49e0_b60a_c55c4049cd4e.slice/crio-b862a1d4995e019a3406a175dde36f12d6c227fa84cf6db5a3c27d511db4eef8 WatchSource:0}: Error finding container b862a1d4995e019a3406a175dde36f12d6c227fa84cf6db5a3c27d511db4eef8: Status 404 returned error can't find the container with id b862a1d4995e019a3406a175dde36f12d6c227fa84cf6db5a3c27d511db4eef8 Jun 13 01:14:19.757722 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.757619 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f53056e7-0404-4074-bc19-664e206fce89-serving-cert\") pod \"console-operator-5dbbb5d744-bb7cg\" (UID: \"f53056e7-0404-4074-bc19-664e206fce89\") " pod="openshift-console-operator/console-operator-5dbbb5d744-bb7cg" Jun 13 01:14:19.766046 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.766025 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5b4k\" (UniqueName: \"kubernetes.io/projected/f53056e7-0404-4074-bc19-664e206fce89-kube-api-access-s5b4k\") pod \"console-operator-5dbbb5d744-bb7cg\" (UID: \"f53056e7-0404-4074-bc19-664e206fce89\") " pod="openshift-console-operator/console-operator-5dbbb5d744-bb7cg" Jun 13 01:14:19.768886 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.768834 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-n4tj4"] Jun 13 01:14:19.772987 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:14:19.772959 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod208b1445_3851_419f_8fcc_27aac35ea1e4.slice/crio-2da4f3504c8ab516dfe84e4387405625eb5874ac62cbfbce8fe7b5a0e3e1d6a6 WatchSource:0}: Error finding container 2da4f3504c8ab516dfe84e4387405625eb5874ac62cbfbce8fe7b5a0e3e1d6a6: Status 404 returned error can't find the container with id 2da4f3504c8ab516dfe84e4387405625eb5874ac62cbfbce8fe7b5a0e3e1d6a6 Jun 13 01:14:19.826438 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.826394 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-bb7cg" Jun 13 01:14:19.857119 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.857004 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-9skm6"] Jun 13 01:14:19.859674 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:14:19.859646 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85945bf4_40ee_4de7_8da2_e6b0e27fcb8e.slice/crio-afb12fbeef70363f31027aea938448657663ccf5c53f708eb1250bf9fdc6228e WatchSource:0}: Error finding container afb12fbeef70363f31027aea938448657663ccf5c53f708eb1250bf9fdc6228e: Status 404 returned error can't find the container with id afb12fbeef70363f31027aea938448657663ccf5c53f708eb1250bf9fdc6228e Jun 13 01:14:19.872189 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.872153 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-qfrjk"] Jun 13 01:14:19.876700 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:14:19.876669 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39a10cfc_561c_4e76_b463_c90fbe10aa0f.slice/crio-cc1537241d5934cbf76a4136304060aa7c79f8f5a6e9dc7c8053537817f56a19 WatchSource:0}: Error finding container cc1537241d5934cbf76a4136304060aa7c79f8f5a6e9dc7c8053537817f56a19: Status 404 returned error can't find the container with id cc1537241d5934cbf76a4136304060aa7c79f8f5a6e9dc7c8053537817f56a19 Jun 13 01:14:19.954441 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:19.954407 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-bb7cg"] Jun 13 01:14:19.957293 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:14:19.957269 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf53056e7_0404_4074_bc19_664e206fce89.slice/crio-fb5efa485d2e155515f82d614010f7e862537cfbcbd38705b4fb3c39b7edb51c WatchSource:0}: Error finding container fb5efa485d2e155515f82d614010f7e862537cfbcbd38705b4fb3c39b7edb51c: Status 404 returned error can't find the container with id fb5efa485d2e155515f82d614010f7e862537cfbcbd38705b4fb3c39b7edb51c Jun 13 01:14:20.058277 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:20.058239 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d13950cf-613e-41c1-bf53-33ba410bf0fe-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-6jsbc\" (UID: \"d13950cf-613e-41c1-bf53-33ba410bf0fe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-6jsbc" Jun 13 01:14:20.058428 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:20.058373 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/15d41019-db02-4ef2-b0e8-88c9cc63aef8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-9k2t8\" (UID: \"15d41019-db02-4ef2-b0e8-88c9cc63aef8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9k2t8" Jun 13 01:14:20.058428 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:20.058379 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 13 01:14:20.058428 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:20.058419 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 13 01:14:20.058602 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:20.058476 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15d41019-db02-4ef2-b0e8-88c9cc63aef8-cluster-monitoring-operator-tls podName:15d41019-db02-4ef2-b0e8-88c9cc63aef8 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:21.058460588 +0000 UTC m=+212.924475787 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/15d41019-db02-4ef2-b0e8-88c9cc63aef8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-9k2t8" (UID: "15d41019-db02-4ef2-b0e8-88c9cc63aef8") : secret "cluster-monitoring-operator-tls" not found Jun 13 01:14:20.058602 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:20.058492 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d13950cf-613e-41c1-bf53-33ba410bf0fe-samples-operator-tls podName:d13950cf-613e-41c1-bf53-33ba410bf0fe nodeName:}" failed. No retries permitted until 2026-06-13 01:14:21.05848512 +0000 UTC m=+212.924500319 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d13950cf-613e-41c1-bf53-33ba410bf0fe-samples-operator-tls") pod "cluster-samples-operator-9547488fd-6jsbc" (UID: "d13950cf-613e-41c1-bf53-33ba410bf0fe") : secret "samples-operator-tls" not found Jun 13 01:14:20.129726 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:20.129651 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-9skm6" event={"ID":"85945bf4-40ee-4de7-8da2-e6b0e27fcb8e","Type":"ContainerStarted","Data":"5d014e64781a5276160757d4c29ca2a6fca5f1544cb11582a35da8b88f6e2dcb"} Jun 13 01:14:20.129726 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:20.129691 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-9skm6" event={"ID":"85945bf4-40ee-4de7-8da2-e6b0e27fcb8e","Type":"ContainerStarted","Data":"afb12fbeef70363f31027aea938448657663ccf5c53f708eb1250bf9fdc6228e"} Jun 13 01:14:20.130866 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:20.130837 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9x5wx" event={"ID":"50fd466c-b2e3-49e0-b60a-c55c4049cd4e","Type":"ContainerStarted","Data":"b862a1d4995e019a3406a175dde36f12d6c227fa84cf6db5a3c27d511db4eef8"} Jun 13 01:14:20.131849 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:20.131825 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-n4tj4" event={"ID":"208b1445-3851-419f-8fcc-27aac35ea1e4","Type":"ContainerStarted","Data":"2da4f3504c8ab516dfe84e4387405625eb5874ac62cbfbce8fe7b5a0e3e1d6a6"} Jun 13 01:14:20.132827 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:20.132804 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-bb7cg" event={"ID":"f53056e7-0404-4074-bc19-664e206fce89","Type":"ContainerStarted","Data":"fb5efa485d2e155515f82d614010f7e862537cfbcbd38705b4fb3c39b7edb51c"} Jun 13 01:14:20.133896 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:20.133877 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-qfrjk" event={"ID":"39a10cfc-561c-4e76-b463-c90fbe10aa0f","Type":"ContainerStarted","Data":"cc1537241d5934cbf76a4136304060aa7c79f8f5a6e9dc7c8053537817f56a19"} Jun 13 01:14:20.147343 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:20.147304 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6947749cfc-9skm6" podStartSLOduration=1.147293919 podStartE2EDuration="1.147293919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:14:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:14:20.146135108 +0000 UTC m=+212.012150613" watchObservedRunningTime="2026-06-13 01:14:20.147293919 +0000 UTC m=+212.013309131" Jun 13 01:14:20.158739 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:20.158716 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ee44e07-c5aa-417a-ae59-c24f0572b921-metrics-certs\") pod \"router-default-7784bb8876-wvjz6\" (UID: \"8ee44e07-c5aa-417a-ae59-c24f0572b921\") " pod="openshift-ingress/router-default-7784bb8876-wvjz6" Jun 13 01:14:20.158839 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:20.158762 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ee44e07-c5aa-417a-ae59-c24f0572b921-service-ca-bundle\") pod \"router-default-7784bb8876-wvjz6\" (UID: \"8ee44e07-c5aa-417a-ae59-c24f0572b921\") " pod="openshift-ingress/router-default-7784bb8876-wvjz6" Jun 13 01:14:20.158899 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:20.158857 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 13 01:14:20.158969 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:20.158923 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ee44e07-c5aa-417a-ae59-c24f0572b921-metrics-certs podName:8ee44e07-c5aa-417a-ae59-c24f0572b921 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:21.158906045 +0000 UTC m=+213.024921257 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ee44e07-c5aa-417a-ae59-c24f0572b921-metrics-certs") pod "router-default-7784bb8876-wvjz6" (UID: "8ee44e07-c5aa-417a-ae59-c24f0572b921") : secret "router-metrics-certs-default" not found Jun 13 01:14:20.158969 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:20.158957 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ee44e07-c5aa-417a-ae59-c24f0572b921-service-ca-bundle podName:8ee44e07-c5aa-417a-ae59-c24f0572b921 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:21.158932649 +0000 UTC m=+213.024947856 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8ee44e07-c5aa-417a-ae59-c24f0572b921-service-ca-bundle") pod "router-default-7784bb8876-wvjz6" (UID: "8ee44e07-c5aa-417a-ae59-c24f0572b921") : configmap references non-existent config key: service-ca.crt Jun 13 01:14:21.065900 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:21.065707 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/15d41019-db02-4ef2-b0e8-88c9cc63aef8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-9k2t8\" (UID: \"15d41019-db02-4ef2-b0e8-88c9cc63aef8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9k2t8" Jun 13 01:14:21.065900 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:21.065784 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d13950cf-613e-41c1-bf53-33ba410bf0fe-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-6jsbc\" (UID: \"d13950cf-613e-41c1-bf53-33ba410bf0fe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-6jsbc" Jun 13 01:14:21.066449 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:21.065939 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 13 01:14:21.066449 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:21.065994 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 13 01:14:21.066449 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:21.066062 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15d41019-db02-4ef2-b0e8-88c9cc63aef8-cluster-monitoring-operator-tls podName:15d41019-db02-4ef2-b0e8-88c9cc63aef8 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:23.066002901 +0000 UTC m=+214.932018117 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/15d41019-db02-4ef2-b0e8-88c9cc63aef8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-9k2t8" (UID: "15d41019-db02-4ef2-b0e8-88c9cc63aef8") : secret "cluster-monitoring-operator-tls" not found Jun 13 01:14:21.066449 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:21.066087 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d13950cf-613e-41c1-bf53-33ba410bf0fe-samples-operator-tls podName:d13950cf-613e-41c1-bf53-33ba410bf0fe nodeName:}" failed. No retries permitted until 2026-06-13 01:14:23.066074757 +0000 UTC m=+214.932089968 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d13950cf-613e-41c1-bf53-33ba410bf0fe-samples-operator-tls") pod "cluster-samples-operator-9547488fd-6jsbc" (UID: "d13950cf-613e-41c1-bf53-33ba410bf0fe") : secret "samples-operator-tls" not found Jun 13 01:14:21.166577 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:21.166549 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ee44e07-c5aa-417a-ae59-c24f0572b921-metrics-certs\") pod \"router-default-7784bb8876-wvjz6\" (UID: \"8ee44e07-c5aa-417a-ae59-c24f0572b921\") " pod="openshift-ingress/router-default-7784bb8876-wvjz6" Jun 13 01:14:21.166681 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:21.166617 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ee44e07-c5aa-417a-ae59-c24f0572b921-service-ca-bundle\") pod \"router-default-7784bb8876-wvjz6\" (UID: \"8ee44e07-c5aa-417a-ae59-c24f0572b921\") " pod="openshift-ingress/router-default-7784bb8876-wvjz6" Jun 13 01:14:21.166781 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:21.166767 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ee44e07-c5aa-417a-ae59-c24f0572b921-service-ca-bundle podName:8ee44e07-c5aa-417a-ae59-c24f0572b921 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:23.166748417 +0000 UTC m=+215.032763617 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8ee44e07-c5aa-417a-ae59-c24f0572b921-service-ca-bundle") pod "router-default-7784bb8876-wvjz6" (UID: "8ee44e07-c5aa-417a-ae59-c24f0572b921") : configmap references non-existent config key: service-ca.crt Jun 13 01:14:21.166863 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:21.166784 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 13 01:14:21.166863 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:21.166845 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ee44e07-c5aa-417a-ae59-c24f0572b921-metrics-certs podName:8ee44e07-c5aa-417a-ae59-c24f0572b921 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:23.166833712 +0000 UTC m=+215.032848925 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ee44e07-c5aa-417a-ae59-c24f0572b921-metrics-certs") pod "router-default-7784bb8876-wvjz6" (UID: "8ee44e07-c5aa-417a-ae59-c24f0572b921") : secret "router-metrics-certs-default" not found Jun 13 01:14:22.142853 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:22.142818 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-qfrjk" event={"ID":"39a10cfc-561c-4e76-b463-c90fbe10aa0f","Type":"ContainerStarted","Data":"7b59c705f4033b6712faf9d686f9c103fc72bd789f2e8dd1ffa1bb574b3d6434"} Jun 13 01:14:22.157654 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:22.157607 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-qfrjk" podStartSLOduration=1.9246860529999998 podStartE2EDuration="3.157591234s" totalImagesPullingTime="1.232905181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:14:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:14:22.157175834 +0000 UTC m=+214.023191067" watchObservedRunningTime="2026-06-13 01:14:22.157591234 +0000 UTC m=+214.023606456" Jun 13 01:14:22.976440 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:22.976417 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4csfs"] Jun 13 01:14:22.978250 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:22.978236 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4csfs" Jun 13 01:14:22.985653 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:22.985631 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 13 01:14:22.986190 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:22.986165 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 13 01:14:22.986860 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:22.986835 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 13 01:14:22.987233 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:22.987214 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 13 01:14:22.987421 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:22.987234 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hgh9r\"" Jun 13 01:14:22.992507 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:22.992483 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4csfs"] Jun 13 01:14:23.083036 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:23.083008 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/68a74310-9fc6-4c21-9bcb-b16bdf015f98-data-volume\") pod \"insights-runtime-extractor-4csfs\" (UID: \"68a74310-9fc6-4c21-9bcb-b16bdf015f98\") " pod="openshift-insights/insights-runtime-extractor-4csfs" Jun 13 01:14:23.083139 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:23.083075 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68a74310-9fc6-4c21-9bcb-b16bdf015f98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4csfs\" (UID: \"68a74310-9fc6-4c21-9bcb-b16bdf015f98\") " pod="openshift-insights/insights-runtime-extractor-4csfs" Jun 13 01:14:23.083207 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:23.083160 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/15d41019-db02-4ef2-b0e8-88c9cc63aef8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-9k2t8\" (UID: \"15d41019-db02-4ef2-b0e8-88c9cc63aef8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9k2t8" Jun 13 01:14:23.083207 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:23.083187 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68a74310-9fc6-4c21-9bcb-b16bdf015f98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4csfs\" (UID: \"68a74310-9fc6-4c21-9bcb-b16bdf015f98\") " pod="openshift-insights/insights-runtime-extractor-4csfs" Jun 13 01:14:23.083303 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:23.083232 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/68a74310-9fc6-4c21-9bcb-b16bdf015f98-crio-socket\") pod \"insights-runtime-extractor-4csfs\" (UID: \"68a74310-9fc6-4c21-9bcb-b16bdf015f98\") " pod="openshift-insights/insights-runtime-extractor-4csfs" Jun 13 01:14:23.083303 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:23.083278 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d13950cf-613e-41c1-bf53-33ba410bf0fe-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-6jsbc\" (UID: \"d13950cf-613e-41c1-bf53-33ba410bf0fe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-6jsbc" Jun 13 01:14:23.083303 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:23.083293 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 13 01:14:23.083422 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:23.083306 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb5dh\" (UniqueName: \"kubernetes.io/projected/68a74310-9fc6-4c21-9bcb-b16bdf015f98-kube-api-access-nb5dh\") pod \"insights-runtime-extractor-4csfs\" (UID: \"68a74310-9fc6-4c21-9bcb-b16bdf015f98\") " pod="openshift-insights/insights-runtime-extractor-4csfs" Jun 13 01:14:23.083422 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:23.083352 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15d41019-db02-4ef2-b0e8-88c9cc63aef8-cluster-monitoring-operator-tls podName:15d41019-db02-4ef2-b0e8-88c9cc63aef8 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:27.083333463 +0000 UTC m=+218.949348663 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/15d41019-db02-4ef2-b0e8-88c9cc63aef8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-9k2t8" (UID: "15d41019-db02-4ef2-b0e8-88c9cc63aef8") : secret "cluster-monitoring-operator-tls" not found Jun 13 01:14:23.083422 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:23.083391 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 13 01:14:23.083515 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:23.083451 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d13950cf-613e-41c1-bf53-33ba410bf0fe-samples-operator-tls podName:d13950cf-613e-41c1-bf53-33ba410bf0fe nodeName:}" failed. No retries permitted until 2026-06-13 01:14:27.083435131 +0000 UTC m=+218.949450344 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d13950cf-613e-41c1-bf53-33ba410bf0fe-samples-operator-tls") pod "cluster-samples-operator-9547488fd-6jsbc" (UID: "d13950cf-613e-41c1-bf53-33ba410bf0fe") : secret "samples-operator-tls" not found Jun 13 01:14:23.147823 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:23.147733 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9x5wx" event={"ID":"50fd466c-b2e3-49e0-b60a-c55c4049cd4e","Type":"ContainerStarted","Data":"92ab9943d19bfd7fd44218307943a01d88abc2dbb1618905d6b1edb9701e8dd0"} Jun 13 01:14:23.149279 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:23.149251 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-n4tj4" event={"ID":"208b1445-3851-419f-8fcc-27aac35ea1e4","Type":"ContainerStarted","Data":"77410be1227e282091f57a25e774c8a248e6592ffd68a79165f95ef22c4f42a9"} Jun 13 01:14:23.150719 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:23.150689 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bb7cg_f53056e7-0404-4074-bc19-664e206fce89/console-operator/0.log" Jun 13 01:14:23.150812 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:23.150733 2573 generic.go:356] "Generic (PLEG): container finished" podID="f53056e7-0404-4074-bc19-664e206fce89" containerID="c3a52d3471a77f54dcb97e75b9371370a62a70d338c7ddf155fbbe3f60243b8d" exitCode=255 Jun 13 01:14:23.150812 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:23.150804 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-bb7cg" event={"ID":"f53056e7-0404-4074-bc19-664e206fce89","Type":"ContainerDied","Data":"c3a52d3471a77f54dcb97e75b9371370a62a70d338c7ddf155fbbe3f60243b8d"} Jun 13 01:14:23.151010 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:23.150996 2573 scope.go:117] "RemoveContainer" containerID="c3a52d3471a77f54dcb97e75b9371370a62a70d338c7ddf155fbbe3f60243b8d" Jun 13 01:14:23.163297 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:23.163258 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9x5wx" podStartSLOduration=1.02043339 podStartE2EDuration="4.16324664s" totalImagesPullingTime="3.14281325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:14:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:14:23.162275653 +0000 UTC m=+215.028290876" watchObservedRunningTime="2026-06-13 01:14:23.16324664 +0000 UTC m=+215.029261860" Jun 13 01:14:23.178141 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:23.178103 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-n4tj4" podStartSLOduration=1.046290392 podStartE2EDuration="4.178087762s" totalImagesPullingTime="3.13179737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:14:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:14:23.176608347 +0000 UTC m=+215.042623581" watchObservedRunningTime="2026-06-13 01:14:23.178087762 +0000 UTC m=+215.044103025" Jun 13 01:14:23.184027 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:23.184005 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/68a74310-9fc6-4c21-9bcb-b16bdf015f98-data-volume\") pod \"insights-runtime-extractor-4csfs\" (UID: \"68a74310-9fc6-4c21-9bcb-b16bdf015f98\") " pod="openshift-insights/insights-runtime-extractor-4csfs" Jun 13 01:14:23.184120 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:23.184059 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68a74310-9fc6-4c21-9bcb-b16bdf015f98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4csfs\" (UID: \"68a74310-9fc6-4c21-9bcb-b16bdf015f98\") " pod="openshift-insights/insights-runtime-extractor-4csfs" Jun 13 01:14:23.184120 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:23.184079 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ee44e07-c5aa-417a-ae59-c24f0572b921-metrics-certs\") pod \"router-default-7784bb8876-wvjz6\" (UID: \"8ee44e07-c5aa-417a-ae59-c24f0572b921\") " pod="openshift-ingress/router-default-7784bb8876-wvjz6" Jun 13 01:14:23.184120 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:23.184101 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ee44e07-c5aa-417a-ae59-c24f0572b921-service-ca-bundle\") pod \"router-default-7784bb8876-wvjz6\" (UID: \"8ee44e07-c5aa-417a-ae59-c24f0572b921\") " pod="openshift-ingress/router-default-7784bb8876-wvjz6" Jun 13 01:14:23.184277 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:23.184132 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68a74310-9fc6-4c21-9bcb-b16bdf015f98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4csfs\" (UID: \"68a74310-9fc6-4c21-9bcb-b16bdf015f98\") " pod="openshift-insights/insights-runtime-extractor-4csfs" Jun 13 01:14:23.184277 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:23.184160 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/68a74310-9fc6-4c21-9bcb-b16bdf015f98-crio-socket\") pod \"insights-runtime-extractor-4csfs\" (UID: \"68a74310-9fc6-4c21-9bcb-b16bdf015f98\") " pod="openshift-insights/insights-runtime-extractor-4csfs" Jun 13 01:14:23.184277 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:23.184193 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb5dh\" (UniqueName: \"kubernetes.io/projected/68a74310-9fc6-4c21-9bcb-b16bdf015f98-kube-api-access-nb5dh\") pod \"insights-runtime-extractor-4csfs\" (UID: \"68a74310-9fc6-4c21-9bcb-b16bdf015f98\") " pod="openshift-insights/insights-runtime-extractor-4csfs" Jun 13 01:14:23.184408 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:23.184285 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 01:14:23.184408 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:23.184348 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68a74310-9fc6-4c21-9bcb-b16bdf015f98-kube-rbac-proxy-cm podName:68a74310-9fc6-4c21-9bcb-b16bdf015f98 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:23.684327963 +0000 UTC m=+215.550343187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/68a74310-9fc6-4c21-9bcb-b16bdf015f98-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4csfs" (UID: "68a74310-9fc6-4c21-9bcb-b16bdf015f98") : configmap "kube-rbac-proxy" not found Jun 13 01:14:23.184513 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:23.184487 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/68a74310-9fc6-4c21-9bcb-b16bdf015f98-data-volume\") pod \"insights-runtime-extractor-4csfs\" (UID: \"68a74310-9fc6-4c21-9bcb-b16bdf015f98\") " pod="openshift-insights/insights-runtime-extractor-4csfs" Jun 13 01:14:23.184513 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:23.184508 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 01:14:23.184606 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:23.184526 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/68a74310-9fc6-4c21-9bcb-b16bdf015f98-crio-socket\") pod \"insights-runtime-extractor-4csfs\" (UID: \"68a74310-9fc6-4c21-9bcb-b16bdf015f98\") " pod="openshift-insights/insights-runtime-extractor-4csfs" Jun 13 01:14:23.184606 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:23.184551 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68a74310-9fc6-4c21-9bcb-b16bdf015f98-insights-runtime-extractor-tls podName:68a74310-9fc6-4c21-9bcb-b16bdf015f98 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:23.684537314 +0000 UTC m=+215.550552524 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68a74310-9fc6-4c21-9bcb-b16bdf015f98-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4csfs" (UID: "68a74310-9fc6-4c21-9bcb-b16bdf015f98") : secret "insights-runtime-extractor-tls" not found Jun 13 01:14:23.184606 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:23.184580 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 13 01:14:23.184606 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:23.184584 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ee44e07-c5aa-417a-ae59-c24f0572b921-service-ca-bundle podName:8ee44e07-c5aa-417a-ae59-c24f0572b921 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:27.184570974 +0000 UTC m=+219.050586180 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8ee44e07-c5aa-417a-ae59-c24f0572b921-service-ca-bundle") pod "router-default-7784bb8876-wvjz6" (UID: "8ee44e07-c5aa-417a-ae59-c24f0572b921") : configmap references non-existent config key: service-ca.crt Jun 13 01:14:23.184743 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:23.184625 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ee44e07-c5aa-417a-ae59-c24f0572b921-metrics-certs podName:8ee44e07-c5aa-417a-ae59-c24f0572b921 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:27.184612237 +0000 UTC m=+219.050627437 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ee44e07-c5aa-417a-ae59-c24f0572b921-metrics-certs") pod "router-default-7784bb8876-wvjz6" (UID: "8ee44e07-c5aa-417a-ae59-c24f0572b921") : secret "router-metrics-certs-default" not found Jun 13 01:14:23.197439 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:23.197415 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb5dh\" (UniqueName: \"kubernetes.io/projected/68a74310-9fc6-4c21-9bcb-b16bdf015f98-kube-api-access-nb5dh\") pod \"insights-runtime-extractor-4csfs\" (UID: \"68a74310-9fc6-4c21-9bcb-b16bdf015f98\") " pod="openshift-insights/insights-runtime-extractor-4csfs" Jun 13 01:14:23.689816 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:23.689781 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68a74310-9fc6-4c21-9bcb-b16bdf015f98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4csfs\" (UID: \"68a74310-9fc6-4c21-9bcb-b16bdf015f98\") " pod="openshift-insights/insights-runtime-extractor-4csfs" Jun 13 01:14:23.689953 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:23.689886 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 01:14:23.689953 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:23.689938 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68a74310-9fc6-4c21-9bcb-b16bdf015f98-kube-rbac-proxy-cm podName:68a74310-9fc6-4c21-9bcb-b16bdf015f98 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:24.689925159 +0000 UTC m=+216.555940359 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/68a74310-9fc6-4c21-9bcb-b16bdf015f98-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4csfs" (UID: "68a74310-9fc6-4c21-9bcb-b16bdf015f98") : configmap "kube-rbac-proxy" not found Jun 13 01:14:23.690050 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:23.689885 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68a74310-9fc6-4c21-9bcb-b16bdf015f98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4csfs\" (UID: \"68a74310-9fc6-4c21-9bcb-b16bdf015f98\") " pod="openshift-insights/insights-runtime-extractor-4csfs" Jun 13 01:14:23.690050 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:23.689986 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 01:14:23.690050 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:23.690039 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68a74310-9fc6-4c21-9bcb-b16bdf015f98-insights-runtime-extractor-tls podName:68a74310-9fc6-4c21-9bcb-b16bdf015f98 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:24.690025182 +0000 UTC m=+216.556040388 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68a74310-9fc6-4c21-9bcb-b16bdf015f98-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4csfs" (UID: "68a74310-9fc6-4c21-9bcb-b16bdf015f98") : secret "insights-runtime-extractor-tls" not found Jun 13 01:14:24.155027 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:24.155006 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bb7cg_f53056e7-0404-4074-bc19-664e206fce89/console-operator/1.log" Jun 13 01:14:24.155389 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:24.155342 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bb7cg_f53056e7-0404-4074-bc19-664e206fce89/console-operator/0.log" Jun 13 01:14:24.155389 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:24.155371 2573 generic.go:356] "Generic (PLEG): container finished" podID="f53056e7-0404-4074-bc19-664e206fce89" containerID="1ad84b57b2359d35260180debc31b79047920d86d6454465b7b02a4e14fc8171" exitCode=255 Jun 13 01:14:24.155479 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:24.155404 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-bb7cg" event={"ID":"f53056e7-0404-4074-bc19-664e206fce89","Type":"ContainerDied","Data":"1ad84b57b2359d35260180debc31b79047920d86d6454465b7b02a4e14fc8171"} Jun 13 01:14:24.155479 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:24.155471 2573 scope.go:117] "RemoveContainer" containerID="c3a52d3471a77f54dcb97e75b9371370a62a70d338c7ddf155fbbe3f60243b8d" Jun 13 01:14:24.155703 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:24.155686 2573 scope.go:117] "RemoveContainer" containerID="1ad84b57b2359d35260180debc31b79047920d86d6454465b7b02a4e14fc8171" Jun 13 01:14:24.155877 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:24.155856 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-bb7cg_openshift-console-operator(f53056e7-0404-4074-bc19-664e206fce89)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-bb7cg" podUID="f53056e7-0404-4074-bc19-664e206fce89" Jun 13 01:14:24.698084 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:24.698049 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68a74310-9fc6-4c21-9bcb-b16bdf015f98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4csfs\" (UID: \"68a74310-9fc6-4c21-9bcb-b16bdf015f98\") " pod="openshift-insights/insights-runtime-extractor-4csfs" Jun 13 01:14:24.698244 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:24.698121 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68a74310-9fc6-4c21-9bcb-b16bdf015f98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4csfs\" (UID: \"68a74310-9fc6-4c21-9bcb-b16bdf015f98\") " pod="openshift-insights/insights-runtime-extractor-4csfs" Jun 13 01:14:24.698244 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:24.698168 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 01:14:24.698244 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:24.698237 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68a74310-9fc6-4c21-9bcb-b16bdf015f98-kube-rbac-proxy-cm podName:68a74310-9fc6-4c21-9bcb-b16bdf015f98 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:26.698221722 +0000 UTC m=+218.564236926 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/68a74310-9fc6-4c21-9bcb-b16bdf015f98-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4csfs" (UID: "68a74310-9fc6-4c21-9bcb-b16bdf015f98") : configmap "kube-rbac-proxy" not found Jun 13 01:14:24.698244 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:24.698240 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 01:14:24.698394 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:24.698279 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68a74310-9fc6-4c21-9bcb-b16bdf015f98-insights-runtime-extractor-tls podName:68a74310-9fc6-4c21-9bcb-b16bdf015f98 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:26.698267436 +0000 UTC m=+218.564282637 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68a74310-9fc6-4c21-9bcb-b16bdf015f98-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4csfs" (UID: "68a74310-9fc6-4c21-9bcb-b16bdf015f98") : secret "insights-runtime-extractor-tls" not found Jun 13 01:14:24.964535 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:24.964459 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hlh72_e0f5e173-0662-47cd-9792-f07b01ab5eaf/dns-node-resolver/0.log" Jun 13 01:14:25.164225 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:25.164195 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bb7cg_f53056e7-0404-4074-bc19-664e206fce89/console-operator/1.log" Jun 13 01:14:25.164580 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:25.164494 2573 scope.go:117] "RemoveContainer" containerID="1ad84b57b2359d35260180debc31b79047920d86d6454465b7b02a4e14fc8171" Jun 13 01:14:25.164647 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:25.164626 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-bb7cg_openshift-console-operator(f53056e7-0404-4074-bc19-664e206fce89)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-bb7cg" podUID="f53056e7-0404-4074-bc19-664e206fce89" Jun 13 01:14:25.965828 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:25.965804 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4v55b_45611778-f77e-4cab-b564-ffb69bd4a695/node-ca/0.log" Jun 13 01:14:26.712380 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:26.712339 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68a74310-9fc6-4c21-9bcb-b16bdf015f98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4csfs\" (UID: \"68a74310-9fc6-4c21-9bcb-b16bdf015f98\") " pod="openshift-insights/insights-runtime-extractor-4csfs" Jun 13 01:14:26.712793 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:26.712448 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68a74310-9fc6-4c21-9bcb-b16bdf015f98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4csfs\" (UID: \"68a74310-9fc6-4c21-9bcb-b16bdf015f98\") " pod="openshift-insights/insights-runtime-extractor-4csfs" Jun 13 01:14:26.712793 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:26.712507 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 01:14:26.712793 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:26.712523 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 01:14:26.712793 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:26.712575 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68a74310-9fc6-4c21-9bcb-b16bdf015f98-kube-rbac-proxy-cm podName:68a74310-9fc6-4c21-9bcb-b16bdf015f98 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:30.712560547 +0000 UTC m=+222.578575747 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/68a74310-9fc6-4c21-9bcb-b16bdf015f98-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4csfs" (UID: "68a74310-9fc6-4c21-9bcb-b16bdf015f98") : configmap "kube-rbac-proxy" not found Jun 13 01:14:26.712793 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:26.712594 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68a74310-9fc6-4c21-9bcb-b16bdf015f98-insights-runtime-extractor-tls podName:68a74310-9fc6-4c21-9bcb-b16bdf015f98 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:30.712585016 +0000 UTC m=+222.578600217 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68a74310-9fc6-4c21-9bcb-b16bdf015f98-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4csfs" (UID: "68a74310-9fc6-4c21-9bcb-b16bdf015f98") : secret "insights-runtime-extractor-tls" not found Jun 13 01:14:26.780674 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:26.780642 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-g2b6t"] Jun 13 01:14:26.783330 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:26.783307 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-g2b6t" Jun 13 01:14:26.785997 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:26.785977 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 13 01:14:26.786761 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:26.786740 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 13 01:14:26.786868 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:26.786740 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 13 01:14:26.786868 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:26.786743 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-2qdd2\"" Jun 13 01:14:26.786868 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:26.786742 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 13 01:14:26.792669 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:26.792649 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-g2b6t"] Jun 13 01:14:26.913422 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:26.913378 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/afd0d18f-b281-4990-aafc-a566cdffd435-signing-key\") pod \"service-ca-7b994bc59-g2b6t\" (UID: \"afd0d18f-b281-4990-aafc-a566cdffd435\") " pod="openshift-service-ca/service-ca-7b994bc59-g2b6t" Jun 13 01:14:26.913613 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:26.913456 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/afd0d18f-b281-4990-aafc-a566cdffd435-signing-cabundle\") pod \"service-ca-7b994bc59-g2b6t\" (UID: \"afd0d18f-b281-4990-aafc-a566cdffd435\") " pod="openshift-service-ca/service-ca-7b994bc59-g2b6t" Jun 13 01:14:26.913613 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:26.913500 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m47j8\" (UniqueName: \"kubernetes.io/projected/afd0d18f-b281-4990-aafc-a566cdffd435-kube-api-access-m47j8\") pod \"service-ca-7b994bc59-g2b6t\" (UID: \"afd0d18f-b281-4990-aafc-a566cdffd435\") " pod="openshift-service-ca/service-ca-7b994bc59-g2b6t" Jun 13 01:14:26.965622 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:26.965548 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qtfxw_ab5efd87-9312-47f5-8521-d918f3f16571/serve-healthcheck-canary/0.log" Jun 13 01:14:27.013838 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:27.013807 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/afd0d18f-b281-4990-aafc-a566cdffd435-signing-key\") pod \"service-ca-7b994bc59-g2b6t\" (UID: \"afd0d18f-b281-4990-aafc-a566cdffd435\") " pod="openshift-service-ca/service-ca-7b994bc59-g2b6t" Jun 13 01:14:27.013994 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:27.013869 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/afd0d18f-b281-4990-aafc-a566cdffd435-signing-cabundle\") pod \"service-ca-7b994bc59-g2b6t\" (UID: \"afd0d18f-b281-4990-aafc-a566cdffd435\") " pod="openshift-service-ca/service-ca-7b994bc59-g2b6t" Jun 13 01:14:27.013994 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:27.013904 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m47j8\" (UniqueName: \"kubernetes.io/projected/afd0d18f-b281-4990-aafc-a566cdffd435-kube-api-access-m47j8\") pod \"service-ca-7b994bc59-g2b6t\" (UID: \"afd0d18f-b281-4990-aafc-a566cdffd435\") " pod="openshift-service-ca/service-ca-7b994bc59-g2b6t" Jun 13 01:14:27.014472 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:27.014450 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/afd0d18f-b281-4990-aafc-a566cdffd435-signing-cabundle\") pod \"service-ca-7b994bc59-g2b6t\" (UID: \"afd0d18f-b281-4990-aafc-a566cdffd435\") " pod="openshift-service-ca/service-ca-7b994bc59-g2b6t" Jun 13 01:14:27.016164 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:27.016144 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/afd0d18f-b281-4990-aafc-a566cdffd435-signing-key\") pod \"service-ca-7b994bc59-g2b6t\" (UID: \"afd0d18f-b281-4990-aafc-a566cdffd435\") " pod="openshift-service-ca/service-ca-7b994bc59-g2b6t" Jun 13 01:14:27.021990 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:27.021968 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m47j8\" (UniqueName: \"kubernetes.io/projected/afd0d18f-b281-4990-aafc-a566cdffd435-kube-api-access-m47j8\") pod \"service-ca-7b994bc59-g2b6t\" (UID: \"afd0d18f-b281-4990-aafc-a566cdffd435\") " pod="openshift-service-ca/service-ca-7b994bc59-g2b6t" Jun 13 01:14:27.091924 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:27.091902 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-g2b6t" Jun 13 01:14:27.114961 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:27.114925 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/15d41019-db02-4ef2-b0e8-88c9cc63aef8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-9k2t8\" (UID: \"15d41019-db02-4ef2-b0e8-88c9cc63aef8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9k2t8" Jun 13 01:14:27.115055 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:27.115001 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d13950cf-613e-41c1-bf53-33ba410bf0fe-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-6jsbc\" (UID: \"d13950cf-613e-41c1-bf53-33ba410bf0fe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-6jsbc" Jun 13 01:14:27.115055 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:27.115045 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 13 01:14:27.115127 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:27.115096 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 13 01:14:27.115127 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:27.115105 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15d41019-db02-4ef2-b0e8-88c9cc63aef8-cluster-monitoring-operator-tls podName:15d41019-db02-4ef2-b0e8-88c9cc63aef8 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:35.115091042 +0000 UTC m=+226.981106242 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/15d41019-db02-4ef2-b0e8-88c9cc63aef8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-9k2t8" (UID: "15d41019-db02-4ef2-b0e8-88c9cc63aef8") : secret "cluster-monitoring-operator-tls" not found Jun 13 01:14:27.115197 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:27.115133 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d13950cf-613e-41c1-bf53-33ba410bf0fe-samples-operator-tls podName:d13950cf-613e-41c1-bf53-33ba410bf0fe nodeName:}" failed. No retries permitted until 2026-06-13 01:14:35.115122487 +0000 UTC m=+226.981137689 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d13950cf-613e-41c1-bf53-33ba410bf0fe-samples-operator-tls") pod "cluster-samples-operator-9547488fd-6jsbc" (UID: "d13950cf-613e-41c1-bf53-33ba410bf0fe") : secret "samples-operator-tls" not found Jun 13 01:14:27.209426 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:27.209399 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-g2b6t"] Jun 13 01:14:27.211707 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:14:27.211681 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafd0d18f_b281_4990_aafc_a566cdffd435.slice/crio-7dc7d0fe05f9b9d4f8032fa0db9deaba9d962ccc2ca123cdad40c202be62c9ea WatchSource:0}: Error finding container 7dc7d0fe05f9b9d4f8032fa0db9deaba9d962ccc2ca123cdad40c202be62c9ea: Status 404 returned error can't find the container with id 7dc7d0fe05f9b9d4f8032fa0db9deaba9d962ccc2ca123cdad40c202be62c9ea Jun 13 01:14:27.215572 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:27.215549 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ee44e07-c5aa-417a-ae59-c24f0572b921-metrics-certs\") pod \"router-default-7784bb8876-wvjz6\" (UID: \"8ee44e07-c5aa-417a-ae59-c24f0572b921\") " pod="openshift-ingress/router-default-7784bb8876-wvjz6" Jun 13 01:14:27.215661 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:27.215600 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ee44e07-c5aa-417a-ae59-c24f0572b921-service-ca-bundle\") pod \"router-default-7784bb8876-wvjz6\" (UID: \"8ee44e07-c5aa-417a-ae59-c24f0572b921\") " pod="openshift-ingress/router-default-7784bb8876-wvjz6" Jun 13 01:14:27.215746 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:27.215732 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ee44e07-c5aa-417a-ae59-c24f0572b921-service-ca-bundle podName:8ee44e07-c5aa-417a-ae59-c24f0572b921 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:35.215714606 +0000 UTC m=+227.081729809 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8ee44e07-c5aa-417a-ae59-c24f0572b921-service-ca-bundle") pod "router-default-7784bb8876-wvjz6" (UID: "8ee44e07-c5aa-417a-ae59-c24f0572b921") : configmap references non-existent config key: service-ca.crt Jun 13 01:14:27.215833 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:27.215794 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 13 01:14:27.215870 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:27.215854 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ee44e07-c5aa-417a-ae59-c24f0572b921-metrics-certs podName:8ee44e07-c5aa-417a-ae59-c24f0572b921 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:35.215836579 +0000 UTC m=+227.081851797 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ee44e07-c5aa-417a-ae59-c24f0572b921-metrics-certs") pod "router-default-7784bb8876-wvjz6" (UID: "8ee44e07-c5aa-417a-ae59-c24f0572b921") : secret "router-metrics-certs-default" not found Jun 13 01:14:28.175508 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:28.175474 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-g2b6t" event={"ID":"afd0d18f-b281-4990-aafc-a566cdffd435","Type":"ContainerStarted","Data":"a167dd6917797bd808fe3fa595b198e85cca2f664c11ed9c342a5a9026065034"} Jun 13 01:14:28.175889 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:28.175529 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-g2b6t" event={"ID":"afd0d18f-b281-4990-aafc-a566cdffd435","Type":"ContainerStarted","Data":"7dc7d0fe05f9b9d4f8032fa0db9deaba9d962ccc2ca123cdad40c202be62c9ea"} Jun 13 01:14:28.196148 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:28.196106 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7b994bc59-g2b6t" podStartSLOduration=2.196091629 podStartE2EDuration="2.196091629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:14:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:14:28.194191126 +0000 UTC m=+220.060206348" watchObservedRunningTime="2026-06-13 01:14:28.196091629 +0000 UTC m=+220.062106850" Jun 13 01:14:29.827182 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:29.827152 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-bb7cg" Jun 13 01:14:29.827535 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:29.827239 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-bb7cg" Jun 13 01:14:29.827578 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:29.827560 2573 scope.go:117] "RemoveContainer" containerID="1ad84b57b2359d35260180debc31b79047920d86d6454465b7b02a4e14fc8171" Jun 13 01:14:29.827721 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:29.827699 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-bb7cg_openshift-console-operator(f53056e7-0404-4074-bc19-664e206fce89)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-bb7cg" podUID="f53056e7-0404-4074-bc19-664e206fce89" Jun 13 01:14:30.747389 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:30.747357 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68a74310-9fc6-4c21-9bcb-b16bdf015f98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4csfs\" (UID: \"68a74310-9fc6-4c21-9bcb-b16bdf015f98\") " pod="openshift-insights/insights-runtime-extractor-4csfs" Jun 13 01:14:30.747544 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:30.747424 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68a74310-9fc6-4c21-9bcb-b16bdf015f98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4csfs\" (UID: \"68a74310-9fc6-4c21-9bcb-b16bdf015f98\") " pod="openshift-insights/insights-runtime-extractor-4csfs" Jun 13 01:14:30.747544 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:30.747481 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 01:14:30.747544 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:30.747538 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 01:14:30.747710 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:30.747553 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68a74310-9fc6-4c21-9bcb-b16bdf015f98-kube-rbac-proxy-cm podName:68a74310-9fc6-4c21-9bcb-b16bdf015f98 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:38.74753202 +0000 UTC m=+230.613547236 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/68a74310-9fc6-4c21-9bcb-b16bdf015f98-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4csfs" (UID: "68a74310-9fc6-4c21-9bcb-b16bdf015f98") : configmap "kube-rbac-proxy" not found Jun 13 01:14:30.747710 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:30.747575 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68a74310-9fc6-4c21-9bcb-b16bdf015f98-insights-runtime-extractor-tls podName:68a74310-9fc6-4c21-9bcb-b16bdf015f98 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:38.747564591 +0000 UTC m=+230.613579790 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68a74310-9fc6-4c21-9bcb-b16bdf015f98-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4csfs" (UID: "68a74310-9fc6-4c21-9bcb-b16bdf015f98") : secret "insights-runtime-extractor-tls" not found Jun 13 01:14:35.180483 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:35.180439 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/15d41019-db02-4ef2-b0e8-88c9cc63aef8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-9k2t8\" (UID: \"15d41019-db02-4ef2-b0e8-88c9cc63aef8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9k2t8" Jun 13 01:14:35.180865 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:35.180513 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d13950cf-613e-41c1-bf53-33ba410bf0fe-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-6jsbc\" (UID: \"d13950cf-613e-41c1-bf53-33ba410bf0fe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-6jsbc" Jun 13 01:14:35.180865 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:35.180572 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 13 01:14:35.180865 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:14:35.180655 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15d41019-db02-4ef2-b0e8-88c9cc63aef8-cluster-monitoring-operator-tls podName:15d41019-db02-4ef2-b0e8-88c9cc63aef8 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:51.180634937 +0000 UTC m=+243.046650149 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/15d41019-db02-4ef2-b0e8-88c9cc63aef8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-9k2t8" (UID: "15d41019-db02-4ef2-b0e8-88c9cc63aef8") : secret "cluster-monitoring-operator-tls" not found Jun 13 01:14:35.182864 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:35.182836 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d13950cf-613e-41c1-bf53-33ba410bf0fe-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-6jsbc\" (UID: \"d13950cf-613e-41c1-bf53-33ba410bf0fe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-6jsbc" Jun 13 01:14:35.252632 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:35.252601 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-6jsbc" Jun 13 01:14:35.281601 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:35.281573 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ee44e07-c5aa-417a-ae59-c24f0572b921-metrics-certs\") pod \"router-default-7784bb8876-wvjz6\" (UID: \"8ee44e07-c5aa-417a-ae59-c24f0572b921\") " pod="openshift-ingress/router-default-7784bb8876-wvjz6" Jun 13 01:14:35.281699 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:35.281610 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ee44e07-c5aa-417a-ae59-c24f0572b921-service-ca-bundle\") pod \"router-default-7784bb8876-wvjz6\" (UID: \"8ee44e07-c5aa-417a-ae59-c24f0572b921\") " pod="openshift-ingress/router-default-7784bb8876-wvjz6" Jun 13 01:14:35.282195 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:35.282164 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ee44e07-c5aa-417a-ae59-c24f0572b921-service-ca-bundle\") pod \"router-default-7784bb8876-wvjz6\" (UID: \"8ee44e07-c5aa-417a-ae59-c24f0572b921\") " pod="openshift-ingress/router-default-7784bb8876-wvjz6" Jun 13 01:14:35.283899 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:35.283876 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ee44e07-c5aa-417a-ae59-c24f0572b921-metrics-certs\") pod \"router-default-7784bb8876-wvjz6\" (UID: \"8ee44e07-c5aa-417a-ae59-c24f0572b921\") " pod="openshift-ingress/router-default-7784bb8876-wvjz6" Jun 13 01:14:35.336371 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:35.336336 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7784bb8876-wvjz6" Jun 13 01:14:35.373429 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:35.373362 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-6jsbc"] Jun 13 01:14:35.463335 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:35.463308 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7784bb8876-wvjz6"] Jun 13 01:14:35.465495 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:14:35.465446 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ee44e07_c5aa_417a_ae59_c24f0572b921.slice/crio-5dac95fa9e1252a44346cd3f3decf0e9c4f46123a12ea5bb000d59c45f8eb842 WatchSource:0}: Error finding container 5dac95fa9e1252a44346cd3f3decf0e9c4f46123a12ea5bb000d59c45f8eb842: Status 404 returned error can't find the container with id 5dac95fa9e1252a44346cd3f3decf0e9c4f46123a12ea5bb000d59c45f8eb842 Jun 13 01:14:36.203920 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:36.203881 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7784bb8876-wvjz6" event={"ID":"8ee44e07-c5aa-417a-ae59-c24f0572b921","Type":"ContainerStarted","Data":"ff537bb40857227b5bb5c95a3e434795fe289b609aad8f158c26986dd4ba5fb8"} Jun 13 01:14:36.204345 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:36.203955 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7784bb8876-wvjz6" event={"ID":"8ee44e07-c5aa-417a-ae59-c24f0572b921","Type":"ContainerStarted","Data":"5dac95fa9e1252a44346cd3f3decf0e9c4f46123a12ea5bb000d59c45f8eb842"} Jun 13 01:14:36.205017 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:36.204995 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-6jsbc" event={"ID":"d13950cf-613e-41c1-bf53-33ba410bf0fe","Type":"ContainerStarted","Data":"081c0addcb0497cab79b4c472f6698d7b80b2dfa5a02f0c3573f0cd812658575"} Jun 13 01:14:36.221910 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:36.221871 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7784bb8876-wvjz6" podStartSLOduration=17.221859048 podStartE2EDuration="17.221859048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:14:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:14:36.220712442 +0000 UTC m=+228.086727663" watchObservedRunningTime="2026-06-13 01:14:36.221859048 +0000 UTC m=+228.087874301" Jun 13 01:14:36.336533 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:36.336500 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7784bb8876-wvjz6" Jun 13 01:14:36.339099 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:36.339076 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7784bb8876-wvjz6" Jun 13 01:14:37.209616 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:37.209583 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7784bb8876-wvjz6" Jun 13 01:14:37.211133 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:37.211110 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7784bb8876-wvjz6" Jun 13 01:14:38.213321 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:38.213284 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-6jsbc" event={"ID":"d13950cf-613e-41c1-bf53-33ba410bf0fe","Type":"ContainerStarted","Data":"576c3e02f81001e5abb11fc39a7f2bff044fa6ef010a25969eda309db009d7b2"} Jun 13 01:14:38.213709 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:38.213363 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-6jsbc" event={"ID":"d13950cf-613e-41c1-bf53-33ba410bf0fe","Type":"ContainerStarted","Data":"498aa7dfbf604a85aea513dfd3755fad33aa18d1a0f9aa0b31945a979c177929"} Jun 13 01:14:38.230859 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:38.230805 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-6jsbc" podStartSLOduration=17.278987542 podStartE2EDuration="19.230786862s" totalImagesPullingTime="1.95179932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:14:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:14:38.23011822 +0000 UTC m=+230.096133441" watchObservedRunningTime="2026-06-13 01:14:38.230786862 +0000 UTC m=+230.096802084" Jun 13 01:14:38.813121 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:38.813080 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68a74310-9fc6-4c21-9bcb-b16bdf015f98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4csfs\" (UID: \"68a74310-9fc6-4c21-9bcb-b16bdf015f98\") " pod="openshift-insights/insights-runtime-extractor-4csfs" Jun 13 01:14:38.813273 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:38.813155 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68a74310-9fc6-4c21-9bcb-b16bdf015f98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4csfs\" (UID: \"68a74310-9fc6-4c21-9bcb-b16bdf015f98\") " pod="openshift-insights/insights-runtime-extractor-4csfs" Jun 13 01:14:38.813675 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:38.813653 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68a74310-9fc6-4c21-9bcb-b16bdf015f98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4csfs\" (UID: \"68a74310-9fc6-4c21-9bcb-b16bdf015f98\") " pod="openshift-insights/insights-runtime-extractor-4csfs" Jun 13 01:14:38.815398 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:38.815375 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68a74310-9fc6-4c21-9bcb-b16bdf015f98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4csfs\" (UID: \"68a74310-9fc6-4c21-9bcb-b16bdf015f98\") " pod="openshift-insights/insights-runtime-extractor-4csfs" Jun 13 01:14:38.888193 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:38.888153 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4csfs" Jun 13 01:14:39.014027 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:39.014002 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4csfs"] Jun 13 01:14:39.016331 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:14:39.016301 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68a74310_9fc6_4c21_9bcb_b16bdf015f98.slice/crio-61b7d5f08bc00e505286941a7226fd64fe1151c73aeda76ec34e854f7e0c61c3 WatchSource:0}: Error finding container 61b7d5f08bc00e505286941a7226fd64fe1151c73aeda76ec34e854f7e0c61c3: Status 404 returned error can't find the container with id 61b7d5f08bc00e505286941a7226fd64fe1151c73aeda76ec34e854f7e0c61c3 Jun 13 01:14:39.217632 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:39.217591 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4csfs" event={"ID":"68a74310-9fc6-4c21-9bcb-b16bdf015f98","Type":"ContainerStarted","Data":"61b7d5f08bc00e505286941a7226fd64fe1151c73aeda76ec34e854f7e0c61c3"} Jun 13 01:14:40.533461 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:40.533424 2573 scope.go:117] "RemoveContainer" containerID="1ad84b57b2359d35260180debc31b79047920d86d6454465b7b02a4e14fc8171" Jun 13 01:14:43.235009 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:43.234982 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bb7cg_f53056e7-0404-4074-bc19-664e206fce89/console-operator/1.log" Jun 13 01:14:43.235399 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:43.235070 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-bb7cg" event={"ID":"f53056e7-0404-4074-bc19-664e206fce89","Type":"ContainerStarted","Data":"6fa174cbffd8d711749e74f86160eb71af8666b5361e5e1fc67fe9cf37fe8f12"} Jun 13 01:14:43.235399 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:43.235379 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-bb7cg" Jun 13 01:14:43.236902 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:43.236876 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4csfs" event={"ID":"68a74310-9fc6-4c21-9bcb-b16bdf015f98","Type":"ContainerStarted","Data":"4338f8352dcfd24439e7af6ae89ddec1dc476d5659277913eb4161e2ee90b63e"} Jun 13 01:14:43.237027 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:43.236925 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4csfs" event={"ID":"68a74310-9fc6-4c21-9bcb-b16bdf015f98","Type":"ContainerStarted","Data":"e782586ee604cf8cd01f9ff0cae607fdd57ec1d82b074135df2d5feb89fad9dd"} Jun 13 01:14:43.240512 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:43.240494 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5dbbb5d744-bb7cg" Jun 13 01:14:43.257626 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:43.257580 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5dbbb5d744-bb7cg" podStartSLOduration=21.309819354 podStartE2EDuration="24.257566697s" totalImagesPullingTime="2.947747343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:14:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:14:43.256461008 +0000 UTC m=+235.122476231" watchObservedRunningTime="2026-06-13 01:14:43.257566697 +0000 UTC m=+235.123581919" Jun 13 01:14:45.245771 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:45.245735 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4csfs" event={"ID":"68a74310-9fc6-4c21-9bcb-b16bdf015f98","Type":"ContainerStarted","Data":"ce534f61bd1ff9a49b8a03a2f7d5c15b4c45bade30420f9f5faa7d0917966f5a"} Jun 13 01:14:45.264974 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:45.264914 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4csfs" podStartSLOduration=18.14619763 podStartE2EDuration="23.264900656s" totalImagesPullingTime="5.118703026s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:14:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:14:45.264302039 +0000 UTC m=+237.130317297" watchObservedRunningTime="2026-06-13 01:14:45.264900656 +0000 UTC m=+237.130915876" Jun 13 01:14:47.469579 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:47.469550 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-t4p89"] Jun 13 01:14:47.471523 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:47.471505 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-t4p89" Jun 13 01:14:47.473715 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:47.473694 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-4w2s7\"" Jun 13 01:14:47.473832 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:47.473782 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 13 01:14:47.474056 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:47.474036 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 13 01:14:47.482661 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:47.482642 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptstt\" (UniqueName: \"kubernetes.io/projected/47f9472f-847e-4c8c-870d-32e019cb7eaa-kube-api-access-ptstt\") pod \"downloads-694c955b9-t4p89\" (UID: \"47f9472f-847e-4c8c-870d-32e019cb7eaa\") " pod="openshift-console/downloads-694c955b9-t4p89" Jun 13 01:14:47.485246 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:47.485224 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-t4p89"] Jun 13 01:14:47.583833 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:47.583788 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptstt\" (UniqueName: \"kubernetes.io/projected/47f9472f-847e-4c8c-870d-32e019cb7eaa-kube-api-access-ptstt\") pod \"downloads-694c955b9-t4p89\" (UID: \"47f9472f-847e-4c8c-870d-32e019cb7eaa\") " pod="openshift-console/downloads-694c955b9-t4p89" Jun 13 01:14:47.593824 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:47.593796 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptstt\" (UniqueName: \"kubernetes.io/projected/47f9472f-847e-4c8c-870d-32e019cb7eaa-kube-api-access-ptstt\") pod \"downloads-694c955b9-t4p89\" (UID: \"47f9472f-847e-4c8c-870d-32e019cb7eaa\") " pod="openshift-console/downloads-694c955b9-t4p89" Jun 13 01:14:47.780066 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:47.779997 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-t4p89" Jun 13 01:14:47.899498 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:47.899469 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-t4p89"] Jun 13 01:14:47.902983 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:14:47.902958 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47f9472f_847e_4c8c_870d_32e019cb7eaa.slice/crio-ac031e8dbec1ac591abfcde83313c119b24faa77eeec617382ccc60ede4922c5 WatchSource:0}: Error finding container ac031e8dbec1ac591abfcde83313c119b24faa77eeec617382ccc60ede4922c5: Status 404 returned error can't find the container with id ac031e8dbec1ac591abfcde83313c119b24faa77eeec617382ccc60ede4922c5 Jun 13 01:14:48.256104 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:48.256072 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-t4p89" event={"ID":"47f9472f-847e-4c8c-870d-32e019cb7eaa","Type":"ContainerStarted","Data":"ac031e8dbec1ac591abfcde83313c119b24faa77eeec617382ccc60ede4922c5"} Jun 13 01:14:51.209801 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:51.209760 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/15d41019-db02-4ef2-b0e8-88c9cc63aef8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-9k2t8\" (UID: \"15d41019-db02-4ef2-b0e8-88c9cc63aef8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9k2t8" Jun 13 01:14:51.212561 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:51.212533 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/15d41019-db02-4ef2-b0e8-88c9cc63aef8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-9k2t8\" (UID: \"15d41019-db02-4ef2-b0e8-88c9cc63aef8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9k2t8" Jun 13 01:14:51.415760 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:51.415731 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d6d84c65d-vjw2j"] Jun 13 01:14:51.421452 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:51.421415 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6d84c65d-vjw2j" Jun 13 01:14:51.424090 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:51.424068 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 13 01:14:51.424201 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:51.424068 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 13 01:14:51.424889 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:51.424651 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 13 01:14:51.424889 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:51.424710 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 13 01:14:51.424889 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:51.424712 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 13 01:14:51.424889 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:51.424757 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qmjhv\"" Jun 13 01:14:51.429101 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:51.429076 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d6d84c65d-vjw2j"] Jun 13 01:14:51.449556 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:51.449536 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2ng5p\"" Jun 13 01:14:51.458449 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:51.458430 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9k2t8" Jun 13 01:14:51.512447 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:51.512183 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jddsm\" (UniqueName: \"kubernetes.io/projected/bb853519-2a82-4e26-bf83-e3576cd75b48-kube-api-access-jddsm\") pod \"console-6d6d84c65d-vjw2j\" (UID: \"bb853519-2a82-4e26-bf83-e3576cd75b48\") " pod="openshift-console/console-6d6d84c65d-vjw2j" Jun 13 01:14:51.512447 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:51.512230 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb853519-2a82-4e26-bf83-e3576cd75b48-service-ca\") pod \"console-6d6d84c65d-vjw2j\" (UID: \"bb853519-2a82-4e26-bf83-e3576cd75b48\") " pod="openshift-console/console-6d6d84c65d-vjw2j" Jun 13 01:14:51.512447 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:51.512261 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb853519-2a82-4e26-bf83-e3576cd75b48-oauth-serving-cert\") pod \"console-6d6d84c65d-vjw2j\" (UID: \"bb853519-2a82-4e26-bf83-e3576cd75b48\") " pod="openshift-console/console-6d6d84c65d-vjw2j" Jun 13 01:14:51.512447 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:51.512289 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb853519-2a82-4e26-bf83-e3576cd75b48-console-serving-cert\") pod \"console-6d6d84c65d-vjw2j\" (UID: \"bb853519-2a82-4e26-bf83-e3576cd75b48\") " pod="openshift-console/console-6d6d84c65d-vjw2j" Jun 13 01:14:51.512447 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:51.512316 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb853519-2a82-4e26-bf83-e3576cd75b48-console-oauth-config\") pod \"console-6d6d84c65d-vjw2j\" (UID: \"bb853519-2a82-4e26-bf83-e3576cd75b48\") " pod="openshift-console/console-6d6d84c65d-vjw2j" Jun 13 01:14:51.512447 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:51.512343 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb853519-2a82-4e26-bf83-e3576cd75b48-console-config\") pod \"console-6d6d84c65d-vjw2j\" (UID: \"bb853519-2a82-4e26-bf83-e3576cd75b48\") " pod="openshift-console/console-6d6d84c65d-vjw2j" Jun 13 01:14:51.588652 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:51.588505 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-9k2t8"] Jun 13 01:14:51.591317 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:14:51.591289 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15d41019_db02_4ef2_b0e8_88c9cc63aef8.slice/crio-8380328d267d4bbdaaaff05393e074a7d00da5c9a920996ce7acc2e5f0afa0f0 WatchSource:0}: Error finding container 8380328d267d4bbdaaaff05393e074a7d00da5c9a920996ce7acc2e5f0afa0f0: Status 404 returned error can't find the container with id 8380328d267d4bbdaaaff05393e074a7d00da5c9a920996ce7acc2e5f0afa0f0 Jun 13 01:14:51.613788 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:51.613751 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jddsm\" (UniqueName: \"kubernetes.io/projected/bb853519-2a82-4e26-bf83-e3576cd75b48-kube-api-access-jddsm\") pod \"console-6d6d84c65d-vjw2j\" (UID: \"bb853519-2a82-4e26-bf83-e3576cd75b48\") " pod="openshift-console/console-6d6d84c65d-vjw2j" Jun 13 01:14:51.613899 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:51.613792 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb853519-2a82-4e26-bf83-e3576cd75b48-service-ca\") pod \"console-6d6d84c65d-vjw2j\" (UID: \"bb853519-2a82-4e26-bf83-e3576cd75b48\") " pod="openshift-console/console-6d6d84c65d-vjw2j" Jun 13 01:14:51.613899 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:51.613821 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb853519-2a82-4e26-bf83-e3576cd75b48-oauth-serving-cert\") pod \"console-6d6d84c65d-vjw2j\" (UID: \"bb853519-2a82-4e26-bf83-e3576cd75b48\") " pod="openshift-console/console-6d6d84c65d-vjw2j" Jun 13 01:14:51.613899 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:51.613848 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb853519-2a82-4e26-bf83-e3576cd75b48-console-serving-cert\") pod \"console-6d6d84c65d-vjw2j\" (UID: \"bb853519-2a82-4e26-bf83-e3576cd75b48\") " pod="openshift-console/console-6d6d84c65d-vjw2j" Jun 13 01:14:51.613899 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:51.613873 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb853519-2a82-4e26-bf83-e3576cd75b48-console-oauth-config\") pod \"console-6d6d84c65d-vjw2j\" (UID: \"bb853519-2a82-4e26-bf83-e3576cd75b48\") " pod="openshift-console/console-6d6d84c65d-vjw2j" Jun 13 01:14:51.614154 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:51.613900 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb853519-2a82-4e26-bf83-e3576cd75b48-console-config\") pod \"console-6d6d84c65d-vjw2j\" (UID: \"bb853519-2a82-4e26-bf83-e3576cd75b48\") " pod="openshift-console/console-6d6d84c65d-vjw2j" Jun 13 01:14:51.614587 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:51.614564 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb853519-2a82-4e26-bf83-e3576cd75b48-service-ca\") pod \"console-6d6d84c65d-vjw2j\" (UID: \"bb853519-2a82-4e26-bf83-e3576cd75b48\") " pod="openshift-console/console-6d6d84c65d-vjw2j" Jun 13 01:14:51.614587 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:51.614576 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb853519-2a82-4e26-bf83-e3576cd75b48-oauth-serving-cert\") pod \"console-6d6d84c65d-vjw2j\" (UID: \"bb853519-2a82-4e26-bf83-e3576cd75b48\") " pod="openshift-console/console-6d6d84c65d-vjw2j" Jun 13 01:14:51.614920 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:51.614902 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb853519-2a82-4e26-bf83-e3576cd75b48-console-config\") pod \"console-6d6d84c65d-vjw2j\" (UID: \"bb853519-2a82-4e26-bf83-e3576cd75b48\") " pod="openshift-console/console-6d6d84c65d-vjw2j" Jun 13 01:14:51.616638 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:51.616617 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb853519-2a82-4e26-bf83-e3576cd75b48-console-oauth-config\") pod \"console-6d6d84c65d-vjw2j\" (UID: \"bb853519-2a82-4e26-bf83-e3576cd75b48\") " pod="openshift-console/console-6d6d84c65d-vjw2j" Jun 13 01:14:51.616729 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:51.616624 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb853519-2a82-4e26-bf83-e3576cd75b48-console-serving-cert\") pod \"console-6d6d84c65d-vjw2j\" (UID: \"bb853519-2a82-4e26-bf83-e3576cd75b48\") " pod="openshift-console/console-6d6d84c65d-vjw2j" Jun 13 01:14:51.622215 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:51.622197 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jddsm\" (UniqueName: \"kubernetes.io/projected/bb853519-2a82-4e26-bf83-e3576cd75b48-kube-api-access-jddsm\") pod \"console-6d6d84c65d-vjw2j\" (UID: \"bb853519-2a82-4e26-bf83-e3576cd75b48\") " pod="openshift-console/console-6d6d84c65d-vjw2j" Jun 13 01:14:51.733613 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:51.733536 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6d84c65d-vjw2j" Jun 13 01:14:51.875016 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:51.874838 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d6d84c65d-vjw2j"] Jun 13 01:14:51.878180 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:14:51.878155 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb853519_2a82_4e26_bf83_e3576cd75b48.slice/crio-52708e2cfc781ff8711ce70efaed250c0c2073f414ce49194ac94d08e0c6dfff WatchSource:0}: Error finding container 52708e2cfc781ff8711ce70efaed250c0c2073f414ce49194ac94d08e0c6dfff: Status 404 returned error can't find the container with id 52708e2cfc781ff8711ce70efaed250c0c2073f414ce49194ac94d08e0c6dfff Jun 13 01:14:52.270926 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:52.270887 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6d84c65d-vjw2j" event={"ID":"bb853519-2a82-4e26-bf83-e3576cd75b48","Type":"ContainerStarted","Data":"52708e2cfc781ff8711ce70efaed250c0c2073f414ce49194ac94d08e0c6dfff"} Jun 13 01:14:52.272236 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:52.272204 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9k2t8" event={"ID":"15d41019-db02-4ef2-b0e8-88c9cc63aef8","Type":"ContainerStarted","Data":"8380328d267d4bbdaaaff05393e074a7d00da5c9a920996ce7acc2e5f0afa0f0"} Jun 13 01:14:54.284263 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:54.284218 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9k2t8" event={"ID":"15d41019-db02-4ef2-b0e8-88c9cc63aef8","Type":"ContainerStarted","Data":"86e167b30b56b1439abb04bddb8c0b732bdaa172a44d328536e3ca3e3d31ed2e"} Jun 13 01:14:54.303441 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:54.303317 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-9k2t8" podStartSLOduration=33.15728353 podStartE2EDuration="35.303255249s" totalImagesPullingTime="2.145971719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:14:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:14:54.302645491 +0000 UTC m=+246.168660715" watchObservedRunningTime="2026-06-13 01:14:54.303255249 +0000 UTC m=+246.169270468" Jun 13 01:14:56.294522 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:56.294481 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6d84c65d-vjw2j" event={"ID":"bb853519-2a82-4e26-bf83-e3576cd75b48","Type":"ContainerStarted","Data":"de19c13f8d2f9150c2437ce6ba0e5a493c3d4d46d59b02f4a7cb0a32af9877f6"} Jun 13 01:14:56.312356 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:14:56.312304 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d6d84c65d-vjw2j" podStartSLOduration=1.667726138 podStartE2EDuration="5.312286438s" totalImagesPullingTime="3.6445603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:14:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:14:56.310978619 +0000 UTC m=+248.176993843" watchObservedRunningTime="2026-06-13 01:14:56.312286438 +0000 UTC m=+248.178301660" Jun 13 01:15:00.390685 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:00.390654 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/323114ca-ff76-4dbd-90b9-8d1c80ebea04-metrics-certs\") pod \"network-metrics-daemon-t4b8x\" (UID: \"323114ca-ff76-4dbd-90b9-8d1c80ebea04\") " pod="openshift-multus/network-metrics-daemon-t4b8x" Jun 13 01:15:00.393143 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:00.393121 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/323114ca-ff76-4dbd-90b9-8d1c80ebea04-metrics-certs\") pod \"network-metrics-daemon-t4b8x\" (UID: \"323114ca-ff76-4dbd-90b9-8d1c80ebea04\") " pod="openshift-multus/network-metrics-daemon-t4b8x" Jun 13 01:15:00.537232 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:00.537189 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-86b5g\"" Jun 13 01:15:00.545553 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:00.545528 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4b8x" Jun 13 01:15:01.734687 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:01.734653 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d6d84c65d-vjw2j" Jun 13 01:15:01.735181 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:01.734745 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d6d84c65d-vjw2j" Jun 13 01:15:01.736362 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:01.736338 2573 patch_prober.go:28] interesting pod/console-6d6d84c65d-vjw2j container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.20:8443/health\": dial tcp 10.132.0.20:8443: connect: connection refused" start-of-body= Jun 13 01:15:01.736486 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:01.736378 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6d6d84c65d-vjw2j" podUID="bb853519-2a82-4e26-bf83-e3576cd75b48" containerName="console" probeResult="failure" output="Get \"https://10.132.0.20:8443/health\": dial tcp 10.132.0.20:8443: connect: connection refused" Jun 13 01:15:02.799047 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:02.799008 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-frsp7"] Jun 13 01:15:02.825740 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:02.825704 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-frsp7"] Jun 13 01:15:02.825911 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:02.825842 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-frsp7" Jun 13 01:15:02.830299 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:02.830273 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 13 01:15:02.830704 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:02.830560 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 13 01:15:02.830810 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:02.830763 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 13 01:15:02.831386 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:02.831296 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-h7kqp\"" Jun 13 01:15:02.856383 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:02.856356 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fmqcx"] Jun 13 01:15:02.883276 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:02.883253 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fmqcx" Jun 13 01:15:02.888343 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:02.888100 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wl8wg\"" Jun 13 01:15:02.888343 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:02.888151 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 13 01:15:02.888343 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:02.888215 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 13 01:15:02.888343 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:02.888269 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 13 01:15:02.915682 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:02.915660 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8535f959-44fe-4b43-977e-8866e21a1887-node-exporter-tls\") pod \"node-exporter-fmqcx\" (UID: \"8535f959-44fe-4b43-977e-8866e21a1887\") " pod="openshift-monitoring/node-exporter-fmqcx" Jun 13 01:15:02.915792 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:02.915688 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8535f959-44fe-4b43-977e-8866e21a1887-sys\") pod \"node-exporter-fmqcx\" (UID: \"8535f959-44fe-4b43-977e-8866e21a1887\") " pod="openshift-monitoring/node-exporter-fmqcx" Jun 13 01:15:02.915792 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:02.915717 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8535f959-44fe-4b43-977e-8866e21a1887-node-exporter-textfile\") pod \"node-exporter-fmqcx\" (UID: \"8535f959-44fe-4b43-977e-8866e21a1887\") " pod="openshift-monitoring/node-exporter-fmqcx" Jun 13 01:15:02.915792 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:02.915776 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8a4889b-1355-42b4-b8d2-dfda8e2c82bd-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-frsp7\" (UID: \"e8a4889b-1355-42b4-b8d2-dfda8e2c82bd\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-frsp7" Jun 13 01:15:02.915983 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:02.915878 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8535f959-44fe-4b43-977e-8866e21a1887-node-exporter-wtmp\") pod \"node-exporter-fmqcx\" (UID: \"8535f959-44fe-4b43-977e-8866e21a1887\") " pod="openshift-monitoring/node-exporter-fmqcx" Jun 13 01:15:02.915983 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:02.915914 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8a4889b-1355-42b4-b8d2-dfda8e2c82bd-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-frsp7\" (UID: \"e8a4889b-1355-42b4-b8d2-dfda8e2c82bd\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-frsp7" Jun 13 01:15:02.915983 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:02.915956 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8535f959-44fe-4b43-977e-8866e21a1887-root\") pod \"node-exporter-fmqcx\" (UID: \"8535f959-44fe-4b43-977e-8866e21a1887\") " pod="openshift-monitoring/node-exporter-fmqcx" Jun 13 01:15:02.916134 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:02.915980 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8535f959-44fe-4b43-977e-8866e21a1887-node-exporter-accelerators-collector-config\") pod \"node-exporter-fmqcx\" (UID: \"8535f959-44fe-4b43-977e-8866e21a1887\") " pod="openshift-monitoring/node-exporter-fmqcx" Jun 13 01:15:02.916134 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:02.916041 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8535f959-44fe-4b43-977e-8866e21a1887-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fmqcx\" (UID: \"8535f959-44fe-4b43-977e-8866e21a1887\") " pod="openshift-monitoring/node-exporter-fmqcx" Jun 13 01:15:02.916134 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:02.916078 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbpb5\" (UniqueName: \"kubernetes.io/projected/8535f959-44fe-4b43-977e-8866e21a1887-kube-api-access-lbpb5\") pod \"node-exporter-fmqcx\" (UID: \"8535f959-44fe-4b43-977e-8866e21a1887\") " pod="openshift-monitoring/node-exporter-fmqcx" Jun 13 01:15:02.916285 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:02.916145 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9qcw\" (UniqueName: \"kubernetes.io/projected/e8a4889b-1355-42b4-b8d2-dfda8e2c82bd-kube-api-access-k9qcw\") pod \"openshift-state-metrics-6b8d965dd5-frsp7\" (UID: \"e8a4889b-1355-42b4-b8d2-dfda8e2c82bd\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-frsp7" Jun 13 01:15:02.916285 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:02.916177 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8a4889b-1355-42b4-b8d2-dfda8e2c82bd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-frsp7\" (UID: \"e8a4889b-1355-42b4-b8d2-dfda8e2c82bd\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-frsp7" Jun 13 01:15:02.916285 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:02.916203 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8535f959-44fe-4b43-977e-8866e21a1887-metrics-client-ca\") pod \"node-exporter-fmqcx\" (UID: \"8535f959-44fe-4b43-977e-8866e21a1887\") " pod="openshift-monitoring/node-exporter-fmqcx" Jun 13 01:15:03.016920 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.016887 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8a4889b-1355-42b4-b8d2-dfda8e2c82bd-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-frsp7\" (UID: \"e8a4889b-1355-42b4-b8d2-dfda8e2c82bd\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-frsp7" Jun 13 01:15:03.016920 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.016920 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8535f959-44fe-4b43-977e-8866e21a1887-root\") pod \"node-exporter-fmqcx\" (UID: \"8535f959-44fe-4b43-977e-8866e21a1887\") " pod="openshift-monitoring/node-exporter-fmqcx" Jun 13 01:15:03.017137 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.016939 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8535f959-44fe-4b43-977e-8866e21a1887-node-exporter-accelerators-collector-config\") pod \"node-exporter-fmqcx\" (UID: \"8535f959-44fe-4b43-977e-8866e21a1887\") " pod="openshift-monitoring/node-exporter-fmqcx" Jun 13 01:15:03.017137 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.017002 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8535f959-44fe-4b43-977e-8866e21a1887-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fmqcx\" (UID: \"8535f959-44fe-4b43-977e-8866e21a1887\") " pod="openshift-monitoring/node-exporter-fmqcx" Jun 13 01:15:03.017137 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.017024 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbpb5\" (UniqueName: \"kubernetes.io/projected/8535f959-44fe-4b43-977e-8866e21a1887-kube-api-access-lbpb5\") pod \"node-exporter-fmqcx\" (UID: \"8535f959-44fe-4b43-977e-8866e21a1887\") " pod="openshift-monitoring/node-exporter-fmqcx" Jun 13 01:15:03.017137 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.017019 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8535f959-44fe-4b43-977e-8866e21a1887-root\") pod \"node-exporter-fmqcx\" (UID: \"8535f959-44fe-4b43-977e-8866e21a1887\") " pod="openshift-monitoring/node-exporter-fmqcx" Jun 13 01:15:03.017137 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.017061 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9qcw\" (UniqueName: \"kubernetes.io/projected/e8a4889b-1355-42b4-b8d2-dfda8e2c82bd-kube-api-access-k9qcw\") pod \"openshift-state-metrics-6b8d965dd5-frsp7\" (UID: \"e8a4889b-1355-42b4-b8d2-dfda8e2c82bd\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-frsp7" Jun 13 01:15:03.017137 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.017098 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8a4889b-1355-42b4-b8d2-dfda8e2c82bd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-frsp7\" (UID: \"e8a4889b-1355-42b4-b8d2-dfda8e2c82bd\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-frsp7" Jun 13 01:15:03.017137 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.017123 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8535f959-44fe-4b43-977e-8866e21a1887-metrics-client-ca\") pod \"node-exporter-fmqcx\" (UID: \"8535f959-44fe-4b43-977e-8866e21a1887\") " pod="openshift-monitoring/node-exporter-fmqcx" Jun 13 01:15:03.017497 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.017148 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8535f959-44fe-4b43-977e-8866e21a1887-node-exporter-tls\") pod \"node-exporter-fmqcx\" (UID: \"8535f959-44fe-4b43-977e-8866e21a1887\") " pod="openshift-monitoring/node-exporter-fmqcx" Jun 13 01:15:03.017497 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.017180 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8535f959-44fe-4b43-977e-8866e21a1887-sys\") pod \"node-exporter-fmqcx\" (UID: \"8535f959-44fe-4b43-977e-8866e21a1887\") " pod="openshift-monitoring/node-exporter-fmqcx" Jun 13 01:15:03.017497 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.017203 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8535f959-44fe-4b43-977e-8866e21a1887-node-exporter-textfile\") pod \"node-exporter-fmqcx\" (UID: \"8535f959-44fe-4b43-977e-8866e21a1887\") " pod="openshift-monitoring/node-exporter-fmqcx" Jun 13 01:15:03.017497 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.017225 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8a4889b-1355-42b4-b8d2-dfda8e2c82bd-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-frsp7\" (UID: \"e8a4889b-1355-42b4-b8d2-dfda8e2c82bd\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-frsp7" Jun 13 01:15:03.017497 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.017289 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8535f959-44fe-4b43-977e-8866e21a1887-node-exporter-wtmp\") pod \"node-exporter-fmqcx\" (UID: \"8535f959-44fe-4b43-977e-8866e21a1887\") " pod="openshift-monitoring/node-exporter-fmqcx" Jun 13 01:15:03.017497 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:15:03.017321 2573 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 13 01:15:03.017497 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:15:03.017386 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8535f959-44fe-4b43-977e-8866e21a1887-node-exporter-tls podName:8535f959-44fe-4b43-977e-8866e21a1887 nodeName:}" failed. No retries permitted until 2026-06-13 01:15:03.517368403 +0000 UTC m=+255.383383618 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8535f959-44fe-4b43-977e-8866e21a1887-node-exporter-tls") pod "node-exporter-fmqcx" (UID: "8535f959-44fe-4b43-977e-8866e21a1887") : secret "node-exporter-tls" not found Jun 13 01:15:03.017497 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.017416 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8535f959-44fe-4b43-977e-8866e21a1887-node-exporter-wtmp\") pod \"node-exporter-fmqcx\" (UID: \"8535f959-44fe-4b43-977e-8866e21a1887\") " pod="openshift-monitoring/node-exporter-fmqcx" Jun 13 01:15:03.017893 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.017506 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8535f959-44fe-4b43-977e-8866e21a1887-sys\") pod \"node-exporter-fmqcx\" (UID: \"8535f959-44fe-4b43-977e-8866e21a1887\") " pod="openshift-monitoring/node-exporter-fmqcx" Jun 13 01:15:03.017893 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.017708 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8a4889b-1355-42b4-b8d2-dfda8e2c82bd-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-frsp7\" (UID: \"e8a4889b-1355-42b4-b8d2-dfda8e2c82bd\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-frsp7" Jun 13 01:15:03.017893 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.017745 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8535f959-44fe-4b43-977e-8866e21a1887-node-exporter-textfile\") pod \"node-exporter-fmqcx\" (UID: \"8535f959-44fe-4b43-977e-8866e21a1887\") " pod="openshift-monitoring/node-exporter-fmqcx" Jun 13 01:15:03.017893 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.017762 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8535f959-44fe-4b43-977e-8866e21a1887-node-exporter-accelerators-collector-config\") pod \"node-exporter-fmqcx\" (UID: \"8535f959-44fe-4b43-977e-8866e21a1887\") " pod="openshift-monitoring/node-exporter-fmqcx" Jun 13 01:15:03.018121 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.018038 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8535f959-44fe-4b43-977e-8866e21a1887-metrics-client-ca\") pod \"node-exporter-fmqcx\" (UID: \"8535f959-44fe-4b43-977e-8866e21a1887\") " pod="openshift-monitoring/node-exporter-fmqcx" Jun 13 01:15:03.020105 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.020078 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8535f959-44fe-4b43-977e-8866e21a1887-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fmqcx\" (UID: \"8535f959-44fe-4b43-977e-8866e21a1887\") " pod="openshift-monitoring/node-exporter-fmqcx" Jun 13 01:15:03.020105 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.020102 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8a4889b-1355-42b4-b8d2-dfda8e2c82bd-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-frsp7\" (UID: \"e8a4889b-1355-42b4-b8d2-dfda8e2c82bd\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-frsp7" Jun 13 01:15:03.020301 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.020280 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8a4889b-1355-42b4-b8d2-dfda8e2c82bd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-frsp7\" (UID: \"e8a4889b-1355-42b4-b8d2-dfda8e2c82bd\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-frsp7" Jun 13 01:15:03.026757 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.026734 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbpb5\" (UniqueName: \"kubernetes.io/projected/8535f959-44fe-4b43-977e-8866e21a1887-kube-api-access-lbpb5\") pod \"node-exporter-fmqcx\" (UID: \"8535f959-44fe-4b43-977e-8866e21a1887\") " pod="openshift-monitoring/node-exporter-fmqcx" Jun 13 01:15:03.029761 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.029743 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9qcw\" (UniqueName: \"kubernetes.io/projected/e8a4889b-1355-42b4-b8d2-dfda8e2c82bd-kube-api-access-k9qcw\") pod \"openshift-state-metrics-6b8d965dd5-frsp7\" (UID: \"e8a4889b-1355-42b4-b8d2-dfda8e2c82bd\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-frsp7" Jun 13 01:15:03.138903 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.138826 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-frsp7" Jun 13 01:15:03.522448 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.522361 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8535f959-44fe-4b43-977e-8866e21a1887-node-exporter-tls\") pod \"node-exporter-fmqcx\" (UID: \"8535f959-44fe-4b43-977e-8866e21a1887\") " pod="openshift-monitoring/node-exporter-fmqcx" Jun 13 01:15:03.524930 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.524905 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8535f959-44fe-4b43-977e-8866e21a1887-node-exporter-tls\") pod \"node-exporter-fmqcx\" (UID: \"8535f959-44fe-4b43-977e-8866e21a1887\") " pod="openshift-monitoring/node-exporter-fmqcx" Jun 13 01:15:03.796344 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.796255 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fmqcx" Jun 13 01:15:03.802753 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.802723 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 01:15:03.849465 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.849417 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 01:15:03.849597 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.849518 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:03.853165 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.852072 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 13 01:15:03.853165 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.852088 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 13 01:15:03.853165 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.852365 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 13 01:15:03.853165 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.852396 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 13 01:15:03.853165 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.852492 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 13 01:15:03.853165 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.852592 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 13 01:15:03.853165 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.852592 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 13 01:15:03.853165 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.852657 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 13 01:15:03.853165 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.852894 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-r8w5g\"" Jun 13 01:15:03.853165 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.853150 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 13 01:15:03.926413 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.926382 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a899a540-b336-4fe0-a89f-fedb6aae57cd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:03.926552 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.926423 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a899a540-b336-4fe0-a89f-fedb6aae57cd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:03.926552 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.926459 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a899a540-b336-4fe0-a89f-fedb6aae57cd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:03.926552 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.926515 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r29m2\" (UniqueName: \"kubernetes.io/projected/a899a540-b336-4fe0-a89f-fedb6aae57cd-kube-api-access-r29m2\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:03.926723 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.926569 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a899a540-b336-4fe0-a89f-fedb6aae57cd-config-volume\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:03.926723 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.926626 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a899a540-b336-4fe0-a89f-fedb6aae57cd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:03.926723 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.926675 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a899a540-b336-4fe0-a89f-fedb6aae57cd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:03.926723 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.926720 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a899a540-b336-4fe0-a89f-fedb6aae57cd-config-out\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:03.926886 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.926796 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a899a540-b336-4fe0-a89f-fedb6aae57cd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:03.926886 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.926829 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a899a540-b336-4fe0-a89f-fedb6aae57cd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:03.926886 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.926860 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a899a540-b336-4fe0-a89f-fedb6aae57cd-web-config\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:03.927052 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.926894 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a899a540-b336-4fe0-a89f-fedb6aae57cd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:03.927052 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:03.926924 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a899a540-b336-4fe0-a89f-fedb6aae57cd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:04.027549 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:04.027508 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a899a540-b336-4fe0-a89f-fedb6aae57cd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:04.027710 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:04.027558 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a899a540-b336-4fe0-a89f-fedb6aae57cd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:04.027710 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:04.027588 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a899a540-b336-4fe0-a89f-fedb6aae57cd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:04.027835 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:04.027779 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a899a540-b336-4fe0-a89f-fedb6aae57cd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:04.027835 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:04.027825 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r29m2\" (UniqueName: \"kubernetes.io/projected/a899a540-b336-4fe0-a89f-fedb6aae57cd-kube-api-access-r29m2\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:04.027934 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:04.027866 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a899a540-b336-4fe0-a89f-fedb6aae57cd-config-volume\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:04.027934 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:04.027904 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a899a540-b336-4fe0-a89f-fedb6aae57cd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:04.028067 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:04.027963 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a899a540-b336-4fe0-a89f-fedb6aae57cd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:04.028067 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:04.028009 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a899a540-b336-4fe0-a89f-fedb6aae57cd-config-out\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:04.028067 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:04.028053 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a899a540-b336-4fe0-a89f-fedb6aae57cd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:04.028213 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:04.028090 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a899a540-b336-4fe0-a89f-fedb6aae57cd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:04.028213 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:04.028124 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a899a540-b336-4fe0-a89f-fedb6aae57cd-web-config\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:04.028213 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:04.028159 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a899a540-b336-4fe0-a89f-fedb6aae57cd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:04.029525 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:04.028538 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a899a540-b336-4fe0-a89f-fedb6aae57cd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:04.029525 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:04.029058 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a899a540-b336-4fe0-a89f-fedb6aae57cd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:04.029700 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:15:04.029578 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a899a540-b336-4fe0-a89f-fedb6aae57cd-alertmanager-trusted-ca-bundle podName:a899a540-b336-4fe0-a89f-fedb6aae57cd nodeName:}" failed. No retries permitted until 2026-06-13 01:15:04.529556683 +0000 UTC m=+256.395571887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/a899a540-b336-4fe0-a89f-fedb6aae57cd-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "a899a540-b336-4fe0-a89f-fedb6aae57cd") : configmap references non-existent config key: ca-bundle.crt Jun 13 01:15:04.033684 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:04.033661 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a899a540-b336-4fe0-a89f-fedb6aae57cd-web-config\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:04.034058 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:04.034034 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a899a540-b336-4fe0-a89f-fedb6aae57cd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:04.034396 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:04.034358 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a899a540-b336-4fe0-a89f-fedb6aae57cd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:04.035053 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:04.034896 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a899a540-b336-4fe0-a89f-fedb6aae57cd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:04.035053 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:04.035017 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a899a540-b336-4fe0-a89f-fedb6aae57cd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:04.037231 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:04.036807 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a899a540-b336-4fe0-a89f-fedb6aae57cd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:04.037231 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:04.037194 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a899a540-b336-4fe0-a89f-fedb6aae57cd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:04.037231 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:04.037225 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a899a540-b336-4fe0-a89f-fedb6aae57cd-config-out\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:04.037785 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:04.037756 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a899a540-b336-4fe0-a89f-fedb6aae57cd-config-volume\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:04.040027 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:04.039995 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r29m2\" (UniqueName: \"kubernetes.io/projected/a899a540-b336-4fe0-a89f-fedb6aae57cd-kube-api-access-r29m2\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:04.534041 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:04.533996 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a899a540-b336-4fe0-a89f-fedb6aae57cd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:04.534920 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:04.534896 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a899a540-b336-4fe0-a89f-fedb6aae57cd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a899a540-b336-4fe0-a89f-fedb6aae57cd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:04.761940 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:04.761903 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:15:07.437243 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:15:07.435148 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8535f959_44fe_4b43_977e_8866e21a1887.slice/crio-249bd7ba67fab485347f2098aeb7a4ca7aa38527aa9aac4fb29422e732483682 WatchSource:0}: Error finding container 249bd7ba67fab485347f2098aeb7a4ca7aa38527aa9aac4fb29422e732483682: Status 404 returned error can't find the container with id 249bd7ba67fab485347f2098aeb7a4ca7aa38527aa9aac4fb29422e732483682 Jun 13 01:15:07.520406 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:07.519344 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-bvmvr"] Jun 13 01:15:07.522304 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:07.522280 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-bvmvr" Jun 13 01:15:07.528142 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:07.526450 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-mjszq\"" Jun 13 01:15:07.528864 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:07.528645 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 13 01:15:07.545907 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:07.539995 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-bvmvr"] Jun 13 01:15:07.547154 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:07.547128 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d6d84c65d-vjw2j"] Jun 13 01:15:07.618473 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:07.618442 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t4b8x"] Jun 13 01:15:07.621051 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:15:07.621010 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod323114ca_ff76_4dbd_90b9_8d1c80ebea04.slice/crio-e4455b55f2898ca25d8b2863e305d34a7e1c1493c0eb06af78a12243d8985271 WatchSource:0}: Error finding container e4455b55f2898ca25d8b2863e305d34a7e1c1493c0eb06af78a12243d8985271: Status 404 returned error can't find the container with id e4455b55f2898ca25d8b2863e305d34a7e1c1493c0eb06af78a12243d8985271 Jun 13 01:15:07.648182 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:07.648158 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 01:15:07.653483 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:15:07.653454 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda899a540_b336_4fe0_a89f_fedb6aae57cd.slice/crio-d41b16001cbffef68ab1d698e910aea3abea4d5c50340141fb92b3fa859194e8 WatchSource:0}: Error finding container d41b16001cbffef68ab1d698e910aea3abea4d5c50340141fb92b3fa859194e8: Status 404 returned error can't find the container with id d41b16001cbffef68ab1d698e910aea3abea4d5c50340141fb92b3fa859194e8 Jun 13 01:15:07.664752 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:07.664684 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smb6v\" (UniqueName: \"kubernetes.io/projected/ae77d882-43e9-42c7-86d7-29ac316f8b0f-kube-api-access-smb6v\") pod \"monitoring-plugin-589576dfc7-bvmvr\" (UID: \"ae77d882-43e9-42c7-86d7-29ac316f8b0f\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-bvmvr" Jun 13 01:15:07.664832 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:07.664813 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae77d882-43e9-42c7-86d7-29ac316f8b0f-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-bvmvr\" (UID: \"ae77d882-43e9-42c7-86d7-29ac316f8b0f\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-bvmvr" Jun 13 01:15:07.664961 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:07.664850 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-frsp7"] Jun 13 01:15:07.671773 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:15:07.667146 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8a4889b_1355_42b4_b8d2_dfda8e2c82bd.slice/crio-6f483d4fc2b1d9e7df41b50866a75c383ae045522935ce96094b6208f2785748 WatchSource:0}: Error finding container 6f483d4fc2b1d9e7df41b50866a75c383ae045522935ce96094b6208f2785748: Status 404 returned error can't find the container with id 6f483d4fc2b1d9e7df41b50866a75c383ae045522935ce96094b6208f2785748 Jun 13 01:15:07.766095 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:07.766059 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smb6v\" (UniqueName: \"kubernetes.io/projected/ae77d882-43e9-42c7-86d7-29ac316f8b0f-kube-api-access-smb6v\") pod \"monitoring-plugin-589576dfc7-bvmvr\" (UID: \"ae77d882-43e9-42c7-86d7-29ac316f8b0f\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-bvmvr" Jun 13 01:15:07.766234 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:07.766158 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae77d882-43e9-42c7-86d7-29ac316f8b0f-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-bvmvr\" (UID: \"ae77d882-43e9-42c7-86d7-29ac316f8b0f\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-bvmvr" Jun 13 01:15:07.769136 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:07.769113 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae77d882-43e9-42c7-86d7-29ac316f8b0f-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-bvmvr\" (UID: \"ae77d882-43e9-42c7-86d7-29ac316f8b0f\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-bvmvr" Jun 13 01:15:07.775313 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:07.775281 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smb6v\" (UniqueName: \"kubernetes.io/projected/ae77d882-43e9-42c7-86d7-29ac316f8b0f-kube-api-access-smb6v\") pod \"monitoring-plugin-589576dfc7-bvmvr\" (UID: \"ae77d882-43e9-42c7-86d7-29ac316f8b0f\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-bvmvr" Jun 13 01:15:07.860186 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:07.860153 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-bvmvr" Jun 13 01:15:08.024713 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:08.024600 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-bvmvr"] Jun 13 01:15:08.028676 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:15:08.028642 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae77d882_43e9_42c7_86d7_29ac316f8b0f.slice/crio-2b43e551f8bcadb5b941b9a84202e9c479b75b1962c5526d1b80ab3bc7ec91ab WatchSource:0}: Error finding container 2b43e551f8bcadb5b941b9a84202e9c479b75b1962c5526d1b80ab3bc7ec91ab: Status 404 returned error can't find the container with id 2b43e551f8bcadb5b941b9a84202e9c479b75b1962c5526d1b80ab3bc7ec91ab Jun 13 01:15:08.346501 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:08.346376 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-bvmvr" event={"ID":"ae77d882-43e9-42c7-86d7-29ac316f8b0f","Type":"ContainerStarted","Data":"2b43e551f8bcadb5b941b9a84202e9c479b75b1962c5526d1b80ab3bc7ec91ab"} Jun 13 01:15:08.349237 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:08.349135 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a899a540-b336-4fe0-a89f-fedb6aae57cd","Type":"ContainerStarted","Data":"d41b16001cbffef68ab1d698e910aea3abea4d5c50340141fb92b3fa859194e8"} Jun 13 01:15:08.354824 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:08.352330 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-t4p89" event={"ID":"47f9472f-847e-4c8c-870d-32e019cb7eaa","Type":"ContainerStarted","Data":"5b207e084c34b381a0348cde61559060f20befca28458f3fca01c0625358b6b8"} Jun 13 01:15:08.354824 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:08.354779 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-t4p89" Jun 13 01:15:08.361062 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:08.361002 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t4b8x" event={"ID":"323114ca-ff76-4dbd-90b9-8d1c80ebea04","Type":"ContainerStarted","Data":"e4455b55f2898ca25d8b2863e305d34a7e1c1493c0eb06af78a12243d8985271"} Jun 13 01:15:08.366179 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:08.366090 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-t4p89" Jun 13 01:15:08.369000 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:08.368908 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fmqcx" event={"ID":"8535f959-44fe-4b43-977e-8866e21a1887","Type":"ContainerStarted","Data":"249bd7ba67fab485347f2098aeb7a4ca7aa38527aa9aac4fb29422e732483682"} Jun 13 01:15:08.371746 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:08.371624 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-frsp7" event={"ID":"e8a4889b-1355-42b4-b8d2-dfda8e2c82bd","Type":"ContainerStarted","Data":"2fa1f52f13d11bd46f5d9ce3c39fe9ec57bfed41bf9acc933008352a805aac29"} Jun 13 01:15:08.371746 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:08.371674 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-frsp7" event={"ID":"e8a4889b-1355-42b4-b8d2-dfda8e2c82bd","Type":"ContainerStarted","Data":"d550697b84452854daa81178947cd52c4122e578313aa28bc15021facd95abd2"} Jun 13 01:15:08.371746 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:08.371702 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-frsp7" event={"ID":"e8a4889b-1355-42b4-b8d2-dfda8e2c82bd","Type":"ContainerStarted","Data":"6f483d4fc2b1d9e7df41b50866a75c383ae045522935ce96094b6208f2785748"} Jun 13 01:15:08.396780 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:08.396609 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-t4p89" podStartSLOduration=1.8095797500000002 podStartE2EDuration="21.39658858s" totalImagesPullingTime="19.58700883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:14:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:15:08.37698401 +0000 UTC m=+260.242999233" watchObservedRunningTime="2026-06-13 01:15:08.39658858 +0000 UTC m=+260.262603803" Jun 13 01:15:11.387839 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:11.387725 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t4b8x" event={"ID":"323114ca-ff76-4dbd-90b9-8d1c80ebea04","Type":"ContainerStarted","Data":"cd3b5d8974d2e731f65f59836ecdf7c399cb594bc925c74a8770358ec2f58e57"} Jun 13 01:15:11.390310 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:11.390279 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fmqcx" event={"ID":"8535f959-44fe-4b43-977e-8866e21a1887","Type":"ContainerStarted","Data":"2864f9e5c915b8af3c50a04caf21f5f4617f7003d5f00a0b2a51107d26b461b2"} Jun 13 01:15:11.393345 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:11.393228 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-frsp7" event={"ID":"e8a4889b-1355-42b4-b8d2-dfda8e2c82bd","Type":"ContainerStarted","Data":"5342bdd48072583100864d422e920040b6ad2b0365e788d9341ff09620736881"} Jun 13 01:15:11.395077 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:11.395003 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a899a540-b336-4fe0-a89f-fedb6aae57cd","Type":"ContainerStarted","Data":"ef69b474fb4ceca6b8a188c7cd0ac534b27d7e9b9317e3885f17a15638c9726a"} Jun 13 01:15:12.401308 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:12.401269 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-bvmvr" event={"ID":"ae77d882-43e9-42c7-86d7-29ac316f8b0f","Type":"ContainerStarted","Data":"b15cf635b4560d2ccdcc77621ff58f712136898290e6cd2dc92e23692763aaa5"} Jun 13 01:15:12.401750 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:12.401428 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-bvmvr" Jun 13 01:15:12.403188 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:12.403156 2573 generic.go:356] "Generic (PLEG): container finished" podID="a899a540-b336-4fe0-a89f-fedb6aae57cd" containerID="ef69b474fb4ceca6b8a188c7cd0ac534b27d7e9b9317e3885f17a15638c9726a" exitCode=0 Jun 13 01:15:12.403322 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:12.403245 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a899a540-b336-4fe0-a89f-fedb6aae57cd","Type":"ContainerDied","Data":"ef69b474fb4ceca6b8a188c7cd0ac534b27d7e9b9317e3885f17a15638c9726a"} Jun 13 01:15:12.405569 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:12.405544 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t4b8x" event={"ID":"323114ca-ff76-4dbd-90b9-8d1c80ebea04","Type":"ContainerStarted","Data":"2d2e2e20b382931bac74cc3f3a70131b1401120c1d526e8800d09c7dbc88f07b"} Jun 13 01:15:12.407884 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:12.407838 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-bvmvr" Jun 13 01:15:12.408261 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:12.408236 2573 generic.go:356] "Generic (PLEG): container finished" podID="8535f959-44fe-4b43-977e-8866e21a1887" containerID="2864f9e5c915b8af3c50a04caf21f5f4617f7003d5f00a0b2a51107d26b461b2" exitCode=0 Jun 13 01:15:12.408351 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:12.408319 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fmqcx" event={"ID":"8535f959-44fe-4b43-977e-8866e21a1887","Type":"ContainerDied","Data":"2864f9e5c915b8af3c50a04caf21f5f4617f7003d5f00a0b2a51107d26b461b2"} Jun 13 01:15:12.417094 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:12.417057 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-bvmvr" podStartSLOduration=1.815350394 podStartE2EDuration="5.417037622s" totalImagesPullingTime="3.601687228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:15:12.416481514 +0000 UTC m=+264.282496737" watchObservedRunningTime="2026-06-13 01:15:12.417037622 +0000 UTC m=+264.283052844" Jun 13 01:15:12.449840 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:12.449788 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-t4b8x" podStartSLOduration=260.865791137 podStartE2EDuration="4m24.449769697s" totalImagesPullingTime="3.58397856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:10:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:15:12.449183344 +0000 UTC m=+264.315198568" watchObservedRunningTime="2026-06-13 01:15:12.449769697 +0000 UTC m=+264.315784920" Jun 13 01:15:12.518158 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:12.518105 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-frsp7" podStartSLOduration=7.100355491 podStartE2EDuration="10.518083333s" totalImagesPullingTime="3.417727842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:15:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:15:12.51699503 +0000 UTC m=+264.383010246" watchObservedRunningTime="2026-06-13 01:15:12.518083333 +0000 UTC m=+264.384098558" Jun 13 01:15:13.415833 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:13.415795 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fmqcx" event={"ID":"8535f959-44fe-4b43-977e-8866e21a1887","Type":"ContainerStarted","Data":"1afab4ea14b1c5fe7b8ea29e7a50a996db79d3f80f16e6b11a1872cf06b3ecbb"} Jun 13 01:15:13.416305 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:13.415862 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fmqcx" event={"ID":"8535f959-44fe-4b43-977e-8866e21a1887","Type":"ContainerStarted","Data":"628371d789351c9a93ca8379eb708044abe356b55b064ea4e35eadef50b784ee"} Jun 13 01:15:13.438149 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:13.438093 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fmqcx" podStartSLOduration=7.564995579 podStartE2EDuration="11.438071408s" totalImagesPullingTime="3.771938756s" totalInitContainerRuntime="101.137073ms" isStatefulPod=true podCreationTimestamp="2026-06-13 01:15:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:15:13.436774584 +0000 UTC m=+265.302789809" watchObservedRunningTime="2026-06-13 01:15:13.438071408 +0000 UTC m=+265.304086630" Jun 13 01:15:14.423362 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:14.423325 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a899a540-b336-4fe0-a89f-fedb6aae57cd","Type":"ContainerStarted","Data":"605200e515cade9a06f08e1ae5046462a6a3e87b52b19ce449c0b8a0a30e65ba"} Jun 13 01:15:15.433182 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:15.433141 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a899a540-b336-4fe0-a89f-fedb6aae57cd","Type":"ContainerStarted","Data":"710b73d4d3a40a579fc7bcad671b5b6cb5223497d737efe260ccd8d0020d4bc5"} Jun 13 01:15:15.433784 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:15.433233 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a899a540-b336-4fe0-a89f-fedb6aae57cd","Type":"ContainerStarted","Data":"f04533f1a508744c1d8447b844bad7d18b6aceca67978b96a63df85a6516f6e7"} Jun 13 01:15:15.433784 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:15.433277 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a899a540-b336-4fe0-a89f-fedb6aae57cd","Type":"ContainerStarted","Data":"0e7898d9e1e0518c3b2fab5f8f10bb4bbef0a7403708cb15efad112bb9c7ba1a"} Jun 13 01:15:15.433784 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:15.433309 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a899a540-b336-4fe0-a89f-fedb6aae57cd","Type":"ContainerStarted","Data":"b32626fd58c15e7aa6b2df30e115651f69965f3d131eab4586ace8971fb3443c"} Jun 13 01:15:16.442431 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:16.442394 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a899a540-b336-4fe0-a89f-fedb6aae57cd","Type":"ContainerStarted","Data":"6370eada5ab9716b5e43e97936898ec726fe1bc243c722fe3d78dae5f29539c1"} Jun 13 01:15:16.506820 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:16.506757 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=6.835118879 podStartE2EDuration="13.506741285s" totalImagesPullingTime="6.645927308s" totalInitContainerRuntime="25.695098ms" isStatefulPod=false podCreationTimestamp="2026-06-13 01:15:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:15:16.506336987 +0000 UTC m=+268.372352253" watchObservedRunningTime="2026-06-13 01:15:16.506741285 +0000 UTC m=+268.372756543" Jun 13 01:15:30.007844 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:15:30.007795 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-76n9p" podUID="a3350408-8867-4ba4-8fec-37d9e005eb39" Jun 13 01:15:30.007844 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:15:30.007810 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" podUID="85b53893-9a6d-407b-b03d-19de5c6d06e5" Jun 13 01:15:30.492956 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:30.492908 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:15:30.492956 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:30.492923 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-76n9p" Jun 13 01:15:32.576864 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:32.576813 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6d6d84c65d-vjw2j" podUID="bb853519-2a82-4e26-bf83-e3576cd75b48" containerName="console" containerID="cri-o://de19c13f8d2f9150c2437ce6ba0e5a493c3d4d46d59b02f4a7cb0a32af9877f6" gracePeriod=15 Jun 13 01:15:33.006030 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:33.005993 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3350408-8867-4ba4-8fec-37d9e005eb39-metrics-tls\") pod \"dns-default-76n9p\" (UID: \"a3350408-8867-4ba4-8fec-37d9e005eb39\") " pod="openshift-dns/dns-default-76n9p" Jun 13 01:15:33.006030 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:33.006033 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-tls\") pod \"image-registry-6ff5965f98-2ltfx\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:15:33.008436 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:33.008400 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3350408-8867-4ba4-8fec-37d9e005eb39-metrics-tls\") pod \"dns-default-76n9p\" (UID: \"a3350408-8867-4ba4-8fec-37d9e005eb39\") " pod="openshift-dns/dns-default-76n9p" Jun 13 01:15:33.008436 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:33.008434 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-tls\") pod \"image-registry-6ff5965f98-2ltfx\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:15:33.197273 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:33.197242 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hswsv\"" Jun 13 01:15:33.197273 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:33.197242 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mqb2w\"" Jun 13 01:15:33.204282 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:33.204263 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:15:33.204390 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:33.204356 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-76n9p" Jun 13 01:15:33.338382 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:33.338357 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-76n9p"] Jun 13 01:15:33.340670 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:15:33.340639 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3350408_8867_4ba4_8fec_37d9e005eb39.slice/crio-f60cbccc2b472e674ac7b8efa5efb75ec58eefa2f2fd56d7e80ebd4db1d778f6 WatchSource:0}: Error finding container f60cbccc2b472e674ac7b8efa5efb75ec58eefa2f2fd56d7e80ebd4db1d778f6: Status 404 returned error can't find the container with id f60cbccc2b472e674ac7b8efa5efb75ec58eefa2f2fd56d7e80ebd4db1d778f6 Jun 13 01:15:33.360475 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:33.360456 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6ff5965f98-2ltfx"] Jun 13 01:15:33.362180 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:15:33.362156 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85b53893_9a6d_407b_b03d_19de5c6d06e5.slice/crio-8542ef3c6554941a7a9ba6c11947831b48b50f31d53bb9df444f29defeb28e2c WatchSource:0}: Error finding container 8542ef3c6554941a7a9ba6c11947831b48b50f31d53bb9df444f29defeb28e2c: Status 404 returned error can't find the container with id 8542ef3c6554941a7a9ba6c11947831b48b50f31d53bb9df444f29defeb28e2c Jun 13 01:15:33.506024 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:33.505982 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" event={"ID":"85b53893-9a6d-407b-b03d-19de5c6d06e5","Type":"ContainerStarted","Data":"6de9b3f5f4c7946f149b8ff6cd33bafada6dd25b7e281de4b8a3d376b298a987"} Jun 13 01:15:33.506209 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:33.506054 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" event={"ID":"85b53893-9a6d-407b-b03d-19de5c6d06e5","Type":"ContainerStarted","Data":"8542ef3c6554941a7a9ba6c11947831b48b50f31d53bb9df444f29defeb28e2c"} Jun 13 01:15:33.506209 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:33.506190 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:15:33.507177 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:33.507154 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-76n9p" event={"ID":"a3350408-8867-4ba4-8fec-37d9e005eb39","Type":"ContainerStarted","Data":"f60cbccc2b472e674ac7b8efa5efb75ec58eefa2f2fd56d7e80ebd4db1d778f6"} Jun 13 01:15:33.526402 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:33.526313 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" podStartSLOduration=284.526293499 podStartE2EDuration="4m44.526293499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:10:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:15:33.524232501 +0000 UTC m=+285.390247724" watchObservedRunningTime="2026-06-13 01:15:33.526293499 +0000 UTC m=+285.392308724" Jun 13 01:15:34.512784 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:34.512747 2573 generic.go:356] "Generic (PLEG): container finished" podID="208b1445-3851-419f-8fcc-27aac35ea1e4" containerID="77410be1227e282091f57a25e774c8a248e6592ffd68a79165f95ef22c4f42a9" exitCode=0 Jun 13 01:15:34.513223 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:34.512825 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-n4tj4" event={"ID":"208b1445-3851-419f-8fcc-27aac35ea1e4","Type":"ContainerDied","Data":"77410be1227e282091f57a25e774c8a248e6592ffd68a79165f95ef22c4f42a9"} Jun 13 01:15:34.513223 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:34.513197 2573 scope.go:117] "RemoveContainer" containerID="77410be1227e282091f57a25e774c8a248e6592ffd68a79165f95ef22c4f42a9" Jun 13 01:15:35.518869 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:35.518835 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-n4tj4" event={"ID":"208b1445-3851-419f-8fcc-27aac35ea1e4","Type":"ContainerStarted","Data":"2e71b53c60bb2e9634255353c683022e93013941dafe7c8714826a314c4ed9d1"} Jun 13 01:15:35.929909 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:35.929882 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a899a540-b336-4fe0-a89f-fedb6aae57cd/init-config-reloader/0.log" Jun 13 01:15:36.129262 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:36.129189 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a899a540-b336-4fe0-a89f-fedb6aae57cd/alertmanager/0.log" Jun 13 01:15:36.329475 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:36.329438 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a899a540-b336-4fe0-a89f-fedb6aae57cd/config-reloader/0.log" Jun 13 01:15:36.524567 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:36.524533 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-76n9p" event={"ID":"a3350408-8867-4ba4-8fec-37d9e005eb39","Type":"ContainerStarted","Data":"560dc317cd89e9815feee3f004021aef1f5d8a909a7fc6d1c3613f50ebff4eb8"} Jun 13 01:15:36.525003 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:36.524592 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-76n9p" Jun 13 01:15:36.525003 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:36.524609 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-76n9p" event={"ID":"a3350408-8867-4ba4-8fec-37d9e005eb39","Type":"ContainerStarted","Data":"e49b73307a11594b2edfe88a22027f9e16155f504ffc44a9da89e4a526a744fa"} Jun 13 01:15:36.530815 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:36.530795 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a899a540-b336-4fe0-a89f-fedb6aae57cd/kube-rbac-proxy-web/0.log" Jun 13 01:15:36.544437 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:36.544400 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-76n9p" podStartSLOduration=251.260433176 podStartE2EDuration="4m13.544387166s" totalImagesPullingTime="2.28395399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:11:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:15:36.54377973 +0000 UTC m=+288.409794953" watchObservedRunningTime="2026-06-13 01:15:36.544387166 +0000 UTC m=+288.410402388" Jun 13 01:15:36.728731 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:36.728698 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a899a540-b336-4fe0-a89f-fedb6aae57cd/kube-rbac-proxy/0.log" Jun 13 01:15:36.929585 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:36.929557 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a899a540-b336-4fe0-a89f-fedb6aae57cd/kube-rbac-proxy-metric/0.log" Jun 13 01:15:37.132849 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:37.132826 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a899a540-b336-4fe0-a89f-fedb6aae57cd/prom-label-proxy/0.log" Jun 13 01:15:37.331444 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:37.331356 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-9k2t8_15d41019-db02-4ef2-b0e8-88c9cc63aef8/cluster-monitoring-operator/0.log" Jun 13 01:15:38.330031 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:38.330003 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-bvmvr_ae77d882-43e9-42c7-86d7-29ac316f8b0f/monitoring-plugin/0.log" Jun 13 01:15:39.129277 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:39.129251 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fmqcx_8535f959-44fe-4b43-977e-8866e21a1887/init-textfile/0.log" Jun 13 01:15:39.330841 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:39.330808 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fmqcx_8535f959-44fe-4b43-977e-8866e21a1887/node-exporter/0.log" Jun 13 01:15:39.529634 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:39.529606 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fmqcx_8535f959-44fe-4b43-977e-8866e21a1887/kube-rbac-proxy/0.log" Jun 13 01:15:40.330487 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:40.330458 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-frsp7_e8a4889b-1355-42b4-b8d2-dfda8e2c82bd/kube-rbac-proxy-main/0.log" Jun 13 01:15:40.528938 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:40.528908 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-frsp7_e8a4889b-1355-42b4-b8d2-dfda8e2c82bd/kube-rbac-proxy-self/0.log" Jun 13 01:15:40.733927 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:40.733888 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-frsp7_e8a4889b-1355-42b4-b8d2-dfda8e2c82bd/openshift-state-metrics/0.log" Jun 13 01:15:44.329907 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:44.329875 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bb7cg_f53056e7-0404-4074-bc19-664e206fce89/console-operator/1.log" Jun 13 01:15:44.532179 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:44.532149 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bb7cg_f53056e7-0404-4074-bc19-664e206fce89/console-operator/2.log" Jun 13 01:15:44.554749 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:44.554718 2573 generic.go:356] "Generic (PLEG): container finished" podID="50fd466c-b2e3-49e0-b60a-c55c4049cd4e" containerID="92ab9943d19bfd7fd44218307943a01d88abc2dbb1618905d6b1edb9701e8dd0" exitCode=0 Jun 13 01:15:44.554921 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:44.554795 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9x5wx" event={"ID":"50fd466c-b2e3-49e0-b60a-c55c4049cd4e","Type":"ContainerDied","Data":"92ab9943d19bfd7fd44218307943a01d88abc2dbb1618905d6b1edb9701e8dd0"} Jun 13 01:15:44.555181 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:44.555164 2573 scope.go:117] "RemoveContainer" containerID="92ab9943d19bfd7fd44218307943a01d88abc2dbb1618905d6b1edb9701e8dd0" Jun 13 01:15:44.729611 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:44.729584 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d6d84c65d-vjw2j_bb853519-2a82-4e26-bf83-e3576cd75b48/console/0.log" Jun 13 01:15:45.332349 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:45.332317 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-t4p89_47f9472f-847e-4c8c-870d-32e019cb7eaa/download-server/0.log" Jun 13 01:15:45.529960 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:45.529920 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-76n9p_a3350408-8867-4ba4-8fec-37d9e005eb39/dns/0.log" Jun 13 01:15:45.566797 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:45.566766 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9x5wx" event={"ID":"50fd466c-b2e3-49e0-b60a-c55c4049cd4e","Type":"ContainerStarted","Data":"562eefa9985099abcd6b8beaf6a187fc895e80b88f05b7a32deb45e46220051e"} Jun 13 01:15:45.730204 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:45.730169 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-76n9p_a3350408-8867-4ba4-8fec-37d9e005eb39/kube-rbac-proxy/0.log" Jun 13 01:15:46.530410 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:46.530381 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-76n9p" Jun 13 01:15:46.929705 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:46.929678 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hlh72_e0f5e173-0662-47cd-9792-f07b01ab5eaf/dns-node-resolver/0.log" Jun 13 01:15:47.329988 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:47.329892 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6ff5965f98-2ltfx_85b53893-9a6d-407b-b03d-19de5c6d06e5/registry/0.log" Jun 13 01:15:47.929440 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:47.929411 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4v55b_45611778-f77e-4cab-b564-ffb69bd4a695/node-ca/0.log" Jun 13 01:15:48.227613 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.227593 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d6d84c65d-vjw2j_bb853519-2a82-4e26-bf83-e3576cd75b48/console/0.log" Jun 13 01:15:48.241234 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.241213 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6d84c65d-vjw2j" Jun 13 01:15:48.330571 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.330538 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7784bb8876-wvjz6_8ee44e07-c5aa-417a-ae59-c24f0572b921/router/0.log" Jun 13 01:15:48.343667 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.343639 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jddsm\" (UniqueName: \"kubernetes.io/projected/bb853519-2a82-4e26-bf83-e3576cd75b48-kube-api-access-jddsm\") pod \"bb853519-2a82-4e26-bf83-e3576cd75b48\" (UID: \"bb853519-2a82-4e26-bf83-e3576cd75b48\") " Jun 13 01:15:48.343786 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.343675 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb853519-2a82-4e26-bf83-e3576cd75b48-service-ca\") pod \"bb853519-2a82-4e26-bf83-e3576cd75b48\" (UID: \"bb853519-2a82-4e26-bf83-e3576cd75b48\") " Jun 13 01:15:48.343786 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.343712 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb853519-2a82-4e26-bf83-e3576cd75b48-console-config\") pod \"bb853519-2a82-4e26-bf83-e3576cd75b48\" (UID: \"bb853519-2a82-4e26-bf83-e3576cd75b48\") " Jun 13 01:15:48.343902 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.343886 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb853519-2a82-4e26-bf83-e3576cd75b48-console-serving-cert\") pod \"bb853519-2a82-4e26-bf83-e3576cd75b48\" (UID: \"bb853519-2a82-4e26-bf83-e3576cd75b48\") " Jun 13 01:15:48.343977 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.343938 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb853519-2a82-4e26-bf83-e3576cd75b48-console-oauth-config\") pod \"bb853519-2a82-4e26-bf83-e3576cd75b48\" (UID: \"bb853519-2a82-4e26-bf83-e3576cd75b48\") " Jun 13 01:15:48.344035 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.344004 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb853519-2a82-4e26-bf83-e3576cd75b48-oauth-serving-cert\") pod \"bb853519-2a82-4e26-bf83-e3576cd75b48\" (UID: \"bb853519-2a82-4e26-bf83-e3576cd75b48\") " Jun 13 01:15:48.344121 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.344097 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb853519-2a82-4e26-bf83-e3576cd75b48-service-ca" (OuterVolumeSpecName: "service-ca") pod "bb853519-2a82-4e26-bf83-e3576cd75b48" (UID: "bb853519-2a82-4e26-bf83-e3576cd75b48"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:15:48.344164 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.344103 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb853519-2a82-4e26-bf83-e3576cd75b48-console-config" (OuterVolumeSpecName: "console-config") pod "bb853519-2a82-4e26-bf83-e3576cd75b48" (UID: "bb853519-2a82-4e26-bf83-e3576cd75b48"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:15:48.344390 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.344372 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb853519-2a82-4e26-bf83-e3576cd75b48-service-ca\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:15:48.344485 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.344391 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb853519-2a82-4e26-bf83-e3576cd75b48-console-config\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:15:48.344485 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.344399 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb853519-2a82-4e26-bf83-e3576cd75b48-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bb853519-2a82-4e26-bf83-e3576cd75b48" (UID: "bb853519-2a82-4e26-bf83-e3576cd75b48"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:15:48.346087 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.346057 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb853519-2a82-4e26-bf83-e3576cd75b48-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bb853519-2a82-4e26-bf83-e3576cd75b48" (UID: "bb853519-2a82-4e26-bf83-e3576cd75b48"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 01:15:48.346198 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.346167 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb853519-2a82-4e26-bf83-e3576cd75b48-kube-api-access-jddsm" (OuterVolumeSpecName: "kube-api-access-jddsm") pod "bb853519-2a82-4e26-bf83-e3576cd75b48" (UID: "bb853519-2a82-4e26-bf83-e3576cd75b48"). InnerVolumeSpecName "kube-api-access-jddsm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:15:48.346256 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.346190 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb853519-2a82-4e26-bf83-e3576cd75b48-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bb853519-2a82-4e26-bf83-e3576cd75b48" (UID: "bb853519-2a82-4e26-bf83-e3576cd75b48"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 01:15:48.445232 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.445203 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jddsm\" (UniqueName: \"kubernetes.io/projected/bb853519-2a82-4e26-bf83-e3576cd75b48-kube-api-access-jddsm\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:15:48.445232 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.445229 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb853519-2a82-4e26-bf83-e3576cd75b48-console-serving-cert\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:15:48.445232 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.445238 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb853519-2a82-4e26-bf83-e3576cd75b48-console-oauth-config\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:15:48.445450 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.445248 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb853519-2a82-4e26-bf83-e3576cd75b48-oauth-serving-cert\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:15:48.472967 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.472880 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d6d84c65d-vjw2j_bb853519-2a82-4e26-bf83-e3576cd75b48/console/0.log" Jun 13 01:15:48.475910 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.475888 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bb7cg_f53056e7-0404-4074-bc19-664e206fce89/console-operator/1.log" Jun 13 01:15:48.478043 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.478022 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d6d84c65d-vjw2j_bb853519-2a82-4e26-bf83-e3576cd75b48/console/0.log" Jun 13 01:15:48.481556 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.481536 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bb7cg_f53056e7-0404-4074-bc19-664e206fce89/console-operator/1.log" Jun 13 01:15:48.486137 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.486121 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9jdpp_6109025b-0598-4cbf-b841-200e35db36cf/ovn-acl-logging/0.log" Jun 13 01:15:48.489381 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.489364 2573 kubelet.go:1648] "Image garbage collection succeeded" Jun 13 01:15:48.491187 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.491171 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9jdpp_6109025b-0598-4cbf-b841-200e35db36cf/ovn-acl-logging/0.log" Jun 13 01:15:48.745832 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.579516 2573 generic.go:356] "Generic (PLEG): container finished" podID="bb853519-2a82-4e26-bf83-e3576cd75b48" containerID="de19c13f8d2f9150c2437ce6ba0e5a493c3d4d46d59b02f4a7cb0a32af9877f6" exitCode=137 Jun 13 01:15:48.745832 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.579578 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6d84c65d-vjw2j" Jun 13 01:15:48.745832 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.579603 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6d84c65d-vjw2j" event={"ID":"bb853519-2a82-4e26-bf83-e3576cd75b48","Type":"ContainerDied","Data":"de19c13f8d2f9150c2437ce6ba0e5a493c3d4d46d59b02f4a7cb0a32af9877f6"} Jun 13 01:15:48.745832 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.579676 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6d84c65d-vjw2j" event={"ID":"bb853519-2a82-4e26-bf83-e3576cd75b48","Type":"ContainerDied","Data":"52708e2cfc781ff8711ce70efaed250c0c2073f414ce49194ac94d08e0c6dfff"} Jun 13 01:15:48.745832 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.579697 2573 scope.go:117] "RemoveContainer" containerID="de19c13f8d2f9150c2437ce6ba0e5a493c3d4d46d59b02f4a7cb0a32af9877f6" Jun 13 01:15:48.745832 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.588546 2573 scope.go:117] "RemoveContainer" containerID="de19c13f8d2f9150c2437ce6ba0e5a493c3d4d46d59b02f4a7cb0a32af9877f6" Jun 13 01:15:48.745832 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:15:48.588806 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de19c13f8d2f9150c2437ce6ba0e5a493c3d4d46d59b02f4a7cb0a32af9877f6\": container with ID starting with de19c13f8d2f9150c2437ce6ba0e5a493c3d4d46d59b02f4a7cb0a32af9877f6 not found: ID does not exist" containerID="de19c13f8d2f9150c2437ce6ba0e5a493c3d4d46d59b02f4a7cb0a32af9877f6" Jun 13 01:15:48.745832 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.588842 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de19c13f8d2f9150c2437ce6ba0e5a493c3d4d46d59b02f4a7cb0a32af9877f6"} err="failed to get container status \"de19c13f8d2f9150c2437ce6ba0e5a493c3d4d46d59b02f4a7cb0a32af9877f6\": rpc error: code = NotFound desc = could not find container \"de19c13f8d2f9150c2437ce6ba0e5a493c3d4d46d59b02f4a7cb0a32af9877f6\": container with ID starting with de19c13f8d2f9150c2437ce6ba0e5a493c3d4d46d59b02f4a7cb0a32af9877f6 not found: ID does not exist" Jun 13 01:15:48.745832 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.609518 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d6d84c65d-vjw2j"] Jun 13 01:15:48.745832 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.613462 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d6d84c65d-vjw2j"] Jun 13 01:15:48.929700 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:48.929665 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qtfxw_ab5efd87-9312-47f5-8521-d918f3f16571/serve-healthcheck-canary/0.log" Jun 13 01:15:50.541818 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:50.541751 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb853519-2a82-4e26-bf83-e3576cd75b48" path="/var/lib/kubelet/pods/bb853519-2a82-4e26-bf83-e3576cd75b48/volumes" Jun 13 01:15:53.208852 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:53.208821 2573 patch_prober.go:28] interesting pod/image-registry-6ff5965f98-2ltfx container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 01:15:53.209244 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:53.208870 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" podUID="85b53893-9a6d-407b-b03d-19de5c6d06e5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 01:15:54.517833 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:15:54.517803 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:16:16.892403 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:16.892363 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6ff5965f98-2ltfx"] Jun 13 01:16:27.096634 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.096594 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7457f99b99-dz5fx"] Jun 13 01:16:27.097136 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.097066 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb853519-2a82-4e26-bf83-e3576cd75b48" containerName="console" Jun 13 01:16:27.097136 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.097095 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb853519-2a82-4e26-bf83-e3576cd75b48" containerName="console" Jun 13 01:16:27.097255 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.097167 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb853519-2a82-4e26-bf83-e3576cd75b48" containerName="console" Jun 13 01:16:27.100737 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.100715 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7457f99b99-dz5fx" Jun 13 01:16:27.103342 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.103317 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 13 01:16:27.103468 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.103337 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-t7jk5\"" Jun 13 01:16:27.103468 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.103351 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 13 01:16:27.103468 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.103369 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 13 01:16:27.103468 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.103411 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 13 01:16:27.103693 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.103680 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 13 01:16:27.108745 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.108721 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 13 01:16:27.113396 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.113372 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7457f99b99-dz5fx"] Jun 13 01:16:27.161652 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.161619 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/faed9d27-1483-4cd5-9cd0-16a171ecaa3c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7457f99b99-dz5fx\" (UID: \"faed9d27-1483-4cd5-9cd0-16a171ecaa3c\") " pod="openshift-monitoring/telemeter-client-7457f99b99-dz5fx" Jun 13 01:16:27.161652 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.161655 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faed9d27-1483-4cd5-9cd0-16a171ecaa3c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7457f99b99-dz5fx\" (UID: \"faed9d27-1483-4cd5-9cd0-16a171ecaa3c\") " pod="openshift-monitoring/telemeter-client-7457f99b99-dz5fx" Jun 13 01:16:27.161847 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.161680 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8wrr\" (UniqueName: \"kubernetes.io/projected/faed9d27-1483-4cd5-9cd0-16a171ecaa3c-kube-api-access-g8wrr\") pod \"telemeter-client-7457f99b99-dz5fx\" (UID: \"faed9d27-1483-4cd5-9cd0-16a171ecaa3c\") " pod="openshift-monitoring/telemeter-client-7457f99b99-dz5fx" Jun 13 01:16:27.161847 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.161784 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faed9d27-1483-4cd5-9cd0-16a171ecaa3c-serving-certs-ca-bundle\") pod \"telemeter-client-7457f99b99-dz5fx\" (UID: \"faed9d27-1483-4cd5-9cd0-16a171ecaa3c\") " pod="openshift-monitoring/telemeter-client-7457f99b99-dz5fx" Jun 13 01:16:27.161847 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.161817 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/faed9d27-1483-4cd5-9cd0-16a171ecaa3c-telemeter-client-tls\") pod \"telemeter-client-7457f99b99-dz5fx\" (UID: \"faed9d27-1483-4cd5-9cd0-16a171ecaa3c\") " pod="openshift-monitoring/telemeter-client-7457f99b99-dz5fx" Jun 13 01:16:27.161940 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.161850 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/faed9d27-1483-4cd5-9cd0-16a171ecaa3c-metrics-client-ca\") pod \"telemeter-client-7457f99b99-dz5fx\" (UID: \"faed9d27-1483-4cd5-9cd0-16a171ecaa3c\") " pod="openshift-monitoring/telemeter-client-7457f99b99-dz5fx" Jun 13 01:16:27.161940 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.161882 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/faed9d27-1483-4cd5-9cd0-16a171ecaa3c-secret-telemeter-client\") pod \"telemeter-client-7457f99b99-dz5fx\" (UID: \"faed9d27-1483-4cd5-9cd0-16a171ecaa3c\") " pod="openshift-monitoring/telemeter-client-7457f99b99-dz5fx" Jun 13 01:16:27.161940 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.161907 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/faed9d27-1483-4cd5-9cd0-16a171ecaa3c-federate-client-tls\") pod \"telemeter-client-7457f99b99-dz5fx\" (UID: \"faed9d27-1483-4cd5-9cd0-16a171ecaa3c\") " pod="openshift-monitoring/telemeter-client-7457f99b99-dz5fx" Jun 13 01:16:27.262846 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.262814 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faed9d27-1483-4cd5-9cd0-16a171ecaa3c-serving-certs-ca-bundle\") pod \"telemeter-client-7457f99b99-dz5fx\" (UID: \"faed9d27-1483-4cd5-9cd0-16a171ecaa3c\") " pod="openshift-monitoring/telemeter-client-7457f99b99-dz5fx" Jun 13 01:16:27.262846 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.262850 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/faed9d27-1483-4cd5-9cd0-16a171ecaa3c-telemeter-client-tls\") pod \"telemeter-client-7457f99b99-dz5fx\" (UID: \"faed9d27-1483-4cd5-9cd0-16a171ecaa3c\") " pod="openshift-monitoring/telemeter-client-7457f99b99-dz5fx" Jun 13 01:16:27.263062 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.262979 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/faed9d27-1483-4cd5-9cd0-16a171ecaa3c-metrics-client-ca\") pod \"telemeter-client-7457f99b99-dz5fx\" (UID: \"faed9d27-1483-4cd5-9cd0-16a171ecaa3c\") " pod="openshift-monitoring/telemeter-client-7457f99b99-dz5fx" Jun 13 01:16:27.263062 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.263017 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/faed9d27-1483-4cd5-9cd0-16a171ecaa3c-secret-telemeter-client\") pod \"telemeter-client-7457f99b99-dz5fx\" (UID: \"faed9d27-1483-4cd5-9cd0-16a171ecaa3c\") " pod="openshift-monitoring/telemeter-client-7457f99b99-dz5fx" Jun 13 01:16:27.263062 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.263046 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/faed9d27-1483-4cd5-9cd0-16a171ecaa3c-federate-client-tls\") pod \"telemeter-client-7457f99b99-dz5fx\" (UID: \"faed9d27-1483-4cd5-9cd0-16a171ecaa3c\") " pod="openshift-monitoring/telemeter-client-7457f99b99-dz5fx" Jun 13 01:16:27.263294 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.263091 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/faed9d27-1483-4cd5-9cd0-16a171ecaa3c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7457f99b99-dz5fx\" (UID: \"faed9d27-1483-4cd5-9cd0-16a171ecaa3c\") " pod="openshift-monitoring/telemeter-client-7457f99b99-dz5fx" Jun 13 01:16:27.263294 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.263121 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faed9d27-1483-4cd5-9cd0-16a171ecaa3c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7457f99b99-dz5fx\" (UID: \"faed9d27-1483-4cd5-9cd0-16a171ecaa3c\") " pod="openshift-monitoring/telemeter-client-7457f99b99-dz5fx" Jun 13 01:16:27.263564 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.263543 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8wrr\" (UniqueName: \"kubernetes.io/projected/faed9d27-1483-4cd5-9cd0-16a171ecaa3c-kube-api-access-g8wrr\") pod \"telemeter-client-7457f99b99-dz5fx\" (UID: \"faed9d27-1483-4cd5-9cd0-16a171ecaa3c\") " pod="openshift-monitoring/telemeter-client-7457f99b99-dz5fx" Jun 13 01:16:27.263693 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.263669 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faed9d27-1483-4cd5-9cd0-16a171ecaa3c-serving-certs-ca-bundle\") pod \"telemeter-client-7457f99b99-dz5fx\" (UID: \"faed9d27-1483-4cd5-9cd0-16a171ecaa3c\") " pod="openshift-monitoring/telemeter-client-7457f99b99-dz5fx" Jun 13 01:16:27.263752 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.263632 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/faed9d27-1483-4cd5-9cd0-16a171ecaa3c-metrics-client-ca\") pod \"telemeter-client-7457f99b99-dz5fx\" (UID: \"faed9d27-1483-4cd5-9cd0-16a171ecaa3c\") " pod="openshift-monitoring/telemeter-client-7457f99b99-dz5fx" Jun 13 01:16:27.263974 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.263935 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faed9d27-1483-4cd5-9cd0-16a171ecaa3c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7457f99b99-dz5fx\" (UID: \"faed9d27-1483-4cd5-9cd0-16a171ecaa3c\") " pod="openshift-monitoring/telemeter-client-7457f99b99-dz5fx" Jun 13 01:16:27.265524 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.265496 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/faed9d27-1483-4cd5-9cd0-16a171ecaa3c-secret-telemeter-client\") pod \"telemeter-client-7457f99b99-dz5fx\" (UID: \"faed9d27-1483-4cd5-9cd0-16a171ecaa3c\") " pod="openshift-monitoring/telemeter-client-7457f99b99-dz5fx" Jun 13 01:16:27.265651 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.265632 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/faed9d27-1483-4cd5-9cd0-16a171ecaa3c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7457f99b99-dz5fx\" (UID: \"faed9d27-1483-4cd5-9cd0-16a171ecaa3c\") " pod="openshift-monitoring/telemeter-client-7457f99b99-dz5fx" Jun 13 01:16:27.265778 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.265762 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/faed9d27-1483-4cd5-9cd0-16a171ecaa3c-telemeter-client-tls\") pod \"telemeter-client-7457f99b99-dz5fx\" (UID: \"faed9d27-1483-4cd5-9cd0-16a171ecaa3c\") " pod="openshift-monitoring/telemeter-client-7457f99b99-dz5fx" Jun 13 01:16:27.265895 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.265879 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/faed9d27-1483-4cd5-9cd0-16a171ecaa3c-federate-client-tls\") pod \"telemeter-client-7457f99b99-dz5fx\" (UID: \"faed9d27-1483-4cd5-9cd0-16a171ecaa3c\") " pod="openshift-monitoring/telemeter-client-7457f99b99-dz5fx" Jun 13 01:16:27.271417 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.271395 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8wrr\" (UniqueName: \"kubernetes.io/projected/faed9d27-1483-4cd5-9cd0-16a171ecaa3c-kube-api-access-g8wrr\") pod \"telemeter-client-7457f99b99-dz5fx\" (UID: \"faed9d27-1483-4cd5-9cd0-16a171ecaa3c\") " pod="openshift-monitoring/telemeter-client-7457f99b99-dz5fx" Jun 13 01:16:27.411481 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.411447 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7457f99b99-dz5fx" Jun 13 01:16:27.550401 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.550377 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7457f99b99-dz5fx"] Jun 13 01:16:27.553028 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:16:27.552994 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaed9d27_1483_4cd5_9cd0_16a171ecaa3c.slice/crio-a424b8f5fa71e7407243ddd71cb61074b151a7182e80e182706c83d3f5a0a372 WatchSource:0}: Error finding container a424b8f5fa71e7407243ddd71cb61074b151a7182e80e182706c83d3f5a0a372: Status 404 returned error can't find the container with id a424b8f5fa71e7407243ddd71cb61074b151a7182e80e182706c83d3f5a0a372 Jun 13 01:16:27.554805 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.554789 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 01:16:27.736655 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:27.736569 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7457f99b99-dz5fx" event={"ID":"faed9d27-1483-4cd5-9cd0-16a171ecaa3c","Type":"ContainerStarted","Data":"a424b8f5fa71e7407243ddd71cb61074b151a7182e80e182706c83d3f5a0a372"} Jun 13 01:16:29.746414 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:29.746383 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7457f99b99-dz5fx" event={"ID":"faed9d27-1483-4cd5-9cd0-16a171ecaa3c","Type":"ContainerStarted","Data":"cf406a35399e3a035dd9f84184dde18f0a0a5af146e9d3b8c34037b32db29585"} Jun 13 01:16:29.746690 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:29.746464 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7457f99b99-dz5fx" event={"ID":"faed9d27-1483-4cd5-9cd0-16a171ecaa3c","Type":"ContainerStarted","Data":"fba65c6937b3e526a8e8e2dbf4ea37fb015e87b19b1e98ec55a0a0e5e1cb5a13"} Jun 13 01:16:30.752057 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:30.752025 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7457f99b99-dz5fx" event={"ID":"faed9d27-1483-4cd5-9cd0-16a171ecaa3c","Type":"ContainerStarted","Data":"8f447ef5df432aa70d1a7a6d8c50b20427358d350168db24cc7914cb6d81d84e"} Jun 13 01:16:30.776416 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:30.776367 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7457f99b99-dz5fx" podStartSLOduration=1.773370775 podStartE2EDuration="3.7763513s" totalImagesPullingTime="2.002980525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:16:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:16:30.774318895 +0000 UTC m=+342.640334114" watchObservedRunningTime="2026-06-13 01:16:30.7763513 +0000 UTC m=+342.642366521" Jun 13 01:16:41.912128 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:41.912042 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" podUID="85b53893-9a6d-407b-b03d-19de5c6d06e5" containerName="registry" containerID="cri-o://6de9b3f5f4c7946f149b8ff6cd33bafada6dd25b7e281de4b8a3d376b298a987" gracePeriod=30 Jun 13 01:16:43.163192 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:43.163170 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:16:43.285049 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:43.284980 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85b53893-9a6d-407b-b03d-19de5c6d06e5-trusted-ca\") pod \"85b53893-9a6d-407b-b03d-19de5c6d06e5\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " Jun 13 01:16:43.285049 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:43.285018 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85b53893-9a6d-407b-b03d-19de5c6d06e5-installation-pull-secrets\") pod \"85b53893-9a6d-407b-b03d-19de5c6d06e5\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " Jun 13 01:16:43.285049 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:43.285045 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fl5qx\" (UniqueName: \"kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-kube-api-access-fl5qx\") pod \"85b53893-9a6d-407b-b03d-19de5c6d06e5\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " Jun 13 01:16:43.285311 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:43.285179 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85b53893-9a6d-407b-b03d-19de5c6d06e5-ca-trust-extracted\") pod \"85b53893-9a6d-407b-b03d-19de5c6d06e5\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " Jun 13 01:16:43.285311 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:43.285224 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-certificates\") pod \"85b53893-9a6d-407b-b03d-19de5c6d06e5\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " Jun 13 01:16:43.285311 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:43.285277 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-tls\") pod \"85b53893-9a6d-407b-b03d-19de5c6d06e5\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " Jun 13 01:16:43.285311 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:43.285307 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85b53893-9a6d-407b-b03d-19de5c6d06e5-image-registry-private-configuration\") pod \"85b53893-9a6d-407b-b03d-19de5c6d06e5\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " Jun 13 01:16:43.285516 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:43.285429 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-bound-sa-token\") pod \"85b53893-9a6d-407b-b03d-19de5c6d06e5\" (UID: \"85b53893-9a6d-407b-b03d-19de5c6d06e5\") " Jun 13 01:16:43.285722 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:43.285629 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "85b53893-9a6d-407b-b03d-19de5c6d06e5" (UID: "85b53893-9a6d-407b-b03d-19de5c6d06e5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:16:43.285835 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:43.285764 2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-certificates\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:16:43.285835 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:43.285774 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85b53893-9a6d-407b-b03d-19de5c6d06e5-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "85b53893-9a6d-407b-b03d-19de5c6d06e5" (UID: "85b53893-9a6d-407b-b03d-19de5c6d06e5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:16:43.287850 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:43.287813 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "85b53893-9a6d-407b-b03d-19de5c6d06e5" (UID: "85b53893-9a6d-407b-b03d-19de5c6d06e5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:16:43.287973 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:43.287919 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85b53893-9a6d-407b-b03d-19de5c6d06e5-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "85b53893-9a6d-407b-b03d-19de5c6d06e5" (UID: "85b53893-9a6d-407b-b03d-19de5c6d06e5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 01:16:43.288038 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:43.288008 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85b53893-9a6d-407b-b03d-19de5c6d06e5-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "85b53893-9a6d-407b-b03d-19de5c6d06e5" (UID: "85b53893-9a6d-407b-b03d-19de5c6d06e5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 01:16:43.288085 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:43.288048 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "85b53893-9a6d-407b-b03d-19de5c6d06e5" (UID: "85b53893-9a6d-407b-b03d-19de5c6d06e5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:16:43.288085 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:43.288055 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-kube-api-access-fl5qx" (OuterVolumeSpecName: "kube-api-access-fl5qx") pod "85b53893-9a6d-407b-b03d-19de5c6d06e5" (UID: "85b53893-9a6d-407b-b03d-19de5c6d06e5"). InnerVolumeSpecName "kube-api-access-fl5qx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:16:43.293062 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:43.293039 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85b53893-9a6d-407b-b03d-19de5c6d06e5-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "85b53893-9a6d-407b-b03d-19de5c6d06e5" (UID: "85b53893-9a6d-407b-b03d-19de5c6d06e5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:16:43.386694 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:43.386672 2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85b53893-9a6d-407b-b03d-19de5c6d06e5-installation-pull-secrets\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:16:43.386694 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:43.386692 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fl5qx\" (UniqueName: \"kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-kube-api-access-fl5qx\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:16:43.386813 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:43.386701 2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85b53893-9a6d-407b-b03d-19de5c6d06e5-ca-trust-extracted\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:16:43.386813 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:43.386710 2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-registry-tls\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:16:43.386813 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:43.386719 2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85b53893-9a6d-407b-b03d-19de5c6d06e5-image-registry-private-configuration\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:16:43.386813 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:43.386728 2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85b53893-9a6d-407b-b03d-19de5c6d06e5-bound-sa-token\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:16:43.386813 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:43.386735 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85b53893-9a6d-407b-b03d-19de5c6d06e5-trusted-ca\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:16:43.804497 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:43.804463 2573 generic.go:356] "Generic (PLEG): container finished" podID="85b53893-9a6d-407b-b03d-19de5c6d06e5" containerID="6de9b3f5f4c7946f149b8ff6cd33bafada6dd25b7e281de4b8a3d376b298a987" exitCode=0 Jun 13 01:16:43.804658 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:43.804503 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" Jun 13 01:16:43.804658 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:43.804494 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" event={"ID":"85b53893-9a6d-407b-b03d-19de5c6d06e5","Type":"ContainerDied","Data":"6de9b3f5f4c7946f149b8ff6cd33bafada6dd25b7e281de4b8a3d376b298a987"} Jun 13 01:16:43.804658 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:43.804610 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6ff5965f98-2ltfx" event={"ID":"85b53893-9a6d-407b-b03d-19de5c6d06e5","Type":"ContainerDied","Data":"8542ef3c6554941a7a9ba6c11947831b48b50f31d53bb9df444f29defeb28e2c"} Jun 13 01:16:43.804658 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:43.804634 2573 scope.go:117] "RemoveContainer" containerID="6de9b3f5f4c7946f149b8ff6cd33bafada6dd25b7e281de4b8a3d376b298a987" Jun 13 01:16:43.813154 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:43.813134 2573 scope.go:117] "RemoveContainer" containerID="6de9b3f5f4c7946f149b8ff6cd33bafada6dd25b7e281de4b8a3d376b298a987" Jun 13 01:16:43.813385 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:16:43.813366 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6de9b3f5f4c7946f149b8ff6cd33bafada6dd25b7e281de4b8a3d376b298a987\": container with ID starting with 6de9b3f5f4c7946f149b8ff6cd33bafada6dd25b7e281de4b8a3d376b298a987 not found: ID does not exist" containerID="6de9b3f5f4c7946f149b8ff6cd33bafada6dd25b7e281de4b8a3d376b298a987" Jun 13 01:16:43.813453 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:43.813398 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6de9b3f5f4c7946f149b8ff6cd33bafada6dd25b7e281de4b8a3d376b298a987"} err="failed to get container status \"6de9b3f5f4c7946f149b8ff6cd33bafada6dd25b7e281de4b8a3d376b298a987\": rpc error: code = NotFound desc = could not find container \"6de9b3f5f4c7946f149b8ff6cd33bafada6dd25b7e281de4b8a3d376b298a987\": container with ID starting with 6de9b3f5f4c7946f149b8ff6cd33bafada6dd25b7e281de4b8a3d376b298a987 not found: ID does not exist" Jun 13 01:16:43.826084 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:43.826063 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6ff5965f98-2ltfx"] Jun 13 01:16:43.829386 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:43.829367 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6ff5965f98-2ltfx"] Jun 13 01:16:44.537645 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:16:44.537613 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85b53893-9a6d-407b-b03d-19de5c6d06e5" path="/var/lib/kubelet/pods/85b53893-9a6d-407b-b03d-19de5c6d06e5/volumes" Jun 13 01:17:33.067340 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:33.067307 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7s67j"] Jun 13 01:17:33.067730 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:33.067595 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85b53893-9a6d-407b-b03d-19de5c6d06e5" containerName="registry" Jun 13 01:17:33.067730 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:33.067605 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="85b53893-9a6d-407b-b03d-19de5c6d06e5" containerName="registry" Jun 13 01:17:33.067730 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:33.067666 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="85b53893-9a6d-407b-b03d-19de5c6d06e5" containerName="registry" Jun 13 01:17:33.069470 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:33.069455 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7s67j" Jun 13 01:17:33.072224 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:33.072201 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 13 01:17:33.072344 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:33.072201 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fffvh\"" Jun 13 01:17:33.072865 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:33.072847 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 13 01:17:33.073146 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:33.073104 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqmgh\" (UniqueName: \"kubernetes.io/projected/25cdcabf-e004-4333-84fb-8d6932dbc813-kube-api-access-cqmgh\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7s67j\" (UID: \"25cdcabf-e004-4333-84fb-8d6932dbc813\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7s67j" Jun 13 01:17:33.073231 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:33.073177 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25cdcabf-e004-4333-84fb-8d6932dbc813-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7s67j\" (UID: \"25cdcabf-e004-4333-84fb-8d6932dbc813\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7s67j" Jun 13 01:17:33.073285 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:33.073239 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25cdcabf-e004-4333-84fb-8d6932dbc813-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7s67j\" (UID: \"25cdcabf-e004-4333-84fb-8d6932dbc813\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7s67j" Jun 13 01:17:33.079393 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:33.079370 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7s67j"] Jun 13 01:17:33.174116 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:33.174090 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25cdcabf-e004-4333-84fb-8d6932dbc813-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7s67j\" (UID: \"25cdcabf-e004-4333-84fb-8d6932dbc813\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7s67j" Jun 13 01:17:33.174301 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:33.174121 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25cdcabf-e004-4333-84fb-8d6932dbc813-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7s67j\" (UID: \"25cdcabf-e004-4333-84fb-8d6932dbc813\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7s67j" Jun 13 01:17:33.174301 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:33.174197 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqmgh\" (UniqueName: \"kubernetes.io/projected/25cdcabf-e004-4333-84fb-8d6932dbc813-kube-api-access-cqmgh\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7s67j\" (UID: \"25cdcabf-e004-4333-84fb-8d6932dbc813\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7s67j" Jun 13 01:17:33.174525 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:33.174508 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25cdcabf-e004-4333-84fb-8d6932dbc813-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7s67j\" (UID: \"25cdcabf-e004-4333-84fb-8d6932dbc813\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7s67j" Jun 13 01:17:33.174570 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:33.174514 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25cdcabf-e004-4333-84fb-8d6932dbc813-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7s67j\" (UID: \"25cdcabf-e004-4333-84fb-8d6932dbc813\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7s67j" Jun 13 01:17:33.182112 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:33.182091 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqmgh\" (UniqueName: \"kubernetes.io/projected/25cdcabf-e004-4333-84fb-8d6932dbc813-kube-api-access-cqmgh\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7s67j\" (UID: \"25cdcabf-e004-4333-84fb-8d6932dbc813\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7s67j" Jun 13 01:17:33.378844 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:33.378765 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7s67j" Jun 13 01:17:33.501540 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:33.501510 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7s67j"] Jun 13 01:17:33.504609 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:17:33.504584 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25cdcabf_e004_4333_84fb_8d6932dbc813.slice/crio-913cfaa1f899760ad5697852dcc68fb0bfde9a35209f452314989f789e63d327 WatchSource:0}: Error finding container 913cfaa1f899760ad5697852dcc68fb0bfde9a35209f452314989f789e63d327: Status 404 returned error can't find the container with id 913cfaa1f899760ad5697852dcc68fb0bfde9a35209f452314989f789e63d327 Jun 13 01:17:33.995012 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:33.994982 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7s67j" event={"ID":"25cdcabf-e004-4333-84fb-8d6932dbc813","Type":"ContainerStarted","Data":"913cfaa1f899760ad5697852dcc68fb0bfde9a35209f452314989f789e63d327"} Jun 13 01:17:41.026288 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:41.026255 2573 generic.go:356] "Generic (PLEG): container finished" podID="25cdcabf-e004-4333-84fb-8d6932dbc813" containerID="5b6dfc8c213d43f6b16b095e8f9a36cd63c70c053055b01d89066eea7c0f0fd0" exitCode=0 Jun 13 01:17:41.026665 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:41.026347 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7s67j" event={"ID":"25cdcabf-e004-4333-84fb-8d6932dbc813","Type":"ContainerDied","Data":"5b6dfc8c213d43f6b16b095e8f9a36cd63c70c053055b01d89066eea7c0f0fd0"} Jun 13 01:17:44.039549 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:44.039509 2573 generic.go:356] "Generic (PLEG): container finished" podID="25cdcabf-e004-4333-84fb-8d6932dbc813" containerID="00c4b93625abbcc81d774405ee2abf2886474881a78a928f20bc6928f8021093" exitCode=0 Jun 13 01:17:44.039920 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:44.039558 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7s67j" event={"ID":"25cdcabf-e004-4333-84fb-8d6932dbc813","Type":"ContainerDied","Data":"00c4b93625abbcc81d774405ee2abf2886474881a78a928f20bc6928f8021093"} Jun 13 01:17:52.077014 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:52.076974 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7s67j" event={"ID":"25cdcabf-e004-4333-84fb-8d6932dbc813","Type":"ContainerStarted","Data":"0deab2135f53aaa3995b291d642e8072231a8c15c364362397ff0df3a498da65"} Jun 13 01:17:52.096496 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:52.096435 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7s67j" podStartSLOduration=2.439665691 podStartE2EDuration="19.096415575s" totalImagesPullingTime="16.656749884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:17:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:17:52.095625943 +0000 UTC m=+423.961641177" watchObservedRunningTime="2026-06-13 01:17:52.096415575 +0000 UTC m=+423.962430803" Jun 13 01:17:53.082998 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:53.082963 2573 generic.go:356] "Generic (PLEG): container finished" podID="25cdcabf-e004-4333-84fb-8d6932dbc813" containerID="0deab2135f53aaa3995b291d642e8072231a8c15c364362397ff0df3a498da65" exitCode=0 Jun 13 01:17:53.083364 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:53.083049 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7s67j" event={"ID":"25cdcabf-e004-4333-84fb-8d6932dbc813","Type":"ContainerDied","Data":"0deab2135f53aaa3995b291d642e8072231a8c15c364362397ff0df3a498da65"} Jun 13 01:17:54.216413 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:54.216378 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7s67j" Jun 13 01:17:54.258805 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:54.258776 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqmgh\" (UniqueName: \"kubernetes.io/projected/25cdcabf-e004-4333-84fb-8d6932dbc813-kube-api-access-cqmgh\") pod \"25cdcabf-e004-4333-84fb-8d6932dbc813\" (UID: \"25cdcabf-e004-4333-84fb-8d6932dbc813\") " Jun 13 01:17:54.258997 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:54.258844 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25cdcabf-e004-4333-84fb-8d6932dbc813-bundle\") pod \"25cdcabf-e004-4333-84fb-8d6932dbc813\" (UID: \"25cdcabf-e004-4333-84fb-8d6932dbc813\") " Jun 13 01:17:54.258997 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:54.258888 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25cdcabf-e004-4333-84fb-8d6932dbc813-util\") pod \"25cdcabf-e004-4333-84fb-8d6932dbc813\" (UID: \"25cdcabf-e004-4333-84fb-8d6932dbc813\") " Jun 13 01:17:54.259551 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:54.259526 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25cdcabf-e004-4333-84fb-8d6932dbc813-bundle" (OuterVolumeSpecName: "bundle") pod "25cdcabf-e004-4333-84fb-8d6932dbc813" (UID: "25cdcabf-e004-4333-84fb-8d6932dbc813"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:17:54.261117 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:54.261087 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25cdcabf-e004-4333-84fb-8d6932dbc813-kube-api-access-cqmgh" (OuterVolumeSpecName: "kube-api-access-cqmgh") pod "25cdcabf-e004-4333-84fb-8d6932dbc813" (UID: "25cdcabf-e004-4333-84fb-8d6932dbc813"). InnerVolumeSpecName "kube-api-access-cqmgh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:17:54.263840 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:54.263818 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25cdcabf-e004-4333-84fb-8d6932dbc813-util" (OuterVolumeSpecName: "util") pod "25cdcabf-e004-4333-84fb-8d6932dbc813" (UID: "25cdcabf-e004-4333-84fb-8d6932dbc813"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:17:54.359915 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:54.359836 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqmgh\" (UniqueName: \"kubernetes.io/projected/25cdcabf-e004-4333-84fb-8d6932dbc813-kube-api-access-cqmgh\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:17:54.359915 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:54.359867 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25cdcabf-e004-4333-84fb-8d6932dbc813-bundle\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:17:54.359915 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:54.359878 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25cdcabf-e004-4333-84fb-8d6932dbc813-util\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:17:55.092975 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:55.092920 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7s67j" event={"ID":"25cdcabf-e004-4333-84fb-8d6932dbc813","Type":"ContainerDied","Data":"913cfaa1f899760ad5697852dcc68fb0bfde9a35209f452314989f789e63d327"} Jun 13 01:17:55.093142 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:55.092992 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="913cfaa1f899760ad5697852dcc68fb0bfde9a35209f452314989f789e63d327" Jun 13 01:17:55.093142 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:17:55.092959 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7s67j" Jun 13 01:18:01.203079 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:01.203043 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wtmzp"] Jun 13 01:18:01.203473 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:01.203344 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25cdcabf-e004-4333-84fb-8d6932dbc813" containerName="util" Jun 13 01:18:01.203473 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:01.203355 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="25cdcabf-e004-4333-84fb-8d6932dbc813" containerName="util" Jun 13 01:18:01.203473 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:01.203364 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25cdcabf-e004-4333-84fb-8d6932dbc813" containerName="pull" Jun 13 01:18:01.203473 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:01.203370 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="25cdcabf-e004-4333-84fb-8d6932dbc813" containerName="pull" Jun 13 01:18:01.203473 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:01.203387 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25cdcabf-e004-4333-84fb-8d6932dbc813" containerName="extract" Jun 13 01:18:01.203473 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:01.203393 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="25cdcabf-e004-4333-84fb-8d6932dbc813" containerName="extract" Jun 13 01:18:01.203473 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:01.203441 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="25cdcabf-e004-4333-84fb-8d6932dbc813" containerName="extract" Jun 13 01:18:01.207342 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:01.207326 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wtmzp" Jun 13 01:18:01.210136 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:01.210111 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 13 01:18:01.210373 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:01.210356 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 13 01:18:01.211250 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:01.211235 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-d4mcr\"" Jun 13 01:18:01.219041 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:01.219020 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wtmzp"] Jun 13 01:18:01.314044 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:01.314005 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8d9g\" (UniqueName: \"kubernetes.io/projected/f48b5f73-9b93-487c-ac01-2ac172fb3ff3-kube-api-access-c8d9g\") pod \"cert-manager-operator-controller-manager-57757f7cfc-wtmzp\" (UID: \"f48b5f73-9b93-487c-ac01-2ac172fb3ff3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wtmzp" Jun 13 01:18:01.314225 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:01.314084 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f48b5f73-9b93-487c-ac01-2ac172fb3ff3-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-wtmzp\" (UID: \"f48b5f73-9b93-487c-ac01-2ac172fb3ff3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wtmzp" Jun 13 01:18:01.415157 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:01.415124 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f48b5f73-9b93-487c-ac01-2ac172fb3ff3-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-wtmzp\" (UID: \"f48b5f73-9b93-487c-ac01-2ac172fb3ff3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wtmzp" Jun 13 01:18:01.415323 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:01.415169 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8d9g\" (UniqueName: \"kubernetes.io/projected/f48b5f73-9b93-487c-ac01-2ac172fb3ff3-kube-api-access-c8d9g\") pod \"cert-manager-operator-controller-manager-57757f7cfc-wtmzp\" (UID: \"f48b5f73-9b93-487c-ac01-2ac172fb3ff3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wtmzp" Jun 13 01:18:01.415514 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:01.415497 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f48b5f73-9b93-487c-ac01-2ac172fb3ff3-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-wtmzp\" (UID: \"f48b5f73-9b93-487c-ac01-2ac172fb3ff3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wtmzp" Jun 13 01:18:01.426086 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:01.426053 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8d9g\" (UniqueName: \"kubernetes.io/projected/f48b5f73-9b93-487c-ac01-2ac172fb3ff3-kube-api-access-c8d9g\") pod \"cert-manager-operator-controller-manager-57757f7cfc-wtmzp\" (UID: \"f48b5f73-9b93-487c-ac01-2ac172fb3ff3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wtmzp" Jun 13 01:18:01.516273 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:01.516174 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wtmzp" Jun 13 01:18:01.649847 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:01.649816 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wtmzp"] Jun 13 01:18:01.653169 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:18:01.653141 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf48b5f73_9b93_487c_ac01_2ac172fb3ff3.slice/crio-04c4e129d32b3a950b71e9f6f2ed944881bc4f2360fbf0ebb272ae84bc51a828 WatchSource:0}: Error finding container 04c4e129d32b3a950b71e9f6f2ed944881bc4f2360fbf0ebb272ae84bc51a828: Status 404 returned error can't find the container with id 04c4e129d32b3a950b71e9f6f2ed944881bc4f2360fbf0ebb272ae84bc51a828 Jun 13 01:18:02.121101 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:02.121018 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wtmzp" event={"ID":"f48b5f73-9b93-487c-ac01-2ac172fb3ff3","Type":"ContainerStarted","Data":"04c4e129d32b3a950b71e9f6f2ed944881bc4f2360fbf0ebb272ae84bc51a828"} Jun 13 01:18:04.134297 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:04.134200 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wtmzp" event={"ID":"f48b5f73-9b93-487c-ac01-2ac172fb3ff3","Type":"ContainerStarted","Data":"74e17b5322806a6aad4197b6e9435e5d71eb42548c9907d5dcd1aef46a44352d"} Jun 13 01:18:04.154668 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:04.154613 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wtmzp" podStartSLOduration=1.158586391 podStartE2EDuration="3.15459775s" totalImagesPullingTime="1.996011359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:18:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:18:04.152641062 +0000 UTC m=+436.018656285" watchObservedRunningTime="2026-06-13 01:18:04.15459775 +0000 UTC m=+436.020612971" Jun 13 01:18:05.909689 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:05.909652 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2vsl"] Jun 13 01:18:05.913285 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:05.913266 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2vsl" Jun 13 01:18:05.915627 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:05.915605 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 13 01:18:05.915720 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:05.915614 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 13 01:18:05.916491 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:05.916475 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fffvh\"" Jun 13 01:18:05.920812 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:05.920788 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2vsl"] Jun 13 01:18:06.055717 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:06.055683 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdv6w\" (UniqueName: \"kubernetes.io/projected/a42ba768-9121-4e33-82cc-694903a4b2df-kube-api-access-bdv6w\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2vsl\" (UID: \"a42ba768-9121-4e33-82cc-694903a4b2df\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2vsl" Jun 13 01:18:06.055888 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:06.055733 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a42ba768-9121-4e33-82cc-694903a4b2df-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2vsl\" (UID: \"a42ba768-9121-4e33-82cc-694903a4b2df\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2vsl" Jun 13 01:18:06.055888 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:06.055847 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a42ba768-9121-4e33-82cc-694903a4b2df-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2vsl\" (UID: \"a42ba768-9121-4e33-82cc-694903a4b2df\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2vsl" Jun 13 01:18:06.157097 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:06.157053 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a42ba768-9121-4e33-82cc-694903a4b2df-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2vsl\" (UID: \"a42ba768-9121-4e33-82cc-694903a4b2df\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2vsl" Jun 13 01:18:06.157097 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:06.157106 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdv6w\" (UniqueName: \"kubernetes.io/projected/a42ba768-9121-4e33-82cc-694903a4b2df-kube-api-access-bdv6w\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2vsl\" (UID: \"a42ba768-9121-4e33-82cc-694903a4b2df\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2vsl" Jun 13 01:18:06.157359 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:06.157144 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a42ba768-9121-4e33-82cc-694903a4b2df-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2vsl\" (UID: \"a42ba768-9121-4e33-82cc-694903a4b2df\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2vsl" Jun 13 01:18:06.157524 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:06.157503 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a42ba768-9121-4e33-82cc-694903a4b2df-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2vsl\" (UID: \"a42ba768-9121-4e33-82cc-694903a4b2df\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2vsl" Jun 13 01:18:06.157524 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:06.157514 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a42ba768-9121-4e33-82cc-694903a4b2df-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2vsl\" (UID: \"a42ba768-9121-4e33-82cc-694903a4b2df\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2vsl" Jun 13 01:18:06.165696 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:06.165633 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdv6w\" (UniqueName: \"kubernetes.io/projected/a42ba768-9121-4e33-82cc-694903a4b2df-kube-api-access-bdv6w\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2vsl\" (UID: \"a42ba768-9121-4e33-82cc-694903a4b2df\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2vsl" Jun 13 01:18:06.223081 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:06.223048 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2vsl" Jun 13 01:18:06.353861 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:06.353837 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2vsl"] Jun 13 01:18:06.356231 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:18:06.356206 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda42ba768_9121_4e33_82cc_694903a4b2df.slice/crio-7cf8a20e7ef5ca592013c0b3e423f93e45aab5d55f6f9d522f003e7da2513742 WatchSource:0}: Error finding container 7cf8a20e7ef5ca592013c0b3e423f93e45aab5d55f6f9d522f003e7da2513742: Status 404 returned error can't find the container with id 7cf8a20e7ef5ca592013c0b3e423f93e45aab5d55f6f9d522f003e7da2513742 Jun 13 01:18:07.147809 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:07.147774 2573 generic.go:356] "Generic (PLEG): container finished" podID="a42ba768-9121-4e33-82cc-694903a4b2df" containerID="173185d4c53b59a4f4743cadbd15041d699833e262c92b3782926672c677fefb" exitCode=0 Jun 13 01:18:07.148200 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:07.147856 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2vsl" event={"ID":"a42ba768-9121-4e33-82cc-694903a4b2df","Type":"ContainerDied","Data":"173185d4c53b59a4f4743cadbd15041d699833e262c92b3782926672c677fefb"} Jun 13 01:18:07.148200 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:07.147905 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2vsl" event={"ID":"a42ba768-9121-4e33-82cc-694903a4b2df","Type":"ContainerStarted","Data":"7cf8a20e7ef5ca592013c0b3e423f93e45aab5d55f6f9d522f003e7da2513742"} Jun 13 01:18:09.252736 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:09.252692 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-fnwmh"] Jun 13 01:18:09.262553 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:09.262526 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-fnwmh" Jun 13 01:18:09.265659 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:09.265564 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 13 01:18:09.265659 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:09.265613 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 13 01:18:09.266428 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:09.266387 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-fnwmh"] Jun 13 01:18:09.266428 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:09.266409 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-zrnrs\"" Jun 13 01:18:09.383621 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:09.383572 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d8c64f3-3370-4f97-a7ba-f82f9f03cb67-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-fnwmh\" (UID: \"1d8c64f3-3370-4f97-a7ba-f82f9f03cb67\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-fnwmh" Jun 13 01:18:09.383794 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:09.383649 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brwnw\" (UniqueName: \"kubernetes.io/projected/1d8c64f3-3370-4f97-a7ba-f82f9f03cb67-kube-api-access-brwnw\") pod \"cert-manager-cainjector-5d99449ffd-fnwmh\" (UID: \"1d8c64f3-3370-4f97-a7ba-f82f9f03cb67\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-fnwmh" Jun 13 01:18:09.484749 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:09.484713 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d8c64f3-3370-4f97-a7ba-f82f9f03cb67-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-fnwmh\" (UID: \"1d8c64f3-3370-4f97-a7ba-f82f9f03cb67\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-fnwmh" Jun 13 01:18:09.484900 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:09.484773 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brwnw\" (UniqueName: \"kubernetes.io/projected/1d8c64f3-3370-4f97-a7ba-f82f9f03cb67-kube-api-access-brwnw\") pod \"cert-manager-cainjector-5d99449ffd-fnwmh\" (UID: \"1d8c64f3-3370-4f97-a7ba-f82f9f03cb67\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-fnwmh" Jun 13 01:18:09.495032 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:09.495005 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d8c64f3-3370-4f97-a7ba-f82f9f03cb67-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-fnwmh\" (UID: \"1d8c64f3-3370-4f97-a7ba-f82f9f03cb67\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-fnwmh" Jun 13 01:18:09.495280 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:09.495261 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brwnw\" (UniqueName: \"kubernetes.io/projected/1d8c64f3-3370-4f97-a7ba-f82f9f03cb67-kube-api-access-brwnw\") pod \"cert-manager-cainjector-5d99449ffd-fnwmh\" (UID: \"1d8c64f3-3370-4f97-a7ba-f82f9f03cb67\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-fnwmh" Jun 13 01:18:09.582231 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:09.582206 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-fnwmh" Jun 13 01:18:09.722581 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:09.722549 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-fnwmh"] Jun 13 01:18:09.733881 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:18:09.733850 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d8c64f3_3370_4f97_a7ba_f82f9f03cb67.slice/crio-f96c3adcf4a8861d7a09eea41a63ad8423a32f8711d8c73280eb6b0a3a0310e1 WatchSource:0}: Error finding container f96c3adcf4a8861d7a09eea41a63ad8423a32f8711d8c73280eb6b0a3a0310e1: Status 404 returned error can't find the container with id f96c3adcf4a8861d7a09eea41a63ad8423a32f8711d8c73280eb6b0a3a0310e1 Jun 13 01:18:10.161717 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:10.161681 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-fnwmh" event={"ID":"1d8c64f3-3370-4f97-a7ba-f82f9f03cb67","Type":"ContainerStarted","Data":"f96c3adcf4a8861d7a09eea41a63ad8423a32f8711d8c73280eb6b0a3a0310e1"} Jun 13 01:18:10.163371 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:10.163347 2573 generic.go:356] "Generic (PLEG): container finished" podID="a42ba768-9121-4e33-82cc-694903a4b2df" containerID="c27c65e0680434b36462aed26a67aa1c73df67a4c52472e5edd0cb786fb4a7cc" exitCode=0 Jun 13 01:18:10.163457 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:10.163435 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2vsl" event={"ID":"a42ba768-9121-4e33-82cc-694903a4b2df","Type":"ContainerDied","Data":"c27c65e0680434b36462aed26a67aa1c73df67a4c52472e5edd0cb786fb4a7cc"} Jun 13 01:18:11.170713 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:11.170680 2573 generic.go:356] "Generic (PLEG): container finished" podID="a42ba768-9121-4e33-82cc-694903a4b2df" containerID="14655226c780bf2be081869718a8ea57a0aceaf8cdab5ce7c482ad0836ac9ac3" exitCode=0 Jun 13 01:18:11.171104 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:11.170765 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2vsl" event={"ID":"a42ba768-9121-4e33-82cc-694903a4b2df","Type":"ContainerDied","Data":"14655226c780bf2be081869718a8ea57a0aceaf8cdab5ce7c482ad0836ac9ac3"} Jun 13 01:18:12.320463 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:12.320437 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2vsl" Jun 13 01:18:12.409659 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:12.409632 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a42ba768-9121-4e33-82cc-694903a4b2df-util\") pod \"a42ba768-9121-4e33-82cc-694903a4b2df\" (UID: \"a42ba768-9121-4e33-82cc-694903a4b2df\") " Jun 13 01:18:12.409841 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:12.409760 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdv6w\" (UniqueName: \"kubernetes.io/projected/a42ba768-9121-4e33-82cc-694903a4b2df-kube-api-access-bdv6w\") pod \"a42ba768-9121-4e33-82cc-694903a4b2df\" (UID: \"a42ba768-9121-4e33-82cc-694903a4b2df\") " Jun 13 01:18:12.409841 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:12.409783 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a42ba768-9121-4e33-82cc-694903a4b2df-bundle\") pod \"a42ba768-9121-4e33-82cc-694903a4b2df\" (UID: \"a42ba768-9121-4e33-82cc-694903a4b2df\") " Jun 13 01:18:12.410202 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:12.410175 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a42ba768-9121-4e33-82cc-694903a4b2df-bundle" (OuterVolumeSpecName: "bundle") pod "a42ba768-9121-4e33-82cc-694903a4b2df" (UID: "a42ba768-9121-4e33-82cc-694903a4b2df"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:18:12.411877 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:12.411852 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a42ba768-9121-4e33-82cc-694903a4b2df-kube-api-access-bdv6w" (OuterVolumeSpecName: "kube-api-access-bdv6w") pod "a42ba768-9121-4e33-82cc-694903a4b2df" (UID: "a42ba768-9121-4e33-82cc-694903a4b2df"). InnerVolumeSpecName "kube-api-access-bdv6w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:18:12.414327 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:12.414299 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a42ba768-9121-4e33-82cc-694903a4b2df-util" (OuterVolumeSpecName: "util") pod "a42ba768-9121-4e33-82cc-694903a4b2df" (UID: "a42ba768-9121-4e33-82cc-694903a4b2df"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:18:12.511052 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:12.510977 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdv6w\" (UniqueName: \"kubernetes.io/projected/a42ba768-9121-4e33-82cc-694903a4b2df-kube-api-access-bdv6w\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:18:12.511052 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:12.511002 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a42ba768-9121-4e33-82cc-694903a4b2df-bundle\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:18:12.511052 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:12.511011 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a42ba768-9121-4e33-82cc-694903a4b2df-util\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:18:13.181744 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:13.181704 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-fnwmh" event={"ID":"1d8c64f3-3370-4f97-a7ba-f82f9f03cb67","Type":"ContainerStarted","Data":"a6db682185439c9af98cd7d0a333c749c88ae6364a93f59e390031bcd7d50cd9"} Jun 13 01:18:13.183417 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:13.183390 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2vsl" event={"ID":"a42ba768-9121-4e33-82cc-694903a4b2df","Type":"ContainerDied","Data":"7cf8a20e7ef5ca592013c0b3e423f93e45aab5d55f6f9d522f003e7da2513742"} Jun 13 01:18:13.183526 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:13.183435 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2vsl" Jun 13 01:18:13.183526 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:13.183464 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7cf8a20e7ef5ca592013c0b3e423f93e45aab5d55f6f9d522f003e7da2513742" Jun 13 01:18:13.197475 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:13.197429 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-fnwmh" podStartSLOduration=1.62120811 podStartE2EDuration="4.197413577s" totalImagesPullingTime="2.576205467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:18:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:18:13.195888149 +0000 UTC m=+445.061903373" watchObservedRunningTime="2026-06-13 01:18:13.197413577 +0000 UTC m=+445.063428800" Jun 13 01:18:23.151033 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:23.150995 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5cwb8"] Jun 13 01:18:23.151451 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:23.151305 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a42ba768-9121-4e33-82cc-694903a4b2df" containerName="pull" Jun 13 01:18:23.151451 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:23.151317 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a42ba768-9121-4e33-82cc-694903a4b2df" containerName="pull" Jun 13 01:18:23.151451 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:23.151345 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a42ba768-9121-4e33-82cc-694903a4b2df" containerName="util" Jun 13 01:18:23.151451 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:23.151352 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a42ba768-9121-4e33-82cc-694903a4b2df" containerName="util" Jun 13 01:18:23.151451 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:23.151366 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a42ba768-9121-4e33-82cc-694903a4b2df" containerName="extract" Jun 13 01:18:23.151451 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:23.151372 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a42ba768-9121-4e33-82cc-694903a4b2df" containerName="extract" Jun 13 01:18:23.151451 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:23.151423 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a42ba768-9121-4e33-82cc-694903a4b2df" containerName="extract" Jun 13 01:18:23.163341 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:23.163314 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5cwb8" Jun 13 01:18:23.163488 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:23.163463 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5cwb8"] Jun 13 01:18:23.165777 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:23.165746 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 13 01:18:23.165777 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:23.165772 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 13 01:18:23.166783 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:23.166762 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-ctdr9\"" Jun 13 01:18:23.300979 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:23.300931 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00741bf9-86da-4596-abb0-bf7f50fbd507-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5cwb8\" (UID: \"00741bf9-86da-4596-abb0-bf7f50fbd507\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5cwb8" Jun 13 01:18:23.301201 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:23.301038 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc8qb\" (UniqueName: \"kubernetes.io/projected/00741bf9-86da-4596-abb0-bf7f50fbd507-kube-api-access-kc8qb\") pod \"openshift-lws-operator-fd8ccff4c-5cwb8\" (UID: \"00741bf9-86da-4596-abb0-bf7f50fbd507\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5cwb8" Jun 13 01:18:23.402250 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:23.402167 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00741bf9-86da-4596-abb0-bf7f50fbd507-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5cwb8\" (UID: \"00741bf9-86da-4596-abb0-bf7f50fbd507\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5cwb8" Jun 13 01:18:23.402250 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:23.402224 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc8qb\" (UniqueName: \"kubernetes.io/projected/00741bf9-86da-4596-abb0-bf7f50fbd507-kube-api-access-kc8qb\") pod \"openshift-lws-operator-fd8ccff4c-5cwb8\" (UID: \"00741bf9-86da-4596-abb0-bf7f50fbd507\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5cwb8" Jun 13 01:18:23.402604 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:23.402582 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00741bf9-86da-4596-abb0-bf7f50fbd507-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5cwb8\" (UID: \"00741bf9-86da-4596-abb0-bf7f50fbd507\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5cwb8" Jun 13 01:18:23.410240 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:23.410214 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc8qb\" (UniqueName: \"kubernetes.io/projected/00741bf9-86da-4596-abb0-bf7f50fbd507-kube-api-access-kc8qb\") pod \"openshift-lws-operator-fd8ccff4c-5cwb8\" (UID: \"00741bf9-86da-4596-abb0-bf7f50fbd507\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5cwb8" Jun 13 01:18:23.473228 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:23.473191 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5cwb8" Jun 13 01:18:23.613345 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:23.613317 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5cwb8"] Jun 13 01:18:23.615334 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:18:23.615307 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00741bf9_86da_4596_abb0_bf7f50fbd507.slice/crio-af7aa8ba8de75704f967181c9f6c27ecdf61b31c07e099f87fa6c97b3c99f901 WatchSource:0}: Error finding container af7aa8ba8de75704f967181c9f6c27ecdf61b31c07e099f87fa6c97b3c99f901: Status 404 returned error can't find the container with id af7aa8ba8de75704f967181c9f6c27ecdf61b31c07e099f87fa6c97b3c99f901 Jun 13 01:18:24.233098 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:24.233060 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5cwb8" event={"ID":"00741bf9-86da-4596-abb0-bf7f50fbd507","Type":"ContainerStarted","Data":"af7aa8ba8de75704f967181c9f6c27ecdf61b31c07e099f87fa6c97b3c99f901"} Jun 13 01:18:26.245415 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:26.245375 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5cwb8" event={"ID":"00741bf9-86da-4596-abb0-bf7f50fbd507","Type":"ContainerStarted","Data":"a3392abba2e8430de8e4cad6455d240ae44341f64b711c72e072887e3108c5c0"} Jun 13 01:18:26.269460 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:26.269399 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5cwb8" podStartSLOduration=1.233266223 podStartE2EDuration="3.269376901s" totalImagesPullingTime="2.036110678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:18:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:18:26.267330344 +0000 UTC m=+458.133345567" watchObservedRunningTime="2026-06-13 01:18:26.269376901 +0000 UTC m=+458.135392124" Jun 13 01:18:30.951539 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:30.951493 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxkvst"] Jun 13 01:18:30.957793 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:30.957764 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxkvst" Jun 13 01:18:30.960544 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:30.960517 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 13 01:18:30.960729 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:30.960561 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 13 01:18:30.961609 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:30.961576 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fffvh\"" Jun 13 01:18:30.963788 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:30.963768 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxkvst"] Jun 13 01:18:30.964042 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:30.964019 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/595cdf56-1681-407a-a25d-97d7d9b76870-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxkvst\" (UID: \"595cdf56-1681-407a-a25d-97d7d9b76870\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxkvst" Jun 13 01:18:30.964113 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:30.964056 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86bcv\" (UniqueName: \"kubernetes.io/projected/595cdf56-1681-407a-a25d-97d7d9b76870-kube-api-access-86bcv\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxkvst\" (UID: \"595cdf56-1681-407a-a25d-97d7d9b76870\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxkvst" Jun 13 01:18:30.964171 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:30.964142 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/595cdf56-1681-407a-a25d-97d7d9b76870-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxkvst\" (UID: \"595cdf56-1681-407a-a25d-97d7d9b76870\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxkvst" Jun 13 01:18:31.064890 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:31.064857 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/595cdf56-1681-407a-a25d-97d7d9b76870-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxkvst\" (UID: \"595cdf56-1681-407a-a25d-97d7d9b76870\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxkvst" Jun 13 01:18:31.064890 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:31.064897 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86bcv\" (UniqueName: \"kubernetes.io/projected/595cdf56-1681-407a-a25d-97d7d9b76870-kube-api-access-86bcv\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxkvst\" (UID: \"595cdf56-1681-407a-a25d-97d7d9b76870\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxkvst" Jun 13 01:18:31.065104 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:31.064967 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/595cdf56-1681-407a-a25d-97d7d9b76870-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxkvst\" (UID: \"595cdf56-1681-407a-a25d-97d7d9b76870\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxkvst" Jun 13 01:18:31.065358 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:31.065337 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/595cdf56-1681-407a-a25d-97d7d9b76870-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxkvst\" (UID: \"595cdf56-1681-407a-a25d-97d7d9b76870\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxkvst" Jun 13 01:18:31.065401 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:31.065341 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/595cdf56-1681-407a-a25d-97d7d9b76870-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxkvst\" (UID: \"595cdf56-1681-407a-a25d-97d7d9b76870\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxkvst" Jun 13 01:18:31.073485 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:31.073463 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86bcv\" (UniqueName: \"kubernetes.io/projected/595cdf56-1681-407a-a25d-97d7d9b76870-kube-api-access-86bcv\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxkvst\" (UID: \"595cdf56-1681-407a-a25d-97d7d9b76870\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxkvst" Jun 13 01:18:31.267732 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:31.267646 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxkvst" Jun 13 01:18:31.397201 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:31.397174 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxkvst"] Jun 13 01:18:31.399471 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:18:31.399445 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod595cdf56_1681_407a_a25d_97d7d9b76870.slice/crio-fc447ee14072b839660216aa7f892e0a2a62af110e41010e44cd4316a0ded53a WatchSource:0}: Error finding container fc447ee14072b839660216aa7f892e0a2a62af110e41010e44cd4316a0ded53a: Status 404 returned error can't find the container with id fc447ee14072b839660216aa7f892e0a2a62af110e41010e44cd4316a0ded53a Jun 13 01:18:32.273876 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:32.273845 2573 generic.go:356] "Generic (PLEG): container finished" podID="595cdf56-1681-407a-a25d-97d7d9b76870" containerID="d73d8bf5f9cfe583a2aaefa74d6709f52e95de9c4046261239480ae8aec38128" exitCode=0 Jun 13 01:18:32.274265 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:32.273901 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxkvst" event={"ID":"595cdf56-1681-407a-a25d-97d7d9b76870","Type":"ContainerDied","Data":"d73d8bf5f9cfe583a2aaefa74d6709f52e95de9c4046261239480ae8aec38128"} Jun 13 01:18:32.274265 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:32.273933 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxkvst" event={"ID":"595cdf56-1681-407a-a25d-97d7d9b76870","Type":"ContainerStarted","Data":"fc447ee14072b839660216aa7f892e0a2a62af110e41010e44cd4316a0ded53a"} Jun 13 01:18:33.280344 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:33.280308 2573 generic.go:356] "Generic (PLEG): container finished" podID="595cdf56-1681-407a-a25d-97d7d9b76870" containerID="eaaa9b33296e41ecfbf9785b94e7625d5fa622306139fe4df0136a416209d3bc" exitCode=0 Jun 13 01:18:33.280695 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:33.280370 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxkvst" event={"ID":"595cdf56-1681-407a-a25d-97d7d9b76870","Type":"ContainerDied","Data":"eaaa9b33296e41ecfbf9785b94e7625d5fa622306139fe4df0136a416209d3bc"} Jun 13 01:18:34.287565 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:34.287526 2573 generic.go:356] "Generic (PLEG): container finished" podID="595cdf56-1681-407a-a25d-97d7d9b76870" containerID="4928db99cda0e12c5edcc81822f9a2682cfef6467515508053055468118cd619" exitCode=0 Jun 13 01:18:34.287975 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:34.287610 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxkvst" event={"ID":"595cdf56-1681-407a-a25d-97d7d9b76870","Type":"ContainerDied","Data":"4928db99cda0e12c5edcc81822f9a2682cfef6467515508053055468118cd619"} Jun 13 01:18:35.423459 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:35.423432 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxkvst" Jun 13 01:18:35.493825 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:35.493791 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/595cdf56-1681-407a-a25d-97d7d9b76870-bundle\") pod \"595cdf56-1681-407a-a25d-97d7d9b76870\" (UID: \"595cdf56-1681-407a-a25d-97d7d9b76870\") " Jun 13 01:18:35.494011 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:35.493838 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/595cdf56-1681-407a-a25d-97d7d9b76870-util\") pod \"595cdf56-1681-407a-a25d-97d7d9b76870\" (UID: \"595cdf56-1681-407a-a25d-97d7d9b76870\") " Jun 13 01:18:35.494011 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:35.493860 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86bcv\" (UniqueName: \"kubernetes.io/projected/595cdf56-1681-407a-a25d-97d7d9b76870-kube-api-access-86bcv\") pod \"595cdf56-1681-407a-a25d-97d7d9b76870\" (UID: \"595cdf56-1681-407a-a25d-97d7d9b76870\") " Jun 13 01:18:35.494717 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:35.494682 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/595cdf56-1681-407a-a25d-97d7d9b76870-bundle" (OuterVolumeSpecName: "bundle") pod "595cdf56-1681-407a-a25d-97d7d9b76870" (UID: "595cdf56-1681-407a-a25d-97d7d9b76870"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:18:35.496037 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:35.496015 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/595cdf56-1681-407a-a25d-97d7d9b76870-kube-api-access-86bcv" (OuterVolumeSpecName: "kube-api-access-86bcv") pod "595cdf56-1681-407a-a25d-97d7d9b76870" (UID: "595cdf56-1681-407a-a25d-97d7d9b76870"). InnerVolumeSpecName "kube-api-access-86bcv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:18:35.499753 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:35.499717 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/595cdf56-1681-407a-a25d-97d7d9b76870-util" (OuterVolumeSpecName: "util") pod "595cdf56-1681-407a-a25d-97d7d9b76870" (UID: "595cdf56-1681-407a-a25d-97d7d9b76870"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:18:35.595289 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:35.595204 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/595cdf56-1681-407a-a25d-97d7d9b76870-util\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:18:35.595289 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:35.595232 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86bcv\" (UniqueName: \"kubernetes.io/projected/595cdf56-1681-407a-a25d-97d7d9b76870-kube-api-access-86bcv\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:18:35.595289 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:35.595243 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/595cdf56-1681-407a-a25d-97d7d9b76870-bundle\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:18:36.298634 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:36.298604 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxkvst" Jun 13 01:18:36.298634 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:36.298619 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxkvst" event={"ID":"595cdf56-1681-407a-a25d-97d7d9b76870","Type":"ContainerDied","Data":"fc447ee14072b839660216aa7f892e0a2a62af110e41010e44cd4316a0ded53a"} Jun 13 01:18:36.298843 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:36.298659 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fc447ee14072b839660216aa7f892e0a2a62af110e41010e44cd4316a0ded53a" Jun 13 01:18:44.088369 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:44.088334 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-fkvxq"] Jun 13 01:18:44.088741 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:44.088650 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="595cdf56-1681-407a-a25d-97d7d9b76870" containerName="util" Jun 13 01:18:44.088741 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:44.088660 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="595cdf56-1681-407a-a25d-97d7d9b76870" containerName="util" Jun 13 01:18:44.088741 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:44.088674 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="595cdf56-1681-407a-a25d-97d7d9b76870" containerName="pull" Jun 13 01:18:44.088741 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:44.088680 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="595cdf56-1681-407a-a25d-97d7d9b76870" containerName="pull" Jun 13 01:18:44.088741 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:44.088692 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="595cdf56-1681-407a-a25d-97d7d9b76870" containerName="extract" Jun 13 01:18:44.088741 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:44.088698 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="595cdf56-1681-407a-a25d-97d7d9b76870" containerName="extract" Jun 13 01:18:44.088917 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:44.088751 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="595cdf56-1681-407a-a25d-97d7d9b76870" containerName="extract" Jun 13 01:18:44.091938 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:44.091923 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-fkvxq" Jun 13 01:18:44.095886 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:44.095862 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 13 01:18:44.096020 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:44.095872 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 13 01:18:44.096408 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:44.096393 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 13 01:18:44.096710 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:44.096693 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qth8m\"" Jun 13 01:18:44.097679 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:44.097660 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 13 01:18:44.146103 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:44.146074 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-fkvxq"] Jun 13 01:18:44.166469 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:44.166442 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8830de2-2efa-406e-a8f6-3bf4588a4de3-tmp\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-fkvxq\" (UID: \"d8830de2-2efa-406e-a8f6-3bf4588a4de3\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-fkvxq" Jun 13 01:18:44.166625 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:44.166478 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d8830de2-2efa-406e-a8f6-3bf4588a4de3-manifests\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-fkvxq\" (UID: \"d8830de2-2efa-406e-a8f6-3bf4588a4de3\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-fkvxq" Jun 13 01:18:44.166625 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:44.166499 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d8830de2-2efa-406e-a8f6-3bf4588a4de3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-fkvxq\" (UID: \"d8830de2-2efa-406e-a8f6-3bf4588a4de3\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-fkvxq" Jun 13 01:18:44.166625 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:44.166604 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbm9s\" (UniqueName: \"kubernetes.io/projected/d8830de2-2efa-406e-a8f6-3bf4588a4de3-kube-api-access-cbm9s\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-fkvxq\" (UID: \"d8830de2-2efa-406e-a8f6-3bf4588a4de3\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-fkvxq" Jun 13 01:18:44.166775 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:44.166640 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d8830de2-2efa-406e-a8f6-3bf4588a4de3-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-fkvxq\" (UID: \"d8830de2-2efa-406e-a8f6-3bf4588a4de3\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-fkvxq" Jun 13 01:18:44.267271 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:44.267232 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8830de2-2efa-406e-a8f6-3bf4588a4de3-tmp\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-fkvxq\" (UID: \"d8830de2-2efa-406e-a8f6-3bf4588a4de3\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-fkvxq" Jun 13 01:18:44.267271 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:44.267278 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d8830de2-2efa-406e-a8f6-3bf4588a4de3-manifests\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-fkvxq\" (UID: \"d8830de2-2efa-406e-a8f6-3bf4588a4de3\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-fkvxq" Jun 13 01:18:44.267514 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:44.267302 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d8830de2-2efa-406e-a8f6-3bf4588a4de3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-fkvxq\" (UID: \"d8830de2-2efa-406e-a8f6-3bf4588a4de3\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-fkvxq" Jun 13 01:18:44.267514 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:44.267332 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbm9s\" (UniqueName: \"kubernetes.io/projected/d8830de2-2efa-406e-a8f6-3bf4588a4de3-kube-api-access-cbm9s\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-fkvxq\" (UID: \"d8830de2-2efa-406e-a8f6-3bf4588a4de3\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-fkvxq" Jun 13 01:18:44.267514 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:44.267357 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d8830de2-2efa-406e-a8f6-3bf4588a4de3-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-fkvxq\" (UID: \"d8830de2-2efa-406e-a8f6-3bf4588a4de3\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-fkvxq" Jun 13 01:18:44.267668 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:44.267611 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d8830de2-2efa-406e-a8f6-3bf4588a4de3-manifests\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-fkvxq\" (UID: \"d8830de2-2efa-406e-a8f6-3bf4588a4de3\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-fkvxq" Jun 13 01:18:44.269696 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:44.269666 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8830de2-2efa-406e-a8f6-3bf4588a4de3-tmp\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-fkvxq\" (UID: \"d8830de2-2efa-406e-a8f6-3bf4588a4de3\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-fkvxq" Jun 13 01:18:44.269829 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:44.269781 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d8830de2-2efa-406e-a8f6-3bf4588a4de3-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-fkvxq\" (UID: \"d8830de2-2efa-406e-a8f6-3bf4588a4de3\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-fkvxq" Jun 13 01:18:44.269829 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:44.269788 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d8830de2-2efa-406e-a8f6-3bf4588a4de3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-fkvxq\" (UID: \"d8830de2-2efa-406e-a8f6-3bf4588a4de3\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-fkvxq" Jun 13 01:18:44.276115 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:44.276090 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbm9s\" (UniqueName: \"kubernetes.io/projected/d8830de2-2efa-406e-a8f6-3bf4588a4de3-kube-api-access-cbm9s\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-fkvxq\" (UID: \"d8830de2-2efa-406e-a8f6-3bf4588a4de3\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-fkvxq" Jun 13 01:18:44.401818 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:44.401789 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-fkvxq" Jun 13 01:18:44.560743 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:44.560719 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-fkvxq"] Jun 13 01:18:44.562267 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:18:44.562237 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8830de2_2efa_406e_a8f6_3bf4588a4de3.slice/crio-060818e8309805f2dc43dddffaad785f680456a5fade22854c6bbf6e233e1d6a WatchSource:0}: Error finding container 060818e8309805f2dc43dddffaad785f680456a5fade22854c6bbf6e233e1d6a: Status 404 returned error can't find the container with id 060818e8309805f2dc43dddffaad785f680456a5fade22854c6bbf6e233e1d6a Jun 13 01:18:45.344528 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:45.344488 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-fkvxq" event={"ID":"d8830de2-2efa-406e-a8f6-3bf4588a4de3","Type":"ContainerStarted","Data":"060818e8309805f2dc43dddffaad785f680456a5fade22854c6bbf6e233e1d6a"} Jun 13 01:18:48.360263 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:48.360221 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-fkvxq" event={"ID":"d8830de2-2efa-406e-a8f6-3bf4588a4de3","Type":"ContainerStarted","Data":"3cd45250bb7ae44d190afc7b38018c64cbed2eaa7a9555ef66a448934586d4ba"} Jun 13 01:18:49.365856 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:49.365820 2573 generic.go:356] "Generic (PLEG): container finished" podID="d8830de2-2efa-406e-a8f6-3bf4588a4de3" containerID="3cd45250bb7ae44d190afc7b38018c64cbed2eaa7a9555ef66a448934586d4ba" exitCode=0 Jun 13 01:18:49.366238 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:49.365892 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-fkvxq" event={"ID":"d8830de2-2efa-406e-a8f6-3bf4588a4de3","Type":"ContainerDied","Data":"3cd45250bb7ae44d190afc7b38018c64cbed2eaa7a9555ef66a448934586d4ba"} Jun 13 01:18:50.372564 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:50.372529 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-fkvxq" event={"ID":"d8830de2-2efa-406e-a8f6-3bf4588a4de3","Type":"ContainerStarted","Data":"3c3941c3ffdac12678259f64b10bd95525eb65c3452f7777d0d4dc7e87c7295c"} Jun 13 01:18:50.372907 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:50.372649 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-fkvxq" Jun 13 01:18:50.395308 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:18:50.395260 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-fkvxq" podStartSLOduration=2.243576895 podStartE2EDuration="6.395243938s" totalImagesPullingTime="3.167333483s" totalInitContainerRuntime="984.33356ms" isStatefulPod=false podCreationTimestamp="2026-06-13 01:18:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:18:50.392561634 +0000 UTC m=+482.258576856" watchObservedRunningTime="2026-06-13 01:18:50.395243938 +0000 UTC m=+482.261259159" Jun 13 01:19:01.379491 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:01.379461 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-fkvxq" Jun 13 01:19:03.538915 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:03.538879 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-678b9f85fb-bsjjd"] Jun 13 01:19:03.541542 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:03.541520 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-678b9f85fb-bsjjd" Jun 13 01:19:03.544208 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:03.544184 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 13 01:19:03.544670 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:03.544515 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 13 01:19:03.545301 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:03.545279 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4gdnq\"" Jun 13 01:19:03.552686 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:03.552666 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-678b9f85fb-bsjjd"] Jun 13 01:19:03.628249 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:03.628218 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bd07423-068c-4f65-b0a6-a60b9115b75b-tls-certs\") pod \"kube-auth-proxy-678b9f85fb-bsjjd\" (UID: \"5bd07423-068c-4f65-b0a6-a60b9115b75b\") " pod="openshift-ingress/kube-auth-proxy-678b9f85fb-bsjjd" Jun 13 01:19:03.628433 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:03.628255 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpr4d\" (UniqueName: \"kubernetes.io/projected/5bd07423-068c-4f65-b0a6-a60b9115b75b-kube-api-access-dpr4d\") pod \"kube-auth-proxy-678b9f85fb-bsjjd\" (UID: \"5bd07423-068c-4f65-b0a6-a60b9115b75b\") " pod="openshift-ingress/kube-auth-proxy-678b9f85fb-bsjjd" Jun 13 01:19:03.628433 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:03.628278 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5bd07423-068c-4f65-b0a6-a60b9115b75b-tmp\") pod \"kube-auth-proxy-678b9f85fb-bsjjd\" (UID: \"5bd07423-068c-4f65-b0a6-a60b9115b75b\") " pod="openshift-ingress/kube-auth-proxy-678b9f85fb-bsjjd" Jun 13 01:19:03.729046 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:03.729003 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5bd07423-068c-4f65-b0a6-a60b9115b75b-tmp\") pod \"kube-auth-proxy-678b9f85fb-bsjjd\" (UID: \"5bd07423-068c-4f65-b0a6-a60b9115b75b\") " pod="openshift-ingress/kube-auth-proxy-678b9f85fb-bsjjd" Jun 13 01:19:03.729225 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:03.729112 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bd07423-068c-4f65-b0a6-a60b9115b75b-tls-certs\") pod \"kube-auth-proxy-678b9f85fb-bsjjd\" (UID: \"5bd07423-068c-4f65-b0a6-a60b9115b75b\") " pod="openshift-ingress/kube-auth-proxy-678b9f85fb-bsjjd" Jun 13 01:19:03.729225 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:03.729140 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpr4d\" (UniqueName: \"kubernetes.io/projected/5bd07423-068c-4f65-b0a6-a60b9115b75b-kube-api-access-dpr4d\") pod \"kube-auth-proxy-678b9f85fb-bsjjd\" (UID: \"5bd07423-068c-4f65-b0a6-a60b9115b75b\") " pod="openshift-ingress/kube-auth-proxy-678b9f85fb-bsjjd" Jun 13 01:19:03.731429 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:03.731398 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5bd07423-068c-4f65-b0a6-a60b9115b75b-tmp\") pod \"kube-auth-proxy-678b9f85fb-bsjjd\" (UID: \"5bd07423-068c-4f65-b0a6-a60b9115b75b\") " pod="openshift-ingress/kube-auth-proxy-678b9f85fb-bsjjd" Jun 13 01:19:03.731542 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:03.731517 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bd07423-068c-4f65-b0a6-a60b9115b75b-tls-certs\") pod \"kube-auth-proxy-678b9f85fb-bsjjd\" (UID: \"5bd07423-068c-4f65-b0a6-a60b9115b75b\") " pod="openshift-ingress/kube-auth-proxy-678b9f85fb-bsjjd" Jun 13 01:19:03.746386 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:03.746353 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpr4d\" (UniqueName: \"kubernetes.io/projected/5bd07423-068c-4f65-b0a6-a60b9115b75b-kube-api-access-dpr4d\") pod \"kube-auth-proxy-678b9f85fb-bsjjd\" (UID: \"5bd07423-068c-4f65-b0a6-a60b9115b75b\") " pod="openshift-ingress/kube-auth-proxy-678b9f85fb-bsjjd" Jun 13 01:19:03.778514 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:03.778488 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-hvmbg"] Jun 13 01:19:03.780650 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:03.780636 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-hvmbg" Jun 13 01:19:03.783078 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:03.783055 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 13 01:19:03.783304 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:03.783290 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-vmvrl\"" Jun 13 01:19:03.790293 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:03.790229 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-hvmbg"] Jun 13 01:19:03.853956 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:03.853912 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-678b9f85fb-bsjjd" Jun 13 01:19:03.930306 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:03.930274 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a336de5e-aea3-4ce7-aeda-d1f103b8ee89-cert\") pod \"odh-model-controller-6dc94f689f-hvmbg\" (UID: \"a336de5e-aea3-4ce7-aeda-d1f103b8ee89\") " pod="opendatahub/odh-model-controller-6dc94f689f-hvmbg" Jun 13 01:19:03.930474 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:03.930360 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zstgs\" (UniqueName: \"kubernetes.io/projected/a336de5e-aea3-4ce7-aeda-d1f103b8ee89-kube-api-access-zstgs\") pod \"odh-model-controller-6dc94f689f-hvmbg\" (UID: \"a336de5e-aea3-4ce7-aeda-d1f103b8ee89\") " pod="opendatahub/odh-model-controller-6dc94f689f-hvmbg" Jun 13 01:19:04.016978 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:04.016936 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-678b9f85fb-bsjjd"] Jun 13 01:19:04.019832 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:19:04.019805 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bd07423_068c_4f65_b0a6_a60b9115b75b.slice/crio-529d44524340400ece3c31d0f2379857e1bbc07eecdfd9e5229bd8214e0f4631 WatchSource:0}: Error finding container 529d44524340400ece3c31d0f2379857e1bbc07eecdfd9e5229bd8214e0f4631: Status 404 returned error can't find the container with id 529d44524340400ece3c31d0f2379857e1bbc07eecdfd9e5229bd8214e0f4631 Jun 13 01:19:04.030773 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:04.030746 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zstgs\" (UniqueName: \"kubernetes.io/projected/a336de5e-aea3-4ce7-aeda-d1f103b8ee89-kube-api-access-zstgs\") pod \"odh-model-controller-6dc94f689f-hvmbg\" (UID: \"a336de5e-aea3-4ce7-aeda-d1f103b8ee89\") " pod="opendatahub/odh-model-controller-6dc94f689f-hvmbg" Jun 13 01:19:04.030871 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:04.030808 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a336de5e-aea3-4ce7-aeda-d1f103b8ee89-cert\") pod \"odh-model-controller-6dc94f689f-hvmbg\" (UID: \"a336de5e-aea3-4ce7-aeda-d1f103b8ee89\") " pod="opendatahub/odh-model-controller-6dc94f689f-hvmbg" Jun 13 01:19:04.030928 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:19:04.030916 2573 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 13 01:19:04.030989 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:19:04.030983 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a336de5e-aea3-4ce7-aeda-d1f103b8ee89-cert podName:a336de5e-aea3-4ce7-aeda-d1f103b8ee89 nodeName:}" failed. No retries permitted until 2026-06-13 01:19:04.530965219 +0000 UTC m=+496.396980419 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a336de5e-aea3-4ce7-aeda-d1f103b8ee89-cert") pod "odh-model-controller-6dc94f689f-hvmbg" (UID: "a336de5e-aea3-4ce7-aeda-d1f103b8ee89") : secret "odh-model-controller-webhook-cert" not found Jun 13 01:19:04.043491 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:04.043429 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zstgs\" (UniqueName: \"kubernetes.io/projected/a336de5e-aea3-4ce7-aeda-d1f103b8ee89-kube-api-access-zstgs\") pod \"odh-model-controller-6dc94f689f-hvmbg\" (UID: \"a336de5e-aea3-4ce7-aeda-d1f103b8ee89\") " pod="opendatahub/odh-model-controller-6dc94f689f-hvmbg" Jun 13 01:19:04.441215 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:04.441175 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-678b9f85fb-bsjjd" event={"ID":"5bd07423-068c-4f65-b0a6-a60b9115b75b","Type":"ContainerStarted","Data":"529d44524340400ece3c31d0f2379857e1bbc07eecdfd9e5229bd8214e0f4631"} Jun 13 01:19:04.536505 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:04.536472 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a336de5e-aea3-4ce7-aeda-d1f103b8ee89-cert\") pod \"odh-model-controller-6dc94f689f-hvmbg\" (UID: \"a336de5e-aea3-4ce7-aeda-d1f103b8ee89\") " pod="opendatahub/odh-model-controller-6dc94f689f-hvmbg" Jun 13 01:19:04.538977 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:04.538928 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a336de5e-aea3-4ce7-aeda-d1f103b8ee89-cert\") pod \"odh-model-controller-6dc94f689f-hvmbg\" (UID: \"a336de5e-aea3-4ce7-aeda-d1f103b8ee89\") " pod="opendatahub/odh-model-controller-6dc94f689f-hvmbg" Jun 13 01:19:04.692404 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:04.692316 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-hvmbg" Jun 13 01:19:04.863465 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:04.863437 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-hvmbg"] Jun 13 01:19:04.866150 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:19:04.866120 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda336de5e_aea3_4ce7_aeda_d1f103b8ee89.slice/crio-b08cf947bfa0b4644542132522b0801d77134a7c1064572a98c99f44871851aa WatchSource:0}: Error finding container b08cf947bfa0b4644542132522b0801d77134a7c1064572a98c99f44871851aa: Status 404 returned error can't find the container with id b08cf947bfa0b4644542132522b0801d77134a7c1064572a98c99f44871851aa Jun 13 01:19:05.451126 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:05.451083 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-hvmbg" event={"ID":"a336de5e-aea3-4ce7-aeda-d1f103b8ee89","Type":"ContainerStarted","Data":"b08cf947bfa0b4644542132522b0801d77134a7c1064572a98c99f44871851aa"} Jun 13 01:19:05.486486 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:05.486449 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lhldj"] Jun 13 01:19:05.490898 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:05.490871 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lhldj" Jun 13 01:19:05.493803 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:05.493773 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 13 01:19:05.493934 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:05.493837 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fffvh\"" Jun 13 01:19:05.498916 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:05.497744 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lhldj"] Jun 13 01:19:05.498916 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:05.497865 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 13 01:19:05.645602 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:05.645316 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1270520-6ca4-4adc-8858-70fecd688df8-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lhldj\" (UID: \"e1270520-6ca4-4adc-8858-70fecd688df8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lhldj" Jun 13 01:19:05.645602 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:05.645388 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc4nh\" (UniqueName: \"kubernetes.io/projected/e1270520-6ca4-4adc-8858-70fecd688df8-kube-api-access-rc4nh\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lhldj\" (UID: \"e1270520-6ca4-4adc-8858-70fecd688df8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lhldj" Jun 13 01:19:05.645602 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:05.645427 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1270520-6ca4-4adc-8858-70fecd688df8-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lhldj\" (UID: \"e1270520-6ca4-4adc-8858-70fecd688df8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lhldj" Jun 13 01:19:05.746906 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:05.746626 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1270520-6ca4-4adc-8858-70fecd688df8-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lhldj\" (UID: \"e1270520-6ca4-4adc-8858-70fecd688df8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lhldj" Jun 13 01:19:05.746906 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:05.746695 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc4nh\" (UniqueName: \"kubernetes.io/projected/e1270520-6ca4-4adc-8858-70fecd688df8-kube-api-access-rc4nh\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lhldj\" (UID: \"e1270520-6ca4-4adc-8858-70fecd688df8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lhldj" Jun 13 01:19:05.746906 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:05.746732 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1270520-6ca4-4adc-8858-70fecd688df8-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lhldj\" (UID: \"e1270520-6ca4-4adc-8858-70fecd688df8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lhldj" Jun 13 01:19:05.747492 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:05.747203 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1270520-6ca4-4adc-8858-70fecd688df8-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lhldj\" (UID: \"e1270520-6ca4-4adc-8858-70fecd688df8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lhldj" Jun 13 01:19:05.747492 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:05.747457 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1270520-6ca4-4adc-8858-70fecd688df8-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lhldj\" (UID: \"e1270520-6ca4-4adc-8858-70fecd688df8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lhldj" Jun 13 01:19:05.758315 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:05.758265 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc4nh\" (UniqueName: \"kubernetes.io/projected/e1270520-6ca4-4adc-8858-70fecd688df8-kube-api-access-rc4nh\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lhldj\" (UID: \"e1270520-6ca4-4adc-8858-70fecd688df8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lhldj" Jun 13 01:19:05.809483 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:05.809239 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lhldj" Jun 13 01:19:08.283868 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:08.283845 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lhldj"] Jun 13 01:19:08.285749 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:19:08.285719 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1270520_6ca4_4adc_8858_70fecd688df8.slice/crio-c8f0fe97fd615e2dda4de24d4e6fb379ebb8ab0f2fadf866e8132edbe81ac1c5 WatchSource:0}: Error finding container c8f0fe97fd615e2dda4de24d4e6fb379ebb8ab0f2fadf866e8132edbe81ac1c5: Status 404 returned error can't find the container with id c8f0fe97fd615e2dda4de24d4e6fb379ebb8ab0f2fadf866e8132edbe81ac1c5 Jun 13 01:19:08.468248 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:08.468163 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-678b9f85fb-bsjjd" event={"ID":"5bd07423-068c-4f65-b0a6-a60b9115b75b","Type":"ContainerStarted","Data":"4706225d7fb247a486e1c9a3ccde08ba8889841458921ef25d556b827c162980"} Jun 13 01:19:08.469640 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:08.469615 2573 generic.go:356] "Generic (PLEG): container finished" podID="e1270520-6ca4-4adc-8858-70fecd688df8" containerID="381e6a462b5801d334bcf0d437638d90a4d6d915208b3a4f48ed617e1818d96d" exitCode=0 Jun 13 01:19:08.469758 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:08.469695 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lhldj" event={"ID":"e1270520-6ca4-4adc-8858-70fecd688df8","Type":"ContainerDied","Data":"381e6a462b5801d334bcf0d437638d90a4d6d915208b3a4f48ed617e1818d96d"} Jun 13 01:19:08.469758 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:08.469736 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lhldj" event={"ID":"e1270520-6ca4-4adc-8858-70fecd688df8","Type":"ContainerStarted","Data":"c8f0fe97fd615e2dda4de24d4e6fb379ebb8ab0f2fadf866e8132edbe81ac1c5"} Jun 13 01:19:08.471359 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:08.471334 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-hvmbg" event={"ID":"a336de5e-aea3-4ce7-aeda-d1f103b8ee89","Type":"ContainerStarted","Data":"68fbf82e867c9b96d2efee10c82f14fec218234f590c08d3baa17280c39c0347"} Jun 13 01:19:08.471481 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:08.471399 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-hvmbg" Jun 13 01:19:08.485210 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:08.485146 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-678b9f85fb-bsjjd" podStartSLOduration=1.355276516 podStartE2EDuration="5.485133961s" totalImagesPullingTime="4.129857445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:19:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:19:08.4845537 +0000 UTC m=+500.350568918" watchObservedRunningTime="2026-06-13 01:19:08.485133961 +0000 UTC m=+500.351149183" Jun 13 01:19:08.521644 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:08.521597 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-hvmbg" podStartSLOduration=2.236598456 podStartE2EDuration="5.521583674s" totalImagesPullingTime="3.284985218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:19:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:19:08.520087768 +0000 UTC m=+500.386102990" watchObservedRunningTime="2026-06-13 01:19:08.521583674 +0000 UTC m=+500.387598896" Jun 13 01:19:09.477888 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:09.477800 2573 generic.go:356] "Generic (PLEG): container finished" podID="e1270520-6ca4-4adc-8858-70fecd688df8" containerID="441db0bc1b15bcd910ee24d42989829784d0b66a894d5ff016b2e287e3ca0c51" exitCode=0 Jun 13 01:19:09.478302 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:09.477894 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lhldj" event={"ID":"e1270520-6ca4-4adc-8858-70fecd688df8","Type":"ContainerDied","Data":"441db0bc1b15bcd910ee24d42989829784d0b66a894d5ff016b2e287e3ca0c51"} Jun 13 01:19:10.484558 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:10.484521 2573 generic.go:356] "Generic (PLEG): container finished" podID="e1270520-6ca4-4adc-8858-70fecd688df8" containerID="ec7622183b2a2442a0dad978b555f4ff2d4436ec915f5a2b930e77fae90e933f" exitCode=0 Jun 13 01:19:10.484999 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:10.484584 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lhldj" event={"ID":"e1270520-6ca4-4adc-8858-70fecd688df8","Type":"ContainerDied","Data":"ec7622183b2a2442a0dad978b555f4ff2d4436ec915f5a2b930e77fae90e933f"} Jun 13 01:19:11.618452 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.618428 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lhldj" Jun 13 01:19:11.680531 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.680490 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8554b6f6b8-7xcl6"] Jun 13 01:19:11.680891 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.680876 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1270520-6ca4-4adc-8858-70fecd688df8" containerName="extract" Jun 13 01:19:11.681034 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.680893 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1270520-6ca4-4adc-8858-70fecd688df8" containerName="extract" Jun 13 01:19:11.681034 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.680909 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1270520-6ca4-4adc-8858-70fecd688df8" containerName="util" Jun 13 01:19:11.681034 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.680915 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1270520-6ca4-4adc-8858-70fecd688df8" containerName="util" Jun 13 01:19:11.681034 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.680933 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1270520-6ca4-4adc-8858-70fecd688df8" containerName="pull" Jun 13 01:19:11.681034 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.680938 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1270520-6ca4-4adc-8858-70fecd688df8" containerName="pull" Jun 13 01:19:11.681034 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.681032 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1270520-6ca4-4adc-8858-70fecd688df8" containerName="extract" Jun 13 01:19:11.683961 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.683930 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-7xcl6" Jun 13 01:19:11.688589 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.688556 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-fccpl\"" Jun 13 01:19:11.688938 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.688922 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 13 01:19:11.689017 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.688975 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 13 01:19:11.689066 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.689050 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 13 01:19:11.697500 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.697478 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8554b6f6b8-7xcl6"] Jun 13 01:19:11.701455 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.701424 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rc4nh\" (UniqueName: \"kubernetes.io/projected/e1270520-6ca4-4adc-8858-70fecd688df8-kube-api-access-rc4nh\") pod \"e1270520-6ca4-4adc-8858-70fecd688df8\" (UID: \"e1270520-6ca4-4adc-8858-70fecd688df8\") " Jun 13 01:19:11.701554 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.701512 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1270520-6ca4-4adc-8858-70fecd688df8-bundle\") pod \"e1270520-6ca4-4adc-8858-70fecd688df8\" (UID: \"e1270520-6ca4-4adc-8858-70fecd688df8\") " Jun 13 01:19:11.701554 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.701536 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1270520-6ca4-4adc-8858-70fecd688df8-util\") pod \"e1270520-6ca4-4adc-8858-70fecd688df8\" (UID: \"e1270520-6ca4-4adc-8858-70fecd688df8\") " Jun 13 01:19:11.702412 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.702387 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1270520-6ca4-4adc-8858-70fecd688df8-bundle" (OuterVolumeSpecName: "bundle") pod "e1270520-6ca4-4adc-8858-70fecd688df8" (UID: "e1270520-6ca4-4adc-8858-70fecd688df8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:19:11.703469 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.703440 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1270520-6ca4-4adc-8858-70fecd688df8-kube-api-access-rc4nh" (OuterVolumeSpecName: "kube-api-access-rc4nh") pod "e1270520-6ca4-4adc-8858-70fecd688df8" (UID: "e1270520-6ca4-4adc-8858-70fecd688df8"). InnerVolumeSpecName "kube-api-access-rc4nh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:19:11.706395 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.706372 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1270520-6ca4-4adc-8858-70fecd688df8-util" (OuterVolumeSpecName: "util") pod "e1270520-6ca4-4adc-8858-70fecd688df8" (UID: "e1270520-6ca4-4adc-8858-70fecd688df8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:19:11.802724 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.802644 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f5b7baf3-d0bc-4234-8fa5-4cb63e625f18-manager-config\") pod \"lws-controller-manager-8554b6f6b8-7xcl6\" (UID: \"f5b7baf3-d0bc-4234-8fa5-4cb63e625f18\") " pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-7xcl6" Jun 13 01:19:11.802724 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.802683 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f5b7baf3-d0bc-4234-8fa5-4cb63e625f18-metrics-cert\") pod \"lws-controller-manager-8554b6f6b8-7xcl6\" (UID: \"f5b7baf3-d0bc-4234-8fa5-4cb63e625f18\") " pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-7xcl6" Jun 13 01:19:11.802909 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.802819 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5b7baf3-d0bc-4234-8fa5-4cb63e625f18-cert\") pod \"lws-controller-manager-8554b6f6b8-7xcl6\" (UID: \"f5b7baf3-d0bc-4234-8fa5-4cb63e625f18\") " pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-7xcl6" Jun 13 01:19:11.802909 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.802852 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwrkn\" (UniqueName: \"kubernetes.io/projected/f5b7baf3-d0bc-4234-8fa5-4cb63e625f18-kube-api-access-dwrkn\") pod \"lws-controller-manager-8554b6f6b8-7xcl6\" (UID: \"f5b7baf3-d0bc-4234-8fa5-4cb63e625f18\") " pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-7xcl6" Jun 13 01:19:11.802909 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.802908 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rc4nh\" (UniqueName: \"kubernetes.io/projected/e1270520-6ca4-4adc-8858-70fecd688df8-kube-api-access-rc4nh\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:19:11.803026 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.802918 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1270520-6ca4-4adc-8858-70fecd688df8-bundle\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:19:11.803026 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.802927 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1270520-6ca4-4adc-8858-70fecd688df8-util\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:19:11.904182 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.904144 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f5b7baf3-d0bc-4234-8fa5-4cb63e625f18-manager-config\") pod \"lws-controller-manager-8554b6f6b8-7xcl6\" (UID: \"f5b7baf3-d0bc-4234-8fa5-4cb63e625f18\") " pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-7xcl6" Jun 13 01:19:11.904182 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.904186 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f5b7baf3-d0bc-4234-8fa5-4cb63e625f18-metrics-cert\") pod \"lws-controller-manager-8554b6f6b8-7xcl6\" (UID: \"f5b7baf3-d0bc-4234-8fa5-4cb63e625f18\") " pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-7xcl6" Jun 13 01:19:11.904447 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.904256 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5b7baf3-d0bc-4234-8fa5-4cb63e625f18-cert\") pod \"lws-controller-manager-8554b6f6b8-7xcl6\" (UID: \"f5b7baf3-d0bc-4234-8fa5-4cb63e625f18\") " pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-7xcl6" Jun 13 01:19:11.904447 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.904276 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwrkn\" (UniqueName: \"kubernetes.io/projected/f5b7baf3-d0bc-4234-8fa5-4cb63e625f18-kube-api-access-dwrkn\") pod \"lws-controller-manager-8554b6f6b8-7xcl6\" (UID: \"f5b7baf3-d0bc-4234-8fa5-4cb63e625f18\") " pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-7xcl6" Jun 13 01:19:11.904920 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.904894 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f5b7baf3-d0bc-4234-8fa5-4cb63e625f18-manager-config\") pod \"lws-controller-manager-8554b6f6b8-7xcl6\" (UID: \"f5b7baf3-d0bc-4234-8fa5-4cb63e625f18\") " pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-7xcl6" Jun 13 01:19:11.906744 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.906715 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f5b7baf3-d0bc-4234-8fa5-4cb63e625f18-metrics-cert\") pod \"lws-controller-manager-8554b6f6b8-7xcl6\" (UID: \"f5b7baf3-d0bc-4234-8fa5-4cb63e625f18\") " pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-7xcl6" Jun 13 01:19:11.906851 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.906832 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5b7baf3-d0bc-4234-8fa5-4cb63e625f18-cert\") pod \"lws-controller-manager-8554b6f6b8-7xcl6\" (UID: \"f5b7baf3-d0bc-4234-8fa5-4cb63e625f18\") " pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-7xcl6" Jun 13 01:19:11.913115 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.913090 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwrkn\" (UniqueName: \"kubernetes.io/projected/f5b7baf3-d0bc-4234-8fa5-4cb63e625f18-kube-api-access-dwrkn\") pod \"lws-controller-manager-8554b6f6b8-7xcl6\" (UID: \"f5b7baf3-d0bc-4234-8fa5-4cb63e625f18\") " pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-7xcl6" Jun 13 01:19:11.994154 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:11.994124 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-7xcl6" Jun 13 01:19:12.125116 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:12.125091 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8554b6f6b8-7xcl6"] Jun 13 01:19:12.127541 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:19:12.127517 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5b7baf3_d0bc_4234_8fa5_4cb63e625f18.slice/crio-7d6c10932235187095eb220c4c2d75df0b171dc67eb6540a36c3fc2c69c707b9 WatchSource:0}: Error finding container 7d6c10932235187095eb220c4c2d75df0b171dc67eb6540a36c3fc2c69c707b9: Status 404 returned error can't find the container with id 7d6c10932235187095eb220c4c2d75df0b171dc67eb6540a36c3fc2c69c707b9 Jun 13 01:19:12.497328 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:12.497293 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-7xcl6" event={"ID":"f5b7baf3-d0bc-4234-8fa5-4cb63e625f18","Type":"ContainerStarted","Data":"7d6c10932235187095eb220c4c2d75df0b171dc67eb6540a36c3fc2c69c707b9"} Jun 13 01:19:12.499651 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:12.499617 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lhldj" event={"ID":"e1270520-6ca4-4adc-8858-70fecd688df8","Type":"ContainerDied","Data":"c8f0fe97fd615e2dda4de24d4e6fb379ebb8ab0f2fadf866e8132edbe81ac1c5"} Jun 13 01:19:12.499770 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:12.499664 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lhldj" Jun 13 01:19:12.499770 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:12.499671 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8f0fe97fd615e2dda4de24d4e6fb379ebb8ab0f2fadf866e8132edbe81ac1c5" Jun 13 01:19:13.506340 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:13.506309 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-7xcl6" event={"ID":"f5b7baf3-d0bc-4234-8fa5-4cb63e625f18","Type":"ContainerStarted","Data":"bc2ecb05d87227989f1b247f89e8fc7fba26395c0ad3fc508922d534f1586188"} Jun 13 01:19:13.506693 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:13.506429 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-7xcl6" Jun 13 01:19:13.534337 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:13.534290 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-7xcl6" podStartSLOduration=1.346022801 podStartE2EDuration="2.534274177s" totalImagesPullingTime="1.188251376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:19:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:19:13.532518615 +0000 UTC m=+505.398533838" watchObservedRunningTime="2026-06-13 01:19:13.534274177 +0000 UTC m=+505.400289401" Jun 13 01:19:19.480567 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:19.480536 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-hvmbg" Jun 13 01:19:20.846695 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:20.846662 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alxn8n"] Jun 13 01:19:20.850889 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:20.850870 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alxn8n" Jun 13 01:19:20.853712 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:20.853688 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 13 01:19:20.853829 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:20.853737 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 13 01:19:20.854684 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:20.854666 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fffvh\"" Jun 13 01:19:20.865787 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:20.865764 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alxn8n"] Jun 13 01:19:20.987095 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:20.987056 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tqpv\" (UniqueName: \"kubernetes.io/projected/442d6fa6-2d49-4ad4-99a7-525402c0e6bb-kube-api-access-5tqpv\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alxn8n\" (UID: \"442d6fa6-2d49-4ad4-99a7-525402c0e6bb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alxn8n" Jun 13 01:19:20.987409 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:20.987391 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/442d6fa6-2d49-4ad4-99a7-525402c0e6bb-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alxn8n\" (UID: \"442d6fa6-2d49-4ad4-99a7-525402c0e6bb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alxn8n" Jun 13 01:19:20.987569 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:20.987555 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/442d6fa6-2d49-4ad4-99a7-525402c0e6bb-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alxn8n\" (UID: \"442d6fa6-2d49-4ad4-99a7-525402c0e6bb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alxn8n" Jun 13 01:19:21.088426 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:21.088393 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/442d6fa6-2d49-4ad4-99a7-525402c0e6bb-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alxn8n\" (UID: \"442d6fa6-2d49-4ad4-99a7-525402c0e6bb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alxn8n" Jun 13 01:19:21.088575 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:21.088462 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tqpv\" (UniqueName: \"kubernetes.io/projected/442d6fa6-2d49-4ad4-99a7-525402c0e6bb-kube-api-access-5tqpv\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alxn8n\" (UID: \"442d6fa6-2d49-4ad4-99a7-525402c0e6bb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alxn8n" Jun 13 01:19:21.088575 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:21.088498 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/442d6fa6-2d49-4ad4-99a7-525402c0e6bb-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alxn8n\" (UID: \"442d6fa6-2d49-4ad4-99a7-525402c0e6bb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alxn8n" Jun 13 01:19:21.088761 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:21.088741 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/442d6fa6-2d49-4ad4-99a7-525402c0e6bb-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alxn8n\" (UID: \"442d6fa6-2d49-4ad4-99a7-525402c0e6bb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alxn8n" Jun 13 01:19:21.088805 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:21.088771 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/442d6fa6-2d49-4ad4-99a7-525402c0e6bb-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alxn8n\" (UID: \"442d6fa6-2d49-4ad4-99a7-525402c0e6bb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alxn8n" Jun 13 01:19:21.101335 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:21.101278 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tqpv\" (UniqueName: \"kubernetes.io/projected/442d6fa6-2d49-4ad4-99a7-525402c0e6bb-kube-api-access-5tqpv\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alxn8n\" (UID: \"442d6fa6-2d49-4ad4-99a7-525402c0e6bb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alxn8n" Jun 13 01:19:21.160326 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:21.160293 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alxn8n" Jun 13 01:19:21.304903 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:21.304874 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alxn8n"] Jun 13 01:19:21.305930 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:19:21.305905 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod442d6fa6_2d49_4ad4_99a7_525402c0e6bb.slice/crio-fd3c48547ff099821a338cdf55fc4403fe44792da21250d09cab596b68413caf WatchSource:0}: Error finding container fd3c48547ff099821a338cdf55fc4403fe44792da21250d09cab596b68413caf: Status 404 returned error can't find the container with id fd3c48547ff099821a338cdf55fc4403fe44792da21250d09cab596b68413caf Jun 13 01:19:21.555490 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:21.555453 2573 generic.go:356] "Generic (PLEG): container finished" podID="442d6fa6-2d49-4ad4-99a7-525402c0e6bb" containerID="089610c5eb9afc27bfd5facbed72628c9bd704ddeb5156dc69f24256152ba6b0" exitCode=0 Jun 13 01:19:21.555634 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:21.555496 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alxn8n" event={"ID":"442d6fa6-2d49-4ad4-99a7-525402c0e6bb","Type":"ContainerDied","Data":"089610c5eb9afc27bfd5facbed72628c9bd704ddeb5156dc69f24256152ba6b0"} Jun 13 01:19:21.555634 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:21.555539 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alxn8n" event={"ID":"442d6fa6-2d49-4ad4-99a7-525402c0e6bb","Type":"ContainerStarted","Data":"fd3c48547ff099821a338cdf55fc4403fe44792da21250d09cab596b68413caf"} Jun 13 01:19:22.562260 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:22.562224 2573 generic.go:356] "Generic (PLEG): container finished" podID="442d6fa6-2d49-4ad4-99a7-525402c0e6bb" containerID="6b3bd47d68c7e225526c773622652e9bd2e04a83535f634b934d11e03ad5bb1a" exitCode=0 Jun 13 01:19:22.562605 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:22.562273 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alxn8n" event={"ID":"442d6fa6-2d49-4ad4-99a7-525402c0e6bb","Type":"ContainerDied","Data":"6b3bd47d68c7e225526c773622652e9bd2e04a83535f634b934d11e03ad5bb1a"} Jun 13 01:19:23.569875 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:23.569839 2573 generic.go:356] "Generic (PLEG): container finished" podID="442d6fa6-2d49-4ad4-99a7-525402c0e6bb" containerID="5eaaece6086afb5356e62e89404e2d7fc02e6311e13eb6a2be74056095dce486" exitCode=0 Jun 13 01:19:23.570273 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:23.569933 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alxn8n" event={"ID":"442d6fa6-2d49-4ad4-99a7-525402c0e6bb","Type":"ContainerDied","Data":"5eaaece6086afb5356e62e89404e2d7fc02e6311e13eb6a2be74056095dce486"} Jun 13 01:19:24.515292 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:24.515263 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-7xcl6" Jun 13 01:19:24.715507 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:24.715479 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alxn8n" Jun 13 01:19:24.715883 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:24.715757 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tqpv\" (UniqueName: \"kubernetes.io/projected/442d6fa6-2d49-4ad4-99a7-525402c0e6bb-kube-api-access-5tqpv\") pod \"442d6fa6-2d49-4ad4-99a7-525402c0e6bb\" (UID: \"442d6fa6-2d49-4ad4-99a7-525402c0e6bb\") " Jun 13 01:19:24.715883 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:24.715814 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/442d6fa6-2d49-4ad4-99a7-525402c0e6bb-util\") pod \"442d6fa6-2d49-4ad4-99a7-525402c0e6bb\" (UID: \"442d6fa6-2d49-4ad4-99a7-525402c0e6bb\") " Jun 13 01:19:24.715883 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:24.715873 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/442d6fa6-2d49-4ad4-99a7-525402c0e6bb-bundle\") pod \"442d6fa6-2d49-4ad4-99a7-525402c0e6bb\" (UID: \"442d6fa6-2d49-4ad4-99a7-525402c0e6bb\") " Jun 13 01:19:24.716668 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:24.716641 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/442d6fa6-2d49-4ad4-99a7-525402c0e6bb-bundle" (OuterVolumeSpecName: "bundle") pod "442d6fa6-2d49-4ad4-99a7-525402c0e6bb" (UID: "442d6fa6-2d49-4ad4-99a7-525402c0e6bb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:19:24.717852 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:24.717830 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/442d6fa6-2d49-4ad4-99a7-525402c0e6bb-kube-api-access-5tqpv" (OuterVolumeSpecName: "kube-api-access-5tqpv") pod "442d6fa6-2d49-4ad4-99a7-525402c0e6bb" (UID: "442d6fa6-2d49-4ad4-99a7-525402c0e6bb"). InnerVolumeSpecName "kube-api-access-5tqpv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:19:24.721567 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:24.721533 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/442d6fa6-2d49-4ad4-99a7-525402c0e6bb-util" (OuterVolumeSpecName: "util") pod "442d6fa6-2d49-4ad4-99a7-525402c0e6bb" (UID: "442d6fa6-2d49-4ad4-99a7-525402c0e6bb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:19:24.816622 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:24.816547 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/442d6fa6-2d49-4ad4-99a7-525402c0e6bb-util\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:19:24.816622 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:24.816573 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/442d6fa6-2d49-4ad4-99a7-525402c0e6bb-bundle\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:19:24.816622 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:24.816583 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tqpv\" (UniqueName: \"kubernetes.io/projected/442d6fa6-2d49-4ad4-99a7-525402c0e6bb-kube-api-access-5tqpv\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:19:25.582873 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:25.582845 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alxn8n" Jun 13 01:19:25.583070 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:25.582867 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alxn8n" event={"ID":"442d6fa6-2d49-4ad4-99a7-525402c0e6bb","Type":"ContainerDied","Data":"fd3c48547ff099821a338cdf55fc4403fe44792da21250d09cab596b68413caf"} Jun 13 01:19:25.583070 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:19:25.582918 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fd3c48547ff099821a338cdf55fc4403fe44792da21250d09cab596b68413caf" Jun 13 01:20:20.368453 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:20.368412 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02hwbb"] Jun 13 01:20:20.369087 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:20.368901 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="442d6fa6-2d49-4ad4-99a7-525402c0e6bb" containerName="util" Jun 13 01:20:20.369087 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:20.368921 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="442d6fa6-2d49-4ad4-99a7-525402c0e6bb" containerName="util" Jun 13 01:20:20.369087 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:20.368970 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="442d6fa6-2d49-4ad4-99a7-525402c0e6bb" containerName="pull" Jun 13 01:20:20.369087 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:20.368979 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="442d6fa6-2d49-4ad4-99a7-525402c0e6bb" containerName="pull" Jun 13 01:20:20.369087 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:20.368998 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="442d6fa6-2d49-4ad4-99a7-525402c0e6bb" containerName="extract" Jun 13 01:20:20.369087 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:20.369007 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="442d6fa6-2d49-4ad4-99a7-525402c0e6bb" containerName="extract" Jun 13 01:20:20.369406 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:20.369106 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="442d6fa6-2d49-4ad4-99a7-525402c0e6bb" containerName="extract" Jun 13 01:20:20.371543 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:20.371521 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02hwbb" Jun 13 01:20:20.374079 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:20.374061 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 13 01:20:20.375048 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:20.375027 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gnhtx\"" Jun 13 01:20:20.375118 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:20.375027 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 13 01:20:20.384324 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:20.384303 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02hwbb"] Jun 13 01:20:20.464909 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:20.464876 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2494\" (UniqueName: \"kubernetes.io/projected/ca68196d-11bc-47a3-8b7d-66f9b2814c01-kube-api-access-r2494\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02hwbb\" (UID: \"ca68196d-11bc-47a3-8b7d-66f9b2814c01\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02hwbb" Jun 13 01:20:20.465073 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:20.464915 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca68196d-11bc-47a3-8b7d-66f9b2814c01-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02hwbb\" (UID: \"ca68196d-11bc-47a3-8b7d-66f9b2814c01\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02hwbb" Jun 13 01:20:20.465073 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:20.465001 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca68196d-11bc-47a3-8b7d-66f9b2814c01-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02hwbb\" (UID: \"ca68196d-11bc-47a3-8b7d-66f9b2814c01\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02hwbb" Jun 13 01:20:20.566408 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:20.566378 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2494\" (UniqueName: \"kubernetes.io/projected/ca68196d-11bc-47a3-8b7d-66f9b2814c01-kube-api-access-r2494\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02hwbb\" (UID: \"ca68196d-11bc-47a3-8b7d-66f9b2814c01\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02hwbb" Jun 13 01:20:20.566581 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:20.566415 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca68196d-11bc-47a3-8b7d-66f9b2814c01-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02hwbb\" (UID: \"ca68196d-11bc-47a3-8b7d-66f9b2814c01\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02hwbb" Jun 13 01:20:20.566581 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:20.566448 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca68196d-11bc-47a3-8b7d-66f9b2814c01-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02hwbb\" (UID: \"ca68196d-11bc-47a3-8b7d-66f9b2814c01\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02hwbb" Jun 13 01:20:20.566754 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:20.566730 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca68196d-11bc-47a3-8b7d-66f9b2814c01-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02hwbb\" (UID: \"ca68196d-11bc-47a3-8b7d-66f9b2814c01\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02hwbb" Jun 13 01:20:20.566892 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:20.566758 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca68196d-11bc-47a3-8b7d-66f9b2814c01-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02hwbb\" (UID: \"ca68196d-11bc-47a3-8b7d-66f9b2814c01\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02hwbb" Jun 13 01:20:20.574769 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:20.574745 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2494\" (UniqueName: \"kubernetes.io/projected/ca68196d-11bc-47a3-8b7d-66f9b2814c01-kube-api-access-r2494\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02hwbb\" (UID: \"ca68196d-11bc-47a3-8b7d-66f9b2814c01\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02hwbb" Jun 13 01:20:20.680246 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:20.680220 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02hwbb" Jun 13 01:20:20.806591 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:20.806565 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02hwbb"] Jun 13 01:20:20.808188 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:20:20.808163 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca68196d_11bc_47a3_8b7d_66f9b2814c01.slice/crio-f74032e484c318e9e7536accb619913cd44be2e1a42a9eace7e8c34069e5d104 WatchSource:0}: Error finding container f74032e484c318e9e7536accb619913cd44be2e1a42a9eace7e8c34069e5d104: Status 404 returned error can't find the container with id f74032e484c318e9e7536accb619913cd44be2e1a42a9eace7e8c34069e5d104 Jun 13 01:20:20.855836 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:20.855811 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02hwbb" event={"ID":"ca68196d-11bc-47a3-8b7d-66f9b2814c01","Type":"ContainerStarted","Data":"f74032e484c318e9e7536accb619913cd44be2e1a42a9eace7e8c34069e5d104"} Jun 13 01:20:20.960617 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:20.960547 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925xff"] Jun 13 01:20:20.962872 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:20.962857 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925xff" Jun 13 01:20:20.971644 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:20.971623 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925xff"] Jun 13 01:20:21.070273 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.070242 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7809474f-bcc4-4820-a901-6e9c674f2b16-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925xff\" (UID: \"7809474f-bcc4-4820-a901-6e9c674f2b16\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925xff" Jun 13 01:20:21.070420 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.070314 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfvqj\" (UniqueName: \"kubernetes.io/projected/7809474f-bcc4-4820-a901-6e9c674f2b16-kube-api-access-sfvqj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925xff\" (UID: \"7809474f-bcc4-4820-a901-6e9c674f2b16\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925xff" Jun 13 01:20:21.070420 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.070359 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7809474f-bcc4-4820-a901-6e9c674f2b16-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925xff\" (UID: \"7809474f-bcc4-4820-a901-6e9c674f2b16\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925xff" Jun 13 01:20:21.171740 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.171698 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfvqj\" (UniqueName: \"kubernetes.io/projected/7809474f-bcc4-4820-a901-6e9c674f2b16-kube-api-access-sfvqj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925xff\" (UID: \"7809474f-bcc4-4820-a901-6e9c674f2b16\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925xff" Jun 13 01:20:21.171901 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.171776 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7809474f-bcc4-4820-a901-6e9c674f2b16-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925xff\" (UID: \"7809474f-bcc4-4820-a901-6e9c674f2b16\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925xff" Jun 13 01:20:21.171901 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.171821 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7809474f-bcc4-4820-a901-6e9c674f2b16-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925xff\" (UID: \"7809474f-bcc4-4820-a901-6e9c674f2b16\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925xff" Jun 13 01:20:21.172215 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.172196 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7809474f-bcc4-4820-a901-6e9c674f2b16-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925xff\" (UID: \"7809474f-bcc4-4820-a901-6e9c674f2b16\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925xff" Jun 13 01:20:21.172276 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.172256 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7809474f-bcc4-4820-a901-6e9c674f2b16-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925xff\" (UID: \"7809474f-bcc4-4820-a901-6e9c674f2b16\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925xff" Jun 13 01:20:21.179999 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.179976 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfvqj\" (UniqueName: \"kubernetes.io/projected/7809474f-bcc4-4820-a901-6e9c674f2b16-kube-api-access-sfvqj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925xff\" (UID: \"7809474f-bcc4-4820-a901-6e9c674f2b16\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925xff" Jun 13 01:20:21.272574 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.272498 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925xff" Jun 13 01:20:21.358896 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.358868 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gkqhz"] Jun 13 01:20:21.361426 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.361404 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gkqhz" Jun 13 01:20:21.372629 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.372605 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gkqhz"] Jun 13 01:20:21.401848 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.401826 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925xff"] Jun 13 01:20:21.403309 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:20:21.403273 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7809474f_bcc4_4820_a901_6e9c674f2b16.slice/crio-3326934c011ec8dc7272b301aca55cb41bf633fd4fe017af532c931be6f2a92f WatchSource:0}: Error finding container 3326934c011ec8dc7272b301aca55cb41bf633fd4fe017af532c931be6f2a92f: Status 404 returned error can't find the container with id 3326934c011ec8dc7272b301aca55cb41bf633fd4fe017af532c931be6f2a92f Jun 13 01:20:21.474252 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.474228 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqkdj\" (UniqueName: \"kubernetes.io/projected/a2a36b19-4afd-41bc-8884-d579597eff4e-kube-api-access-jqkdj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gkqhz\" (UID: \"a2a36b19-4afd-41bc-8884-d579597eff4e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gkqhz" Jun 13 01:20:21.474340 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.474266 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2a36b19-4afd-41bc-8884-d579597eff4e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gkqhz\" (UID: \"a2a36b19-4afd-41bc-8884-d579597eff4e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gkqhz" Jun 13 01:20:21.474396 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.474365 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2a36b19-4afd-41bc-8884-d579597eff4e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gkqhz\" (UID: \"a2a36b19-4afd-41bc-8884-d579597eff4e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gkqhz" Jun 13 01:20:21.575253 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.575185 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2a36b19-4afd-41bc-8884-d579597eff4e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gkqhz\" (UID: \"a2a36b19-4afd-41bc-8884-d579597eff4e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gkqhz" Jun 13 01:20:21.575253 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.575245 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqkdj\" (UniqueName: \"kubernetes.io/projected/a2a36b19-4afd-41bc-8884-d579597eff4e-kube-api-access-jqkdj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gkqhz\" (UID: \"a2a36b19-4afd-41bc-8884-d579597eff4e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gkqhz" Jun 13 01:20:21.575389 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.575282 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2a36b19-4afd-41bc-8884-d579597eff4e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gkqhz\" (UID: \"a2a36b19-4afd-41bc-8884-d579597eff4e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gkqhz" Jun 13 01:20:21.575532 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.575514 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2a36b19-4afd-41bc-8884-d579597eff4e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gkqhz\" (UID: \"a2a36b19-4afd-41bc-8884-d579597eff4e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gkqhz" Jun 13 01:20:21.575611 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.575593 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2a36b19-4afd-41bc-8884-d579597eff4e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gkqhz\" (UID: \"a2a36b19-4afd-41bc-8884-d579597eff4e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gkqhz" Jun 13 01:20:21.586364 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.586343 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqkdj\" (UniqueName: \"kubernetes.io/projected/a2a36b19-4afd-41bc-8884-d579597eff4e-kube-api-access-jqkdj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gkqhz\" (UID: \"a2a36b19-4afd-41bc-8884-d579597eff4e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gkqhz" Jun 13 01:20:21.672894 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.672861 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gkqhz" Jun 13 01:20:21.760780 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.760748 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tnqlb"] Jun 13 01:20:21.764114 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.764096 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tnqlb" Jun 13 01:20:21.771436 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.771413 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tnqlb"] Jun 13 01:20:21.840878 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.840849 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gkqhz"] Jun 13 01:20:21.842766 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:20:21.842734 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2a36b19_4afd_41bc_8884_d579597eff4e.slice/crio-826ad345e50e3de0836b1104b2196f28bad5cb18c1e8ff7acb411f3e81fe8b83 WatchSource:0}: Error finding container 826ad345e50e3de0836b1104b2196f28bad5cb18c1e8ff7acb411f3e81fe8b83: Status 404 returned error can't find the container with id 826ad345e50e3de0836b1104b2196f28bad5cb18c1e8ff7acb411f3e81fe8b83 Jun 13 01:20:21.862739 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.862714 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gkqhz" event={"ID":"a2a36b19-4afd-41bc-8884-d579597eff4e","Type":"ContainerStarted","Data":"826ad345e50e3de0836b1104b2196f28bad5cb18c1e8ff7acb411f3e81fe8b83"} Jun 13 01:20:21.864095 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.864072 2573 generic.go:356] "Generic (PLEG): container finished" podID="7809474f-bcc4-4820-a901-6e9c674f2b16" containerID="aec7526450c4a309d1e9b938e0601c00c4c92a089359e349821c4d8ca1e53583" exitCode=0 Jun 13 01:20:21.864172 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.864154 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925xff" event={"ID":"7809474f-bcc4-4820-a901-6e9c674f2b16","Type":"ContainerDied","Data":"aec7526450c4a309d1e9b938e0601c00c4c92a089359e349821c4d8ca1e53583"} Jun 13 01:20:21.864227 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.864192 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925xff" event={"ID":"7809474f-bcc4-4820-a901-6e9c674f2b16","Type":"ContainerStarted","Data":"3326934c011ec8dc7272b301aca55cb41bf633fd4fe017af532c931be6f2a92f"} Jun 13 01:20:21.865575 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.865555 2573 generic.go:356] "Generic (PLEG): container finished" podID="ca68196d-11bc-47a3-8b7d-66f9b2814c01" containerID="f737f6b811923d0a8fe715a590346ba047ee4b96db75db54afc97a9dc587a68e" exitCode=0 Jun 13 01:20:21.865667 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.865598 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02hwbb" event={"ID":"ca68196d-11bc-47a3-8b7d-66f9b2814c01","Type":"ContainerDied","Data":"f737f6b811923d0a8fe715a590346ba047ee4b96db75db54afc97a9dc587a68e"} Jun 13 01:20:21.877806 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.877784 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpf5t\" (UniqueName: \"kubernetes.io/projected/da95a02f-fd7c-44d0-b829-732cc9909995-kube-api-access-xpf5t\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tnqlb\" (UID: \"da95a02f-fd7c-44d0-b829-732cc9909995\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tnqlb" Jun 13 01:20:21.877898 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.877821 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da95a02f-fd7c-44d0-b829-732cc9909995-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tnqlb\" (UID: \"da95a02f-fd7c-44d0-b829-732cc9909995\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tnqlb" Jun 13 01:20:21.877962 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.877904 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da95a02f-fd7c-44d0-b829-732cc9909995-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tnqlb\" (UID: \"da95a02f-fd7c-44d0-b829-732cc9909995\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tnqlb" Jun 13 01:20:21.978734 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.978708 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpf5t\" (UniqueName: \"kubernetes.io/projected/da95a02f-fd7c-44d0-b829-732cc9909995-kube-api-access-xpf5t\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tnqlb\" (UID: \"da95a02f-fd7c-44d0-b829-732cc9909995\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tnqlb" Jun 13 01:20:21.978836 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.978745 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da95a02f-fd7c-44d0-b829-732cc9909995-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tnqlb\" (UID: \"da95a02f-fd7c-44d0-b829-732cc9909995\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tnqlb" Jun 13 01:20:21.978888 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.978836 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da95a02f-fd7c-44d0-b829-732cc9909995-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tnqlb\" (UID: \"da95a02f-fd7c-44d0-b829-732cc9909995\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tnqlb" Jun 13 01:20:21.979160 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.979136 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da95a02f-fd7c-44d0-b829-732cc9909995-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tnqlb\" (UID: \"da95a02f-fd7c-44d0-b829-732cc9909995\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tnqlb" Jun 13 01:20:21.979257 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.979202 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da95a02f-fd7c-44d0-b829-732cc9909995-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tnqlb\" (UID: \"da95a02f-fd7c-44d0-b829-732cc9909995\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tnqlb" Jun 13 01:20:21.987833 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:21.987812 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpf5t\" (UniqueName: \"kubernetes.io/projected/da95a02f-fd7c-44d0-b829-732cc9909995-kube-api-access-xpf5t\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tnqlb\" (UID: \"da95a02f-fd7c-44d0-b829-732cc9909995\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tnqlb" Jun 13 01:20:22.076343 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:22.076321 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tnqlb" Jun 13 01:20:22.205707 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:22.205684 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tnqlb"] Jun 13 01:20:22.206778 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:20:22.206753 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda95a02f_fd7c_44d0_b829_732cc9909995.slice/crio-8cf6613300f423b5b309be3762fdebdd02d92267983084e86319e7685c2a7493 WatchSource:0}: Error finding container 8cf6613300f423b5b309be3762fdebdd02d92267983084e86319e7685c2a7493: Status 404 returned error can't find the container with id 8cf6613300f423b5b309be3762fdebdd02d92267983084e86319e7685c2a7493 Jun 13 01:20:22.873443 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:22.873389 2573 generic.go:356] "Generic (PLEG): container finished" podID="7809474f-bcc4-4820-a901-6e9c674f2b16" containerID="79270fa2955fd065f2360b5e4fc677dc1122c29f50ef4350135a8e6fa1bb1004" exitCode=0 Jun 13 01:20:22.873765 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:22.873475 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925xff" event={"ID":"7809474f-bcc4-4820-a901-6e9c674f2b16","Type":"ContainerDied","Data":"79270fa2955fd065f2360b5e4fc677dc1122c29f50ef4350135a8e6fa1bb1004"} Jun 13 01:20:22.875330 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:22.875310 2573 generic.go:356] "Generic (PLEG): container finished" podID="ca68196d-11bc-47a3-8b7d-66f9b2814c01" containerID="be8d4a0a28cfc0b6c7fd889c9a11f79b9d5374da9c8a1584ae5fc7e0a2a69525" exitCode=0 Jun 13 01:20:22.875431 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:22.875385 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02hwbb" event={"ID":"ca68196d-11bc-47a3-8b7d-66f9b2814c01","Type":"ContainerDied","Data":"be8d4a0a28cfc0b6c7fd889c9a11f79b9d5374da9c8a1584ae5fc7e0a2a69525"} Jun 13 01:20:22.876817 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:22.876793 2573 generic.go:356] "Generic (PLEG): container finished" podID="da95a02f-fd7c-44d0-b829-732cc9909995" containerID="cfd2ccf3f8b118aa5bf23dfd8cd35eb89332eb2ca6711c78f2f500f3e2d338ea" exitCode=0 Jun 13 01:20:22.876981 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:22.876898 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tnqlb" event={"ID":"da95a02f-fd7c-44d0-b829-732cc9909995","Type":"ContainerDied","Data":"cfd2ccf3f8b118aa5bf23dfd8cd35eb89332eb2ca6711c78f2f500f3e2d338ea"} Jun 13 01:20:22.876981 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:22.876960 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tnqlb" event={"ID":"da95a02f-fd7c-44d0-b829-732cc9909995","Type":"ContainerStarted","Data":"8cf6613300f423b5b309be3762fdebdd02d92267983084e86319e7685c2a7493"} Jun 13 01:20:22.878558 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:22.878498 2573 generic.go:356] "Generic (PLEG): container finished" podID="a2a36b19-4afd-41bc-8884-d579597eff4e" containerID="f811e5edf4f397978a11fb6e51ccbfbc3fbde37b069d1c66c09fecde1781ea9c" exitCode=0 Jun 13 01:20:22.878558 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:22.878530 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gkqhz" event={"ID":"a2a36b19-4afd-41bc-8884-d579597eff4e","Type":"ContainerDied","Data":"f811e5edf4f397978a11fb6e51ccbfbc3fbde37b069d1c66c09fecde1781ea9c"} Jun 13 01:20:23.885639 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:23.885551 2573 generic.go:356] "Generic (PLEG): container finished" podID="da95a02f-fd7c-44d0-b829-732cc9909995" containerID="dbfd5f7c5ef9b5c33714c08540e8842005e3a492524b849194596bde0c5d1333" exitCode=0 Jun 13 01:20:23.886068 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:23.885642 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tnqlb" event={"ID":"da95a02f-fd7c-44d0-b829-732cc9909995","Type":"ContainerDied","Data":"dbfd5f7c5ef9b5c33714c08540e8842005e3a492524b849194596bde0c5d1333"} Jun 13 01:20:23.887419 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:23.887392 2573 generic.go:356] "Generic (PLEG): container finished" podID="a2a36b19-4afd-41bc-8884-d579597eff4e" containerID="917aec6d137cbc495f9809ba2aed545a04147e1b43d577403a9e634c20dee733" exitCode=0 Jun 13 01:20:23.887534 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:23.887468 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gkqhz" event={"ID":"a2a36b19-4afd-41bc-8884-d579597eff4e","Type":"ContainerDied","Data":"917aec6d137cbc495f9809ba2aed545a04147e1b43d577403a9e634c20dee733"} Jun 13 01:20:23.889698 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:23.889674 2573 generic.go:356] "Generic (PLEG): container finished" podID="7809474f-bcc4-4820-a901-6e9c674f2b16" containerID="e21f65e66ef969066e09ab21aafcce9e88114725c89e3e2e8f3490ecb0b0cc58" exitCode=0 Jun 13 01:20:23.889795 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:23.889762 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925xff" event={"ID":"7809474f-bcc4-4820-a901-6e9c674f2b16","Type":"ContainerDied","Data":"e21f65e66ef969066e09ab21aafcce9e88114725c89e3e2e8f3490ecb0b0cc58"} Jun 13 01:20:23.891706 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:23.891685 2573 generic.go:356] "Generic (PLEG): container finished" podID="ca68196d-11bc-47a3-8b7d-66f9b2814c01" containerID="de56ffe7014622474b44f4640332bdad8d69cab35a5bd0711e45bff8967b3f97" exitCode=0 Jun 13 01:20:23.891783 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:23.891732 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02hwbb" event={"ID":"ca68196d-11bc-47a3-8b7d-66f9b2814c01","Type":"ContainerDied","Data":"de56ffe7014622474b44f4640332bdad8d69cab35a5bd0711e45bff8967b3f97"} Jun 13 01:20:24.898881 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:24.898851 2573 generic.go:356] "Generic (PLEG): container finished" podID="da95a02f-fd7c-44d0-b829-732cc9909995" containerID="080652358c5f5c9b9753ae1cb2f1cf90f6b23374b1200caf6e962b6ed71c9f4a" exitCode=0 Jun 13 01:20:24.899328 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:24.898952 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tnqlb" event={"ID":"da95a02f-fd7c-44d0-b829-732cc9909995","Type":"ContainerDied","Data":"080652358c5f5c9b9753ae1cb2f1cf90f6b23374b1200caf6e962b6ed71c9f4a"} Jun 13 01:20:24.900881 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:24.900859 2573 generic.go:356] "Generic (PLEG): container finished" podID="a2a36b19-4afd-41bc-8884-d579597eff4e" containerID="77bdb769221a8f287c8ae6991fde1a213766a594924929fe6920d54ef4d052da" exitCode=0 Jun 13 01:20:24.901026 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:24.900899 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gkqhz" event={"ID":"a2a36b19-4afd-41bc-8884-d579597eff4e","Type":"ContainerDied","Data":"77bdb769221a8f287c8ae6991fde1a213766a594924929fe6920d54ef4d052da"} Jun 13 01:20:25.036132 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:25.036108 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02hwbb" Jun 13 01:20:25.063472 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:25.063450 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925xff" Jun 13 01:20:25.207833 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:25.207756 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfvqj\" (UniqueName: \"kubernetes.io/projected/7809474f-bcc4-4820-a901-6e9c674f2b16-kube-api-access-sfvqj\") pod \"7809474f-bcc4-4820-a901-6e9c674f2b16\" (UID: \"7809474f-bcc4-4820-a901-6e9c674f2b16\") " Jun 13 01:20:25.207833 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:25.207793 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7809474f-bcc4-4820-a901-6e9c674f2b16-bundle\") pod \"7809474f-bcc4-4820-a901-6e9c674f2b16\" (UID: \"7809474f-bcc4-4820-a901-6e9c674f2b16\") " Jun 13 01:20:25.207833 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:25.207829 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca68196d-11bc-47a3-8b7d-66f9b2814c01-util\") pod \"ca68196d-11bc-47a3-8b7d-66f9b2814c01\" (UID: \"ca68196d-11bc-47a3-8b7d-66f9b2814c01\") " Jun 13 01:20:25.208139 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:25.207851 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2494\" (UniqueName: \"kubernetes.io/projected/ca68196d-11bc-47a3-8b7d-66f9b2814c01-kube-api-access-r2494\") pod \"ca68196d-11bc-47a3-8b7d-66f9b2814c01\" (UID: \"ca68196d-11bc-47a3-8b7d-66f9b2814c01\") " Jun 13 01:20:25.208139 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:25.207877 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca68196d-11bc-47a3-8b7d-66f9b2814c01-bundle\") pod \"ca68196d-11bc-47a3-8b7d-66f9b2814c01\" (UID: \"ca68196d-11bc-47a3-8b7d-66f9b2814c01\") " Jun 13 01:20:25.208139 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:25.207940 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7809474f-bcc4-4820-a901-6e9c674f2b16-util\") pod \"7809474f-bcc4-4820-a901-6e9c674f2b16\" (UID: \"7809474f-bcc4-4820-a901-6e9c674f2b16\") " Jun 13 01:20:25.208402 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:25.208372 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7809474f-bcc4-4820-a901-6e9c674f2b16-bundle" (OuterVolumeSpecName: "bundle") pod "7809474f-bcc4-4820-a901-6e9c674f2b16" (UID: "7809474f-bcc4-4820-a901-6e9c674f2b16"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:20:25.208481 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:25.208406 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca68196d-11bc-47a3-8b7d-66f9b2814c01-bundle" (OuterVolumeSpecName: "bundle") pod "ca68196d-11bc-47a3-8b7d-66f9b2814c01" (UID: "ca68196d-11bc-47a3-8b7d-66f9b2814c01"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:20:25.210186 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:25.210159 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7809474f-bcc4-4820-a901-6e9c674f2b16-kube-api-access-sfvqj" (OuterVolumeSpecName: "kube-api-access-sfvqj") pod "7809474f-bcc4-4820-a901-6e9c674f2b16" (UID: "7809474f-bcc4-4820-a901-6e9c674f2b16"). InnerVolumeSpecName "kube-api-access-sfvqj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:20:25.210318 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:25.210296 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca68196d-11bc-47a3-8b7d-66f9b2814c01-kube-api-access-r2494" (OuterVolumeSpecName: "kube-api-access-r2494") pod "ca68196d-11bc-47a3-8b7d-66f9b2814c01" (UID: "ca68196d-11bc-47a3-8b7d-66f9b2814c01"). InnerVolumeSpecName "kube-api-access-r2494". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:20:25.215701 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:25.215675 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7809474f-bcc4-4820-a901-6e9c674f2b16-util" (OuterVolumeSpecName: "util") pod "7809474f-bcc4-4820-a901-6e9c674f2b16" (UID: "7809474f-bcc4-4820-a901-6e9c674f2b16"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:20:25.216752 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:25.216735 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca68196d-11bc-47a3-8b7d-66f9b2814c01-util" (OuterVolumeSpecName: "util") pod "ca68196d-11bc-47a3-8b7d-66f9b2814c01" (UID: "ca68196d-11bc-47a3-8b7d-66f9b2814c01"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:20:25.309289 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:25.309264 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfvqj\" (UniqueName: \"kubernetes.io/projected/7809474f-bcc4-4820-a901-6e9c674f2b16-kube-api-access-sfvqj\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:20:25.309289 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:25.309289 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7809474f-bcc4-4820-a901-6e9c674f2b16-bundle\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:20:25.309417 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:25.309299 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca68196d-11bc-47a3-8b7d-66f9b2814c01-util\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:20:25.309417 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:25.309307 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2494\" (UniqueName: \"kubernetes.io/projected/ca68196d-11bc-47a3-8b7d-66f9b2814c01-kube-api-access-r2494\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:20:25.309417 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:25.309316 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca68196d-11bc-47a3-8b7d-66f9b2814c01-bundle\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:20:25.309417 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:25.309324 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7809474f-bcc4-4820-a901-6e9c674f2b16-util\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:20:25.910714 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:25.910690 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925xff" Jun 13 01:20:25.911148 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:25.910690 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925xff" event={"ID":"7809474f-bcc4-4820-a901-6e9c674f2b16","Type":"ContainerDied","Data":"3326934c011ec8dc7272b301aca55cb41bf633fd4fe017af532c931be6f2a92f"} Jun 13 01:20:25.911148 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:25.910807 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3326934c011ec8dc7272b301aca55cb41bf633fd4fe017af532c931be6f2a92f" Jun 13 01:20:25.912429 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:25.912403 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02hwbb" Jun 13 01:20:25.912545 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:25.912432 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02hwbb" event={"ID":"ca68196d-11bc-47a3-8b7d-66f9b2814c01","Type":"ContainerDied","Data":"f74032e484c318e9e7536accb619913cd44be2e1a42a9eace7e8c34069e5d104"} Jun 13 01:20:25.912545 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:25.912471 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f74032e484c318e9e7536accb619913cd44be2e1a42a9eace7e8c34069e5d104" Jun 13 01:20:26.069894 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:26.069873 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tnqlb" Jun 13 01:20:26.071972 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:26.071932 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gkqhz" Jun 13 01:20:26.216211 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:26.216125 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da95a02f-fd7c-44d0-b829-732cc9909995-bundle\") pod \"da95a02f-fd7c-44d0-b829-732cc9909995\" (UID: \"da95a02f-fd7c-44d0-b829-732cc9909995\") " Jun 13 01:20:26.216211 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:26.216196 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqkdj\" (UniqueName: \"kubernetes.io/projected/a2a36b19-4afd-41bc-8884-d579597eff4e-kube-api-access-jqkdj\") pod \"a2a36b19-4afd-41bc-8884-d579597eff4e\" (UID: \"a2a36b19-4afd-41bc-8884-d579597eff4e\") " Jun 13 01:20:26.216386 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:26.216237 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2a36b19-4afd-41bc-8884-d579597eff4e-bundle\") pod \"a2a36b19-4afd-41bc-8884-d579597eff4e\" (UID: \"a2a36b19-4afd-41bc-8884-d579597eff4e\") " Jun 13 01:20:26.216386 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:26.216267 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpf5t\" (UniqueName: \"kubernetes.io/projected/da95a02f-fd7c-44d0-b829-732cc9909995-kube-api-access-xpf5t\") pod \"da95a02f-fd7c-44d0-b829-732cc9909995\" (UID: \"da95a02f-fd7c-44d0-b829-732cc9909995\") " Jun 13 01:20:26.216386 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:26.216291 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2a36b19-4afd-41bc-8884-d579597eff4e-util\") pod \"a2a36b19-4afd-41bc-8884-d579597eff4e\" (UID: \"a2a36b19-4afd-41bc-8884-d579597eff4e\") " Jun 13 01:20:26.216386 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:26.216360 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da95a02f-fd7c-44d0-b829-732cc9909995-util\") pod \"da95a02f-fd7c-44d0-b829-732cc9909995\" (UID: \"da95a02f-fd7c-44d0-b829-732cc9909995\") " Jun 13 01:20:26.216845 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:26.216817 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da95a02f-fd7c-44d0-b829-732cc9909995-bundle" (OuterVolumeSpecName: "bundle") pod "da95a02f-fd7c-44d0-b829-732cc9909995" (UID: "da95a02f-fd7c-44d0-b829-732cc9909995"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:20:26.216977 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:26.216919 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2a36b19-4afd-41bc-8884-d579597eff4e-bundle" (OuterVolumeSpecName: "bundle") pod "a2a36b19-4afd-41bc-8884-d579597eff4e" (UID: "a2a36b19-4afd-41bc-8884-d579597eff4e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:20:26.218791 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:26.218765 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2a36b19-4afd-41bc-8884-d579597eff4e-kube-api-access-jqkdj" (OuterVolumeSpecName: "kube-api-access-jqkdj") pod "a2a36b19-4afd-41bc-8884-d579597eff4e" (UID: "a2a36b19-4afd-41bc-8884-d579597eff4e"). InnerVolumeSpecName "kube-api-access-jqkdj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:20:26.218885 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:26.218849 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da95a02f-fd7c-44d0-b829-732cc9909995-kube-api-access-xpf5t" (OuterVolumeSpecName: "kube-api-access-xpf5t") pod "da95a02f-fd7c-44d0-b829-732cc9909995" (UID: "da95a02f-fd7c-44d0-b829-732cc9909995"). InnerVolumeSpecName "kube-api-access-xpf5t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:20:26.222595 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:26.222563 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da95a02f-fd7c-44d0-b829-732cc9909995-util" (OuterVolumeSpecName: "util") pod "da95a02f-fd7c-44d0-b829-732cc9909995" (UID: "da95a02f-fd7c-44d0-b829-732cc9909995"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:20:26.222710 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:26.222690 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2a36b19-4afd-41bc-8884-d579597eff4e-util" (OuterVolumeSpecName: "util") pod "a2a36b19-4afd-41bc-8884-d579597eff4e" (UID: "a2a36b19-4afd-41bc-8884-d579597eff4e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:20:26.317923 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:26.317893 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da95a02f-fd7c-44d0-b829-732cc9909995-bundle\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:20:26.317923 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:26.317919 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqkdj\" (UniqueName: \"kubernetes.io/projected/a2a36b19-4afd-41bc-8884-d579597eff4e-kube-api-access-jqkdj\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:20:26.318085 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:26.317929 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2a36b19-4afd-41bc-8884-d579597eff4e-bundle\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:20:26.318085 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:26.317938 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpf5t\" (UniqueName: \"kubernetes.io/projected/da95a02f-fd7c-44d0-b829-732cc9909995-kube-api-access-xpf5t\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:20:26.318085 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:26.317966 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2a36b19-4afd-41bc-8884-d579597eff4e-util\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:20:26.318085 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:26.317975 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da95a02f-fd7c-44d0-b829-732cc9909995-util\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:20:26.919812 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:26.919789 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tnqlb" Jun 13 01:20:26.920267 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:26.919784 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tnqlb" event={"ID":"da95a02f-fd7c-44d0-b829-732cc9909995","Type":"ContainerDied","Data":"8cf6613300f423b5b309be3762fdebdd02d92267983084e86319e7685c2a7493"} Jun 13 01:20:26.920267 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:26.919905 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8cf6613300f423b5b309be3762fdebdd02d92267983084e86319e7685c2a7493" Jun 13 01:20:26.921779 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:26.921755 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gkqhz" event={"ID":"a2a36b19-4afd-41bc-8884-d579597eff4e","Type":"ContainerDied","Data":"826ad345e50e3de0836b1104b2196f28bad5cb18c1e8ff7acb411f3e81fe8b83"} Jun 13 01:20:26.921918 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:26.921797 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="826ad345e50e3de0836b1104b2196f28bad5cb18c1e8ff7acb411f3e81fe8b83" Jun 13 01:20:26.921918 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:26.921762 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gkqhz" Jun 13 01:20:48.517387 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:48.517355 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bb7cg_f53056e7-0404-4074-bc19-664e206fce89/console-operator/1.log" Jun 13 01:20:48.519292 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:48.519265 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bb7cg_f53056e7-0404-4074-bc19-664e206fce89/console-operator/1.log" Jun 13 01:20:48.525779 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:48.525761 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9jdpp_6109025b-0598-4cbf-b841-200e35db36cf/ovn-acl-logging/0.log" Jun 13 01:20:48.527718 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:48.527700 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9jdpp_6109025b-0598-4cbf-b841-200e35db36cf/ovn-acl-logging/0.log" Jun 13 01:20:56.446817 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.443893 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ghbmb"] Jun 13 01:20:56.450025 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.447727 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca68196d-11bc-47a3-8b7d-66f9b2814c01" containerName="pull" Jun 13 01:20:56.450025 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.447752 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca68196d-11bc-47a3-8b7d-66f9b2814c01" containerName="pull" Jun 13 01:20:56.450025 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.447762 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da95a02f-fd7c-44d0-b829-732cc9909995" containerName="extract" Jun 13 01:20:56.450025 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.447772 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="da95a02f-fd7c-44d0-b829-732cc9909995" containerName="extract" Jun 13 01:20:56.450025 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.447786 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da95a02f-fd7c-44d0-b829-732cc9909995" containerName="pull" Jun 13 01:20:56.450025 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.447795 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="da95a02f-fd7c-44d0-b829-732cc9909995" containerName="pull" Jun 13 01:20:56.450025 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.447822 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca68196d-11bc-47a3-8b7d-66f9b2814c01" containerName="util" Jun 13 01:20:56.450025 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.447831 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca68196d-11bc-47a3-8b7d-66f9b2814c01" containerName="util" Jun 13 01:20:56.450025 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.447844 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2a36b19-4afd-41bc-8884-d579597eff4e" containerName="util" Jun 13 01:20:56.450025 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.447851 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2a36b19-4afd-41bc-8884-d579597eff4e" containerName="util" Jun 13 01:20:56.450025 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.447864 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7809474f-bcc4-4820-a901-6e9c674f2b16" containerName="pull" Jun 13 01:20:56.450025 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.447873 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7809474f-bcc4-4820-a901-6e9c674f2b16" containerName="pull" Jun 13 01:20:56.450025 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.447883 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7809474f-bcc4-4820-a901-6e9c674f2b16" containerName="util" Jun 13 01:20:56.450025 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.447892 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7809474f-bcc4-4820-a901-6e9c674f2b16" containerName="util" Jun 13 01:20:56.450025 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.447900 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da95a02f-fd7c-44d0-b829-732cc9909995" containerName="util" Jun 13 01:20:56.450025 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.447908 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="da95a02f-fd7c-44d0-b829-732cc9909995" containerName="util" Jun 13 01:20:56.450025 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.447917 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2a36b19-4afd-41bc-8884-d579597eff4e" containerName="extract" Jun 13 01:20:56.450025 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.447925 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2a36b19-4afd-41bc-8884-d579597eff4e" containerName="extract" Jun 13 01:20:56.450025 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.447935 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7809474f-bcc4-4820-a901-6e9c674f2b16" containerName="extract" Jun 13 01:20:56.450025 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.447962 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7809474f-bcc4-4820-a901-6e9c674f2b16" containerName="extract" Jun 13 01:20:56.450025 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.447971 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2a36b19-4afd-41bc-8884-d579597eff4e" containerName="pull" Jun 13 01:20:56.450025 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.447979 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2a36b19-4afd-41bc-8884-d579597eff4e" containerName="pull" Jun 13 01:20:56.450025 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.447990 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca68196d-11bc-47a3-8b7d-66f9b2814c01" containerName="extract" Jun 13 01:20:56.450025 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.447998 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca68196d-11bc-47a3-8b7d-66f9b2814c01" containerName="extract" Jun 13 01:20:56.450025 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.448075 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7809474f-bcc4-4820-a901-6e9c674f2b16" containerName="extract" Jun 13 01:20:56.450025 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.448090 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2a36b19-4afd-41bc-8884-d579597eff4e" containerName="extract" Jun 13 01:20:56.450025 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.448099 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca68196d-11bc-47a3-8b7d-66f9b2814c01" containerName="extract" Jun 13 01:20:56.450025 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.448108 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="da95a02f-fd7c-44d0-b829-732cc9909995" containerName="extract" Jun 13 01:20:56.451344 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.451326 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ghbmb" Jun 13 01:20:56.453913 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.453886 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ghbmb"] Jun 13 01:20:56.454085 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.454066 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 13 01:20:56.454162 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.454096 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 13 01:20:56.454162 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.454075 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 13 01:20:56.454162 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.454141 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gnhtx\"" Jun 13 01:20:56.454703 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.454688 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 13 01:20:56.566532 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.566510 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/170c12ed-d4ae-4a80-be82-9aab5c9a9d6a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ghbmb\" (UID: \"170c12ed-d4ae-4a80-be82-9aab5c9a9d6a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ghbmb" Jun 13 01:20:56.566657 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.566542 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/170c12ed-d4ae-4a80-be82-9aab5c9a9d6a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ghbmb\" (UID: \"170c12ed-d4ae-4a80-be82-9aab5c9a9d6a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ghbmb" Jun 13 01:20:56.566657 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.566573 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj828\" (UniqueName: \"kubernetes.io/projected/170c12ed-d4ae-4a80-be82-9aab5c9a9d6a-kube-api-access-zj828\") pod \"kuadrant-console-plugin-66b5774985-ghbmb\" (UID: \"170c12ed-d4ae-4a80-be82-9aab5c9a9d6a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ghbmb" Jun 13 01:20:56.667337 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.667313 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj828\" (UniqueName: \"kubernetes.io/projected/170c12ed-d4ae-4a80-be82-9aab5c9a9d6a-kube-api-access-zj828\") pod \"kuadrant-console-plugin-66b5774985-ghbmb\" (UID: \"170c12ed-d4ae-4a80-be82-9aab5c9a9d6a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ghbmb" Jun 13 01:20:56.667446 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.667383 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/170c12ed-d4ae-4a80-be82-9aab5c9a9d6a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ghbmb\" (UID: \"170c12ed-d4ae-4a80-be82-9aab5c9a9d6a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ghbmb" Jun 13 01:20:56.667446 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.667413 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/170c12ed-d4ae-4a80-be82-9aab5c9a9d6a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ghbmb\" (UID: \"170c12ed-d4ae-4a80-be82-9aab5c9a9d6a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ghbmb" Jun 13 01:20:56.667550 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:20:56.667535 2573 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 13 01:20:56.667619 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:20:56.667609 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/170c12ed-d4ae-4a80-be82-9aab5c9a9d6a-plugin-serving-cert podName:170c12ed-d4ae-4a80-be82-9aab5c9a9d6a nodeName:}" failed. No retries permitted until 2026-06-13 01:20:57.167588743 +0000 UTC m=+609.033603952 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/170c12ed-d4ae-4a80-be82-9aab5c9a9d6a-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-ghbmb" (UID: "170c12ed-d4ae-4a80-be82-9aab5c9a9d6a") : secret "plugin-serving-cert" not found Jun 13 01:20:56.668100 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.668084 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/170c12ed-d4ae-4a80-be82-9aab5c9a9d6a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ghbmb\" (UID: \"170c12ed-d4ae-4a80-be82-9aab5c9a9d6a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ghbmb" Jun 13 01:20:56.675554 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:56.675527 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj828\" (UniqueName: \"kubernetes.io/projected/170c12ed-d4ae-4a80-be82-9aab5c9a9d6a-kube-api-access-zj828\") pod \"kuadrant-console-plugin-66b5774985-ghbmb\" (UID: \"170c12ed-d4ae-4a80-be82-9aab5c9a9d6a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ghbmb" Jun 13 01:20:57.171269 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:57.171233 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/170c12ed-d4ae-4a80-be82-9aab5c9a9d6a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ghbmb\" (UID: \"170c12ed-d4ae-4a80-be82-9aab5c9a9d6a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ghbmb" Jun 13 01:20:57.173610 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:57.173591 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/170c12ed-d4ae-4a80-be82-9aab5c9a9d6a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ghbmb\" (UID: \"170c12ed-d4ae-4a80-be82-9aab5c9a9d6a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ghbmb" Jun 13 01:20:57.361779 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:57.361738 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ghbmb" Jun 13 01:20:57.500145 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:57.499383 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ghbmb"] Jun 13 01:20:57.502681 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:20:57.502649 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod170c12ed_d4ae_4a80_be82_9aab5c9a9d6a.slice/crio-e7b8b713c4d4dc2f64536c8c3bcaf352cdebbd6454f5a4a84298522ae7397f26 WatchSource:0}: Error finding container e7b8b713c4d4dc2f64536c8c3bcaf352cdebbd6454f5a4a84298522ae7397f26: Status 404 returned error can't find the container with id e7b8b713c4d4dc2f64536c8c3bcaf352cdebbd6454f5a4a84298522ae7397f26 Jun 13 01:20:58.089084 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:20:58.089052 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ghbmb" event={"ID":"170c12ed-d4ae-4a80-be82-9aab5c9a9d6a","Type":"ContainerStarted","Data":"e7b8b713c4d4dc2f64536c8c3bcaf352cdebbd6454f5a4a84298522ae7397f26"} Jun 13 01:21:23.241274 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:21:23.241240 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ghbmb" event={"ID":"170c12ed-d4ae-4a80-be82-9aab5c9a9d6a","Type":"ContainerStarted","Data":"4c45abfdba99ce018190ac922f78486f2f9b9c2008240213b16dfc72e1ffb7fb"} Jun 13 01:21:23.259243 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:21:23.259200 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ghbmb" podStartSLOduration=2.450297648 podStartE2EDuration="27.259186195s" totalImagesPullingTime="24.808888547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:20:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:21:23.257572391 +0000 UTC m=+635.123587652" watchObservedRunningTime="2026-06-13 01:21:23.259186195 +0000 UTC m=+635.125201417" Jun 13 01:21:37.346585 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:21:37.346552 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:21:37.348907 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:21:37.348891 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-nvfst" Jun 13 01:21:37.351888 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:21:37.351868 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 13 01:21:37.359236 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:21:37.359215 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:21:37.391055 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:21:37.391021 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:21:37.402304 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:21:37.402277 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/90f3bbc6-9f80-453d-ac04-b863c0cfd02c-config-file\") pod \"limitador-limitador-54d6d988d5-nvfst\" (UID: \"90f3bbc6-9f80-453d-ac04-b863c0cfd02c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nvfst" Jun 13 01:21:37.402402 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:21:37.402314 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdvt9\" (UniqueName: \"kubernetes.io/projected/90f3bbc6-9f80-453d-ac04-b863c0cfd02c-kube-api-access-cdvt9\") pod \"limitador-limitador-54d6d988d5-nvfst\" (UID: \"90f3bbc6-9f80-453d-ac04-b863c0cfd02c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nvfst" Jun 13 01:21:37.503145 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:21:37.503105 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/90f3bbc6-9f80-453d-ac04-b863c0cfd02c-config-file\") pod \"limitador-limitador-54d6d988d5-nvfst\" (UID: \"90f3bbc6-9f80-453d-ac04-b863c0cfd02c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nvfst" Jun 13 01:21:37.503145 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:21:37.503150 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdvt9\" (UniqueName: \"kubernetes.io/projected/90f3bbc6-9f80-453d-ac04-b863c0cfd02c-kube-api-access-cdvt9\") pod \"limitador-limitador-54d6d988d5-nvfst\" (UID: \"90f3bbc6-9f80-453d-ac04-b863c0cfd02c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nvfst" Jun 13 01:21:37.503765 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:21:37.503747 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/90f3bbc6-9f80-453d-ac04-b863c0cfd02c-config-file\") pod \"limitador-limitador-54d6d988d5-nvfst\" (UID: \"90f3bbc6-9f80-453d-ac04-b863c0cfd02c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nvfst" Jun 13 01:21:37.513410 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:21:37.513381 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdvt9\" (UniqueName: \"kubernetes.io/projected/90f3bbc6-9f80-453d-ac04-b863c0cfd02c-kube-api-access-cdvt9\") pod \"limitador-limitador-54d6d988d5-nvfst\" (UID: \"90f3bbc6-9f80-453d-ac04-b863c0cfd02c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nvfst" Jun 13 01:21:37.660511 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:21:37.660476 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-nvfst" Jun 13 01:21:37.795137 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:21:37.795110 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:21:37.796677 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:21:37.796642 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90f3bbc6_9f80_453d_ac04_b863c0cfd02c.slice/crio-2c666eb6aed9820bb720aff21ecde7dd9422b87b8cba317fe13c470bb77f2727 WatchSource:0}: Error finding container 2c666eb6aed9820bb720aff21ecde7dd9422b87b8cba317fe13c470bb77f2727: Status 404 returned error can't find the container with id 2c666eb6aed9820bb720aff21ecde7dd9422b87b8cba317fe13c470bb77f2727 Jun 13 01:21:37.798644 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:21:37.798625 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 01:21:38.214815 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:21:38.214780 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-7dxht"] Jun 13 01:21:38.218104 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:21:38.218087 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7dxht" Jun 13 01:21:38.220590 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:21:38.220569 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-m9lqh\"" Jun 13 01:21:38.226452 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:21:38.226429 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7dxht"] Jun 13 01:21:38.308770 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:21:38.308737 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmznp\" (UniqueName: \"kubernetes.io/projected/4e896a7e-7f89-4dd6-ad14-5ee6e2ab2692-kube-api-access-nmznp\") pod \"authorino-75d556bd77-7dxht\" (UID: \"4e896a7e-7f89-4dd6-ad14-5ee6e2ab2692\") " pod="kuadrant-system/authorino-75d556bd77-7dxht" Jun 13 01:21:38.323085 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:21:38.323055 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-nvfst" event={"ID":"90f3bbc6-9f80-453d-ac04-b863c0cfd02c","Type":"ContainerStarted","Data":"2c666eb6aed9820bb720aff21ecde7dd9422b87b8cba317fe13c470bb77f2727"} Jun 13 01:21:38.410282 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:21:38.410230 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmznp\" (UniqueName: \"kubernetes.io/projected/4e896a7e-7f89-4dd6-ad14-5ee6e2ab2692-kube-api-access-nmznp\") pod \"authorino-75d556bd77-7dxht\" (UID: \"4e896a7e-7f89-4dd6-ad14-5ee6e2ab2692\") " pod="kuadrant-system/authorino-75d556bd77-7dxht" Jun 13 01:21:38.419697 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:21:38.419656 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmznp\" (UniqueName: \"kubernetes.io/projected/4e896a7e-7f89-4dd6-ad14-5ee6e2ab2692-kube-api-access-nmznp\") pod \"authorino-75d556bd77-7dxht\" (UID: \"4e896a7e-7f89-4dd6-ad14-5ee6e2ab2692\") " pod="kuadrant-system/authorino-75d556bd77-7dxht" Jun 13 01:21:38.528961 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:21:38.528785 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7dxht" Jun 13 01:21:38.705221 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:21:38.704856 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7dxht"] Jun 13 01:21:38.708124 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:21:38.708092 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e896a7e_7f89_4dd6_ad14_5ee6e2ab2692.slice/crio-c5db5d173fe7a51ded76591c22f64024c4838207546e14cca7025e2ae2fb5b2b WatchSource:0}: Error finding container c5db5d173fe7a51ded76591c22f64024c4838207546e14cca7025e2ae2fb5b2b: Status 404 returned error can't find the container with id c5db5d173fe7a51ded76591c22f64024c4838207546e14cca7025e2ae2fb5b2b Jun 13 01:21:39.333695 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:21:39.333654 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7dxht" event={"ID":"4e896a7e-7f89-4dd6-ad14-5ee6e2ab2692","Type":"ContainerStarted","Data":"c5db5d173fe7a51ded76591c22f64024c4838207546e14cca7025e2ae2fb5b2b"} Jun 13 01:21:44.367232 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:21:44.367191 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7dxht" event={"ID":"4e896a7e-7f89-4dd6-ad14-5ee6e2ab2692","Type":"ContainerStarted","Data":"edc6c1b24bfb613f0fe7c61fb13af22ab2fa0f973096194b0f61d88f3827ec9b"} Jun 13 01:21:44.368898 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:21:44.368866 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-nvfst" event={"ID":"90f3bbc6-9f80-453d-ac04-b863c0cfd02c","Type":"ContainerStarted","Data":"0832866d8e058d0f1fe55fe5f38f4cc815bde26f43e1930f33f24435c7166543"} Jun 13 01:21:44.369063 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:21:44.368975 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-nvfst" Jun 13 01:21:44.387704 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:21:44.387651 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-7dxht" podStartSLOduration=1.393052628 podStartE2EDuration="6.3876364s" totalImagesPullingTime="4.994583772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:21:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:21:44.385412646 +0000 UTC m=+656.251427870" watchObservedRunningTime="2026-06-13 01:21:44.3876364 +0000 UTC m=+656.253651622" Jun 13 01:21:44.409902 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:21:44.409841 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-nvfst" podStartSLOduration=1.514398113 podStartE2EDuration="7.409818651s" totalImagesPullingTime="5.895420538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:21:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:21:44.405888794 +0000 UTC m=+656.271904051" watchObservedRunningTime="2026-06-13 01:21:44.409818651 +0000 UTC m=+656.275833874" Jun 13 01:21:55.376295 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:21:55.376261 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-nvfst" Jun 13 01:22:09.738253 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:09.738219 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c85t7"] Jun 13 01:22:09.740629 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:09.740612 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c85t7" Jun 13 01:22:09.743202 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:09.743175 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 13 01:22:09.743309 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:09.743185 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 13 01:22:09.744091 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:09.744073 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fffvh\"" Jun 13 01:22:09.749527 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:09.749505 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c85t7"] Jun 13 01:22:09.882617 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:09.882575 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b6a8613-c404-4c07-9db6-8b77ee3e35b4-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c85t7\" (UID: \"1b6a8613-c404-4c07-9db6-8b77ee3e35b4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c85t7" Jun 13 01:22:09.882789 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:09.882628 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b6a8613-c404-4c07-9db6-8b77ee3e35b4-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c85t7\" (UID: \"1b6a8613-c404-4c07-9db6-8b77ee3e35b4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c85t7" Jun 13 01:22:09.882789 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:09.882653 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqmkx\" (UniqueName: \"kubernetes.io/projected/1b6a8613-c404-4c07-9db6-8b77ee3e35b4-kube-api-access-vqmkx\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c85t7\" (UID: \"1b6a8613-c404-4c07-9db6-8b77ee3e35b4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c85t7" Jun 13 01:22:09.983955 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:09.983921 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b6a8613-c404-4c07-9db6-8b77ee3e35b4-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c85t7\" (UID: \"1b6a8613-c404-4c07-9db6-8b77ee3e35b4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c85t7" Jun 13 01:22:09.984121 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:09.983988 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqmkx\" (UniqueName: \"kubernetes.io/projected/1b6a8613-c404-4c07-9db6-8b77ee3e35b4-kube-api-access-vqmkx\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c85t7\" (UID: \"1b6a8613-c404-4c07-9db6-8b77ee3e35b4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c85t7" Jun 13 01:22:09.984121 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:09.984063 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b6a8613-c404-4c07-9db6-8b77ee3e35b4-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c85t7\" (UID: \"1b6a8613-c404-4c07-9db6-8b77ee3e35b4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c85t7" Jun 13 01:22:09.984409 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:09.984391 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b6a8613-c404-4c07-9db6-8b77ee3e35b4-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c85t7\" (UID: \"1b6a8613-c404-4c07-9db6-8b77ee3e35b4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c85t7" Jun 13 01:22:09.984446 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:09.984422 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b6a8613-c404-4c07-9db6-8b77ee3e35b4-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c85t7\" (UID: \"1b6a8613-c404-4c07-9db6-8b77ee3e35b4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c85t7" Jun 13 01:22:09.992965 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:09.992881 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqmkx\" (UniqueName: \"kubernetes.io/projected/1b6a8613-c404-4c07-9db6-8b77ee3e35b4-kube-api-access-vqmkx\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c85t7\" (UID: \"1b6a8613-c404-4c07-9db6-8b77ee3e35b4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c85t7" Jun 13 01:22:10.050330 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:10.050269 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c85t7" Jun 13 01:22:10.185426 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:10.185388 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c85t7"] Jun 13 01:22:10.187036 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:22:10.187012 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b6a8613_c404_4c07_9db6_8b77ee3e35b4.slice/crio-c4c30c24875783771ea08bba7870ce7b963c3207cbd0b87aec8b7278d8cfcdf6 WatchSource:0}: Error finding container c4c30c24875783771ea08bba7870ce7b963c3207cbd0b87aec8b7278d8cfcdf6: Status 404 returned error can't find the container with id c4c30c24875783771ea08bba7870ce7b963c3207cbd0b87aec8b7278d8cfcdf6 Jun 13 01:22:10.516792 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:10.516712 2573 generic.go:356] "Generic (PLEG): container finished" podID="1b6a8613-c404-4c07-9db6-8b77ee3e35b4" containerID="a5f7dcab476c171cfc362f924c351d4fad13a35c409a24f8fde2da91c7c6f4ef" exitCode=0 Jun 13 01:22:10.516977 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:10.516807 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c85t7" event={"ID":"1b6a8613-c404-4c07-9db6-8b77ee3e35b4","Type":"ContainerDied","Data":"a5f7dcab476c171cfc362f924c351d4fad13a35c409a24f8fde2da91c7c6f4ef"} Jun 13 01:22:10.516977 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:10.516864 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c85t7" event={"ID":"1b6a8613-c404-4c07-9db6-8b77ee3e35b4","Type":"ContainerStarted","Data":"c4c30c24875783771ea08bba7870ce7b963c3207cbd0b87aec8b7278d8cfcdf6"} Jun 13 01:22:11.523746 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:11.523712 2573 generic.go:356] "Generic (PLEG): container finished" podID="1b6a8613-c404-4c07-9db6-8b77ee3e35b4" containerID="bd7d9b2a9bd7c7fde00a928dceb8cb21f79ec54031520466507278523ecc8771" exitCode=0 Jun 13 01:22:11.524169 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:11.523794 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c85t7" event={"ID":"1b6a8613-c404-4c07-9db6-8b77ee3e35b4","Type":"ContainerDied","Data":"bd7d9b2a9bd7c7fde00a928dceb8cb21f79ec54031520466507278523ecc8771"} Jun 13 01:22:12.531800 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:12.531766 2573 generic.go:356] "Generic (PLEG): container finished" podID="1b6a8613-c404-4c07-9db6-8b77ee3e35b4" containerID="37c0c7ec57d3db3692b41b021e52197a7de9150daf0b23c488df6b21a46ebbce" exitCode=0 Jun 13 01:22:12.532181 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:12.531857 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c85t7" event={"ID":"1b6a8613-c404-4c07-9db6-8b77ee3e35b4","Type":"ContainerDied","Data":"37c0c7ec57d3db3692b41b021e52197a7de9150daf0b23c488df6b21a46ebbce"} Jun 13 01:22:13.664773 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:13.664752 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c85t7" Jun 13 01:22:13.820937 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:13.820854 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqmkx\" (UniqueName: \"kubernetes.io/projected/1b6a8613-c404-4c07-9db6-8b77ee3e35b4-kube-api-access-vqmkx\") pod \"1b6a8613-c404-4c07-9db6-8b77ee3e35b4\" (UID: \"1b6a8613-c404-4c07-9db6-8b77ee3e35b4\") " Jun 13 01:22:13.820937 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:13.820915 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b6a8613-c404-4c07-9db6-8b77ee3e35b4-util\") pod \"1b6a8613-c404-4c07-9db6-8b77ee3e35b4\" (UID: \"1b6a8613-c404-4c07-9db6-8b77ee3e35b4\") " Jun 13 01:22:13.821129 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:13.820971 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b6a8613-c404-4c07-9db6-8b77ee3e35b4-bundle\") pod \"1b6a8613-c404-4c07-9db6-8b77ee3e35b4\" (UID: \"1b6a8613-c404-4c07-9db6-8b77ee3e35b4\") " Jun 13 01:22:13.821473 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:13.821432 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b6a8613-c404-4c07-9db6-8b77ee3e35b4-bundle" (OuterVolumeSpecName: "bundle") pod "1b6a8613-c404-4c07-9db6-8b77ee3e35b4" (UID: "1b6a8613-c404-4c07-9db6-8b77ee3e35b4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:22:13.822924 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:13.822895 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b6a8613-c404-4c07-9db6-8b77ee3e35b4-kube-api-access-vqmkx" (OuterVolumeSpecName: "kube-api-access-vqmkx") pod "1b6a8613-c404-4c07-9db6-8b77ee3e35b4" (UID: "1b6a8613-c404-4c07-9db6-8b77ee3e35b4"). InnerVolumeSpecName "kube-api-access-vqmkx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:22:13.826365 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:13.826344 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b6a8613-c404-4c07-9db6-8b77ee3e35b4-util" (OuterVolumeSpecName: "util") pod "1b6a8613-c404-4c07-9db6-8b77ee3e35b4" (UID: "1b6a8613-c404-4c07-9db6-8b77ee3e35b4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:22:13.921791 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:13.921756 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqmkx\" (UniqueName: \"kubernetes.io/projected/1b6a8613-c404-4c07-9db6-8b77ee3e35b4-kube-api-access-vqmkx\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:22:13.921791 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:13.921786 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b6a8613-c404-4c07-9db6-8b77ee3e35b4-util\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:22:13.921791 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:13.921797 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b6a8613-c404-4c07-9db6-8b77ee3e35b4-bundle\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:22:14.543901 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:14.543873 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c85t7" Jun 13 01:22:14.543901 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:14.543882 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c85t7" event={"ID":"1b6a8613-c404-4c07-9db6-8b77ee3e35b4","Type":"ContainerDied","Data":"c4c30c24875783771ea08bba7870ce7b963c3207cbd0b87aec8b7278d8cfcdf6"} Jun 13 01:22:14.544103 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:22:14.543920 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c4c30c24875783771ea08bba7870ce7b963c3207cbd0b87aec8b7278d8cfcdf6" Jun 13 01:23:04.022644 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.022604 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6mw2g"] Jun 13 01:23:04.023247 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.023145 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b6a8613-c404-4c07-9db6-8b77ee3e35b4" containerName="util" Jun 13 01:23:04.023247 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.023165 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b6a8613-c404-4c07-9db6-8b77ee3e35b4" containerName="util" Jun 13 01:23:04.023247 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.023184 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b6a8613-c404-4c07-9db6-8b77ee3e35b4" containerName="extract" Jun 13 01:23:04.023247 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.023193 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b6a8613-c404-4c07-9db6-8b77ee3e35b4" containerName="extract" Jun 13 01:23:04.023247 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.023217 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b6a8613-c404-4c07-9db6-8b77ee3e35b4" containerName="pull" Jun 13 01:23:04.023247 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.023227 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b6a8613-c404-4c07-9db6-8b77ee3e35b4" containerName="pull" Jun 13 01:23:04.023544 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.023319 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b6a8613-c404-4c07-9db6-8b77ee3e35b4" containerName="extract" Jun 13 01:23:04.026491 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.026471 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6mw2g" Jun 13 01:23:04.035145 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.035121 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6mw2g"] Jun 13 01:23:04.151094 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.151062 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkfdx\" (UniqueName: \"kubernetes.io/projected/36a215c0-b851-431f-ba4f-c711aa4c5939-kube-api-access-qkfdx\") pod \"authorino-5d4b67c446-6mw2g\" (UID: \"36a215c0-b851-431f-ba4f-c711aa4c5939\") " pod="kuadrant-system/authorino-5d4b67c446-6mw2g" Jun 13 01:23:04.252366 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.252332 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkfdx\" (UniqueName: \"kubernetes.io/projected/36a215c0-b851-431f-ba4f-c711aa4c5939-kube-api-access-qkfdx\") pod \"authorino-5d4b67c446-6mw2g\" (UID: \"36a215c0-b851-431f-ba4f-c711aa4c5939\") " pod="kuadrant-system/authorino-5d4b67c446-6mw2g" Jun 13 01:23:04.264739 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.264716 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkfdx\" (UniqueName: \"kubernetes.io/projected/36a215c0-b851-431f-ba4f-c711aa4c5939-kube-api-access-qkfdx\") pod \"authorino-5d4b67c446-6mw2g\" (UID: \"36a215c0-b851-431f-ba4f-c711aa4c5939\") " pod="kuadrant-system/authorino-5d4b67c446-6mw2g" Jun 13 01:23:04.280547 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.280488 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6mw2g"] Jun 13 01:23:04.280698 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.280687 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6mw2g" Jun 13 01:23:04.308674 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.308640 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b8fff5889-krpjv"] Jun 13 01:23:04.312505 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.312487 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b8fff5889-krpjv" Jun 13 01:23:04.320438 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.320393 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b8fff5889-krpjv"] Jun 13 01:23:04.419990 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.419965 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6mw2g"] Jun 13 01:23:04.421446 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:23:04.421410 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36a215c0_b851_431f_ba4f_c711aa4c5939.slice/crio-3eb14244524bfb3d67ff77ce8f577569275583c3ebc14c0067a9ed1c029e4c57 WatchSource:0}: Error finding container 3eb14244524bfb3d67ff77ce8f577569275583c3ebc14c0067a9ed1c029e4c57: Status 404 returned error can't find the container with id 3eb14244524bfb3d67ff77ce8f577569275583c3ebc14c0067a9ed1c029e4c57 Jun 13 01:23:04.453607 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.453583 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnsb5\" (UniqueName: \"kubernetes.io/projected/84843669-087a-48da-b4f4-1d42c454b7b3-kube-api-access-cnsb5\") pod \"authorino-b8fff5889-krpjv\" (UID: \"84843669-087a-48da-b4f4-1d42c454b7b3\") " pod="kuadrant-system/authorino-b8fff5889-krpjv" Jun 13 01:23:04.492917 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.492888 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b8fff5889-krpjv"] Jun 13 01:23:04.493121 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:23:04.493102 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-cnsb5], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-b8fff5889-krpjv" podUID="84843669-087a-48da-b4f4-1d42c454b7b3" Jun 13 01:23:04.531331 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.531278 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c64b59549-hssps"] Jun 13 01:23:04.534719 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.534703 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c64b59549-hssps" Jun 13 01:23:04.538149 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.538130 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 13 01:23:04.550376 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.550349 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c64b59549-hssps"] Jun 13 01:23:04.553993 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.553975 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnsb5\" (UniqueName: \"kubernetes.io/projected/84843669-087a-48da-b4f4-1d42c454b7b3-kube-api-access-cnsb5\") pod \"authorino-b8fff5889-krpjv\" (UID: \"84843669-087a-48da-b4f4-1d42c454b7b3\") " pod="kuadrant-system/authorino-b8fff5889-krpjv" Jun 13 01:23:04.566656 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.566632 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnsb5\" (UniqueName: \"kubernetes.io/projected/84843669-087a-48da-b4f4-1d42c454b7b3-kube-api-access-cnsb5\") pod \"authorino-b8fff5889-krpjv\" (UID: \"84843669-087a-48da-b4f4-1d42c454b7b3\") " pod="kuadrant-system/authorino-b8fff5889-krpjv" Jun 13 01:23:04.654830 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.654802 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f45bd\" (UniqueName: \"kubernetes.io/projected/037b2353-39c2-4d52-8d16-d3ac4b3c93dc-kube-api-access-f45bd\") pod \"authorino-7c64b59549-hssps\" (UID: \"037b2353-39c2-4d52-8d16-d3ac4b3c93dc\") " pod="kuadrant-system/authorino-7c64b59549-hssps" Jun 13 01:23:04.654929 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.654849 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/037b2353-39c2-4d52-8d16-d3ac4b3c93dc-tls-cert\") pod \"authorino-7c64b59549-hssps\" (UID: \"037b2353-39c2-4d52-8d16-d3ac4b3c93dc\") " pod="kuadrant-system/authorino-7c64b59549-hssps" Jun 13 01:23:04.755453 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.755414 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f45bd\" (UniqueName: \"kubernetes.io/projected/037b2353-39c2-4d52-8d16-d3ac4b3c93dc-kube-api-access-f45bd\") pod \"authorino-7c64b59549-hssps\" (UID: \"037b2353-39c2-4d52-8d16-d3ac4b3c93dc\") " pod="kuadrant-system/authorino-7c64b59549-hssps" Jun 13 01:23:04.755599 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.755463 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/037b2353-39c2-4d52-8d16-d3ac4b3c93dc-tls-cert\") pod \"authorino-7c64b59549-hssps\" (UID: \"037b2353-39c2-4d52-8d16-d3ac4b3c93dc\") " pod="kuadrant-system/authorino-7c64b59549-hssps" Jun 13 01:23:04.757811 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.757788 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/037b2353-39c2-4d52-8d16-d3ac4b3c93dc-tls-cert\") pod \"authorino-7c64b59549-hssps\" (UID: \"037b2353-39c2-4d52-8d16-d3ac4b3c93dc\") " pod="kuadrant-system/authorino-7c64b59549-hssps" Jun 13 01:23:04.764546 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.764520 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f45bd\" (UniqueName: \"kubernetes.io/projected/037b2353-39c2-4d52-8d16-d3ac4b3c93dc-kube-api-access-f45bd\") pod \"authorino-7c64b59549-hssps\" (UID: \"037b2353-39c2-4d52-8d16-d3ac4b3c93dc\") " pod="kuadrant-system/authorino-7c64b59549-hssps" Jun 13 01:23:04.817499 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.817428 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6mw2g" event={"ID":"36a215c0-b851-431f-ba4f-c711aa4c5939","Type":"ContainerStarted","Data":"3eb14244524bfb3d67ff77ce8f577569275583c3ebc14c0067a9ed1c029e4c57"} Jun 13 01:23:04.817499 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.817487 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b8fff5889-krpjv" Jun 13 01:23:04.824321 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.824304 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b8fff5889-krpjv" Jun 13 01:23:04.844267 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.844234 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c64b59549-hssps" Jun 13 01:23:04.957009 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.956976 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cnsb5\" (UniqueName: \"kubernetes.io/projected/84843669-087a-48da-b4f4-1d42c454b7b3-kube-api-access-cnsb5\") pod \"84843669-087a-48da-b4f4-1d42c454b7b3\" (UID: \"84843669-087a-48da-b4f4-1d42c454b7b3\") " Jun 13 01:23:04.959368 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.959340 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84843669-087a-48da-b4f4-1d42c454b7b3-kube-api-access-cnsb5" (OuterVolumeSpecName: "kube-api-access-cnsb5") pod "84843669-087a-48da-b4f4-1d42c454b7b3" (UID: "84843669-087a-48da-b4f4-1d42c454b7b3"). InnerVolumeSpecName "kube-api-access-cnsb5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:23:04.982935 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:04.982911 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c64b59549-hssps"] Jun 13 01:23:04.984670 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:23:04.984645 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod037b2353_39c2_4d52_8d16_d3ac4b3c93dc.slice/crio-9cf79ec896ac72291e08f5a4561171aede413bea4cfbb3429b5736a1f47e7b74 WatchSource:0}: Error finding container 9cf79ec896ac72291e08f5a4561171aede413bea4cfbb3429b5736a1f47e7b74: Status 404 returned error can't find the container with id 9cf79ec896ac72291e08f5a4561171aede413bea4cfbb3429b5736a1f47e7b74 Jun 13 01:23:05.058494 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:05.058469 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnsb5\" (UniqueName: \"kubernetes.io/projected/84843669-087a-48da-b4f4-1d42c454b7b3-kube-api-access-cnsb5\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:23:05.824881 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:05.824844 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-6mw2g" podUID="36a215c0-b851-431f-ba4f-c711aa4c5939" containerName="authorino" containerID="cri-o://c7a62b29551f444095ffb71f5ffe0f00113040086bc56add294b5f85357a9dbf" gracePeriod=30 Jun 13 01:23:05.825096 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:05.824845 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6mw2g" event={"ID":"36a215c0-b851-431f-ba4f-c711aa4c5939","Type":"ContainerStarted","Data":"c7a62b29551f444095ffb71f5ffe0f00113040086bc56add294b5f85357a9dbf"} Jun 13 01:23:05.826537 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:05.826496 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c64b59549-hssps" event={"ID":"037b2353-39c2-4d52-8d16-d3ac4b3c93dc","Type":"ContainerStarted","Data":"7b121386319a02a8cd73cb4f61294f6b0a6e9794c0222de0f396c2d16c3c86ed"} Jun 13 01:23:05.826643 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:05.826550 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c64b59549-hssps" event={"ID":"037b2353-39c2-4d52-8d16-d3ac4b3c93dc","Type":"ContainerStarted","Data":"9cf79ec896ac72291e08f5a4561171aede413bea4cfbb3429b5736a1f47e7b74"} Jun 13 01:23:05.826643 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:05.826609 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b8fff5889-krpjv" Jun 13 01:23:05.842673 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:05.842631 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-6mw2g" podStartSLOduration=1.419840295 podStartE2EDuration="1.842618117s" totalImagesPullingTime="422.777822ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:23:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:23:05.840849305 +0000 UTC m=+737.706864529" watchObservedRunningTime="2026-06-13 01:23:05.842618117 +0000 UTC m=+737.708633338" Jun 13 01:23:05.863149 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:05.863114 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7c64b59549-hssps" podStartSLOduration=1.564725597 podStartE2EDuration="1.863102812s" totalImagesPullingTime="298.377215ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:23:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:23:05.86251744 +0000 UTC m=+737.728532663" watchObservedRunningTime="2026-06-13 01:23:05.863102812 +0000 UTC m=+737.729118033" Jun 13 01:23:05.892487 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:05.892462 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7dxht"] Jun 13 01:23:05.892640 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:05.892609 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-7dxht" podUID="4e896a7e-7f89-4dd6-ad14-5ee6e2ab2692" containerName="authorino" containerID="cri-o://edc6c1b24bfb613f0fe7c61fb13af22ab2fa0f973096194b0f61d88f3827ec9b" gracePeriod=30 Jun 13 01:23:05.913263 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:05.913236 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b8fff5889-krpjv"] Jun 13 01:23:05.918117 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:05.918092 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b8fff5889-krpjv"] Jun 13 01:23:06.117031 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:06.117007 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6mw2g" Jun 13 01:23:06.152597 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:06.152573 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7dxht" Jun 13 01:23:06.269595 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:06.269566 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmznp\" (UniqueName: \"kubernetes.io/projected/4e896a7e-7f89-4dd6-ad14-5ee6e2ab2692-kube-api-access-nmznp\") pod \"4e896a7e-7f89-4dd6-ad14-5ee6e2ab2692\" (UID: \"4e896a7e-7f89-4dd6-ad14-5ee6e2ab2692\") " Jun 13 01:23:06.269738 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:06.269641 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkfdx\" (UniqueName: \"kubernetes.io/projected/36a215c0-b851-431f-ba4f-c711aa4c5939-kube-api-access-qkfdx\") pod \"36a215c0-b851-431f-ba4f-c711aa4c5939\" (UID: \"36a215c0-b851-431f-ba4f-c711aa4c5939\") " Jun 13 01:23:06.271756 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:06.271725 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36a215c0-b851-431f-ba4f-c711aa4c5939-kube-api-access-qkfdx" (OuterVolumeSpecName: "kube-api-access-qkfdx") pod "36a215c0-b851-431f-ba4f-c711aa4c5939" (UID: "36a215c0-b851-431f-ba4f-c711aa4c5939"). InnerVolumeSpecName "kube-api-access-qkfdx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:23:06.271874 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:06.271780 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e896a7e-7f89-4dd6-ad14-5ee6e2ab2692-kube-api-access-nmznp" (OuterVolumeSpecName: "kube-api-access-nmznp") pod "4e896a7e-7f89-4dd6-ad14-5ee6e2ab2692" (UID: "4e896a7e-7f89-4dd6-ad14-5ee6e2ab2692"). InnerVolumeSpecName "kube-api-access-nmznp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:23:06.370596 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:06.370515 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkfdx\" (UniqueName: \"kubernetes.io/projected/36a215c0-b851-431f-ba4f-c711aa4c5939-kube-api-access-qkfdx\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:23:06.370596 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:06.370542 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmznp\" (UniqueName: \"kubernetes.io/projected/4e896a7e-7f89-4dd6-ad14-5ee6e2ab2692-kube-api-access-nmznp\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:23:06.539800 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:06.539758 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84843669-087a-48da-b4f4-1d42c454b7b3" path="/var/lib/kubelet/pods/84843669-087a-48da-b4f4-1d42c454b7b3/volumes" Jun 13 01:23:06.833824 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:06.833794 2573 generic.go:356] "Generic (PLEG): container finished" podID="36a215c0-b851-431f-ba4f-c711aa4c5939" containerID="c7a62b29551f444095ffb71f5ffe0f00113040086bc56add294b5f85357a9dbf" exitCode=0 Jun 13 01:23:06.833824 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:06.833832 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6mw2g" Jun 13 01:23:06.834078 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:06.833874 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6mw2g" event={"ID":"36a215c0-b851-431f-ba4f-c711aa4c5939","Type":"ContainerDied","Data":"c7a62b29551f444095ffb71f5ffe0f00113040086bc56add294b5f85357a9dbf"} Jun 13 01:23:06.834078 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:06.833907 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6mw2g" event={"ID":"36a215c0-b851-431f-ba4f-c711aa4c5939","Type":"ContainerDied","Data":"3eb14244524bfb3d67ff77ce8f577569275583c3ebc14c0067a9ed1c029e4c57"} Jun 13 01:23:06.834078 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:06.833929 2573 scope.go:117] "RemoveContainer" containerID="c7a62b29551f444095ffb71f5ffe0f00113040086bc56add294b5f85357a9dbf" Jun 13 01:23:06.835314 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:06.835185 2573 generic.go:356] "Generic (PLEG): container finished" podID="4e896a7e-7f89-4dd6-ad14-5ee6e2ab2692" containerID="edc6c1b24bfb613f0fe7c61fb13af22ab2fa0f973096194b0f61d88f3827ec9b" exitCode=0 Jun 13 01:23:06.835314 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:06.835237 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7dxht" Jun 13 01:23:06.835314 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:06.835280 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7dxht" event={"ID":"4e896a7e-7f89-4dd6-ad14-5ee6e2ab2692","Type":"ContainerDied","Data":"edc6c1b24bfb613f0fe7c61fb13af22ab2fa0f973096194b0f61d88f3827ec9b"} Jun 13 01:23:06.835314 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:06.835311 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7dxht" event={"ID":"4e896a7e-7f89-4dd6-ad14-5ee6e2ab2692","Type":"ContainerDied","Data":"c5db5d173fe7a51ded76591c22f64024c4838207546e14cca7025e2ae2fb5b2b"} Jun 13 01:23:06.843068 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:06.843051 2573 scope.go:117] "RemoveContainer" containerID="c7a62b29551f444095ffb71f5ffe0f00113040086bc56add294b5f85357a9dbf" Jun 13 01:23:06.843301 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:23:06.843284 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7a62b29551f444095ffb71f5ffe0f00113040086bc56add294b5f85357a9dbf\": container with ID starting with c7a62b29551f444095ffb71f5ffe0f00113040086bc56add294b5f85357a9dbf not found: ID does not exist" containerID="c7a62b29551f444095ffb71f5ffe0f00113040086bc56add294b5f85357a9dbf" Jun 13 01:23:06.843349 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:06.843312 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7a62b29551f444095ffb71f5ffe0f00113040086bc56add294b5f85357a9dbf"} err="failed to get container status \"c7a62b29551f444095ffb71f5ffe0f00113040086bc56add294b5f85357a9dbf\": rpc error: code = NotFound desc = could not find container \"c7a62b29551f444095ffb71f5ffe0f00113040086bc56add294b5f85357a9dbf\": container with ID starting with c7a62b29551f444095ffb71f5ffe0f00113040086bc56add294b5f85357a9dbf not found: ID does not exist" Jun 13 01:23:06.843349 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:06.843330 2573 scope.go:117] "RemoveContainer" containerID="edc6c1b24bfb613f0fe7c61fb13af22ab2fa0f973096194b0f61d88f3827ec9b" Jun 13 01:23:06.851185 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:06.851067 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6mw2g"] Jun 13 01:23:06.851185 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:06.851178 2573 scope.go:117] "RemoveContainer" containerID="edc6c1b24bfb613f0fe7c61fb13af22ab2fa0f973096194b0f61d88f3827ec9b" Jun 13 01:23:06.851477 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:23:06.851451 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edc6c1b24bfb613f0fe7c61fb13af22ab2fa0f973096194b0f61d88f3827ec9b\": container with ID starting with edc6c1b24bfb613f0fe7c61fb13af22ab2fa0f973096194b0f61d88f3827ec9b not found: ID does not exist" containerID="edc6c1b24bfb613f0fe7c61fb13af22ab2fa0f973096194b0f61d88f3827ec9b" Jun 13 01:23:06.851547 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:06.851477 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edc6c1b24bfb613f0fe7c61fb13af22ab2fa0f973096194b0f61d88f3827ec9b"} err="failed to get container status \"edc6c1b24bfb613f0fe7c61fb13af22ab2fa0f973096194b0f61d88f3827ec9b\": rpc error: code = NotFound desc = could not find container \"edc6c1b24bfb613f0fe7c61fb13af22ab2fa0f973096194b0f61d88f3827ec9b\": container with ID starting with edc6c1b24bfb613f0fe7c61fb13af22ab2fa0f973096194b0f61d88f3827ec9b not found: ID does not exist" Jun 13 01:23:06.854937 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:06.854913 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6mw2g"] Jun 13 01:23:06.863555 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:06.863537 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7dxht"] Jun 13 01:23:06.867787 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:06.867768 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7dxht"] Jun 13 01:23:08.539954 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:08.539910 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36a215c0-b851-431f-ba4f-c711aa4c5939" path="/var/lib/kubelet/pods/36a215c0-b851-431f-ba4f-c711aa4c5939/volumes" Jun 13 01:23:08.540319 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:08.540241 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e896a7e-7f89-4dd6-ad14-5ee6e2ab2692" path="/var/lib/kubelet/pods/4e896a7e-7f89-4dd6-ad14-5ee6e2ab2692/volumes" Jun 13 01:23:44.195935 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:23:44.195904 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:24:42.244905 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:42.244871 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d86d87d89-6bmxm"] Jun 13 01:24:42.245321 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:42.245225 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e896a7e-7f89-4dd6-ad14-5ee6e2ab2692" containerName="authorino" Jun 13 01:24:42.245321 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:42.245237 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e896a7e-7f89-4dd6-ad14-5ee6e2ab2692" containerName="authorino" Jun 13 01:24:42.245321 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:42.245249 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36a215c0-b851-431f-ba4f-c711aa4c5939" containerName="authorino" Jun 13 01:24:42.245321 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:42.245255 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="36a215c0-b851-431f-ba4f-c711aa4c5939" containerName="authorino" Jun 13 01:24:42.245463 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:42.245324 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e896a7e-7f89-4dd6-ad14-5ee6e2ab2692" containerName="authorino" Jun 13 01:24:42.245463 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:42.245332 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="36a215c0-b851-431f-ba4f-c711aa4c5939" containerName="authorino" Jun 13 01:24:42.248213 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:42.248199 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d86d87d89-6bmxm" Jun 13 01:24:42.250465 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:42.250443 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 13 01:24:42.259134 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:42.259112 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d86d87d89-6bmxm"] Jun 13 01:24:42.363097 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:42.363069 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bc168f00-a922-428e-b33c-9cf6f5bf315b-oidc-ca\") pod \"authorino-5d86d87d89-6bmxm\" (UID: \"bc168f00-a922-428e-b33c-9cf6f5bf315b\") " pod="kuadrant-system/authorino-5d86d87d89-6bmxm" Jun 13 01:24:42.363229 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:42.363145 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4lv8\" (UniqueName: \"kubernetes.io/projected/bc168f00-a922-428e-b33c-9cf6f5bf315b-kube-api-access-v4lv8\") pod \"authorino-5d86d87d89-6bmxm\" (UID: \"bc168f00-a922-428e-b33c-9cf6f5bf315b\") " pod="kuadrant-system/authorino-5d86d87d89-6bmxm" Jun 13 01:24:42.363229 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:42.363171 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bc168f00-a922-428e-b33c-9cf6f5bf315b-tls-cert\") pod \"authorino-5d86d87d89-6bmxm\" (UID: \"bc168f00-a922-428e-b33c-9cf6f5bf315b\") " pod="kuadrant-system/authorino-5d86d87d89-6bmxm" Jun 13 01:24:42.463696 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:42.463673 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4lv8\" (UniqueName: \"kubernetes.io/projected/bc168f00-a922-428e-b33c-9cf6f5bf315b-kube-api-access-v4lv8\") pod \"authorino-5d86d87d89-6bmxm\" (UID: \"bc168f00-a922-428e-b33c-9cf6f5bf315b\") " pod="kuadrant-system/authorino-5d86d87d89-6bmxm" Jun 13 01:24:42.463696 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:42.463703 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bc168f00-a922-428e-b33c-9cf6f5bf315b-tls-cert\") pod \"authorino-5d86d87d89-6bmxm\" (UID: \"bc168f00-a922-428e-b33c-9cf6f5bf315b\") " pod="kuadrant-system/authorino-5d86d87d89-6bmxm" Jun 13 01:24:42.463874 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:42.463734 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bc168f00-a922-428e-b33c-9cf6f5bf315b-oidc-ca\") pod \"authorino-5d86d87d89-6bmxm\" (UID: \"bc168f00-a922-428e-b33c-9cf6f5bf315b\") " pod="kuadrant-system/authorino-5d86d87d89-6bmxm" Jun 13 01:24:42.464296 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:42.464281 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bc168f00-a922-428e-b33c-9cf6f5bf315b-oidc-ca\") pod \"authorino-5d86d87d89-6bmxm\" (UID: \"bc168f00-a922-428e-b33c-9cf6f5bf315b\") " pod="kuadrant-system/authorino-5d86d87d89-6bmxm" Jun 13 01:24:42.466124 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:42.466108 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bc168f00-a922-428e-b33c-9cf6f5bf315b-tls-cert\") pod \"authorino-5d86d87d89-6bmxm\" (UID: \"bc168f00-a922-428e-b33c-9cf6f5bf315b\") " pod="kuadrant-system/authorino-5d86d87d89-6bmxm" Jun 13 01:24:42.471110 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:42.471089 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4lv8\" (UniqueName: \"kubernetes.io/projected/bc168f00-a922-428e-b33c-9cf6f5bf315b-kube-api-access-v4lv8\") pod \"authorino-5d86d87d89-6bmxm\" (UID: \"bc168f00-a922-428e-b33c-9cf6f5bf315b\") " pod="kuadrant-system/authorino-5d86d87d89-6bmxm" Jun 13 01:24:42.557809 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:42.557748 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d86d87d89-6bmxm" Jun 13 01:24:42.687194 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:42.687166 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d86d87d89-6bmxm"] Jun 13 01:24:42.688715 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:24:42.688677 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbc168f00_a922_428e_b33c_9cf6f5bf315b.slice/crio-34a3ecd946924507c8cc9e5fd3eeb36cb422eb9b1726f84c341516846e201b85 WatchSource:0}: Error finding container 34a3ecd946924507c8cc9e5fd3eeb36cb422eb9b1726f84c341516846e201b85: Status 404 returned error can't find the container with id 34a3ecd946924507c8cc9e5fd3eeb36cb422eb9b1726f84c341516846e201b85 Jun 13 01:24:43.369316 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:43.369225 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d86d87d89-6bmxm" event={"ID":"bc168f00-a922-428e-b33c-9cf6f5bf315b","Type":"ContainerStarted","Data":"85ade0266d5caa82867556b1d6fb77ca4ed62752578edbd8c7d748ad1e838b74"} Jun 13 01:24:43.369316 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:43.369281 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d86d87d89-6bmxm" event={"ID":"bc168f00-a922-428e-b33c-9cf6f5bf315b","Type":"ContainerStarted","Data":"34a3ecd946924507c8cc9e5fd3eeb36cb422eb9b1726f84c341516846e201b85"} Jun 13 01:24:43.386078 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:43.386035 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d86d87d89-6bmxm" podStartSLOduration=0.966679574 podStartE2EDuration="1.386022159s" totalImagesPullingTime="419.342585ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:24:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:24:43.384768036 +0000 UTC m=+835.250783272" watchObservedRunningTime="2026-06-13 01:24:43.386022159 +0000 UTC m=+835.252037381" Jun 13 01:24:43.410708 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:43.410679 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c64b59549-hssps"] Jun 13 01:24:43.410849 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:43.410829 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7c64b59549-hssps" podUID="037b2353-39c2-4d52-8d16-d3ac4b3c93dc" containerName="authorino" containerID="cri-o://7b121386319a02a8cd73cb4f61294f6b0a6e9794c0222de0f396c2d16c3c86ed" gracePeriod=30 Jun 13 01:24:43.669324 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:43.669301 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c64b59549-hssps" Jun 13 01:24:43.775909 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:43.775879 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f45bd\" (UniqueName: \"kubernetes.io/projected/037b2353-39c2-4d52-8d16-d3ac4b3c93dc-kube-api-access-f45bd\") pod \"037b2353-39c2-4d52-8d16-d3ac4b3c93dc\" (UID: \"037b2353-39c2-4d52-8d16-d3ac4b3c93dc\") " Jun 13 01:24:43.776090 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:43.775986 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/037b2353-39c2-4d52-8d16-d3ac4b3c93dc-tls-cert\") pod \"037b2353-39c2-4d52-8d16-d3ac4b3c93dc\" (UID: \"037b2353-39c2-4d52-8d16-d3ac4b3c93dc\") " Jun 13 01:24:43.777968 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:43.777918 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/037b2353-39c2-4d52-8d16-d3ac4b3c93dc-kube-api-access-f45bd" (OuterVolumeSpecName: "kube-api-access-f45bd") pod "037b2353-39c2-4d52-8d16-d3ac4b3c93dc" (UID: "037b2353-39c2-4d52-8d16-d3ac4b3c93dc"). InnerVolumeSpecName "kube-api-access-f45bd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:24:43.786266 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:43.786236 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/037b2353-39c2-4d52-8d16-d3ac4b3c93dc-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "037b2353-39c2-4d52-8d16-d3ac4b3c93dc" (UID: "037b2353-39c2-4d52-8d16-d3ac4b3c93dc"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 01:24:43.876772 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:43.876746 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f45bd\" (UniqueName: \"kubernetes.io/projected/037b2353-39c2-4d52-8d16-d3ac4b3c93dc-kube-api-access-f45bd\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:24:43.876772 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:43.876769 2573 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/037b2353-39c2-4d52-8d16-d3ac4b3c93dc-tls-cert\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:24:44.376019 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:44.375979 2573 generic.go:356] "Generic (PLEG): container finished" podID="037b2353-39c2-4d52-8d16-d3ac4b3c93dc" containerID="7b121386319a02a8cd73cb4f61294f6b0a6e9794c0222de0f396c2d16c3c86ed" exitCode=0 Jun 13 01:24:44.376019 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:44.376022 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c64b59549-hssps" Jun 13 01:24:44.376471 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:44.376073 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c64b59549-hssps" event={"ID":"037b2353-39c2-4d52-8d16-d3ac4b3c93dc","Type":"ContainerDied","Data":"7b121386319a02a8cd73cb4f61294f6b0a6e9794c0222de0f396c2d16c3c86ed"} Jun 13 01:24:44.376471 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:44.376116 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c64b59549-hssps" event={"ID":"037b2353-39c2-4d52-8d16-d3ac4b3c93dc","Type":"ContainerDied","Data":"9cf79ec896ac72291e08f5a4561171aede413bea4cfbb3429b5736a1f47e7b74"} Jun 13 01:24:44.376471 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:44.376137 2573 scope.go:117] "RemoveContainer" containerID="7b121386319a02a8cd73cb4f61294f6b0a6e9794c0222de0f396c2d16c3c86ed" Jun 13 01:24:44.385169 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:44.385151 2573 scope.go:117] "RemoveContainer" containerID="7b121386319a02a8cd73cb4f61294f6b0a6e9794c0222de0f396c2d16c3c86ed" Jun 13 01:24:44.385401 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:24:44.385380 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b121386319a02a8cd73cb4f61294f6b0a6e9794c0222de0f396c2d16c3c86ed\": container with ID starting with 7b121386319a02a8cd73cb4f61294f6b0a6e9794c0222de0f396c2d16c3c86ed not found: ID does not exist" containerID="7b121386319a02a8cd73cb4f61294f6b0a6e9794c0222de0f396c2d16c3c86ed" Jun 13 01:24:44.385479 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:44.385414 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b121386319a02a8cd73cb4f61294f6b0a6e9794c0222de0f396c2d16c3c86ed"} err="failed to get container status \"7b121386319a02a8cd73cb4f61294f6b0a6e9794c0222de0f396c2d16c3c86ed\": rpc error: code = NotFound desc = could not find container \"7b121386319a02a8cd73cb4f61294f6b0a6e9794c0222de0f396c2d16c3c86ed\": container with ID starting with 7b121386319a02a8cd73cb4f61294f6b0a6e9794c0222de0f396c2d16c3c86ed not found: ID does not exist" Jun 13 01:24:44.397763 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:44.397738 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c64b59549-hssps"] Jun 13 01:24:44.401294 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:44.401274 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7c64b59549-hssps"] Jun 13 01:24:44.539312 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:44.539280 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="037b2353-39c2-4d52-8d16-d3ac4b3c93dc" path="/var/lib/kubelet/pods/037b2353-39c2-4d52-8d16-d3ac4b3c93dc/volumes" Jun 13 01:24:53.331327 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:24:53.331289 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:25:11.193785 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:25:11.193746 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:25:30.397656 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:25:30.397623 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:25:35.402854 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:25:35.402772 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:25:43.899536 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:25:43.899500 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:25:48.560005 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:25:48.559975 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bb7cg_f53056e7-0404-4074-bc19-664e206fce89/console-operator/1.log" Jun 13 01:25:48.560456 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:25:48.560043 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bb7cg_f53056e7-0404-4074-bc19-664e206fce89/console-operator/1.log" Jun 13 01:25:48.568091 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:25:48.568069 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9jdpp_6109025b-0598-4cbf-b841-200e35db36cf/ovn-acl-logging/0.log" Jun 13 01:25:48.568320 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:25:48.568307 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9jdpp_6109025b-0598-4cbf-b841-200e35db36cf/ovn-acl-logging/0.log" Jun 13 01:25:56.597108 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:25:56.597007 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:26:57.018028 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:57.017989 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59d4cc4684-jk2jm"] Jun 13 01:26:57.018446 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:57.018345 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="037b2353-39c2-4d52-8d16-d3ac4b3c93dc" containerName="authorino" Jun 13 01:26:57.018446 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:57.018357 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="037b2353-39c2-4d52-8d16-d3ac4b3c93dc" containerName="authorino" Jun 13 01:26:57.018446 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:57.018420 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="037b2353-39c2-4d52-8d16-d3ac4b3c93dc" containerName="authorino" Jun 13 01:26:57.021440 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:57.021416 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59d4cc4684-jk2jm" Jun 13 01:26:57.028058 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:57.028031 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59d4cc4684-jk2jm"] Jun 13 01:26:57.163839 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:57.163814 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/88474cf8-ced8-47e9-9756-287c2e40e903-tls-cert\") pod \"authorino-59d4cc4684-jk2jm\" (UID: \"88474cf8-ced8-47e9-9756-287c2e40e903\") " pod="kuadrant-system/authorino-59d4cc4684-jk2jm" Jun 13 01:26:57.163999 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:57.163844 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wjjw\" (UniqueName: \"kubernetes.io/projected/88474cf8-ced8-47e9-9756-287c2e40e903-kube-api-access-5wjjw\") pod \"authorino-59d4cc4684-jk2jm\" (UID: \"88474cf8-ced8-47e9-9756-287c2e40e903\") " pod="kuadrant-system/authorino-59d4cc4684-jk2jm" Jun 13 01:26:57.163999 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:57.163889 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/88474cf8-ced8-47e9-9756-287c2e40e903-oidc-ca\") pod \"authorino-59d4cc4684-jk2jm\" (UID: \"88474cf8-ced8-47e9-9756-287c2e40e903\") " pod="kuadrant-system/authorino-59d4cc4684-jk2jm" Jun 13 01:26:57.264616 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:57.264586 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/88474cf8-ced8-47e9-9756-287c2e40e903-oidc-ca\") pod \"authorino-59d4cc4684-jk2jm\" (UID: \"88474cf8-ced8-47e9-9756-287c2e40e903\") " pod="kuadrant-system/authorino-59d4cc4684-jk2jm" Jun 13 01:26:57.264760 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:57.264635 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/88474cf8-ced8-47e9-9756-287c2e40e903-tls-cert\") pod \"authorino-59d4cc4684-jk2jm\" (UID: \"88474cf8-ced8-47e9-9756-287c2e40e903\") " pod="kuadrant-system/authorino-59d4cc4684-jk2jm" Jun 13 01:26:57.264760 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:57.264657 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wjjw\" (UniqueName: \"kubernetes.io/projected/88474cf8-ced8-47e9-9756-287c2e40e903-kube-api-access-5wjjw\") pod \"authorino-59d4cc4684-jk2jm\" (UID: \"88474cf8-ced8-47e9-9756-287c2e40e903\") " pod="kuadrant-system/authorino-59d4cc4684-jk2jm" Jun 13 01:26:57.265238 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:57.265215 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/88474cf8-ced8-47e9-9756-287c2e40e903-oidc-ca\") pod \"authorino-59d4cc4684-jk2jm\" (UID: \"88474cf8-ced8-47e9-9756-287c2e40e903\") " pod="kuadrant-system/authorino-59d4cc4684-jk2jm" Jun 13 01:26:57.266999 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:57.266981 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/88474cf8-ced8-47e9-9756-287c2e40e903-tls-cert\") pod \"authorino-59d4cc4684-jk2jm\" (UID: \"88474cf8-ced8-47e9-9756-287c2e40e903\") " pod="kuadrant-system/authorino-59d4cc4684-jk2jm" Jun 13 01:26:57.274814 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:57.274757 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wjjw\" (UniqueName: \"kubernetes.io/projected/88474cf8-ced8-47e9-9756-287c2e40e903-kube-api-access-5wjjw\") pod \"authorino-59d4cc4684-jk2jm\" (UID: \"88474cf8-ced8-47e9-9756-287c2e40e903\") " pod="kuadrant-system/authorino-59d4cc4684-jk2jm" Jun 13 01:26:57.330922 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:57.330899 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59d4cc4684-jk2jm" Jun 13 01:26:57.460367 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:57.460339 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59d4cc4684-jk2jm"] Jun 13 01:26:57.462268 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:26:57.462242 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88474cf8_ced8_47e9_9756_287c2e40e903.slice/crio-447271091f23a79070c5cdb81645e586bcc37be891939340e7e3dd58b650b766 WatchSource:0}: Error finding container 447271091f23a79070c5cdb81645e586bcc37be891939340e7e3dd58b650b766: Status 404 returned error can't find the container with id 447271091f23a79070c5cdb81645e586bcc37be891939340e7e3dd58b650b766 Jun 13 01:26:57.463919 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:57.463904 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 01:26:58.093469 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:58.093415 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59d4cc4684-jk2jm" event={"ID":"88474cf8-ced8-47e9-9756-287c2e40e903","Type":"ContainerStarted","Data":"34e467d12bfcd36ae5b745bb0b13ebe77f529ff36e28105b9f91a5bc010a5660"} Jun 13 01:26:58.093469 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:58.093472 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59d4cc4684-jk2jm" event={"ID":"88474cf8-ced8-47e9-9756-287c2e40e903","Type":"ContainerStarted","Data":"447271091f23a79070c5cdb81645e586bcc37be891939340e7e3dd58b650b766"} Jun 13 01:26:58.113497 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:58.113399 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59d4cc4684-jk2jm" podStartSLOduration=0.729551565 podStartE2EDuration="1.113383261s" totalImagesPullingTime="383.831696ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:26:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:26:58.110512585 +0000 UTC m=+969.976527807" watchObservedRunningTime="2026-06-13 01:26:58.113383261 +0000 UTC m=+969.979398482" Jun 13 01:26:58.143040 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:58.142990 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d86d87d89-6bmxm"] Jun 13 01:26:58.143566 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:58.143215 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d86d87d89-6bmxm" podUID="bc168f00-a922-428e-b33c-9cf6f5bf315b" containerName="authorino" containerID="cri-o://85ade0266d5caa82867556b1d6fb77ca4ed62752578edbd8c7d748ad1e838b74" gracePeriod=30 Jun 13 01:26:58.425742 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:58.425711 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d86d87d89-6bmxm" Jun 13 01:26:58.575425 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:58.575385 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bc168f00-a922-428e-b33c-9cf6f5bf315b-tls-cert\") pod \"bc168f00-a922-428e-b33c-9cf6f5bf315b\" (UID: \"bc168f00-a922-428e-b33c-9cf6f5bf315b\") " Jun 13 01:26:58.575425 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:58.575431 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4lv8\" (UniqueName: \"kubernetes.io/projected/bc168f00-a922-428e-b33c-9cf6f5bf315b-kube-api-access-v4lv8\") pod \"bc168f00-a922-428e-b33c-9cf6f5bf315b\" (UID: \"bc168f00-a922-428e-b33c-9cf6f5bf315b\") " Jun 13 01:26:58.575676 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:58.575478 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bc168f00-a922-428e-b33c-9cf6f5bf315b-oidc-ca\") pod \"bc168f00-a922-428e-b33c-9cf6f5bf315b\" (UID: \"bc168f00-a922-428e-b33c-9cf6f5bf315b\") " Jun 13 01:26:58.577860 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:58.577829 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc168f00-a922-428e-b33c-9cf6f5bf315b-kube-api-access-v4lv8" (OuterVolumeSpecName: "kube-api-access-v4lv8") pod "bc168f00-a922-428e-b33c-9cf6f5bf315b" (UID: "bc168f00-a922-428e-b33c-9cf6f5bf315b"). InnerVolumeSpecName "kube-api-access-v4lv8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:26:58.580616 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:58.580587 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc168f00-a922-428e-b33c-9cf6f5bf315b-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "bc168f00-a922-428e-b33c-9cf6f5bf315b" (UID: "bc168f00-a922-428e-b33c-9cf6f5bf315b"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:26:58.585493 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:58.585467 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc168f00-a922-428e-b33c-9cf6f5bf315b-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "bc168f00-a922-428e-b33c-9cf6f5bf315b" (UID: "bc168f00-a922-428e-b33c-9cf6f5bf315b"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 01:26:58.677208 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:58.677121 2573 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bc168f00-a922-428e-b33c-9cf6f5bf315b-oidc-ca\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:26:58.677208 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:58.677150 2573 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bc168f00-a922-428e-b33c-9cf6f5bf315b-tls-cert\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:26:58.677208 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:58.677179 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4lv8\" (UniqueName: \"kubernetes.io/projected/bc168f00-a922-428e-b33c-9cf6f5bf315b-kube-api-access-v4lv8\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:26:59.099879 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:59.099787 2573 generic.go:356] "Generic (PLEG): container finished" podID="bc168f00-a922-428e-b33c-9cf6f5bf315b" containerID="85ade0266d5caa82867556b1d6fb77ca4ed62752578edbd8c7d748ad1e838b74" exitCode=0 Jun 13 01:26:59.099879 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:59.099828 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d86d87d89-6bmxm" Jun 13 01:26:59.100396 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:59.099881 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d86d87d89-6bmxm" event={"ID":"bc168f00-a922-428e-b33c-9cf6f5bf315b","Type":"ContainerDied","Data":"85ade0266d5caa82867556b1d6fb77ca4ed62752578edbd8c7d748ad1e838b74"} Jun 13 01:26:59.100396 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:59.099927 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d86d87d89-6bmxm" event={"ID":"bc168f00-a922-428e-b33c-9cf6f5bf315b","Type":"ContainerDied","Data":"34a3ecd946924507c8cc9e5fd3eeb36cb422eb9b1726f84c341516846e201b85"} Jun 13 01:26:59.100396 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:59.099964 2573 scope.go:117] "RemoveContainer" containerID="85ade0266d5caa82867556b1d6fb77ca4ed62752578edbd8c7d748ad1e838b74" Jun 13 01:26:59.109727 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:59.109708 2573 scope.go:117] "RemoveContainer" containerID="85ade0266d5caa82867556b1d6fb77ca4ed62752578edbd8c7d748ad1e838b74" Jun 13 01:26:59.110043 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:26:59.110017 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85ade0266d5caa82867556b1d6fb77ca4ed62752578edbd8c7d748ad1e838b74\": container with ID starting with 85ade0266d5caa82867556b1d6fb77ca4ed62752578edbd8c7d748ad1e838b74 not found: ID does not exist" containerID="85ade0266d5caa82867556b1d6fb77ca4ed62752578edbd8c7d748ad1e838b74" Jun 13 01:26:59.110139 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:59.110048 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85ade0266d5caa82867556b1d6fb77ca4ed62752578edbd8c7d748ad1e838b74"} err="failed to get container status \"85ade0266d5caa82867556b1d6fb77ca4ed62752578edbd8c7d748ad1e838b74\": rpc error: code = NotFound desc = could not find container \"85ade0266d5caa82867556b1d6fb77ca4ed62752578edbd8c7d748ad1e838b74\": container with ID starting with 85ade0266d5caa82867556b1d6fb77ca4ed62752578edbd8c7d748ad1e838b74 not found: ID does not exist" Jun 13 01:26:59.121761 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:59.121737 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d86d87d89-6bmxm"] Jun 13 01:26:59.126092 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:26:59.126068 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d86d87d89-6bmxm"] Jun 13 01:27:00.539632 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:27:00.539588 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc168f00-a922-428e-b33c-9cf6f5bf315b" path="/var/lib/kubelet/pods/bc168f00-a922-428e-b33c-9cf6f5bf315b/volumes" Jun 13 01:27:30.197295 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:27:30.197256 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:27:40.812227 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:27:40.812190 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:27:49.200158 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:27:49.200115 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:27:59.599008 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:27:59.598969 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:28:08.694828 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:28:08.694795 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:28:19.201671 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:28:19.201630 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:28:28.337292 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:28:28.337255 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c7b74457c-rw58p"] Jun 13 01:28:28.337830 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:28:28.337809 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc168f00-a922-428e-b33c-9cf6f5bf315b" containerName="authorino" Jun 13 01:28:28.337908 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:28:28.337834 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc168f00-a922-428e-b33c-9cf6f5bf315b" containerName="authorino" Jun 13 01:28:28.337994 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:28:28.337929 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc168f00-a922-428e-b33c-9cf6f5bf315b" containerName="authorino" Jun 13 01:28:28.341071 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:28:28.341051 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c7b74457c-rw58p" Jun 13 01:28:28.344830 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:28:28.344812 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 13 01:28:28.344830 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:28:28.344818 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 13 01:28:28.345015 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:28:28.344838 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-87zgw\"" Jun 13 01:28:28.351037 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:28:28.351016 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c7b74457c-rw58p"] Jun 13 01:28:28.453266 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:28:28.453232 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/89600b98-2e0f-4957-907d-45232170bd7e-webhook-cert\") pod \"maas-controller-c7b74457c-rw58p\" (UID: \"89600b98-2e0f-4957-907d-45232170bd7e\") " pod="opendatahub/maas-controller-c7b74457c-rw58p" Jun 13 01:28:28.453457 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:28:28.453275 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwzm7\" (UniqueName: \"kubernetes.io/projected/89600b98-2e0f-4957-907d-45232170bd7e-kube-api-access-bwzm7\") pod \"maas-controller-c7b74457c-rw58p\" (UID: \"89600b98-2e0f-4957-907d-45232170bd7e\") " pod="opendatahub/maas-controller-c7b74457c-rw58p" Jun 13 01:28:28.554792 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:28:28.554761 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwzm7\" (UniqueName: \"kubernetes.io/projected/89600b98-2e0f-4957-907d-45232170bd7e-kube-api-access-bwzm7\") pod \"maas-controller-c7b74457c-rw58p\" (UID: \"89600b98-2e0f-4957-907d-45232170bd7e\") " pod="opendatahub/maas-controller-c7b74457c-rw58p" Jun 13 01:28:28.554998 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:28:28.554848 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/89600b98-2e0f-4957-907d-45232170bd7e-webhook-cert\") pod \"maas-controller-c7b74457c-rw58p\" (UID: \"89600b98-2e0f-4957-907d-45232170bd7e\") " pod="opendatahub/maas-controller-c7b74457c-rw58p" Jun 13 01:28:28.557271 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:28:28.557253 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/89600b98-2e0f-4957-907d-45232170bd7e-webhook-cert\") pod \"maas-controller-c7b74457c-rw58p\" (UID: \"89600b98-2e0f-4957-907d-45232170bd7e\") " pod="opendatahub/maas-controller-c7b74457c-rw58p" Jun 13 01:28:28.563192 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:28:28.563154 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwzm7\" (UniqueName: \"kubernetes.io/projected/89600b98-2e0f-4957-907d-45232170bd7e-kube-api-access-bwzm7\") pod \"maas-controller-c7b74457c-rw58p\" (UID: \"89600b98-2e0f-4957-907d-45232170bd7e\") " pod="opendatahub/maas-controller-c7b74457c-rw58p" Jun 13 01:28:28.651665 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:28:28.651636 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c7b74457c-rw58p" Jun 13 01:28:28.787865 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:28:28.787831 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c7b74457c-rw58p"] Jun 13 01:28:28.788860 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:28:28.788834 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89600b98_2e0f_4957_907d_45232170bd7e.slice/crio-c9a9e481e76e61e5c1bef49de447272ceb74cdde1e1bf9bf43db3fd67cdd26fc WatchSource:0}: Error finding container c9a9e481e76e61e5c1bef49de447272ceb74cdde1e1bf9bf43db3fd67cdd26fc: Status 404 returned error can't find the container with id c9a9e481e76e61e5c1bef49de447272ceb74cdde1e1bf9bf43db3fd67cdd26fc Jun 13 01:28:29.611652 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:28:29.611621 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c7b74457c-rw58p" event={"ID":"89600b98-2e0f-4957-907d-45232170bd7e","Type":"ContainerStarted","Data":"c9a9e481e76e61e5c1bef49de447272ceb74cdde1e1bf9bf43db3fd67cdd26fc"} Jun 13 01:28:31.624855 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:28:31.624750 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c7b74457c-rw58p" event={"ID":"89600b98-2e0f-4957-907d-45232170bd7e","Type":"ContainerStarted","Data":"41245458fb3b4849a054b9a5b2e4e9f43c14133bff0bb57a9fcf831306612982"} Jun 13 01:28:31.625276 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:28:31.624913 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c7b74457c-rw58p" Jun 13 01:28:31.644346 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:28:31.644296 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-c7b74457c-rw58p" podStartSLOduration=1.178740118 podStartE2EDuration="3.644283172s" totalImagesPullingTime="2.465543054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:28:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:28:31.642299581 +0000 UTC m=+1063.508314827" watchObservedRunningTime="2026-06-13 01:28:31.644283172 +0000 UTC m=+1063.510298394" Jun 13 01:28:42.636745 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:28:42.636715 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c7b74457c-rw58p" Jun 13 01:29:34.002861 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:29:34.002822 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:29:49.395710 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:29:49.395672 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:30:00.147797 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:30:00.147756 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29688570-lcnkq"] Jun 13 01:30:00.151375 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:30:00.151358 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688570-lcnkq" Jun 13 01:30:00.154045 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:30:00.154027 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cd95n\"" Jun 13 01:30:00.158539 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:30:00.158515 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29688570-lcnkq"] Jun 13 01:30:00.246520 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:30:00.246477 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz9qm\" (UniqueName: \"kubernetes.io/projected/963ecc4b-a9bf-44da-bd69-c7f153810ac6-kube-api-access-kz9qm\") pod \"maas-api-key-cleanup-29688570-lcnkq\" (UID: \"963ecc4b-a9bf-44da-bd69-c7f153810ac6\") " pod="opendatahub/maas-api-key-cleanup-29688570-lcnkq" Jun 13 01:30:00.347617 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:30:00.347577 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz9qm\" (UniqueName: \"kubernetes.io/projected/963ecc4b-a9bf-44da-bd69-c7f153810ac6-kube-api-access-kz9qm\") pod \"maas-api-key-cleanup-29688570-lcnkq\" (UID: \"963ecc4b-a9bf-44da-bd69-c7f153810ac6\") " pod="opendatahub/maas-api-key-cleanup-29688570-lcnkq" Jun 13 01:30:00.356422 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:30:00.356395 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz9qm\" (UniqueName: \"kubernetes.io/projected/963ecc4b-a9bf-44da-bd69-c7f153810ac6-kube-api-access-kz9qm\") pod \"maas-api-key-cleanup-29688570-lcnkq\" (UID: \"963ecc4b-a9bf-44da-bd69-c7f153810ac6\") " pod="opendatahub/maas-api-key-cleanup-29688570-lcnkq" Jun 13 01:30:00.463895 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:30:00.463805 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688570-lcnkq" Jun 13 01:30:00.599448 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:30:00.599417 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29688570-lcnkq"] Jun 13 01:30:00.600600 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:30:00.600578 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod963ecc4b_a9bf_44da_bd69_c7f153810ac6.slice/crio-7331095ffd108a37f7a2451903573e98c22aafb96c364d9227f633512a40019f WatchSource:0}: Error finding container 7331095ffd108a37f7a2451903573e98c22aafb96c364d9227f633512a40019f: Status 404 returned error can't find the container with id 7331095ffd108a37f7a2451903573e98c22aafb96c364d9227f633512a40019f Jun 13 01:30:01.131526 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:30:01.131494 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688570-lcnkq" event={"ID":"963ecc4b-a9bf-44da-bd69-c7f153810ac6","Type":"ContainerStarted","Data":"7331095ffd108a37f7a2451903573e98c22aafb96c364d9227f633512a40019f"} Jun 13 01:30:05.158300 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:30:05.158266 2573 generic.go:356] "Generic (PLEG): container finished" podID="963ecc4b-a9bf-44da-bd69-c7f153810ac6" containerID="a6f0ff7ecb058050780087150e37b5f44c2a46573cc77efc7ceb355d1d662a58" exitCode=0 Jun 13 01:30:05.158635 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:30:05.158356 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688570-lcnkq" event={"ID":"963ecc4b-a9bf-44da-bd69-c7f153810ac6","Type":"ContainerDied","Data":"a6f0ff7ecb058050780087150e37b5f44c2a46573cc77efc7ceb355d1d662a58"} Jun 13 01:30:06.295929 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:30:06.295902 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688570-lcnkq" Jun 13 01:30:06.410939 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:30:06.410899 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kz9qm\" (UniqueName: \"kubernetes.io/projected/963ecc4b-a9bf-44da-bd69-c7f153810ac6-kube-api-access-kz9qm\") pod \"963ecc4b-a9bf-44da-bd69-c7f153810ac6\" (UID: \"963ecc4b-a9bf-44da-bd69-c7f153810ac6\") " Jun 13 01:30:06.413079 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:30:06.413048 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/963ecc4b-a9bf-44da-bd69-c7f153810ac6-kube-api-access-kz9qm" (OuterVolumeSpecName: "kube-api-access-kz9qm") pod "963ecc4b-a9bf-44da-bd69-c7f153810ac6" (UID: "963ecc4b-a9bf-44da-bd69-c7f153810ac6"). InnerVolumeSpecName "kube-api-access-kz9qm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:30:06.511847 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:30:06.511817 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kz9qm\" (UniqueName: \"kubernetes.io/projected/963ecc4b-a9bf-44da-bd69-c7f153810ac6-kube-api-access-kz9qm\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:30:07.171011 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:30:07.170981 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688570-lcnkq" Jun 13 01:30:07.171011 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:30:07.171001 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688570-lcnkq" event={"ID":"963ecc4b-a9bf-44da-bd69-c7f153810ac6","Type":"ContainerDied","Data":"7331095ffd108a37f7a2451903573e98c22aafb96c364d9227f633512a40019f"} Jun 13 01:30:07.171216 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:30:07.171050 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7331095ffd108a37f7a2451903573e98c22aafb96c364d9227f633512a40019f" Jun 13 01:30:28.597289 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:30:28.597255 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:30:45.104463 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:30:45.104425 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:30:48.598394 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:30:48.598365 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bb7cg_f53056e7-0404-4074-bc19-664e206fce89/console-operator/1.log" Jun 13 01:30:48.599295 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:30:48.599274 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bb7cg_f53056e7-0404-4074-bc19-664e206fce89/console-operator/1.log" Jun 13 01:30:48.606344 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:30:48.606324 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9jdpp_6109025b-0598-4cbf-b841-200e35db36cf/ovn-acl-logging/0.log" Jun 13 01:30:48.607302 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:30:48.607288 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9jdpp_6109025b-0598-4cbf-b841-200e35db36cf/ovn-acl-logging/0.log" Jun 13 01:30:59.396857 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:30:59.396808 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:31:16.299328 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:31:16.299291 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:32:15.699876 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:32:15.699845 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:32:24.909452 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:32:24.909419 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:32:41.690777 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:32:41.690740 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:32:49.904232 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:32:49.904195 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:33:07.496561 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:33:07.496526 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:33:16.203612 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:33:16.203579 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:33:48.299164 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:33:48.299128 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:33:57.494395 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:33:57.494360 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:34:06.295783 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:34:06.295749 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:34:13.499906 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:34:13.499871 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:34:22.104856 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:34:22.104819 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:34:47.599433 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:34:47.599355 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:34:58.900103 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:34:58.900070 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:35:46.697225 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:35:46.697195 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:35:48.635739 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:35:48.635703 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bb7cg_f53056e7-0404-4074-bc19-664e206fce89/console-operator/1.log" Jun 13 01:35:48.639167 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:35:48.639148 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bb7cg_f53056e7-0404-4074-bc19-664e206fce89/console-operator/1.log" Jun 13 01:35:48.644524 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:35:48.644509 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9jdpp_6109025b-0598-4cbf-b841-200e35db36cf/ovn-acl-logging/0.log" Jun 13 01:35:48.647822 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:35:48.647808 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9jdpp_6109025b-0598-4cbf-b841-200e35db36cf/ovn-acl-logging/0.log" Jun 13 01:35:54.491304 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:35:54.491258 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:36:14.302999 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:36:14.302957 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:36:18.998013 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:36:18.997982 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:36:22.191244 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:36:22.191208 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:36:31.096396 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:36:31.096360 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:36:39.700389 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:36:39.700350 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:36:48.999988 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:36:48.999939 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:36:57.591476 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:36:57.591443 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:37:06.392533 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:37:06.392491 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:37:14.492733 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:37:14.492699 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:37:23.193062 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:37:23.193031 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:37:31.698839 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:37:31.698803 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:39:54.202751 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:39:54.202705 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:39:59.502081 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:39:59.502047 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:40:24.705093 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:40:24.705052 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:40:29.203459 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:40:29.203418 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:40:36.893672 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:40:36.893572 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:40:47.499030 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:40:47.498991 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:40:48.676356 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:40:48.676330 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bb7cg_f53056e7-0404-4074-bc19-664e206fce89/console-operator/1.log" Jun 13 01:40:48.680409 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:40:48.680384 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bb7cg_f53056e7-0404-4074-bc19-664e206fce89/console-operator/1.log" Jun 13 01:40:48.684371 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:40:48.684354 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9jdpp_6109025b-0598-4cbf-b841-200e35db36cf/ovn-acl-logging/0.log" Jun 13 01:40:48.688703 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:40:48.688687 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9jdpp_6109025b-0598-4cbf-b841-200e35db36cf/ovn-acl-logging/0.log" Jun 13 01:40:56.204913 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:40:56.204867 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:41:06.200338 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:41:06.200295 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:41:15.801391 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:41:15.801354 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:41:26.195461 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:41:26.195427 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:41:34.999408 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:41:34.999366 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:41:45.398222 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:41:45.398187 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:41:54.599753 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:41:54.599706 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:42:27.295858 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:42:27.295823 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:43:10.399071 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:43:10.399028 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:43:19.094047 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:43:19.094015 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:43:27.698477 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:43:27.698444 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:43:36.400415 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:43:36.400327 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:43:44.998108 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:43:44.998070 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:43:58.090830 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:43:58.090787 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:44:06.497657 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:44:06.497618 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:44:11.698468 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:44:11.698433 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:44:18.800855 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:44:18.800817 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:44:27.396414 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:44:27.396385 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:44:35.398198 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:44:35.398163 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:44:45.994481 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:44:45.994446 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:45:00.188324 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:45:00.188282 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29688585-gmktr"] Jun 13 01:45:00.188928 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:45:00.188863 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="963ecc4b-a9bf-44da-bd69-c7f153810ac6" containerName="cleanup" Jun 13 01:45:00.188928 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:45:00.188883 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="963ecc4b-a9bf-44da-bd69-c7f153810ac6" containerName="cleanup" Jun 13 01:45:00.189101 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:45:00.189034 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="963ecc4b-a9bf-44da-bd69-c7f153810ac6" containerName="cleanup" Jun 13 01:45:00.192227 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:45:00.192208 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688585-gmktr" Jun 13 01:45:00.195008 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:45:00.194988 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cd95n\"" Jun 13 01:45:00.200661 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:45:00.200640 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k2rb\" (UniqueName: \"kubernetes.io/projected/23bb57b9-a97c-42d9-86e5-fc728416e3ed-kube-api-access-9k2rb\") pod \"maas-api-key-cleanup-29688585-gmktr\" (UID: \"23bb57b9-a97c-42d9-86e5-fc728416e3ed\") " pod="opendatahub/maas-api-key-cleanup-29688585-gmktr" Jun 13 01:45:00.214975 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:45:00.214933 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29688585-gmktr"] Jun 13 01:45:00.301361 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:45:00.301328 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k2rb\" (UniqueName: \"kubernetes.io/projected/23bb57b9-a97c-42d9-86e5-fc728416e3ed-kube-api-access-9k2rb\") pod \"maas-api-key-cleanup-29688585-gmktr\" (UID: \"23bb57b9-a97c-42d9-86e5-fc728416e3ed\") " pod="opendatahub/maas-api-key-cleanup-29688585-gmktr" Jun 13 01:45:00.310375 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:45:00.310344 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k2rb\" (UniqueName: \"kubernetes.io/projected/23bb57b9-a97c-42d9-86e5-fc728416e3ed-kube-api-access-9k2rb\") pod \"maas-api-key-cleanup-29688585-gmktr\" (UID: \"23bb57b9-a97c-42d9-86e5-fc728416e3ed\") " pod="opendatahub/maas-api-key-cleanup-29688585-gmktr" Jun 13 01:45:00.502511 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:45:00.502426 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688585-gmktr" Jun 13 01:45:00.845126 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:45:00.845099 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29688585-gmktr"] Jun 13 01:45:00.847857 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:45:00.847834 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23bb57b9_a97c_42d9_86e5_fc728416e3ed.slice/crio-bfa3511734402760651d9f5d1176c61274ad828ba3074c73e7a05641eeabddc7 WatchSource:0}: Error finding container bfa3511734402760651d9f5d1176c61274ad828ba3074c73e7a05641eeabddc7: Status 404 returned error can't find the container with id bfa3511734402760651d9f5d1176c61274ad828ba3074c73e7a05641eeabddc7 Jun 13 01:45:01.122456 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:45:01.122366 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688585-gmktr" event={"ID":"23bb57b9-a97c-42d9-86e5-fc728416e3ed","Type":"ContainerStarted","Data":"bfa3511734402760651d9f5d1176c61274ad828ba3074c73e7a05641eeabddc7"} Jun 13 01:45:02.129919 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:45:02.129799 2573 generic.go:356] "Generic (PLEG): container finished" podID="23bb57b9-a97c-42d9-86e5-fc728416e3ed" containerID="44e08be85cf92918bdc98b00628148a70873ea5f2ba929aa6673976442923fc8" exitCode=0 Jun 13 01:45:02.129919 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:45:02.129895 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688585-gmktr" event={"ID":"23bb57b9-a97c-42d9-86e5-fc728416e3ed","Type":"ContainerDied","Data":"44e08be85cf92918bdc98b00628148a70873ea5f2ba929aa6673976442923fc8"} Jun 13 01:45:03.266414 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:45:03.266392 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688585-gmktr" Jun 13 01:45:03.329220 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:45:03.329186 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9k2rb\" (UniqueName: \"kubernetes.io/projected/23bb57b9-a97c-42d9-86e5-fc728416e3ed-kube-api-access-9k2rb\") pod \"23bb57b9-a97c-42d9-86e5-fc728416e3ed\" (UID: \"23bb57b9-a97c-42d9-86e5-fc728416e3ed\") " Jun 13 01:45:03.331217 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:45:03.331191 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23bb57b9-a97c-42d9-86e5-fc728416e3ed-kube-api-access-9k2rb" (OuterVolumeSpecName: "kube-api-access-9k2rb") pod "23bb57b9-a97c-42d9-86e5-fc728416e3ed" (UID: "23bb57b9-a97c-42d9-86e5-fc728416e3ed"). InnerVolumeSpecName "kube-api-access-9k2rb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:45:03.430657 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:45:03.430630 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9k2rb\" (UniqueName: \"kubernetes.io/projected/23bb57b9-a97c-42d9-86e5-fc728416e3ed-kube-api-access-9k2rb\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\"" Jun 13 01:45:03.903472 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:45:03.903435 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:45:04.142682 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:45:04.142649 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688585-gmktr" Jun 13 01:45:04.142843 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:45:04.142684 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688585-gmktr" event={"ID":"23bb57b9-a97c-42d9-86e5-fc728416e3ed","Type":"ContainerDied","Data":"bfa3511734402760651d9f5d1176c61274ad828ba3074c73e7a05641eeabddc7"} Jun 13 01:45:04.142843 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:45:04.142730 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bfa3511734402760651d9f5d1176c61274ad828ba3074c73e7a05641eeabddc7" Jun 13 01:45:12.104629 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:45:12.104583 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:45:21.206226 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:45:21.206190 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:45:29.836048 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:45:29.836018 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:45:46.710504 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:45:46.710468 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:45:48.716547 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:45:48.716517 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bb7cg_f53056e7-0404-4074-bc19-664e206fce89/console-operator/1.log" Jun 13 01:45:48.721422 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:45:48.721396 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bb7cg_f53056e7-0404-4074-bc19-664e206fce89/console-operator/1.log" Jun 13 01:45:48.725375 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:45:48.725357 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9jdpp_6109025b-0598-4cbf-b841-200e35db36cf/ovn-acl-logging/0.log" Jun 13 01:45:48.730023 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:45:48.730005 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9jdpp_6109025b-0598-4cbf-b841-200e35db36cf/ovn-acl-logging/0.log" Jun 13 01:45:55.198115 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:45:55.198081 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:46:04.003691 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:46:04.003653 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:46:12.701620 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:46:12.701583 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:46:21.409860 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:46:21.409826 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:46:30.302664 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:46:30.302620 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:46:38.804353 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:46:38.804267 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:46:49.898964 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:46:49.898908 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:46:59.204265 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:46:59.204231 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:47:09.907464 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:47:09.907429 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:47:19.411829 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:47:19.411789 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:47:24.495698 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:47:24.495661 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:47:31.640638 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:47:31.640604 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:47:37.506767 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:47:37.506732 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:47:51.699452 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:47:51.699418 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:48:00.400827 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:00.400795 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:48:09.904306 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:09.904268 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:48:16.404891 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:16.404850 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:48:39.101775 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:39.101739 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:48:52.102249 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:52.102216 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:48:53.324066 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:53.323985 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl"] Jun 13 01:48:53.324533 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:53.324513 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23bb57b9-a97c-42d9-86e5-fc728416e3ed" containerName="cleanup" Jun 13 01:48:53.324602 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:53.324538 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="23bb57b9-a97c-42d9-86e5-fc728416e3ed" containerName="cleanup" Jun 13 01:48:53.324677 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:53.324664 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="23bb57b9-a97c-42d9-86e5-fc728416e3ed" containerName="cleanup" Jun 13 01:48:53.327750 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:53.327729 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" Jun 13 01:48:53.341594 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:53.341572 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 13 01:48:53.342877 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:53.342857 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cd95n\"" Jun 13 01:48:53.355691 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:53.355667 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl"] Jun 13 01:48:53.462310 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:53.462278 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47bc6901-a704-499e-bfb8-44cba4f0a61d-openshift-service-ca\") pod \"maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl\" (UID: \"47bc6901-a704-499e-bfb8-44cba4f0a61d\") " pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" Jun 13 01:48:53.462463 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:53.462348 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47bc6901-a704-499e-bfb8-44cba4f0a61d-maas-api-tls\") pod \"maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl\" (UID: \"47bc6901-a704-499e-bfb8-44cba4f0a61d\") " pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" Jun 13 01:48:53.462463 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:53.462402 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkpvw\" (UniqueName: \"kubernetes.io/projected/47bc6901-a704-499e-bfb8-44cba4f0a61d-kube-api-access-dkpvw\") pod \"maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl\" (UID: \"47bc6901-a704-499e-bfb8-44cba4f0a61d\") " pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" Jun 13 01:48:53.563056 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:53.563027 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkpvw\" (UniqueName: \"kubernetes.io/projected/47bc6901-a704-499e-bfb8-44cba4f0a61d-kube-api-access-dkpvw\") pod \"maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl\" (UID: \"47bc6901-a704-499e-bfb8-44cba4f0a61d\") " pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" Jun 13 01:48:53.563240 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:53.563069 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47bc6901-a704-499e-bfb8-44cba4f0a61d-openshift-service-ca\") pod \"maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl\" (UID: \"47bc6901-a704-499e-bfb8-44cba4f0a61d\") " pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" Jun 13 01:48:53.563240 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:53.563119 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47bc6901-a704-499e-bfb8-44cba4f0a61d-maas-api-tls\") pod \"maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl\" (UID: \"47bc6901-a704-499e-bfb8-44cba4f0a61d\") " pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" Jun 13 01:48:53.563748 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:53.563725 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47bc6901-a704-499e-bfb8-44cba4f0a61d-openshift-service-ca\") pod \"maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl\" (UID: \"47bc6901-a704-499e-bfb8-44cba4f0a61d\") " pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" Jun 13 01:48:53.565395 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:53.565375 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47bc6901-a704-499e-bfb8-44cba4f0a61d-maas-api-tls\") pod \"maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl\" (UID: \"47bc6901-a704-499e-bfb8-44cba4f0a61d\") " pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" Jun 13 01:48:53.571356 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:53.571338 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkpvw\" (UniqueName: \"kubernetes.io/projected/47bc6901-a704-499e-bfb8-44cba4f0a61d-kube-api-access-dkpvw\") pod \"maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl\" (UID: \"47bc6901-a704-499e-bfb8-44cba4f0a61d\") " pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" Jun 13 01:48:53.638035 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:53.637974 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" Jun 13 01:48:53.777011 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:53.776979 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl"] Jun 13 01:48:53.778021 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:48:53.777987 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47bc6901_a704_499e_bfb8_44cba4f0a61d.slice/crio-e845210fa58705e708f3e4fd2bb295ee1875eb137d039bbfedf5f4ca52334db3 WatchSource:0}: Error finding container e845210fa58705e708f3e4fd2bb295ee1875eb137d039bbfedf5f4ca52334db3: Status 404 returned error can't find the container with id e845210fa58705e708f3e4fd2bb295ee1875eb137d039bbfedf5f4ca52334db3 Jun 13 01:48:53.779319 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:53.779298 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 01:48:54.446244 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:54.446207 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" event={"ID":"47bc6901-a704-499e-bfb8-44cba4f0a61d","Type":"ContainerStarted","Data":"e845210fa58705e708f3e4fd2bb295ee1875eb137d039bbfedf5f4ca52334db3"} Jun 13 01:48:55.453677 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:55.453647 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" event={"ID":"47bc6901-a704-499e-bfb8-44cba4f0a61d","Type":"ContainerStarted","Data":"06f12b47f6d059929b9ea8459d1f01313dcac64ab968a6fa92fce161acac3b0a"} Jun 13 01:48:55.454075 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:55.453754 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" Jun 13 01:48:55.470711 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:55.470647 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" podStartSLOduration=1.165715229 podStartE2EDuration="2.470627889s" totalImagesPullingTime="1.30491266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:48:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:48:55.470152085 +0000 UTC m=+2287.336167430" watchObservedRunningTime="2026-06-13 01:48:55.470627889 +0000 UTC m=+2287.336643111" Jun 13 01:48:56.462308 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:56.462274 2573 generic.go:356] "Generic (PLEG): container finished" podID="47bc6901-a704-499e-bfb8-44cba4f0a61d" containerID="06f12b47f6d059929b9ea8459d1f01313dcac64ab968a6fa92fce161acac3b0a" exitCode=1 Jun 13 01:48:56.462766 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:56.462359 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" event={"ID":"47bc6901-a704-499e-bfb8-44cba4f0a61d","Type":"ContainerDied","Data":"06f12b47f6d059929b9ea8459d1f01313dcac64ab968a6fa92fce161acac3b0a"} Jun 13 01:48:56.462766 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:56.462630 2573 scope.go:117] "RemoveContainer" containerID="06f12b47f6d059929b9ea8459d1f01313dcac64ab968a6fa92fce161acac3b0a" Jun 13 01:48:57.470134 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:57.470038 2573 generic.go:356] "Generic (PLEG): container finished" podID="47bc6901-a704-499e-bfb8-44cba4f0a61d" containerID="1cb486c2b1ddbcc7d5ac02c462383c9e583b314b52e2cebf5c4029c63e7cc6ae" exitCode=1 Jun 13 01:48:57.470134 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:57.470107 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" event={"ID":"47bc6901-a704-499e-bfb8-44cba4f0a61d","Type":"ContainerDied","Data":"1cb486c2b1ddbcc7d5ac02c462383c9e583b314b52e2cebf5c4029c63e7cc6ae"} Jun 13 01:48:57.470592 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:57.470179 2573 scope.go:117] "RemoveContainer" containerID="06f12b47f6d059929b9ea8459d1f01313dcac64ab968a6fa92fce161acac3b0a" Jun 13 01:48:57.470592 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:57.470374 2573 scope.go:117] "RemoveContainer" containerID="1cb486c2b1ddbcc7d5ac02c462383c9e583b314b52e2cebf5c4029c63e7cc6ae" Jun 13 01:48:57.470686 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:48:57.470626 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl_opendatahub(47bc6901-a704-499e-bfb8-44cba4f0a61d)\"" pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" podUID="47bc6901-a704-499e-bfb8-44cba4f0a61d" Jun 13 01:48:57.698015 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:57.697971 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:48:58.477142 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:48:58.477114 2573 scope.go:117] "RemoveContainer" containerID="1cb486c2b1ddbcc7d5ac02c462383c9e583b314b52e2cebf5c4029c63e7cc6ae" Jun 13 01:48:58.477510 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:48:58.477284 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl_opendatahub(47bc6901-a704-499e-bfb8-44cba4f0a61d)\"" pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" podUID="47bc6901-a704-499e-bfb8-44cba4f0a61d" Jun 13 01:49:00.454105 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:00.454071 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" Jun 13 01:49:00.454505 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:00.454433 2573 scope.go:117] "RemoveContainer" containerID="1cb486c2b1ddbcc7d5ac02c462383c9e583b314b52e2cebf5c4029c63e7cc6ae" Jun 13 01:49:00.454631 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:49:00.454610 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl_opendatahub(47bc6901-a704-499e-bfb8-44cba4f0a61d)\"" pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" podUID="47bc6901-a704-499e-bfb8-44cba4f0a61d" Jun 13 01:49:01.295458 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:01.295422 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:49:03.639098 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:03.639068 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" Jun 13 01:49:03.639472 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:03.639433 2573 scope.go:117] "RemoveContainer" containerID="1cb486c2b1ddbcc7d5ac02c462383c9e583b314b52e2cebf5c4029c63e7cc6ae" Jun 13 01:49:03.639602 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:49:03.639585 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl_opendatahub(47bc6901-a704-499e-bfb8-44cba4f0a61d)\"" pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" podUID="47bc6901-a704-499e-bfb8-44cba4f0a61d" Jun 13 01:49:06.018707 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:06.018674 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z"] Jun 13 01:49:06.023657 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:06.023637 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z" Jun 13 01:49:06.039396 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:06.039368 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z"] Jun 13 01:49:06.071675 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:06.071643 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a6d03ab-fb05-4aa8-a314-95c676b440d4-openshift-service-ca\") pod \"maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z\" (UID: \"1a6d03ab-fb05-4aa8-a314-95c676b440d4\") " pod="opendatahub/maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z" Jun 13 01:49:06.071844 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:06.071684 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a6d03ab-fb05-4aa8-a314-95c676b440d4-maas-api-tls\") pod \"maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z\" (UID: \"1a6d03ab-fb05-4aa8-a314-95c676b440d4\") " pod="opendatahub/maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z" Jun 13 01:49:06.071844 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:06.071755 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz88m\" (UniqueName: \"kubernetes.io/projected/1a6d03ab-fb05-4aa8-a314-95c676b440d4-kube-api-access-tz88m\") pod \"maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z\" (UID: \"1a6d03ab-fb05-4aa8-a314-95c676b440d4\") " pod="opendatahub/maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z" Jun 13 01:49:06.172412 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:06.172376 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a6d03ab-fb05-4aa8-a314-95c676b440d4-openshift-service-ca\") pod \"maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z\" (UID: \"1a6d03ab-fb05-4aa8-a314-95c676b440d4\") " pod="opendatahub/maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z" Jun 13 01:49:06.172412 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:06.172416 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a6d03ab-fb05-4aa8-a314-95c676b440d4-maas-api-tls\") pod \"maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z\" (UID: \"1a6d03ab-fb05-4aa8-a314-95c676b440d4\") " pod="opendatahub/maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z" Jun 13 01:49:06.172602 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:06.172452 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz88m\" (UniqueName: \"kubernetes.io/projected/1a6d03ab-fb05-4aa8-a314-95c676b440d4-kube-api-access-tz88m\") pod \"maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z\" (UID: \"1a6d03ab-fb05-4aa8-a314-95c676b440d4\") " pod="opendatahub/maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z" Jun 13 01:49:06.173056 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:06.173030 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a6d03ab-fb05-4aa8-a314-95c676b440d4-openshift-service-ca\") pod \"maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z\" (UID: \"1a6d03ab-fb05-4aa8-a314-95c676b440d4\") " pod="opendatahub/maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z" Jun 13 01:49:06.174832 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:06.174814 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a6d03ab-fb05-4aa8-a314-95c676b440d4-maas-api-tls\") pod \"maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z\" (UID: \"1a6d03ab-fb05-4aa8-a314-95c676b440d4\") " pod="opendatahub/maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z" Jun 13 01:49:06.180600 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:06.180581 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz88m\" (UniqueName: \"kubernetes.io/projected/1a6d03ab-fb05-4aa8-a314-95c676b440d4-kube-api-access-tz88m\") pod \"maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z\" (UID: \"1a6d03ab-fb05-4aa8-a314-95c676b440d4\") " pod="opendatahub/maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z" Jun 13 01:49:06.334192 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:06.334108 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z" Jun 13 01:49:06.475472 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:06.475446 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z"] Jun 13 01:49:06.476909 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:49:06.476882 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a6d03ab_fb05_4aa8_a314_95c676b440d4.slice/crio-172f0f8e905b11c16e19bf0c421b8a474e3a7f857205fa5fc2214e38381436d4 WatchSource:0}: Error finding container 172f0f8e905b11c16e19bf0c421b8a474e3a7f857205fa5fc2214e38381436d4: Status 404 returned error can't find the container with id 172f0f8e905b11c16e19bf0c421b8a474e3a7f857205fa5fc2214e38381436d4 Jun 13 01:49:06.521319 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:06.521294 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z" event={"ID":"1a6d03ab-fb05-4aa8-a314-95c676b440d4","Type":"ContainerStarted","Data":"172f0f8e905b11c16e19bf0c421b8a474e3a7f857205fa5fc2214e38381436d4"} Jun 13 01:49:07.492003 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:07.491919 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:49:07.529502 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:07.529471 2573 generic.go:356] "Generic (PLEG): container finished" podID="1a6d03ab-fb05-4aa8-a314-95c676b440d4" containerID="5fbfef9adbd646c8b7873b544a1a2dfc021ce85ccb63e5e7b3a71408c8f1609c" exitCode=1 Jun 13 01:49:07.529655 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:07.529542 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z" event={"ID":"1a6d03ab-fb05-4aa8-a314-95c676b440d4","Type":"ContainerDied","Data":"5fbfef9adbd646c8b7873b544a1a2dfc021ce85ccb63e5e7b3a71408c8f1609c"} Jun 13 01:49:07.529731 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:07.529719 2573 scope.go:117] "RemoveContainer" containerID="5fbfef9adbd646c8b7873b544a1a2dfc021ce85ccb63e5e7b3a71408c8f1609c" Jun 13 01:49:08.537787 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:08.537698 2573 generic.go:356] "Generic (PLEG): container finished" podID="1a6d03ab-fb05-4aa8-a314-95c676b440d4" containerID="13e27108978a95d75f6dcc64f86b3b7cf743cce8f0cdf1ddcbf5cf72f551128f" exitCode=1 Jun 13 01:49:08.538231 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:08.538049 2573 scope.go:117] "RemoveContainer" containerID="13e27108978a95d75f6dcc64f86b3b7cf743cce8f0cdf1ddcbf5cf72f551128f" Jun 13 01:49:08.538231 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:49:08.538204 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z_opendatahub(1a6d03ab-fb05-4aa8-a314-95c676b440d4)\"" pod="opendatahub/maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z" podUID="1a6d03ab-fb05-4aa8-a314-95c676b440d4" Jun 13 01:49:08.540020 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:08.539996 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z" event={"ID":"1a6d03ab-fb05-4aa8-a314-95c676b440d4","Type":"ContainerDied","Data":"13e27108978a95d75f6dcc64f86b3b7cf743cce8f0cdf1ddcbf5cf72f551128f"} Jun 13 01:49:08.540099 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:08.540048 2573 scope.go:117] "RemoveContainer" containerID="5fbfef9adbd646c8b7873b544a1a2dfc021ce85ccb63e5e7b3a71408c8f1609c" Jun 13 01:49:09.545443 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:09.545421 2573 scope.go:117] "RemoveContainer" containerID="13e27108978a95d75f6dcc64f86b3b7cf743cce8f0cdf1ddcbf5cf72f551128f" Jun 13 01:49:09.545786 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:49:09.545573 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z_opendatahub(1a6d03ab-fb05-4aa8-a314-95c676b440d4)\"" pod="opendatahub/maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z" podUID="1a6d03ab-fb05-4aa8-a314-95c676b440d4" Jun 13 01:49:11.334276 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:11.334237 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z" Jun 13 01:49:11.334667 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:11.334641 2573 scope.go:117] "RemoveContainer" containerID="13e27108978a95d75f6dcc64f86b3b7cf743cce8f0cdf1ddcbf5cf72f551128f" Jun 13 01:49:11.334825 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:49:11.334804 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z_opendatahub(1a6d03ab-fb05-4aa8-a314-95c676b440d4)\"" pod="opendatahub/maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z" podUID="1a6d03ab-fb05-4aa8-a314-95c676b440d4" Jun 13 01:49:13.997234 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:13.997195 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nvfst"] Jun 13 01:49:15.533131 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:15.533103 2573 scope.go:117] "RemoveContainer" containerID="1cb486c2b1ddbcc7d5ac02c462383c9e583b314b52e2cebf5c4029c63e7cc6ae" Jun 13 01:49:16.334836 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:16.334803 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z" Jun 13 01:49:16.335223 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:16.335209 2573 scope.go:117] "RemoveContainer" containerID="13e27108978a95d75f6dcc64f86b3b7cf743cce8f0cdf1ddcbf5cf72f551128f" Jun 13 01:49:16.335382 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:49:16.335365 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z_opendatahub(1a6d03ab-fb05-4aa8-a314-95c676b440d4)\"" pod="opendatahub/maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z" podUID="1a6d03ab-fb05-4aa8-a314-95c676b440d4" Jun 13 01:49:16.585793 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:16.585701 2573 generic.go:356] "Generic (PLEG): container finished" podID="47bc6901-a704-499e-bfb8-44cba4f0a61d" containerID="0c47cc2f1e48259c3adfe0a59573b5a1d0767993e2fae6fd0baabd2c479737ed" exitCode=1 Jun 13 01:49:16.585793 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:16.585774 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" event={"ID":"47bc6901-a704-499e-bfb8-44cba4f0a61d","Type":"ContainerDied","Data":"0c47cc2f1e48259c3adfe0a59573b5a1d0767993e2fae6fd0baabd2c479737ed"} Jun 13 01:49:16.586286 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:16.585826 2573 scope.go:117] "RemoveContainer" containerID="1cb486c2b1ddbcc7d5ac02c462383c9e583b314b52e2cebf5c4029c63e7cc6ae" Jun 13 01:49:16.586286 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:16.586117 2573 scope.go:117] "RemoveContainer" containerID="0c47cc2f1e48259c3adfe0a59573b5a1d0767993e2fae6fd0baabd2c479737ed" Jun 13 01:49:16.586362 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:49:16.586326 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl_opendatahub(47bc6901-a704-499e-bfb8-44cba4f0a61d)\"" pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" podUID="47bc6901-a704-499e-bfb8-44cba4f0a61d" Jun 13 01:49:20.454819 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:20.454789 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" Jun 13 01:49:20.455222 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:20.455149 2573 scope.go:117] "RemoveContainer" containerID="0c47cc2f1e48259c3adfe0a59573b5a1d0767993e2fae6fd0baabd2c479737ed" Jun 13 01:49:20.455320 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:49:20.455301 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl_opendatahub(47bc6901-a704-499e-bfb8-44cba4f0a61d)\"" pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" podUID="47bc6901-a704-499e-bfb8-44cba4f0a61d" Jun 13 01:49:23.638902 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:23.638873 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" Jun 13 01:49:23.639487 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:23.639342 2573 scope.go:117] "RemoveContainer" containerID="0c47cc2f1e48259c3adfe0a59573b5a1d0767993e2fae6fd0baabd2c479737ed" Jun 13 01:49:23.639581 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:49:23.639556 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl_opendatahub(47bc6901-a704-499e-bfb8-44cba4f0a61d)\"" pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" podUID="47bc6901-a704-499e-bfb8-44cba4f0a61d" Jun 13 01:49:25.494360 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:25.494323 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-59d4cc4684-jk2jm_88474cf8-ced8-47e9-9756-287c2e40e903/authorino/0.log" Jun 13 01:49:28.536248 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:28.536216 2573 scope.go:117] "RemoveContainer" containerID="13e27108978a95d75f6dcc64f86b3b7cf743cce8f0cdf1ddcbf5cf72f551128f" Jun 13 01:49:29.660497 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:29.660467 2573 generic.go:356] "Generic (PLEG): container finished" podID="1a6d03ab-fb05-4aa8-a314-95c676b440d4" containerID="338f059968f398e71e441ecc5abe5aeccf36b59b17dff09a83b3b650a9b9d3af" exitCode=1 Jun 13 01:49:29.660865 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:29.660539 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z" event={"ID":"1a6d03ab-fb05-4aa8-a314-95c676b440d4","Type":"ContainerDied","Data":"338f059968f398e71e441ecc5abe5aeccf36b59b17dff09a83b3b650a9b9d3af"} Jun 13 01:49:29.660865 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:29.660601 2573 scope.go:117] "RemoveContainer" containerID="13e27108978a95d75f6dcc64f86b3b7cf743cce8f0cdf1ddcbf5cf72f551128f" Jun 13 01:49:29.660994 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:29.660894 2573 scope.go:117] "RemoveContainer" containerID="338f059968f398e71e441ecc5abe5aeccf36b59b17dff09a83b3b650a9b9d3af" Jun 13 01:49:29.661080 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:49:29.661060 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z_opendatahub(1a6d03ab-fb05-4aa8-a314-95c676b440d4)\"" pod="opendatahub/maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z" podUID="1a6d03ab-fb05-4aa8-a314-95c676b440d4" Jun 13 01:49:30.650419 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:30.650389 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl_47bc6901-a704-499e-bfb8-44cba4f0a61d/maas-api/2.log" Jun 13 01:49:30.758257 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:30.758234 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z_1a6d03ab-fb05-4aa8-a314-95c676b440d4/maas-api/2.log" Jun 13 01:49:30.872306 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:30.872278 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29688570-lcnkq_963ecc4b-a9bf-44da-bd69-c7f153810ac6/cleanup/0.log" Jun 13 01:49:30.983037 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:30.982965 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29688585-gmktr_23bb57b9-a97c-42d9-86e5-fc728416e3ed/cleanup/0.log" Jun 13 01:49:31.107812 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:31.107757 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-c7b74457c-rw58p_89600b98-2e0f-4957-907d-45232170bd7e/manager/0.log" Jun 13 01:49:31.334291 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:31.334213 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z" Jun 13 01:49:31.334552 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:31.334538 2573 scope.go:117] "RemoveContainer" containerID="338f059968f398e71e441ecc5abe5aeccf36b59b17dff09a83b3b650a9b9d3af" Jun 13 01:49:31.334733 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:49:31.334711 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z_opendatahub(1a6d03ab-fb05-4aa8-a314-95c676b440d4)\"" pod="opendatahub/maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z" podUID="1a6d03ab-fb05-4aa8-a314-95c676b440d4" Jun 13 01:49:31.347019 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:31.346996 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-hvmbg_a336de5e-aea3-4ce7-aeda-d1f103b8ee89/manager/0.log" Jun 13 01:49:31.455236 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:31.455215 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f7bcb9597-fkvxq_d8830de2-2efa-406e-a8f6-3bf4588a4de3/copy-manifests/0.log" Jun 13 01:49:31.462429 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:31.462410 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f7bcb9597-fkvxq_d8830de2-2efa-406e-a8f6-3bf4588a4de3/manager/0.log" Jun 13 01:49:32.589228 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:32.589160 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925xff_7809474f-bcc4-4820-a901-6e9c674f2b16/util/0.log" Jun 13 01:49:32.597679 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:32.597654 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925xff_7809474f-bcc4-4820-a901-6e9c674f2b16/pull/0.log" Jun 13 01:49:32.603752 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:32.603718 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925xff_7809474f-bcc4-4820-a901-6e9c674f2b16/extract/0.log" Jun 13 01:49:32.714101 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:32.714075 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02hwbb_ca68196d-11bc-47a3-8b7d-66f9b2814c01/util/0.log" Jun 13 01:49:32.720579 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:32.720557 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02hwbb_ca68196d-11bc-47a3-8b7d-66f9b2814c01/pull/0.log" Jun 13 01:49:32.726778 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:32.726762 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02hwbb_ca68196d-11bc-47a3-8b7d-66f9b2814c01/extract/0.log" Jun 13 01:49:32.836513 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:32.836497 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gkqhz_a2a36b19-4afd-41bc-8884-d579597eff4e/util/0.log" Jun 13 01:49:32.842710 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:32.842645 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gkqhz_a2a36b19-4afd-41bc-8884-d579597eff4e/pull/0.log" Jun 13 01:49:32.848584 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:32.848559 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gkqhz_a2a36b19-4afd-41bc-8884-d579597eff4e/extract/0.log" Jun 13 01:49:32.957612 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:32.957590 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tnqlb_da95a02f-fd7c-44d0-b829-732cc9909995/util/0.log" Jun 13 01:49:32.964059 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:32.964027 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tnqlb_da95a02f-fd7c-44d0-b829-732cc9909995/pull/0.log" Jun 13 01:49:32.970167 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:32.970148 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tnqlb_da95a02f-fd7c-44d0-b829-732cc9909995/extract/0.log" Jun 13 01:49:33.096504 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:33.096438 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-59d4cc4684-jk2jm_88474cf8-ced8-47e9-9756-287c2e40e903/authorino/0.log" Jun 13 01:49:33.471684 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:33.471660 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-ghbmb_170c12ed-d4ae-4a80-be82-9aab5c9a9d6a/kuadrant-console-plugin/0.log" Jun 13 01:49:33.851766 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:33.851678 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-nvfst_90f3bbc6-9f80-453d-ac04-b863c0cfd02c/limitador/0.log" Jun 13 01:49:34.668758 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:34.668729 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-678b9f85fb-bsjjd_5bd07423-068c-4f65-b0a6-a60b9115b75b/kube-auth-proxy/0.log" Jun 13 01:49:35.140530 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:35.140457 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7784bb8876-wvjz6_8ee44e07-c5aa-417a-ae59-c24f0572b921/router/0.log" Jun 13 01:49:36.334605 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:36.334567 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z" Jun 13 01:49:36.335032 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:36.335017 2573 scope.go:117] "RemoveContainer" containerID="338f059968f398e71e441ecc5abe5aeccf36b59b17dff09a83b3b650a9b9d3af" Jun 13 01:49:36.335202 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:49:36.335184 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z_opendatahub(1a6d03ab-fb05-4aa8-a314-95c676b440d4)\"" pod="opendatahub/maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z" podUID="1a6d03ab-fb05-4aa8-a314-95c676b440d4" Jun 13 01:49:38.538785 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:38.538758 2573 scope.go:117] "RemoveContainer" containerID="0c47cc2f1e48259c3adfe0a59573b5a1d0767993e2fae6fd0baabd2c479737ed" Jun 13 01:49:39.721286 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:39.721245 2573 generic.go:356] "Generic (PLEG): container finished" podID="47bc6901-a704-499e-bfb8-44cba4f0a61d" containerID="84c0286e7b0105282cd1ab7bd535fb1e01964c5a86d991e724876c0b0c96a1e1" exitCode=1 Jun 13 01:49:39.721708 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:39.721315 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" event={"ID":"47bc6901-a704-499e-bfb8-44cba4f0a61d","Type":"ContainerDied","Data":"84c0286e7b0105282cd1ab7bd535fb1e01964c5a86d991e724876c0b0c96a1e1"} Jun 13 01:49:39.721708 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:39.721372 2573 scope.go:117] "RemoveContainer" containerID="0c47cc2f1e48259c3adfe0a59573b5a1d0767993e2fae6fd0baabd2c479737ed" Jun 13 01:49:39.721708 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:39.721673 2573 scope.go:117] "RemoveContainer" containerID="84c0286e7b0105282cd1ab7bd535fb1e01964c5a86d991e724876c0b0c96a1e1" Jun 13 01:49:39.721918 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:49:39.721895 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl_opendatahub(47bc6901-a704-499e-bfb8-44cba4f0a61d)\"" pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" podUID="47bc6901-a704-499e-bfb8-44cba4f0a61d" Jun 13 01:49:40.454706 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:40.454664 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" Jun 13 01:49:40.476114 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:40.476085 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7rf94/must-gather-p6vvk"] Jun 13 01:49:40.481124 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:40.481106 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7rf94/must-gather-p6vvk" Jun 13 01:49:40.484787 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:40.484737 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7rf94\"/\"openshift-service-ca.crt\"" Jun 13 01:49:40.484787 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:40.484775 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7rf94\"/\"kube-root-ca.crt\"" Jun 13 01:49:40.484973 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:40.484776 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7rf94\"/\"default-dockercfg-xb55v\"" Jun 13 01:49:40.488599 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:40.488575 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7rf94/must-gather-p6vvk"] Jun 13 01:49:40.560928 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:40.560900 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdsth\" (UniqueName: \"kubernetes.io/projected/ee4e201b-351b-4181-9da5-ab8006f81f27-kube-api-access-cdsth\") pod \"must-gather-p6vvk\" (UID: \"ee4e201b-351b-4181-9da5-ab8006f81f27\") " pod="openshift-must-gather-7rf94/must-gather-p6vvk" Jun 13 01:49:40.561102 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:40.561079 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ee4e201b-351b-4181-9da5-ab8006f81f27-must-gather-output\") pod \"must-gather-p6vvk\" (UID: \"ee4e201b-351b-4181-9da5-ab8006f81f27\") " pod="openshift-must-gather-7rf94/must-gather-p6vvk" Jun 13 01:49:40.661629 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:40.661600 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ee4e201b-351b-4181-9da5-ab8006f81f27-must-gather-output\") pod \"must-gather-p6vvk\" (UID: \"ee4e201b-351b-4181-9da5-ab8006f81f27\") " pod="openshift-must-gather-7rf94/must-gather-p6vvk" Jun 13 01:49:40.661753 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:40.661636 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdsth\" (UniqueName: \"kubernetes.io/projected/ee4e201b-351b-4181-9da5-ab8006f81f27-kube-api-access-cdsth\") pod \"must-gather-p6vvk\" (UID: \"ee4e201b-351b-4181-9da5-ab8006f81f27\") " pod="openshift-must-gather-7rf94/must-gather-p6vvk" Jun 13 01:49:40.661979 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:40.661932 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ee4e201b-351b-4181-9da5-ab8006f81f27-must-gather-output\") pod \"must-gather-p6vvk\" (UID: \"ee4e201b-351b-4181-9da5-ab8006f81f27\") " pod="openshift-must-gather-7rf94/must-gather-p6vvk" Jun 13 01:49:40.669680 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:40.669662 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdsth\" (UniqueName: \"kubernetes.io/projected/ee4e201b-351b-4181-9da5-ab8006f81f27-kube-api-access-cdsth\") pod \"must-gather-p6vvk\" (UID: \"ee4e201b-351b-4181-9da5-ab8006f81f27\") " pod="openshift-must-gather-7rf94/must-gather-p6vvk" Jun 13 01:49:40.728963 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:40.728895 2573 scope.go:117] "RemoveContainer" containerID="84c0286e7b0105282cd1ab7bd535fb1e01964c5a86d991e724876c0b0c96a1e1" Jun 13 01:49:40.729271 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:49:40.729078 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl_opendatahub(47bc6901-a704-499e-bfb8-44cba4f0a61d)\"" pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" podUID="47bc6901-a704-499e-bfb8-44cba4f0a61d" Jun 13 01:49:40.791691 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:40.791673 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7rf94/must-gather-p6vvk" Jun 13 01:49:40.924227 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:40.924203 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7rf94/must-gather-p6vvk"] Jun 13 01:49:40.925513 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:49:40.925483 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee4e201b_351b_4181_9da5_ab8006f81f27.slice/crio-e5b7b6914a503d1ff534af202612997687a5ea6995ab36a45e1807a1eed512fb WatchSource:0}: Error finding container e5b7b6914a503d1ff534af202612997687a5ea6995ab36a45e1807a1eed512fb: Status 404 returned error can't find the container with id e5b7b6914a503d1ff534af202612997687a5ea6995ab36a45e1807a1eed512fb Jun 13 01:49:41.739895 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:41.739864 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7rf94/must-gather-p6vvk" event={"ID":"ee4e201b-351b-4181-9da5-ab8006f81f27","Type":"ContainerStarted","Data":"5d18f398840377178f6fe6d46784fd4b36931c0fdc4fb382ded33e73c8f759be"} Jun 13 01:49:41.740363 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:41.739911 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7rf94/must-gather-p6vvk" event={"ID":"ee4e201b-351b-4181-9da5-ab8006f81f27","Type":"ContainerStarted","Data":"e5b7b6914a503d1ff534af202612997687a5ea6995ab36a45e1807a1eed512fb"} Jun 13 01:49:42.751615 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:42.750791 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7rf94/must-gather-p6vvk" event={"ID":"ee4e201b-351b-4181-9da5-ab8006f81f27","Type":"ContainerStarted","Data":"605dff1eab53f95d45d889ccc75b2052fc473535fb76a063efa76eb2506d0ce1"} Jun 13 01:49:42.768245 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:42.768198 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7rf94/must-gather-p6vvk" podStartSLOduration=2.10626097 podStartE2EDuration="2.768180186s" totalImagesPullingTime="661.919216ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:49:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:49:42.765596844 +0000 UTC m=+2334.631612090" watchObservedRunningTime="2026-06-13 01:49:42.768180186 +0000 UTC m=+2334.634195408" Jun 13 01:49:43.327489 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:43.327453 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4gzc9_113d88ff-ddd6-40b7-9c71-a00ce41a6c7d/global-pull-secret-syncer/0.log" Jun 13 01:49:43.521713 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:43.521678 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-t5qq4_0f57e152-5740-40a8-bc29-bcbcadff6f50/konnectivity-agent/0.log" Jun 13 01:49:43.566083 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:43.566057 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-236.ec2.internal_aeada42337847de1ed566b0c344a17a2/haproxy/0.log" Jun 13 01:49:43.638604 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:43.638510 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" Jun 13 01:49:43.638978 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:43.638934 2573 scope.go:117] "RemoveContainer" containerID="84c0286e7b0105282cd1ab7bd535fb1e01964c5a86d991e724876c0b0c96a1e1" Jun 13 01:49:43.639190 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:49:43.639170 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl_opendatahub(47bc6901-a704-499e-bfb8-44cba4f0a61d)\"" pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" podUID="47bc6901-a704-499e-bfb8-44cba4f0a61d" Jun 13 01:49:47.808007 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:47.807974 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925xff_7809474f-bcc4-4820-a901-6e9c674f2b16/extract/0.log" Jun 13 01:49:47.832328 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:47.832301 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925xff_7809474f-bcc4-4820-a901-6e9c674f2b16/util/0.log" Jun 13 01:49:47.856939 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:47.856903 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925xff_7809474f-bcc4-4820-a901-6e9c674f2b16/pull/0.log" Jun 13 01:49:47.887468 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:47.887444 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02hwbb_ca68196d-11bc-47a3-8b7d-66f9b2814c01/extract/0.log" Jun 13 01:49:47.914851 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:47.914756 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02hwbb_ca68196d-11bc-47a3-8b7d-66f9b2814c01/util/0.log" Jun 13 01:49:47.937565 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:47.937517 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02hwbb_ca68196d-11bc-47a3-8b7d-66f9b2814c01/pull/0.log" Jun 13 01:49:47.967957 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:47.967909 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gkqhz_a2a36b19-4afd-41bc-8884-d579597eff4e/extract/0.log" Jun 13 01:49:47.990797 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:47.990765 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gkqhz_a2a36b19-4afd-41bc-8884-d579597eff4e/util/0.log" Jun 13 01:49:48.014151 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:48.014105 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gkqhz_a2a36b19-4afd-41bc-8884-d579597eff4e/pull/0.log" Jun 13 01:49:48.041730 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:48.041705 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tnqlb_da95a02f-fd7c-44d0-b829-732cc9909995/extract/0.log" Jun 13 01:49:48.064179 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:48.064098 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tnqlb_da95a02f-fd7c-44d0-b829-732cc9909995/util/0.log" Jun 13 01:49:48.093904 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:48.093872 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tnqlb_da95a02f-fd7c-44d0-b829-732cc9909995/pull/0.log" Jun 13 01:49:48.503968 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:48.503300 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-59d4cc4684-jk2jm_88474cf8-ced8-47e9-9756-287c2e40e903/authorino/0.log" Jun 13 01:49:48.619276 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:48.619241 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-ghbmb_170c12ed-d4ae-4a80-be82-9aab5c9a9d6a/kuadrant-console-plugin/0.log" Jun 13 01:49:48.765856 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:48.765755 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-nvfst_90f3bbc6-9f80-453d-ac04-b863c0cfd02c/limitador/0.log" Jun 13 01:49:50.418829 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:50.418803 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a899a540-b336-4fe0-a89f-fedb6aae57cd/alertmanager/0.log" Jun 13 01:49:50.443687 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:50.443658 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a899a540-b336-4fe0-a89f-fedb6aae57cd/config-reloader/0.log" Jun 13 01:49:50.469546 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:50.469519 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a899a540-b336-4fe0-a89f-fedb6aae57cd/kube-rbac-proxy-web/0.log" Jun 13 01:49:50.491996 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:50.491967 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a899a540-b336-4fe0-a89f-fedb6aae57cd/kube-rbac-proxy/0.log" Jun 13 01:49:50.514204 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:50.514174 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a899a540-b336-4fe0-a89f-fedb6aae57cd/kube-rbac-proxy-metric/0.log" Jun 13 01:49:50.537987 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:50.536309 2573 scope.go:117] "RemoveContainer" containerID="338f059968f398e71e441ecc5abe5aeccf36b59b17dff09a83b3b650a9b9d3af" Jun 13 01:49:50.540585 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:50.540566 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a899a540-b336-4fe0-a89f-fedb6aae57cd/prom-label-proxy/0.log" Jun 13 01:49:50.566039 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:50.566016 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a899a540-b336-4fe0-a89f-fedb6aae57cd/init-config-reloader/0.log" Jun 13 01:49:50.606843 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:50.606811 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-9k2t8_15d41019-db02-4ef2-b0e8-88c9cc63aef8/cluster-monitoring-operator/0.log" Jun 13 01:49:50.810764 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:50.810682 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-bvmvr_ae77d882-43e9-42c7-86d7-29ac316f8b0f/monitoring-plugin/0.log" Jun 13 01:49:50.922764 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:50.922736 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fmqcx_8535f959-44fe-4b43-977e-8866e21a1887/node-exporter/0.log" Jun 13 01:49:50.944963 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:50.944927 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fmqcx_8535f959-44fe-4b43-977e-8866e21a1887/kube-rbac-proxy/0.log" Jun 13 01:49:50.968222 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:50.968194 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fmqcx_8535f959-44fe-4b43-977e-8866e21a1887/init-textfile/0.log" Jun 13 01:49:51.108624 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:51.108387 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-frsp7_e8a4889b-1355-42b4-b8d2-dfda8e2c82bd/kube-rbac-proxy-main/0.log" Jun 13 01:49:51.133668 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:51.133509 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-frsp7_e8a4889b-1355-42b4-b8d2-dfda8e2c82bd/kube-rbac-proxy-self/0.log" Jun 13 01:49:51.159486 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:51.159452 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-frsp7_e8a4889b-1355-42b4-b8d2-dfda8e2c82bd/openshift-state-metrics/0.log" Jun 13 01:49:51.490584 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:51.490482 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7457f99b99-dz5fx_faed9d27-1483-4cd5-9cd0-16a171ecaa3c/telemeter-client/0.log" Jun 13 01:49:51.530128 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:51.530098 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7457f99b99-dz5fx_faed9d27-1483-4cd5-9cd0-16a171ecaa3c/reload/0.log" Jun 13 01:49:51.555752 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:51.555722 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7457f99b99-dz5fx_faed9d27-1483-4cd5-9cd0-16a171ecaa3c/kube-rbac-proxy/0.log" Jun 13 01:49:51.842315 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:51.842216 2573 generic.go:356] "Generic (PLEG): container finished" podID="1a6d03ab-fb05-4aa8-a314-95c676b440d4" containerID="3bb356c8112fbd5db0ff36c6559079f586fb54c2e8a77009945136e8ee7dfeef" exitCode=1 Jun 13 01:49:51.842515 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:51.842378 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z" event={"ID":"1a6d03ab-fb05-4aa8-a314-95c676b440d4","Type":"ContainerDied","Data":"3bb356c8112fbd5db0ff36c6559079f586fb54c2e8a77009945136e8ee7dfeef"} Jun 13 01:49:51.842515 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:51.842470 2573 scope.go:117] "RemoveContainer" containerID="338f059968f398e71e441ecc5abe5aeccf36b59b17dff09a83b3b650a9b9d3af" Jun 13 01:49:51.842961 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:51.842922 2573 scope.go:117] "RemoveContainer" containerID="3bb356c8112fbd5db0ff36c6559079f586fb54c2e8a77009945136e8ee7dfeef" Jun 13 01:49:51.843445 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:49:51.843414 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z_opendatahub(1a6d03ab-fb05-4aa8-a314-95c676b440d4)\"" pod="opendatahub/maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z" podUID="1a6d03ab-fb05-4aa8-a314-95c676b440d4" Jun 13 01:49:53.802757 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:53.802720 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bb7cg_f53056e7-0404-4074-bc19-664e206fce89/console-operator/1.log" Jun 13 01:49:53.811660 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:53.811630 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bb7cg_f53056e7-0404-4074-bc19-664e206fce89/console-operator/2.log" Jun 13 01:49:54.395051 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:54.395016 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-t4p89_47f9472f-847e-4c8c-870d-32e019cb7eaa/download-server/0.log" Jun 13 01:49:54.868673 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:54.868574 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7rf94/perf-node-gather-daemonset-4mg9s"] Jun 13 01:49:54.877128 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:54.877099 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-4mg9s" Jun 13 01:49:54.877822 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:54.877794 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7rf94/perf-node-gather-daemonset-4mg9s"] Jun 13 01:49:54.905962 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:54.905720 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db5afeb3-7b67-489a-920e-13e013841e53-sys\") pod \"perf-node-gather-daemonset-4mg9s\" (UID: \"db5afeb3-7b67-489a-920e-13e013841e53\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-4mg9s" Jun 13 01:49:54.905962 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:54.905842 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48pkt\" (UniqueName: \"kubernetes.io/projected/db5afeb3-7b67-489a-920e-13e013841e53-kube-api-access-48pkt\") pod \"perf-node-gather-daemonset-4mg9s\" (UID: \"db5afeb3-7b67-489a-920e-13e013841e53\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-4mg9s" Jun 13 01:49:54.905962 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:54.905899 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/db5afeb3-7b67-489a-920e-13e013841e53-proc\") pod \"perf-node-gather-daemonset-4mg9s\" (UID: \"db5afeb3-7b67-489a-920e-13e013841e53\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-4mg9s" Jun 13 01:49:54.905962 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:54.905925 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/db5afeb3-7b67-489a-920e-13e013841e53-podres\") pod \"perf-node-gather-daemonset-4mg9s\" (UID: \"db5afeb3-7b67-489a-920e-13e013841e53\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-4mg9s" Jun 13 01:49:54.906306 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:54.906030 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db5afeb3-7b67-489a-920e-13e013841e53-lib-modules\") pod \"perf-node-gather-daemonset-4mg9s\" (UID: \"db5afeb3-7b67-489a-920e-13e013841e53\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-4mg9s" Jun 13 01:49:55.006905 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:55.006869 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/db5afeb3-7b67-489a-920e-13e013841e53-proc\") pod \"perf-node-gather-daemonset-4mg9s\" (UID: \"db5afeb3-7b67-489a-920e-13e013841e53\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-4mg9s" Jun 13 01:49:55.006905 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:55.006902 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/db5afeb3-7b67-489a-920e-13e013841e53-podres\") pod \"perf-node-gather-daemonset-4mg9s\" (UID: \"db5afeb3-7b67-489a-920e-13e013841e53\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-4mg9s" Jun 13 01:49:55.007179 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:55.006972 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db5afeb3-7b67-489a-920e-13e013841e53-lib-modules\") pod \"perf-node-gather-daemonset-4mg9s\" (UID: \"db5afeb3-7b67-489a-920e-13e013841e53\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-4mg9s" Jun 13 01:49:55.007179 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:55.007017 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/db5afeb3-7b67-489a-920e-13e013841e53-proc\") pod \"perf-node-gather-daemonset-4mg9s\" (UID: \"db5afeb3-7b67-489a-920e-13e013841e53\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-4mg9s" Jun 13 01:49:55.007179 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:55.007032 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db5afeb3-7b67-489a-920e-13e013841e53-sys\") pod \"perf-node-gather-daemonset-4mg9s\" (UID: \"db5afeb3-7b67-489a-920e-13e013841e53\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-4mg9s" Jun 13 01:49:55.007179 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:55.007108 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db5afeb3-7b67-489a-920e-13e013841e53-lib-modules\") pod \"perf-node-gather-daemonset-4mg9s\" (UID: \"db5afeb3-7b67-489a-920e-13e013841e53\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-4mg9s" Jun 13 01:49:55.007179 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:55.007126 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/db5afeb3-7b67-489a-920e-13e013841e53-podres\") pod \"perf-node-gather-daemonset-4mg9s\" (UID: \"db5afeb3-7b67-489a-920e-13e013841e53\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-4mg9s" Jun 13 01:49:55.007179 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:55.007122 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48pkt\" (UniqueName: \"kubernetes.io/projected/db5afeb3-7b67-489a-920e-13e013841e53-kube-api-access-48pkt\") pod \"perf-node-gather-daemonset-4mg9s\" (UID: \"db5afeb3-7b67-489a-920e-13e013841e53\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-4mg9s" Jun 13 01:49:55.007179 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:55.007162 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db5afeb3-7b67-489a-920e-13e013841e53-sys\") pod \"perf-node-gather-daemonset-4mg9s\" (UID: \"db5afeb3-7b67-489a-920e-13e013841e53\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-4mg9s" Jun 13 01:49:55.015325 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:55.015290 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48pkt\" (UniqueName: \"kubernetes.io/projected/db5afeb3-7b67-489a-920e-13e013841e53-kube-api-access-48pkt\") pod \"perf-node-gather-daemonset-4mg9s\" (UID: \"db5afeb3-7b67-489a-920e-13e013841e53\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-4mg9s" Jun 13 01:49:55.104484 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:55.104450 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-bd4ccd799-qfrjk_39a10cfc-561c-4e76-b463-c90fbe10aa0f/volume-data-source-validator/0.log" Jun 13 01:49:55.191062 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:55.191020 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-4mg9s" Jun 13 01:49:55.363959 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:55.363915 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7rf94/perf-node-gather-daemonset-4mg9s"] Jun 13 01:49:55.367774 ip-10-0-140-236 kubenswrapper[2573]: W0613 01:49:55.367738 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddb5afeb3_7b67_489a_920e_13e013841e53.slice/crio-0cb898339578ff164e33e2b5a2f1b3abd545420cb2369d4dba4fad705eb80f2c WatchSource:0}: Error finding container 0cb898339578ff164e33e2b5a2f1b3abd545420cb2369d4dba4fad705eb80f2c: Status 404 returned error can't find the container with id 0cb898339578ff164e33e2b5a2f1b3abd545420cb2369d4dba4fad705eb80f2c Jun 13 01:49:55.533668 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:55.533599 2573 scope.go:117] "RemoveContainer" containerID="84c0286e7b0105282cd1ab7bd535fb1e01964c5a86d991e724876c0b0c96a1e1" Jun 13 01:49:55.533799 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:49:55.533767 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl_opendatahub(47bc6901-a704-499e-bfb8-44cba4f0a61d)\"" pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" podUID="47bc6901-a704-499e-bfb8-44cba4f0a61d" Jun 13 01:49:55.881187 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:55.881085 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-4mg9s" event={"ID":"db5afeb3-7b67-489a-920e-13e013841e53","Type":"ContainerStarted","Data":"9e552508b61dcbc980872e4092354e6a31777e5e08c2db5a1695b4f71a0c5bbb"} Jun 13 01:49:55.881187 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:55.881167 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-4mg9s" event={"ID":"db5afeb3-7b67-489a-920e-13e013841e53","Type":"ContainerStarted","Data":"0cb898339578ff164e33e2b5a2f1b3abd545420cb2369d4dba4fad705eb80f2c"} Jun 13 01:49:55.881603 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:55.881194 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-4mg9s" Jun 13 01:49:55.900349 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:55.900295 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-4mg9s" podStartSLOduration=1.900276876 podStartE2EDuration="1.900276876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:49:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:49:55.899330862 +0000 UTC m=+2347.765346097" watchObservedRunningTime="2026-06-13 01:49:55.900276876 +0000 UTC m=+2347.766292103" Jun 13 01:49:56.187329 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:56.187297 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-76n9p_a3350408-8867-4ba4-8fec-37d9e005eb39/dns/0.log" Jun 13 01:49:56.207218 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:56.207189 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-76n9p_a3350408-8867-4ba4-8fec-37d9e005eb39/kube-rbac-proxy/0.log" Jun 13 01:49:56.334622 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:56.334591 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z" Jun 13 01:49:56.334790 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:56.334651 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z" Jun 13 01:49:56.335050 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:56.335036 2573 scope.go:117] "RemoveContainer" containerID="3bb356c8112fbd5db0ff36c6559079f586fb54c2e8a77009945136e8ee7dfeef" Jun 13 01:49:56.335237 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:49:56.335218 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z_opendatahub(1a6d03ab-fb05-4aa8-a314-95c676b440d4)\"" pod="opendatahub/maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z" podUID="1a6d03ab-fb05-4aa8-a314-95c676b440d4" Jun 13 01:49:56.339103 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:56.339076 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hlh72_e0f5e173-0662-47cd-9792-f07b01ab5eaf/dns-node-resolver/0.log" Jun 13 01:49:56.915519 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:56.915488 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4v55b_45611778-f77e-4cab-b564-ffb69bd4a695/node-ca/0.log" Jun 13 01:49:58.026548 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:58.026519 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-678b9f85fb-bsjjd_5bd07423-068c-4f65-b0a6-a60b9115b75b/kube-auth-proxy/0.log" Jun 13 01:49:58.241248 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:58.241187 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7784bb8876-wvjz6_8ee44e07-c5aa-417a-ae59-c24f0572b921/router/0.log" Jun 13 01:49:58.898090 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:58.898060 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qtfxw_ab5efd87-9312-47f5-8521-d918f3f16571/serve-healthcheck-canary/0.log" Jun 13 01:49:59.470458 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:59.470425 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4csfs_68a74310-9fc6-4c21-9bcb-b16bdf015f98/kube-rbac-proxy/0.log" Jun 13 01:49:59.510362 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:59.510333 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4csfs_68a74310-9fc6-4c21-9bcb-b16bdf015f98/exporter/0.log" Jun 13 01:49:59.543347 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:49:59.543317 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4csfs_68a74310-9fc6-4c21-9bcb-b16bdf015f98/extractor/0.log" Jun 13 01:50:01.897191 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:50:01.897164 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-4mg9s" Jun 13 01:50:02.163274 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:50:02.163201 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl_47bc6901-a704-499e-bfb8-44cba4f0a61d/maas-api/3.log" Jun 13 01:50:02.163274 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:50:02.163194 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl_47bc6901-a704-499e-bfb8-44cba4f0a61d/maas-api/3.log" Jun 13 01:50:02.183023 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:50:02.182983 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z_1a6d03ab-fb05-4aa8-a314-95c676b440d4/maas-api/3.log" Jun 13 01:50:02.183216 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:50:02.183019 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z_1a6d03ab-fb05-4aa8-a314-95c676b440d4/maas-api/3.log" Jun 13 01:50:02.201572 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:50:02.201550 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29688570-lcnkq_963ecc4b-a9bf-44da-bd69-c7f153810ac6/cleanup/0.log" Jun 13 01:50:02.224229 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:50:02.224202 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29688585-gmktr_23bb57b9-a97c-42d9-86e5-fc728416e3ed/cleanup/0.log" Jun 13 01:50:02.345914 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:50:02.345877 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-c7b74457c-rw58p_89600b98-2e0f-4957-907d-45232170bd7e/manager/0.log" Jun 13 01:50:02.449332 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:50:02.449249 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-hvmbg_a336de5e-aea3-4ce7-aeda-d1f103b8ee89/manager/0.log" Jun 13 01:50:02.474466 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:50:02.474437 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f7bcb9597-fkvxq_d8830de2-2efa-406e-a8f6-3bf4588a4de3/manager/0.log" Jun 13 01:50:02.493822 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:50:02.493793 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f7bcb9597-fkvxq_d8830de2-2efa-406e-a8f6-3bf4588a4de3/copy-manifests/0.log" Jun 13 01:50:04.576758 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:50:04.576729 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8554b6f6b8-7xcl6_f5b7baf3-d0bc-4234-8fa5-4cb63e625f18/manager/0.log" Jun 13 01:50:04.629523 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:50:04.629442 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-5cwb8_00741bf9-86da-4596-abb0-bf7f50fbd507/openshift-lws-operator/0.log" Jun 13 01:50:08.330306 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:50:08.330272 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-678b9f85fb-bsjjd_5bd07423-068c-4f65-b0a6-a60b9115b75b/kube-auth-proxy/0.log" Jun 13 01:50:08.513160 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:50:08.513130 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7784bb8876-wvjz6_8ee44e07-c5aa-417a-ae59-c24f0572b921/router/0.log" Jun 13 01:50:09.765268 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:50:09.765205 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-678b9f85fb-bsjjd_5bd07423-068c-4f65-b0a6-a60b9115b75b/kube-auth-proxy/0.log" Jun 13 01:50:09.956236 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:50:09.956192 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7784bb8876-wvjz6_8ee44e07-c5aa-417a-ae59-c24f0572b921/router/0.log" Jun 13 01:50:10.189636 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:50:10.189596 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-9x5wx_50fd466c-b2e3-49e0-b60a-c55c4049cd4e/kube-storage-version-migrator-operator/1.log" Jun 13 01:50:10.191538 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:50:10.191515 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-9x5wx_50fd466c-b2e3-49e0-b60a-c55c4049cd4e/kube-storage-version-migrator-operator/0.log" Jun 13 01:50:10.535149 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:50:10.534895 2573 scope.go:117] "RemoveContainer" containerID="84c0286e7b0105282cd1ab7bd535fb1e01964c5a86d991e724876c0b0c96a1e1" Jun 13 01:50:10.535346 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:50:10.535146 2573 scope.go:117] "RemoveContainer" containerID="3bb356c8112fbd5db0ff36c6559079f586fb54c2e8a77009945136e8ee7dfeef" Jun 13 01:50:10.535346 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:50:10.535331 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z_opendatahub(1a6d03ab-fb05-4aa8-a314-95c676b440d4)\"" pod="opendatahub/maas-api-e2e-ait-8ef6cb6a-7564d8c479-dhl4z" podUID="1a6d03ab-fb05-4aa8-a314-95c676b440d4" Jun 13 01:50:10.535512 ip-10-0-140-236 kubenswrapper[2573]: E0613 01:50:10.535333 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl_opendatahub(47bc6901-a704-499e-bfb8-44cba4f0a61d)\"" pod="opendatahub/maas-api-e2e-ait-7225cfcd-6f986db85d-mdgkl" podUID="47bc6901-a704-499e-bfb8-44cba4f0a61d" Jun 13 01:50:11.488512 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:50:11.488483 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-chd2f_f8284579-c698-4ff6-930c-de63ccccc8bd/kube-multus-additional-cni-plugins/0.log" Jun 13 01:50:11.517360 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:50:11.517325 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-chd2f_f8284579-c698-4ff6-930c-de63ccccc8bd/egress-router-binary-copy/0.log" Jun 13 01:50:11.544771 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:50:11.544748 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-chd2f_f8284579-c698-4ff6-930c-de63ccccc8bd/cni-plugins/0.log" Jun 13 01:50:11.565966 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:50:11.565927 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-chd2f_f8284579-c698-4ff6-930c-de63ccccc8bd/bond-cni-plugin/0.log" Jun 13 01:50:11.587611 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:50:11.587587 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-chd2f_f8284579-c698-4ff6-930c-de63ccccc8bd/routeoverride-cni/0.log" Jun 13 01:50:11.608072 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:50:11.608049 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-chd2f_f8284579-c698-4ff6-930c-de63ccccc8bd/whereabouts-cni-bincopy/0.log" Jun 13 01:50:11.628211 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:50:11.628184 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-chd2f_f8284579-c698-4ff6-930c-de63ccccc8bd/whereabouts-cni/0.log" Jun 13 01:50:11.756429 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:50:11.756360 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-678b9f85fb-bsjjd_5bd07423-068c-4f65-b0a6-a60b9115b75b/kube-auth-proxy/0.log" Jun 13 01:50:11.928921 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:50:11.928897 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7784bb8876-wvjz6_8ee44e07-c5aa-417a-ae59-c24f0572b921/router/0.log" Jun 13 01:50:12.067711 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:50:12.067635 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wbsfg_9281997e-d152-4b6a-ae85-9c590da00f3d/kube-multus/0.log" Jun 13 01:50:12.179762 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:50:12.179731 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-t4b8x_323114ca-ff76-4dbd-90b9-8d1c80ebea04/network-metrics-daemon/0.log" Jun 13 01:50:12.199411 ip-10-0-140-236 kubenswrapper[2573]: I0613 01:50:12.199382 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-t4b8x_323114ca-ff76-4dbd-90b9-8d1c80ebea04/kube-rbac-proxy/0.log"