May 27 21:03:29.161383 ip-10-0-130-116 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 27 21:03:29.161399 ip-10-0-130-116 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 27 21:03:29.161410 ip-10-0-130-116 systemd[1]: kubelet.service: Failed with result 'resources'. May 27 21:03:29.161763 ip-10-0-130-116 systemd[1]: Failed to start Kubernetes Kubelet. May 27 21:03:39.315102 ip-10-0-130-116 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 27 21:03:39.315118 ip-10-0-130-116 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot a2b255ac1869482d90056991e05a987e -- May 27 21:06:15.248367 ip-10-0-130-116 systemd[1]: Starting Kubernetes Kubelet... May 27 21:06:15.763300 ip-10-0-130-116 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 21:06:15.763300 ip-10-0-130-116 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 27 21:06:15.763300 ip-10-0-130-116 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 21:06:15.763300 ip-10-0-130-116 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 27 21:06:15.763300 ip-10-0-130-116 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 21:06:15.765364 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.765275 2566 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 27 21:06:15.770304 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770290 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 21:06:15.770304 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770304 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 21:06:15.770368 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770309 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 21:06:15.770368 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770313 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 21:06:15.770368 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770316 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 21:06:15.770368 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770319 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 21:06:15.770368 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770322 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 21:06:15.770368 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770325 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 21:06:15.770368 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770328 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 21:06:15.770368 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770331 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 21:06:15.770368 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770340 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 21:06:15.770368 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770343 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 21:06:15.770368 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770346 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 21:06:15.770368 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770349 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 21:06:15.770368 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770352 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 21:06:15.770368 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770355 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 21:06:15.770368 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770357 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 21:06:15.770368 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770360 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 21:06:15.770368 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770362 2566 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 21:06:15.770368 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770365 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 21:06:15.770368 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770367 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 21:06:15.770368 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770370 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 21:06:15.770840 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770373 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 21:06:15.770840 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770376 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 21:06:15.770840 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770379 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 21:06:15.770840 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770382 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 21:06:15.770840 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770384 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 21:06:15.770840 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770387 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 21:06:15.770840 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770390 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 21:06:15.770840 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770392 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 21:06:15.770840 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770395 2566 feature_gate.go:328] unrecognized feature gate: Example2 May 27 21:06:15.770840 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770397 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 21:06:15.770840 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770400 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 21:06:15.770840 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770402 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 21:06:15.770840 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770405 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 21:06:15.770840 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770407 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 21:06:15.770840 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770410 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 21:06:15.770840 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770413 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 21:06:15.770840 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770417 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 21:06:15.770840 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770421 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 21:06:15.770840 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770424 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 21:06:15.771356 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770427 2566 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 21:06:15.771356 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770429 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 21:06:15.771356 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770432 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 21:06:15.771356 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770434 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 21:06:15.771356 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770437 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 21:06:15.771356 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770439 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 21:06:15.771356 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770442 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 21:06:15.771356 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770444 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 21:06:15.771356 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770447 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 21:06:15.771356 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770449 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 21:06:15.771356 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770452 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 21:06:15.771356 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770456 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 21:06:15.771356 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770459 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 21:06:15.771356 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770462 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 21:06:15.771356 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770466 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 21:06:15.771356 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770468 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 21:06:15.771356 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770471 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 21:06:15.771356 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770474 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 21:06:15.771356 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770494 2566 feature_gate.go:328] unrecognized feature gate: Example May 27 21:06:15.771356 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770498 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 21:06:15.771854 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770501 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 21:06:15.771854 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770504 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 21:06:15.771854 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770507 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 21:06:15.771854 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770510 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 21:06:15.771854 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770514 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 21:06:15.771854 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770517 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 21:06:15.771854 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770520 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 21:06:15.771854 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770523 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 21:06:15.771854 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770525 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 21:06:15.771854 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770528 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 21:06:15.771854 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770531 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 21:06:15.771854 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770535 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 21:06:15.771854 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770538 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 21:06:15.771854 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770541 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 21:06:15.771854 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770544 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 21:06:15.771854 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770546 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 21:06:15.771854 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770549 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 21:06:15.771854 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770551 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 21:06:15.771854 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770554 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 21:06:15.772330 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770557 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 21:06:15.772330 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770559 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 21:06:15.772330 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770562 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 21:06:15.772330 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770564 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 21:06:15.772330 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770569 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 21:06:15.772330 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770571 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 21:06:15.772330 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770945 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 21:06:15.772330 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770952 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 21:06:15.772330 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770956 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 21:06:15.772330 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770959 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 21:06:15.772330 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770962 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 21:06:15.772330 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770965 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 21:06:15.772330 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770967 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 21:06:15.772330 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770970 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 21:06:15.772330 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770972 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 21:06:15.772330 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770975 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 21:06:15.772330 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770978 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 21:06:15.772330 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770980 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 21:06:15.772330 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770983 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 21:06:15.772330 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770986 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 21:06:15.772809 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770989 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 21:06:15.772809 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770992 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 21:06:15.772809 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770994 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 21:06:15.772809 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.770997 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 21:06:15.772809 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771000 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 21:06:15.772809 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771002 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 21:06:15.772809 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771005 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 21:06:15.772809 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771008 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 21:06:15.772809 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771011 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 21:06:15.772809 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771014 2566 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 21:06:15.772809 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771016 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 21:06:15.772809 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771019 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 21:06:15.772809 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771022 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 21:06:15.772809 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771038 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 21:06:15.772809 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771041 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 21:06:15.772809 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771043 2566 feature_gate.go:328] unrecognized feature gate: Example May 27 21:06:15.772809 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771046 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 21:06:15.772809 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771048 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 21:06:15.772809 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771052 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 21:06:15.773306 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771056 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 21:06:15.773306 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771061 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 21:06:15.773306 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771064 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 21:06:15.773306 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771067 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 21:06:15.773306 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771070 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 21:06:15.773306 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771073 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 21:06:15.773306 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771076 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 21:06:15.773306 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771078 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 21:06:15.773306 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771081 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 21:06:15.773306 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771084 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 21:06:15.773306 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771087 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 21:06:15.773306 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771089 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 21:06:15.773306 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771093 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 21:06:15.773306 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771096 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 21:06:15.773306 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771098 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 21:06:15.773306 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771101 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 21:06:15.773306 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771103 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 21:06:15.773306 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771106 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 21:06:15.773306 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771108 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 21:06:15.773810 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771111 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 21:06:15.773810 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771114 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 21:06:15.773810 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771116 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 21:06:15.773810 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771119 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 21:06:15.773810 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771121 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 21:06:15.773810 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771124 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 21:06:15.773810 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771126 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 21:06:15.773810 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771128 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 21:06:15.773810 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771131 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 21:06:15.773810 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771134 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 21:06:15.773810 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771136 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 21:06:15.773810 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771139 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 21:06:15.773810 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771143 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 21:06:15.773810 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771146 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 21:06:15.773810 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771148 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 21:06:15.773810 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771151 2566 feature_gate.go:328] unrecognized feature gate: Example2 May 27 21:06:15.773810 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771154 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 21:06:15.773810 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771156 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 21:06:15.773810 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771159 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 21:06:15.773810 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771161 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 21:06:15.774354 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771164 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 21:06:15.774354 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771166 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 21:06:15.774354 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771169 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 21:06:15.774354 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771172 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 21:06:15.774354 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771175 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 21:06:15.774354 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771178 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 21:06:15.774354 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771181 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 21:06:15.774354 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771184 2566 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 21:06:15.774354 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771186 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 21:06:15.774354 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771189 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 21:06:15.774354 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771191 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 21:06:15.774354 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771194 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 21:06:15.774354 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771196 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 21:06:15.774354 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771199 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 21:06:15.774354 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771264 2566 flags.go:64] FLAG: --address="0.0.0.0" May 27 21:06:15.774354 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771271 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 27 21:06:15.774354 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771279 2566 flags.go:64] FLAG: --anonymous-auth="true" May 27 21:06:15.774354 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771286 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" May 27 21:06:15.774354 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771292 2566 flags.go:64] FLAG: --authentication-token-webhook="false" May 27 21:06:15.774354 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771296 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 27 21:06:15.774354 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771303 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 27 21:06:15.774870 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771308 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 27 21:06:15.774870 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771311 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 27 21:06:15.774870 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771317 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 27 21:06:15.774870 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771321 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 27 21:06:15.774870 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771325 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 27 21:06:15.774870 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771328 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 27 21:06:15.774870 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771331 2566 flags.go:64] FLAG: --cgroup-root="" May 27 21:06:15.774870 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771334 2566 flags.go:64] FLAG: --cgroups-per-qos="true" May 27 21:06:15.774870 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771337 2566 flags.go:64] FLAG: --client-ca-file="" May 27 21:06:15.774870 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771340 2566 flags.go:64] FLAG: --cloud-config="" May 27 21:06:15.774870 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771343 2566 flags.go:64] FLAG: --cloud-provider="external" May 27 21:06:15.774870 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771346 2566 flags.go:64] FLAG: --cluster-dns="[]" May 27 21:06:15.774870 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771351 2566 flags.go:64] FLAG: --cluster-domain="" May 27 21:06:15.774870 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771354 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 27 21:06:15.774870 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771357 2566 flags.go:64] FLAG: --config-dir="" May 27 21:06:15.774870 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771360 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 27 21:06:15.774870 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771364 2566 flags.go:64] FLAG: --container-log-max-files="5" May 27 21:06:15.774870 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771368 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" May 27 21:06:15.774870 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771371 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 27 21:06:15.774870 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771375 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 27 21:06:15.774870 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771378 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 27 21:06:15.774870 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771381 2566 flags.go:64] FLAG: --contention-profiling="false" May 27 21:06:15.774870 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771384 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" May 27 21:06:15.774870 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771387 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 27 21:06:15.775468 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771390 2566 flags.go:64] FLAG: --cpu-manager-policy="none" May 27 21:06:15.775468 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771393 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" May 27 21:06:15.775468 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771397 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 27 21:06:15.775468 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771400 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 27 21:06:15.775468 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771403 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" May 27 21:06:15.775468 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771406 2566 flags.go:64] FLAG: --enable-load-reader="false" May 27 21:06:15.775468 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771408 2566 flags.go:64] FLAG: --enable-server="true" May 27 21:06:15.775468 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771411 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 27 21:06:15.775468 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771416 2566 flags.go:64] FLAG: --event-burst="100" May 27 21:06:15.775468 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771419 2566 flags.go:64] FLAG: --event-qps="50" May 27 21:06:15.775468 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771422 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 27 21:06:15.775468 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771426 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 27 21:06:15.775468 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771429 2566 flags.go:64] FLAG: --eviction-hard="" May 27 21:06:15.775468 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771433 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 27 21:06:15.775468 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771436 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 27 21:06:15.775468 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771439 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 27 21:06:15.775468 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771443 2566 flags.go:64] FLAG: --eviction-soft="" May 27 21:06:15.775468 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771446 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" May 27 21:06:15.775468 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771449 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" May 27 21:06:15.775468 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771452 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 27 21:06:15.775468 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771455 2566 flags.go:64] FLAG: --experimental-mounter-path="" May 27 21:06:15.775468 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771458 2566 flags.go:64] FLAG: --fail-cgroupv1="false" May 27 21:06:15.775468 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771461 2566 flags.go:64] FLAG: --fail-swap-on="true" May 27 21:06:15.775468 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771464 2566 flags.go:64] FLAG: --feature-gates="" May 27 21:06:15.775468 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771467 2566 flags.go:64] FLAG: --file-check-frequency="20s" May 27 21:06:15.776082 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771471 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 27 21:06:15.776082 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771474 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 27 21:06:15.776082 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771477 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 27 21:06:15.776082 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771480 2566 flags.go:64] FLAG: --healthz-port="10248" May 27 21:06:15.776082 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771484 2566 flags.go:64] FLAG: --help="false" May 27 21:06:15.776082 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771487 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-130-116.ec2.internal" May 27 21:06:15.776082 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771490 2566 flags.go:64] FLAG: --housekeeping-interval="10s" May 27 21:06:15.776082 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771493 2566 flags.go:64] FLAG: --http-check-frequency="20s" May 27 21:06:15.776082 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771495 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 27 21:06:15.776082 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771499 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 27 21:06:15.776082 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771502 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" May 27 21:06:15.776082 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771505 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" May 27 21:06:15.776082 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771508 2566 flags.go:64] FLAG: --image-service-endpoint="" May 27 21:06:15.776082 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771511 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" May 27 21:06:15.776082 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771513 2566 flags.go:64] FLAG: --kube-api-burst="100" May 27 21:06:15.776082 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771516 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 27 21:06:15.776082 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771519 2566 flags.go:64] FLAG: --kube-api-qps="50" May 27 21:06:15.776082 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771523 2566 flags.go:64] FLAG: --kube-reserved="" May 27 21:06:15.776082 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771526 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" May 27 21:06:15.776082 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771529 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 27 21:06:15.776082 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771532 2566 flags.go:64] FLAG: --kubelet-cgroups="" May 27 21:06:15.776082 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771535 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 27 21:06:15.776082 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771538 2566 flags.go:64] FLAG: --lock-file="" May 27 21:06:15.776082 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771541 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" May 27 21:06:15.776659 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771545 2566 flags.go:64] FLAG: --log-flush-frequency="5s" May 27 21:06:15.776659 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771548 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 27 21:06:15.776659 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771553 2566 flags.go:64] FLAG: --log-json-split-stream="false" May 27 21:06:15.776659 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771556 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 27 21:06:15.776659 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771559 2566 flags.go:64] FLAG: --log-text-split-stream="false" May 27 21:06:15.776659 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771562 2566 flags.go:64] FLAG: --logging-format="text" May 27 21:06:15.776659 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771565 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 27 21:06:15.776659 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771568 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" May 27 21:06:15.776659 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771571 2566 flags.go:64] FLAG: --manifest-url="" May 27 21:06:15.776659 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771574 2566 flags.go:64] FLAG: --manifest-url-header="" May 27 21:06:15.776659 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771579 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 27 21:06:15.776659 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771582 2566 flags.go:64] FLAG: --max-open-files="1000000" May 27 21:06:15.776659 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771587 2566 flags.go:64] FLAG: --max-pods="110" May 27 21:06:15.776659 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771590 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" May 27 21:06:15.776659 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771593 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 27 21:06:15.776659 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771596 2566 flags.go:64] FLAG: --memory-manager-policy="None" May 27 21:06:15.776659 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771599 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 27 21:06:15.776659 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771602 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 27 21:06:15.776659 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771605 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" May 27 21:06:15.776659 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771608 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 27 21:06:15.776659 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771615 2566 flags.go:64] FLAG: --node-status-max-images="50" May 27 21:06:15.776659 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771618 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" May 27 21:06:15.776659 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771621 2566 flags.go:64] FLAG: --oom-score-adj="-999" May 27 21:06:15.776659 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771624 2566 flags.go:64] FLAG: --pod-cidr="" May 27 21:06:15.777581 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771627 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 27 21:06:15.777581 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771633 2566 flags.go:64] FLAG: --pod-manifest-path="" May 27 21:06:15.777581 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771640 2566 flags.go:64] FLAG: --pod-max-pids="-1" May 27 21:06:15.777581 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771643 2566 flags.go:64] FLAG: --pods-per-core="0" May 27 21:06:15.777581 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771646 2566 flags.go:64] FLAG: --port="10250" May 27 21:06:15.777581 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771649 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" May 27 21:06:15.777581 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771652 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05bbbf49d6215bb83" May 27 21:06:15.777581 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771655 2566 flags.go:64] FLAG: --qos-reserved="" May 27 21:06:15.777581 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771658 2566 flags.go:64] FLAG: --read-only-port="10255" May 27 21:06:15.777581 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771661 2566 flags.go:64] FLAG: --register-node="true" May 27 21:06:15.777581 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771664 2566 flags.go:64] FLAG: --register-schedulable="true" May 27 21:06:15.777581 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771667 2566 flags.go:64] FLAG: --register-with-taints="" May 27 21:06:15.777581 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771670 2566 flags.go:64] FLAG: --registry-burst="10" May 27 21:06:15.777581 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771673 2566 flags.go:64] FLAG: --registry-qps="5" May 27 21:06:15.777581 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771676 2566 flags.go:64] FLAG: --reserved-cpus="" May 27 21:06:15.777581 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771679 2566 flags.go:64] FLAG: --reserved-memory="" May 27 21:06:15.777581 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771683 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 27 21:06:15.777581 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771686 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 27 21:06:15.777581 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771689 2566 flags.go:64] FLAG: --rotate-certificates="false" May 27 21:06:15.777581 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771692 2566 flags.go:64] FLAG: --rotate-server-certificates="false" May 27 21:06:15.777581 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771695 2566 flags.go:64] FLAG: --runonce="false" May 27 21:06:15.777581 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771698 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 27 21:06:15.777581 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771701 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 27 21:06:15.777581 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771704 2566 flags.go:64] FLAG: --seccomp-default="false" May 27 21:06:15.777581 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771707 2566 flags.go:64] FLAG: --serialize-image-pulls="true" May 27 21:06:15.778277 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771710 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 27 21:06:15.778277 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771713 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 27 21:06:15.778277 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771716 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 27 21:06:15.778277 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771719 2566 flags.go:64] FLAG: --storage-driver-password="root" May 27 21:06:15.778277 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771722 2566 flags.go:64] FLAG: --storage-driver-secure="false" May 27 21:06:15.778277 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771725 2566 flags.go:64] FLAG: --storage-driver-table="stats" May 27 21:06:15.778277 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771728 2566 flags.go:64] FLAG: --storage-driver-user="root" May 27 21:06:15.778277 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771731 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 27 21:06:15.778277 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771734 2566 flags.go:64] FLAG: --sync-frequency="1m0s" May 27 21:06:15.778277 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771738 2566 flags.go:64] FLAG: --system-cgroups="" May 27 21:06:15.778277 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771741 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 27 21:06:15.778277 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771747 2566 flags.go:64] FLAG: --system-reserved-cgroup="" May 27 21:06:15.778277 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771749 2566 flags.go:64] FLAG: --tls-cert-file="" May 27 21:06:15.778277 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771752 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" May 27 21:06:15.778277 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771757 2566 flags.go:64] FLAG: --tls-min-version="" May 27 21:06:15.778277 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771760 2566 flags.go:64] FLAG: --tls-private-key-file="" May 27 21:06:15.778277 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771763 2566 flags.go:64] FLAG: --topology-manager-policy="none" May 27 21:06:15.778277 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771766 2566 flags.go:64] FLAG: --topology-manager-policy-options="" May 27 21:06:15.778277 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771769 2566 flags.go:64] FLAG: --topology-manager-scope="container" May 27 21:06:15.778277 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771772 2566 flags.go:64] FLAG: --v="2" May 27 21:06:15.778277 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771776 2566 flags.go:64] FLAG: --version="false" May 27 21:06:15.778277 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771780 2566 flags.go:64] FLAG: --vmodule="" May 27 21:06:15.778277 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771785 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 27 21:06:15.778277 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.771788 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 27 21:06:15.778277 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771890 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 21:06:15.778885 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771895 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 21:06:15.778885 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771898 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 21:06:15.778885 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771901 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 21:06:15.778885 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771905 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 21:06:15.778885 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771908 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 21:06:15.778885 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771910 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 21:06:15.778885 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771913 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 21:06:15.778885 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771917 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 21:06:15.778885 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771919 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 21:06:15.778885 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771922 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 21:06:15.778885 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771924 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 21:06:15.778885 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771928 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 21:06:15.778885 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771930 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 21:06:15.778885 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771933 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 21:06:15.778885 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771935 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 21:06:15.778885 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771940 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 21:06:15.778885 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771943 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 21:06:15.778885 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771946 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 21:06:15.778885 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771949 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 21:06:15.778885 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771952 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 21:06:15.779453 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771955 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 21:06:15.779453 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771957 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 21:06:15.779453 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771960 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 21:06:15.779453 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771963 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 21:06:15.779453 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771965 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 21:06:15.779453 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771968 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 21:06:15.779453 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771970 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 21:06:15.779453 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771972 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 21:06:15.779453 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771975 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 21:06:15.779453 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771978 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 21:06:15.779453 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771980 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 21:06:15.779453 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771983 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 21:06:15.779453 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771987 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 21:06:15.779453 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771990 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 21:06:15.779453 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771993 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 21:06:15.779453 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771996 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 21:06:15.779453 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.771999 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 21:06:15.779453 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772003 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 21:06:15.779453 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772007 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 21:06:15.779918 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772009 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 21:06:15.779918 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772012 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 21:06:15.779918 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772014 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 21:06:15.779918 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772017 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 21:06:15.779918 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772020 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 21:06:15.779918 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772022 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 21:06:15.779918 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772036 2566 feature_gate.go:328] unrecognized feature gate: Example May 27 21:06:15.779918 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772039 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 21:06:15.779918 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772043 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 21:06:15.779918 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772047 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 21:06:15.779918 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772050 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 21:06:15.779918 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772053 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 21:06:15.779918 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772055 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 21:06:15.779918 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772058 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 21:06:15.779918 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772061 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 21:06:15.779918 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772063 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 21:06:15.779918 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772066 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 21:06:15.779918 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772069 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 21:06:15.779918 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772071 2566 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 21:06:15.779918 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772074 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 21:06:15.780422 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772076 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 21:06:15.780422 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772079 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 21:06:15.780422 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772082 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 21:06:15.780422 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772085 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 21:06:15.780422 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772087 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 21:06:15.780422 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772089 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 21:06:15.780422 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772092 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 21:06:15.780422 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772094 2566 feature_gate.go:328] unrecognized feature gate: Example2 May 27 21:06:15.780422 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772097 2566 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 21:06:15.780422 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772099 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 21:06:15.780422 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772102 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 21:06:15.780422 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772105 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 21:06:15.780422 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772107 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 21:06:15.780422 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772110 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 21:06:15.780422 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772112 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 21:06:15.780422 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772115 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 21:06:15.780422 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772118 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 21:06:15.780422 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772120 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 21:06:15.780422 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772123 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 21:06:15.780422 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772125 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 21:06:15.780916 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772129 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 21:06:15.780916 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772133 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 21:06:15.780916 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772136 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 21:06:15.780916 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772139 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 21:06:15.780916 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772142 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 21:06:15.780916 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.772145 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 21:06:15.780916 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.772847 2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 21:06:15.780916 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.779621 2566 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 27 21:06:15.780916 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.779638 2566 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 27 21:06:15.780916 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779686 2566 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 21:06:15.780916 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779691 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 21:06:15.780916 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779694 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 21:06:15.780916 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779697 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 21:06:15.780916 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779700 2566 feature_gate.go:328] unrecognized feature gate: Example2 May 27 21:06:15.780916 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779702 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 21:06:15.781316 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779705 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 21:06:15.781316 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779708 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 21:06:15.781316 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779710 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 21:06:15.781316 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779713 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 21:06:15.781316 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779716 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 21:06:15.781316 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779718 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 21:06:15.781316 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779721 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 21:06:15.781316 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779724 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 21:06:15.781316 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779727 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 21:06:15.781316 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779730 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 21:06:15.781316 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779732 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 21:06:15.781316 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779735 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 21:06:15.781316 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779737 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 21:06:15.781316 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779740 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 21:06:15.781316 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779743 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 21:06:15.781316 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779745 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 21:06:15.781316 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779748 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 21:06:15.781316 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779750 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 21:06:15.781316 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779753 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 21:06:15.781316 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779756 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 21:06:15.781805 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779759 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 21:06:15.781805 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779761 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 21:06:15.781805 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779764 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 21:06:15.781805 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779766 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 21:06:15.781805 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779769 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 21:06:15.781805 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779773 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 21:06:15.781805 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779776 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 21:06:15.781805 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779779 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 21:06:15.781805 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779781 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 21:06:15.781805 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779784 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 21:06:15.781805 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779787 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 21:06:15.781805 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779789 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 21:06:15.781805 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779792 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 21:06:15.781805 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779794 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 21:06:15.781805 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779797 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 21:06:15.781805 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779800 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 21:06:15.781805 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779803 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 21:06:15.781805 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779805 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 21:06:15.781805 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779808 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 21:06:15.781805 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779810 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 21:06:15.782318 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779813 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 21:06:15.782318 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779817 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 21:06:15.782318 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779821 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 21:06:15.782318 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779824 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 21:06:15.782318 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779827 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 21:06:15.782318 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779830 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 21:06:15.782318 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779833 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 21:06:15.782318 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779836 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 21:06:15.782318 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779839 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 21:06:15.782318 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779843 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 21:06:15.782318 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779846 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 21:06:15.782318 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779849 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 21:06:15.782318 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779852 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 21:06:15.782318 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779854 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 21:06:15.782318 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779857 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 21:06:15.782318 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779859 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 21:06:15.782318 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779862 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 21:06:15.782318 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779865 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 21:06:15.782318 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779869 2566 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 21:06:15.782785 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779871 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 21:06:15.782785 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779874 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 21:06:15.782785 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779876 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 21:06:15.782785 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779879 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 21:06:15.782785 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779882 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 21:06:15.782785 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779884 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 21:06:15.782785 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779887 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 21:06:15.782785 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779889 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 21:06:15.782785 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779892 2566 feature_gate.go:328] unrecognized feature gate: Example May 27 21:06:15.782785 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779894 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 21:06:15.782785 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779897 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 21:06:15.782785 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779899 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 21:06:15.782785 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779902 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 21:06:15.782785 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779904 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 21:06:15.782785 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779907 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 21:06:15.782785 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779909 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 21:06:15.782785 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779912 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 21:06:15.782785 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779914 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 21:06:15.782785 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779917 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 21:06:15.782785 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779919 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 21:06:15.783400 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.779922 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 21:06:15.783400 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.779928 2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 21:06:15.783400 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780039 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 21:06:15.783400 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780044 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 21:06:15.783400 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780047 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 21:06:15.783400 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780050 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 21:06:15.783400 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780054 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 21:06:15.783400 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780057 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 21:06:15.783400 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780060 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 21:06:15.783400 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780063 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 21:06:15.783400 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780066 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 21:06:15.783400 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780069 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 21:06:15.783400 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780073 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 21:06:15.783400 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780075 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 21:06:15.783400 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780078 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 21:06:15.783400 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780081 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 21:06:15.783786 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780083 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 21:06:15.783786 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780086 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 21:06:15.783786 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780088 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 21:06:15.783786 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780091 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 21:06:15.783786 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780095 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 21:06:15.783786 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780099 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 21:06:15.783786 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780102 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 21:06:15.783786 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780105 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 21:06:15.783786 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780108 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 21:06:15.783786 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780111 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 21:06:15.783786 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780114 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 21:06:15.783786 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780117 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 21:06:15.783786 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780120 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 21:06:15.783786 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780123 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 21:06:15.783786 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780125 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 21:06:15.783786 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780128 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 21:06:15.783786 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780131 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 21:06:15.783786 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780134 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 21:06:15.783786 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780136 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 21:06:15.784279 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780139 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 21:06:15.784279 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780142 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 21:06:15.784279 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780144 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 21:06:15.784279 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780147 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 21:06:15.784279 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780149 2566 feature_gate.go:328] unrecognized feature gate: Example2 May 27 21:06:15.784279 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780152 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 21:06:15.784279 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780155 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 21:06:15.784279 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780157 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 21:06:15.784279 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780160 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 21:06:15.784279 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780162 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 21:06:15.784279 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780165 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 21:06:15.784279 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780168 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 21:06:15.784279 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780170 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 21:06:15.784279 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780172 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 21:06:15.784279 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780175 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 21:06:15.784279 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780177 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 21:06:15.784279 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780180 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 21:06:15.784279 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780182 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 21:06:15.784279 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780185 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 21:06:15.784279 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780187 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 21:06:15.784771 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780190 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 21:06:15.784771 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780192 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 21:06:15.784771 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780195 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 21:06:15.784771 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780197 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 21:06:15.784771 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780200 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 21:06:15.784771 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780202 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 21:06:15.784771 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780205 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 21:06:15.784771 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780207 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 21:06:15.784771 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780209 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 21:06:15.784771 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780212 2566 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 21:06:15.784771 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780215 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 21:06:15.784771 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780219 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 21:06:15.784771 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780222 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 21:06:15.784771 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780225 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 21:06:15.784771 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780228 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 21:06:15.784771 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780230 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 21:06:15.784771 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780233 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 21:06:15.784771 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780236 2566 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 21:06:15.784771 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780239 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 21:06:15.785236 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780241 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 21:06:15.785236 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780244 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 21:06:15.785236 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780246 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 21:06:15.785236 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780249 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 21:06:15.785236 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780253 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 21:06:15.785236 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780256 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 21:06:15.785236 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780258 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 21:06:15.785236 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780261 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 21:06:15.785236 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780264 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 21:06:15.785236 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780266 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 21:06:15.785236 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780269 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 21:06:15.785236 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780271 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 21:06:15.785236 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780274 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 21:06:15.785236 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:15.780277 2566 feature_gate.go:328] unrecognized feature gate: Example May 27 21:06:15.785236 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.780282 2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 21:06:15.785236 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.781194 2566 server.go:962] "Client rotation is on, will bootstrap in background" May 27 21:06:15.785679 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.783559 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 27 21:06:15.785679 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.784636 2566 server.go:1019] "Starting client certificate rotation" May 27 21:06:15.785679 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.784729 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 27 21:06:15.785679 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.784766 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 27 21:06:15.814022 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.813998 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 27 21:06:15.816192 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.816160 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 27 21:06:15.830855 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.830825 2566 log.go:25] "Validated CRI v1 runtime API" May 27 21:06:15.837063 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.837046 2566 log.go:25] "Validated CRI v1 image API" May 27 21:06:15.839261 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.839243 2566 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 27 21:06:15.841854 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.841830 2566 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 dcbff106-753a-4adb-bb42-6d2e6a39f827:/dev/nvme0n1p3 ec7edd5c-7d2d-428e-bce2-6cd7acf5c685:/dev/nvme0n1p4] May 27 21:06:15.841933 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.841851 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 27 21:06:15.846413 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.846293 2566 manager.go:217] Machine: {Timestamp:2026-05-27 21:06:15.845731023 +0000 UTC m=+0.465116800 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3115993 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec238e06e2d011c9e69e8f9278b81b34 SystemUUID:ec238e06-e2d0-11c9-e69e-8f9278b81b34 BootID:a2b255ac-1869-482d-9005-6991e05a987e Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:76:f2:37:1b:55 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:76:f2:37:1b:55 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:63:93:1e:72:70 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 27 21:06:15.846413 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.846406 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 27 21:06:15.846553 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.846490 2566 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 27 21:06:15.849805 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.849777 2566 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 27 21:06:15.849957 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.849808 2566 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-116.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 27 21:06:15.850009 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.849967 2566 topology_manager.go:138] "Creating topology manager with none policy" May 27 21:06:15.850009 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.849976 2566 container_manager_linux.go:306] "Creating device plugin manager" May 27 21:06:15.850009 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.849984 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 27 21:06:15.850883 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.850871 2566 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 27 21:06:15.853400 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.853390 2566 state_mem.go:36] "Initialized new in-memory state store" May 27 21:06:15.853691 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.853681 2566 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 27 21:06:15.855264 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.855239 2566 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 27 21:06:15.856450 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.856439 2566 kubelet.go:491] "Attempting to sync node with API server" May 27 21:06:15.856485 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.856460 2566 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 27 21:06:15.856485 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.856473 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 27 21:06:15.856485 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.856482 2566 kubelet.go:397] "Adding apiserver pod source" May 27 21:06:15.856575 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.856511 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 27 21:06:15.857789 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.857776 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 27 21:06:15.857852 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.857794 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 27 21:06:15.861726 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.861705 2566 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 27 21:06:15.864112 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.864094 2566 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 27 21:06:15.865053 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.865041 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 27 21:06:15.865092 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.865059 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 27 21:06:15.865092 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.865065 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 27 21:06:15.865092 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.865071 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 27 21:06:15.865092 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.865092 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 27 21:06:15.865205 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.865098 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 27 21:06:15.865205 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.865107 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 27 21:06:15.865205 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.865113 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 27 21:06:15.865205 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.865120 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 27 21:06:15.865205 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.865126 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 27 21:06:15.865205 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.865138 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 27 21:06:15.865532 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.865523 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 27 21:06:15.865562 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.865553 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 27 21:06:15.865562 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.865558 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 27 21:06:15.869113 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:15.869092 2566 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-116.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 27 21:06:15.869193 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.869182 2566 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 27 21:06:15.869226 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.869213 2566 server.go:1295] "Started kubelet" May 27 21:06:15.869291 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:15.869265 2566 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 27 21:06:15.869488 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.869366 2566 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 27 21:06:15.869557 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.869544 2566 server_v1.go:47] "podresources" method="list" useActivePods=true May 27 21:06:15.869632 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.869617 2566 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-116.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 27 21:06:15.869683 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.869663 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 27 21:06:15.870187 ip-10-0-130-116 systemd[1]: Started Kubernetes Kubelet. May 27 21:06:15.872860 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.872738 2566 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 27 21:06:15.875016 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.875000 2566 server.go:317] "Adding debug handlers to kubelet server" May 27 21:06:15.883106 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:15.881990 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-116.ec2.internal.18b388264fb9e016 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-116.ec2.internal,UID:ip-10-0-130-116.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-116.ec2.internal,},FirstTimestamp:2026-05-27 21:06:15.869194262 +0000 UTC m=+0.488580038,LastTimestamp:2026-05-27 21:06:15.869194262 +0000 UTC m=+0.488580038,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-116.ec2.internal,}" May 27 21:06:15.883473 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.883419 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 27 21:06:15.884125 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.884106 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 27 21:06:15.884347 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.884333 2566 volume_manager.go:295] "The desired_state_of_world populator starts" May 27 21:06:15.884444 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.884433 2566 volume_manager.go:297] "Starting Kubelet Volume Manager" May 27 21:06:15.884636 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.884617 2566 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 27 21:06:15.884721 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.884710 2566 reconstruct.go:97] "Volume reconstruction finished" May 27 21:06:15.884780 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.884723 2566 reconciler.go:26] "Reconciler: start to sync state" May 27 21:06:15.884982 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.884966 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 27 21:06:15.885076 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.884984 2566 factory.go:55] Registering systemd factory May 27 21:06:15.885076 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.884996 2566 factory.go:223] Registration of the systemd container factory successfully May 27 21:06:15.885232 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.885218 2566 factory.go:153] Registering CRI-O factory May 27 21:06:15.885290 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.885235 2566 factory.go:223] Registration of the crio container factory successfully May 27 21:06:15.885290 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.885252 2566 factory.go:103] Registering Raw factory May 27 21:06:15.885290 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.885266 2566 manager.go:1196] Started watching for new ooms in manager May 27 21:06:15.885423 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:15.885381 2566 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 27 21:06:15.885549 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:15.885527 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-116.ec2.internal\" not found" May 27 21:06:15.885702 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.885683 2566 manager.go:319] Starting recovery of all containers May 27 21:06:15.895492 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.895382 2566 manager.go:324] Recovery completed May 27 21:06:15.896135 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:15.896100 2566 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 27 21:06:15.896233 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:15.896177 2566 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-116.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 27 21:06:15.899613 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.899596 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 21:06:15.901438 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.901422 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasSufficientMemory" May 27 21:06:15.901526 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.901455 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasNoDiskPressure" May 27 21:06:15.901526 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.901470 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasSufficientPID" May 27 21:06:15.901962 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.901946 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" May 27 21:06:15.902014 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.901964 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 27 21:06:15.902014 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.901984 2566 state_mem.go:36] "Initialized new in-memory state store" May 27 21:06:15.905885 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.905873 2566 policy_none.go:49] "None policy: Start" May 27 21:06:15.905920 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.905890 2566 memory_manager.go:186] "Starting memorymanager" policy="None" May 27 21:06:15.905920 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.905901 2566 state_mem.go:35] "Initializing new in-memory state store" May 27 21:06:15.908264 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.908246 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-knd4x" May 27 21:06:15.909433 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:15.909368 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-116.ec2.internal.18b3882651a5e1fe default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-116.ec2.internal,UID:ip-10-0-130-116.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-116.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-116.ec2.internal,},FirstTimestamp:2026-05-27 21:06:15.901438462 +0000 UTC m=+0.520824243,LastTimestamp:2026-05-27 21:06:15.901438462 +0000 UTC m=+0.520824243,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-116.ec2.internal,}" May 27 21:06:15.914932 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.914915 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-knd4x" May 27 21:06:15.949677 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.949662 2566 manager.go:341] "Starting Device Plugin manager" May 27 21:06:15.977517 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:15.949693 2566 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 27 21:06:15.977517 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.949702 2566 server.go:85] "Starting device plugin registration server" May 27 21:06:15.977517 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.949943 2566 eviction_manager.go:189] "Eviction manager: starting control loop" May 27 21:06:15.977517 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.949956 2566 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 27 21:06:15.977517 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.950069 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 27 21:06:15.977517 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.950180 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 27 21:06:15.977517 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:15.950189 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 27 21:06:15.977517 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:15.950660 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 27 21:06:15.977517 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:15.950694 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-116.ec2.internal\" not found" May 27 21:06:16.024003 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.023931 2566 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 27 21:06:16.025126 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.025109 2566 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 27 21:06:16.025201 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.025145 2566 status_manager.go:230] "Starting to sync pod status with apiserver" May 27 21:06:16.025201 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.025169 2566 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 27 21:06:16.025201 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.025178 2566 kubelet.go:2451] "Starting kubelet main sync loop" May 27 21:06:16.025341 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:16.025223 2566 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 27 21:06:16.031598 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.031577 2566 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 27 21:06:16.050661 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.050644 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 21:06:16.052198 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.052181 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasSufficientMemory" May 27 21:06:16.052287 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.052210 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasNoDiskPressure" May 27 21:06:16.052287 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.052220 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasSufficientPID" May 27 21:06:16.052287 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.052242 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-116.ec2.internal" May 27 21:06:16.061075 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.061056 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-116.ec2.internal" May 27 21:06:16.061146 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:16.061076 2566 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-116.ec2.internal\": node \"ip-10-0-130-116.ec2.internal\" not found" May 27 21:06:16.074850 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:16.074826 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-116.ec2.internal\" not found" May 27 21:06:16.126123 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.126099 2566 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-116.ec2.internal"] May 27 21:06:16.126220 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.126160 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 21:06:16.127016 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.127000 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasSufficientMemory" May 27 21:06:16.127126 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.127062 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasNoDiskPressure" May 27 21:06:16.127126 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.127079 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasSufficientPID" May 27 21:06:16.128195 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.128180 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 21:06:16.128368 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.128353 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal" May 27 21:06:16.128419 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.128384 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 21:06:16.128934 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.128917 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasSufficientMemory" May 27 21:06:16.129038 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.128946 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasNoDiskPressure" May 27 21:06:16.129038 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.128956 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasSufficientPID" May 27 21:06:16.129038 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.128919 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasSufficientMemory" May 27 21:06:16.129038 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.129015 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasNoDiskPressure" May 27 21:06:16.129189 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.129042 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasSufficientPID" May 27 21:06:16.130018 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.130003 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-116.ec2.internal" May 27 21:06:16.130083 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.130055 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 21:06:16.130732 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.130719 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasSufficientMemory" May 27 21:06:16.130809 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.130748 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasNoDiskPressure" May 27 21:06:16.130809 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.130762 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasSufficientPID" May 27 21:06:16.144613 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:16.144593 2566 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-116.ec2.internal\" not found" node="ip-10-0-130-116.ec2.internal" May 27 21:06:16.147958 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:16.147942 2566 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-116.ec2.internal\" not found" node="ip-10-0-130-116.ec2.internal" May 27 21:06:16.175166 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:16.175145 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-116.ec2.internal\" not found" May 27 21:06:16.186296 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.186277 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/44a5d7b26b94d2de0850a5f86408116e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal\" (UID: \"44a5d7b26b94d2de0850a5f86408116e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal" May 27 21:06:16.186353 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.186301 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44a5d7b26b94d2de0850a5f86408116e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal\" (UID: \"44a5d7b26b94d2de0850a5f86408116e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal" May 27 21:06:16.186353 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.186317 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cbb190866593adbdc91ba8af1639e9f3-config\") pod \"kube-apiserver-proxy-ip-10-0-130-116.ec2.internal\" (UID: \"cbb190866593adbdc91ba8af1639e9f3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-116.ec2.internal" May 27 21:06:16.275439 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:16.275380 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-116.ec2.internal\" not found" May 27 21:06:16.286703 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.286680 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/44a5d7b26b94d2de0850a5f86408116e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal\" (UID: \"44a5d7b26b94d2de0850a5f86408116e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal" May 27 21:06:16.286788 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.286712 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44a5d7b26b94d2de0850a5f86408116e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal\" (UID: \"44a5d7b26b94d2de0850a5f86408116e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal" May 27 21:06:16.286788 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.286739 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cbb190866593adbdc91ba8af1639e9f3-config\") pod \"kube-apiserver-proxy-ip-10-0-130-116.ec2.internal\" (UID: \"cbb190866593adbdc91ba8af1639e9f3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-116.ec2.internal" May 27 21:06:16.286880 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.286795 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/44a5d7b26b94d2de0850a5f86408116e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal\" (UID: \"44a5d7b26b94d2de0850a5f86408116e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal" May 27 21:06:16.286880 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.286864 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cbb190866593adbdc91ba8af1639e9f3-config\") pod \"kube-apiserver-proxy-ip-10-0-130-116.ec2.internal\" (UID: \"cbb190866593adbdc91ba8af1639e9f3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-116.ec2.internal" May 27 21:06:16.286950 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.286899 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44a5d7b26b94d2de0850a5f86408116e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal\" (UID: \"44a5d7b26b94d2de0850a5f86408116e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal" May 27 21:06:16.376102 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:16.376075 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-116.ec2.internal\" not found" May 27 21:06:16.446506 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.446479 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal" May 27 21:06:16.450335 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.450316 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-116.ec2.internal" May 27 21:06:16.476704 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:16.476677 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-116.ec2.internal\" not found" May 27 21:06:16.577200 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:16.577171 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-116.ec2.internal\" not found" May 27 21:06:16.677668 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:16.677638 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-116.ec2.internal\" not found" May 27 21:06:16.689618 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.689593 2566 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 27 21:06:16.784743 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.784715 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 27 21:06:16.784743 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.784721 2566 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal" May 27 21:06:16.785529 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.784873 2566 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 27 21:06:16.785529 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.784882 2566 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 27 21:06:16.798321 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.798298 2566 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 27 21:06:16.802518 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.802503 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 27 21:06:16.803483 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.803471 2566 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-116.ec2.internal" May 27 21:06:16.813918 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.813899 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 27 21:06:16.857180 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.857111 2566 apiserver.go:52] "Watching apiserver" May 27 21:06:16.862587 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.862564 2566 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 27 21:06:16.862977 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.862955 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-h5lwv","openshift-network-operator/iptables-alerter-ds28t","openshift-ovn-kubernetes/ovnkube-node-7tlfn","kube-system/konnectivity-agent-6mrqq","kube-system/kube-apiserver-proxy-ip-10-0-130-116.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g74v","openshift-cluster-node-tuning-operator/tuned-mk9vt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal","openshift-multus/multus-f577f","openshift-dns/node-resolver-d722x","openshift-image-registry/node-ca-22zqb","openshift-multus/multus-additional-cni-plugins-ct8th","openshift-multus/network-metrics-daemon-b7dq5"] May 27 21:06:16.867079 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.867057 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5lwv" May 27 21:06:16.867184 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:16.867123 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h5lwv" podUID="aa70e273-d17b-4a4d-af0c-ccaaf3c319ec" May 27 21:06:16.867244 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.867188 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ds28t" May 27 21:06:16.870544 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.870521 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.872774 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.872755 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6mrqq" May 27 21:06:16.874993 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.874975 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g74v" May 27 21:06:16.877188 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.877170 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.878199 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.878169 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 27 21:06:16.878294 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.878170 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 27 21:06:16.879397 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.879376 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f577f" May 27 21:06:16.880149 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.880126 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 27 21:06:16.880241 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.880165 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rrrbw\"" May 27 21:06:16.880241 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.880194 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 27 21:06:16.880241 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.880208 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 27 21:06:16.880241 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.880232 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 27 21:06:16.880427 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.880330 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 27 21:06:16.880427 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.880408 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 27 21:06:16.880427 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.880418 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 27 21:06:16.880559 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.880450 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 27 21:06:16.880559 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.880476 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 27 21:06:16.880693 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.880646 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 27 21:06:16.880878 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.880863 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 27 21:06:16.881114 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.881098 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 27 21:06:16.881206 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.881115 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 27 21:06:16.881206 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.881162 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6l2vq\"" May 27 21:06:16.881206 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.881102 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tnn7p\"" May 27 21:06:16.881206 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.881181 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 27 21:06:16.881452 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.881222 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6n97w\"" May 27 21:06:16.881452 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.881163 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fwnbj\"" May 27 21:06:16.881718 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.881695 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-d722x" May 27 21:06:16.883744 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.883727 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 27 21:06:16.884477 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.884388 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-22zqb" May 27 21:06:16.885109 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.885089 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 27 21:06:16.885201 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.885151 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 27 21:06:16.885201 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.885169 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 27 21:06:16.885297 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.885208 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-p8q89\"" May 27 21:06:16.885379 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.885359 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 27 21:06:16.886718 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.886701 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ct8th" May 27 21:06:16.889209 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.889194 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dq5" May 27 21:06:16.889285 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:16.889253 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dq5" podUID="5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1" May 27 21:06:16.889446 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.889405 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f3da9f32-8d58-45f4-9bdf-c94b603fb597-etc-sysconfig\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.889510 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.889466 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f3da9f32-8d58-45f4-9bdf-c94b603fb597-lib-modules\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.889555 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.889515 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-multus-socket-dir-parent\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.889631 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.889588 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6skzk\" (UniqueName: \"kubernetes.io/projected/21c99a62-86e8-4647-b45e-aa4260bdd748-kube-api-access-6skzk\") pod \"aws-ebs-csi-driver-node-5g74v\" (UID: \"21c99a62-86e8-4647-b45e-aa4260bdd748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g74v" May 27 21:06:16.889713 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.889698 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-host-cni-bin\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.889774 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.889760 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3da9f32-8d58-45f4-9bdf-c94b603fb597-sys\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.889828 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.889772 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wkn42\"" May 27 21:06:16.889828 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.889788 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 27 21:06:16.889918 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.889876 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3da9f32-8d58-45f4-9bdf-c94b603fb597-var-lib-kubelet\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.889973 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.889938 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-system-cni-dir\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.890022 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.889998 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dc7b84ba-5d87-4bc9-b4e7-b4325d811acc-iptables-alerter-script\") pod \"iptables-alerter-ds28t\" (UID: \"dc7b84ba-5d87-4bc9-b4e7-b4325d811acc\") " pod="openshift-network-operator/iptables-alerter-ds28t" May 27 21:06:16.890093 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.890065 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-systemd-units\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.890093 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.890077 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 27 21:06:16.890199 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.890095 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-log-socket\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.890199 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.890147 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bb5828e9-6222-41c1-9586-5105d4c9d1f3-hosts-file\") pod \"node-resolver-d722x\" (UID: \"bb5828e9-6222-41c1-9586-5105d4c9d1f3\") " pod="openshift-dns/node-resolver-d722x" May 27 21:06:16.890199 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.890179 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f3da9f32-8d58-45f4-9bdf-c94b603fb597-run\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.890316 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.890228 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-host-run-netns\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.890316 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.890272 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-multus-conf-dir\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.890316 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.890292 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cab49327-f463-431f-b649-e6065ef8df95-serviceca\") pod \"node-ca-22zqb\" (UID: \"cab49327-f463-431f-b649-e6065ef8df95\") " pod="openshift-image-registry/node-ca-22zqb" May 27 21:06:16.890316 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.890314 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/924d6e9e-49fd-44b8-9c8c-bc859c8e05cd-os-release\") pod \"multus-additional-cni-plugins-ct8th\" (UID: \"924d6e9e-49fd-44b8-9c8c-bc859c8e05cd\") " pod="openshift-multus/multus-additional-cni-plugins-ct8th" May 27 21:06:16.890460 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.890363 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dc7b84ba-5d87-4bc9-b4e7-b4325d811acc-host-slash\") pod \"iptables-alerter-ds28t\" (UID: \"dc7b84ba-5d87-4bc9-b4e7-b4325d811acc\") " pod="openshift-network-operator/iptables-alerter-ds28t" May 27 21:06:16.890460 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.890391 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0fed42af-d37a-40b7-a34e-d4a611de1479-agent-certs\") pod \"konnectivity-agent-6mrqq\" (UID: \"0fed42af-d37a-40b7-a34e-d4a611de1479\") " pod="kube-system/konnectivity-agent-6mrqq" May 27 21:06:16.890460 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.890406 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/21c99a62-86e8-4647-b45e-aa4260bdd748-device-dir\") pod \"aws-ebs-csi-driver-node-5g74v\" (UID: \"21c99a62-86e8-4647-b45e-aa4260bdd748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g74v" May 27 21:06:16.890460 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.890419 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-os-release\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.890460 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.890432 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/924d6e9e-49fd-44b8-9c8c-bc859c8e05cd-cnibin\") pod \"multus-additional-cni-plugins-ct8th\" (UID: \"924d6e9e-49fd-44b8-9c8c-bc859c8e05cd\") " pod="openshift-multus/multus-additional-cni-plugins-ct8th" May 27 21:06:16.890460 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.890454 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/924d6e9e-49fd-44b8-9c8c-bc859c8e05cd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ct8th\" (UID: \"924d6e9e-49fd-44b8-9c8c-bc859c8e05cd\") " pod="openshift-multus/multus-additional-cni-plugins-ct8th" May 27 21:06:16.890666 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.890481 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/924d6e9e-49fd-44b8-9c8c-bc859c8e05cd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ct8th\" (UID: \"924d6e9e-49fd-44b8-9c8c-bc859c8e05cd\") " pod="openshift-multus/multus-additional-cni-plugins-ct8th" May 27 21:06:16.890666 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.890498 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7gb6\" (UniqueName: \"kubernetes.io/projected/dc7b84ba-5d87-4bc9-b4e7-b4325d811acc-kube-api-access-l7gb6\") pod \"iptables-alerter-ds28t\" (UID: \"dc7b84ba-5d87-4bc9-b4e7-b4325d811acc\") " pod="openshift-network-operator/iptables-alerter-ds28t" May 27 21:06:16.890666 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.890521 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-host-kubelet\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.890666 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.890535 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-cnibin\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.890666 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.890556 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-etc-kubernetes\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.890666 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.890580 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-host-slash\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.890666 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.890620 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb5828e9-6222-41c1-9586-5105d4c9d1f3-tmp-dir\") pod \"node-resolver-d722x\" (UID: \"bb5828e9-6222-41c1-9586-5105d4c9d1f3\") " pod="openshift-dns/node-resolver-d722x" May 27 21:06:16.890666 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.890662 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f3da9f32-8d58-45f4-9bdf-c94b603fb597-etc-systemd\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.890917 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.890683 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/924d6e9e-49fd-44b8-9c8c-bc859c8e05cd-cni-binary-copy\") pod \"multus-additional-cni-plugins-ct8th\" (UID: \"924d6e9e-49fd-44b8-9c8c-bc859c8e05cd\") " pod="openshift-multus/multus-additional-cni-plugins-ct8th" May 27 21:06:16.890917 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.890698 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ndpt\" (UniqueName: \"kubernetes.io/projected/aa70e273-d17b-4a4d-af0c-ccaaf3c319ec-kube-api-access-2ndpt\") pod \"network-check-target-h5lwv\" (UID: \"aa70e273-d17b-4a4d-af0c-ccaaf3c319ec\") " pod="openshift-network-diagnostics/network-check-target-h5lwv" May 27 21:06:16.890917 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.890739 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f3da9f32-8d58-45f4-9bdf-c94b603fb597-etc-sysctl-d\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.890917 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.890769 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c5de23b-1792-4e5c-86a5-b2964c551b92-cni-binary-copy\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.890917 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.890810 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-hostroot\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.890917 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.890842 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/21c99a62-86e8-4647-b45e-aa4260bdd748-registration-dir\") pod \"aws-ebs-csi-driver-node-5g74v\" (UID: \"21c99a62-86e8-4647-b45e-aa4260bdd748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g74v" May 27 21:06:16.891151 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.890901 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/924d6e9e-49fd-44b8-9c8c-bc859c8e05cd-system-cni-dir\") pod \"multus-additional-cni-plugins-ct8th\" (UID: \"924d6e9e-49fd-44b8-9c8c-bc859c8e05cd\") " pod="openshift-multus/multus-additional-cni-plugins-ct8th" May 27 21:06:16.891151 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.890955 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-etc-openvswitch\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.891151 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.890979 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-run-openvswitch\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.891151 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.890995 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-run-ovn\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.891151 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.891020 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/650f3617-9cba-4404-b65b-8d6a46ab3604-env-overrides\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.891151 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.891092 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/650f3617-9cba-4404-b65b-8d6a46ab3604-ovnkube-script-lib\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.891151 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.891134 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/924d6e9e-49fd-44b8-9c8c-bc859c8e05cd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ct8th\" (UID: \"924d6e9e-49fd-44b8-9c8c-bc859c8e05cd\") " pod="openshift-multus/multus-additional-cni-plugins-ct8th" May 27 21:06:16.891405 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.891177 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gn29\" (UniqueName: \"kubernetes.io/projected/924d6e9e-49fd-44b8-9c8c-bc859c8e05cd-kube-api-access-7gn29\") pod \"multus-additional-cni-plugins-ct8th\" (UID: \"924d6e9e-49fd-44b8-9c8c-bc859c8e05cd\") " pod="openshift-multus/multus-additional-cni-plugins-ct8th" May 27 21:06:16.891405 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.891195 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0fed42af-d37a-40b7-a34e-d4a611de1479-konnectivity-ca\") pod \"konnectivity-agent-6mrqq\" (UID: \"0fed42af-d37a-40b7-a34e-d4a611de1479\") " pod="kube-system/konnectivity-agent-6mrqq" May 27 21:06:16.891405 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.891210 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/21c99a62-86e8-4647-b45e-aa4260bdd748-sys-fs\") pod \"aws-ebs-csi-driver-node-5g74v\" (UID: \"21c99a62-86e8-4647-b45e-aa4260bdd748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g74v" May 27 21:06:16.891405 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.891195 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-74lh2\"" May 27 21:06:16.891405 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.891244 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f3da9f32-8d58-45f4-9bdf-c94b603fb597-host\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.891405 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.891259 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6c5de23b-1792-4e5c-86a5-b2964c551b92-multus-daemon-config\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.891405 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.891273 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tr9h\" (UniqueName: \"kubernetes.io/projected/6c5de23b-1792-4e5c-86a5-b2964c551b92-kube-api-access-5tr9h\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.891405 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.891299 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cab49327-f463-431f-b649-e6065ef8df95-host\") pod \"node-ca-22zqb\" (UID: \"cab49327-f463-431f-b649-e6065ef8df95\") " pod="openshift-image-registry/node-ca-22zqb" May 27 21:06:16.891405 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.891320 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/21c99a62-86e8-4647-b45e-aa4260bdd748-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5g74v\" (UID: \"21c99a62-86e8-4647-b45e-aa4260bdd748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g74v" May 27 21:06:16.891405 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.891349 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/21c99a62-86e8-4647-b45e-aa4260bdd748-socket-dir\") pod \"aws-ebs-csi-driver-node-5g74v\" (UID: \"21c99a62-86e8-4647-b45e-aa4260bdd748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g74v" May 27 21:06:16.891858 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.891411 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f3da9f32-8d58-45f4-9bdf-c94b603fb597-etc-modprobe-d\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.891858 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.891425 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f3da9f32-8d58-45f4-9bdf-c94b603fb597-etc-sysctl-conf\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.891858 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.891438 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f3da9f32-8d58-45f4-9bdf-c94b603fb597-etc-tuned\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.891858 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.891484 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwq99\" (UniqueName: \"kubernetes.io/projected/cab49327-f463-431f-b649-e6065ef8df95-kube-api-access-vwq99\") pod \"node-ca-22zqb\" (UID: \"cab49327-f463-431f-b649-e6065ef8df95\") " pod="openshift-image-registry/node-ca-22zqb" May 27 21:06:16.891858 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.891524 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-host-run-netns\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.891858 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.891569 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/650f3617-9cba-4404-b65b-8d6a46ab3604-ovnkube-config\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.891858 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.891596 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-host-run-k8s-cni-cncf-io\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.891858 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.891629 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-host-var-lib-cni-multus\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.891858 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.891712 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-host-run-ovn-kubernetes\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.891858 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.891760 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nq6p\" (UniqueName: \"kubernetes.io/projected/650f3617-9cba-4404-b65b-8d6a46ab3604-kube-api-access-2nq6p\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.891858 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.891801 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzfg8\" (UniqueName: \"kubernetes.io/projected/bb5828e9-6222-41c1-9586-5105d4c9d1f3-kube-api-access-hzfg8\") pod \"node-resolver-d722x\" (UID: \"bb5828e9-6222-41c1-9586-5105d4c9d1f3\") " pod="openshift-dns/node-resolver-d722x" May 27 21:06:16.891858 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.891850 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/21c99a62-86e8-4647-b45e-aa4260bdd748-etc-selinux\") pod \"aws-ebs-csi-driver-node-5g74v\" (UID: \"21c99a62-86e8-4647-b45e-aa4260bdd748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g74v" May 27 21:06:16.892400 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.891893 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-multus-cni-dir\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.892400 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.892001 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3da9f32-8d58-45f4-9bdf-c94b603fb597-tmp\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.892400 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.892102 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-host-var-lib-cni-bin\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.892400 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.892112 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 27 21:06:16.892400 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.892151 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-run-systemd\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.892400 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.892189 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-node-log\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.892400 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.892104 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-f7wpc\"" May 27 21:06:16.892400 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.892205 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 27 21:06:16.892400 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.892240 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx969\" (UniqueName: \"kubernetes.io/projected/f3da9f32-8d58-45f4-9bdf-c94b603fb597-kube-api-access-dx969\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.892400 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.892282 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-host-var-lib-kubelet\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.892400 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.892337 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-host-run-multus-certs\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.892794 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.892396 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-var-lib-openvswitch\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.892794 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.892452 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 27 21:06:16.892794 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.892462 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-host-cni-netd\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.892794 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.892515 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/650f3617-9cba-4404-b65b-8d6a46ab3604-ovn-node-metrics-cert\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.892794 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.892542 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3da9f32-8d58-45f4-9bdf-c94b603fb597-etc-kubernetes\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.892794 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.892592 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.893643 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.893626 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 27 21:06:16.894210 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.894193 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 27 21:06:16.917095 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.917066 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-26 21:01:15 +0000 UTC" deadline="2028-02-03 18:44:42.797016846 +0000 UTC" May 27 21:06:16.917095 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.917091 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14805h38m25.879927638s" May 27 21:06:16.920584 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.920564 2566 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 27 21:06:16.955734 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.955715 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rpkjq" May 27 21:06:16.965096 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:16.965069 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbb190866593adbdc91ba8af1639e9f3.slice/crio-adda46f99c4d92ebae56e36db0a97db332554e9fc86df1098cda40826935a671 WatchSource:0}: Error finding container adda46f99c4d92ebae56e36db0a97db332554e9fc86df1098cda40826935a671: Status 404 returned error can't find the container with id adda46f99c4d92ebae56e36db0a97db332554e9fc86df1098cda40826935a671 May 27 21:06:16.965326 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:16.965304 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44a5d7b26b94d2de0850a5f86408116e.slice/crio-487d0dcede096a79dbe3d3c2a672169bdfaacf54309df51140ab26f57c5c8583 WatchSource:0}: Error finding container 487d0dcede096a79dbe3d3c2a672169bdfaacf54309df51140ab26f57c5c8583: Status 404 returned error can't find the container with id 487d0dcede096a79dbe3d3c2a672169bdfaacf54309df51140ab26f57c5c8583 May 27 21:06:16.969409 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.969393 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 21:06:16.978166 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.978147 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rpkjq" May 27 21:06:16.985519 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.985503 2566 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 27 21:06:16.993420 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.993401 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f3da9f32-8d58-45f4-9bdf-c94b603fb597-run\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.993508 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.993428 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-host-run-netns\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.993508 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.993447 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-multus-conf-dir\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.993508 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.993461 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cab49327-f463-431f-b649-e6065ef8df95-serviceca\") pod \"node-ca-22zqb\" (UID: \"cab49327-f463-431f-b649-e6065ef8df95\") " pod="openshift-image-registry/node-ca-22zqb" May 27 21:06:16.993642 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.993521 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-host-run-netns\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.993642 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.993526 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-multus-conf-dir\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.993642 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.993542 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f3da9f32-8d58-45f4-9bdf-c94b603fb597-run\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.993642 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.993546 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/924d6e9e-49fd-44b8-9c8c-bc859c8e05cd-os-release\") pod \"multus-additional-cni-plugins-ct8th\" (UID: \"924d6e9e-49fd-44b8-9c8c-bc859c8e05cd\") " pod="openshift-multus/multus-additional-cni-plugins-ct8th" May 27 21:06:16.993642 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.993586 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dc7b84ba-5d87-4bc9-b4e7-b4325d811acc-host-slash\") pod \"iptables-alerter-ds28t\" (UID: \"dc7b84ba-5d87-4bc9-b4e7-b4325d811acc\") " pod="openshift-network-operator/iptables-alerter-ds28t" May 27 21:06:16.993642 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.993591 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/924d6e9e-49fd-44b8-9c8c-bc859c8e05cd-os-release\") pod \"multus-additional-cni-plugins-ct8th\" (UID: \"924d6e9e-49fd-44b8-9c8c-bc859c8e05cd\") " pod="openshift-multus/multus-additional-cni-plugins-ct8th" May 27 21:06:16.993642 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.993624 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0fed42af-d37a-40b7-a34e-d4a611de1479-agent-certs\") pod \"konnectivity-agent-6mrqq\" (UID: \"0fed42af-d37a-40b7-a34e-d4a611de1479\") " pod="kube-system/konnectivity-agent-6mrqq" May 27 21:06:16.993642 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.993643 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/21c99a62-86e8-4647-b45e-aa4260bdd748-device-dir\") pod \"aws-ebs-csi-driver-node-5g74v\" (UID: \"21c99a62-86e8-4647-b45e-aa4260bdd748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g74v" May 27 21:06:16.993950 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.993659 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-os-release\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.993950 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.993624 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dc7b84ba-5d87-4bc9-b4e7-b4325d811acc-host-slash\") pod \"iptables-alerter-ds28t\" (UID: \"dc7b84ba-5d87-4bc9-b4e7-b4325d811acc\") " pod="openshift-network-operator/iptables-alerter-ds28t" May 27 21:06:16.993950 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.993679 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/924d6e9e-49fd-44b8-9c8c-bc859c8e05cd-cnibin\") pod \"multus-additional-cni-plugins-ct8th\" (UID: \"924d6e9e-49fd-44b8-9c8c-bc859c8e05cd\") " pod="openshift-multus/multus-additional-cni-plugins-ct8th" May 27 21:06:16.993950 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.993704 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/924d6e9e-49fd-44b8-9c8c-bc859c8e05cd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ct8th\" (UID: \"924d6e9e-49fd-44b8-9c8c-bc859c8e05cd\") " pod="openshift-multus/multus-additional-cni-plugins-ct8th" May 27 21:06:16.993950 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.993737 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/924d6e9e-49fd-44b8-9c8c-bc859c8e05cd-cnibin\") pod \"multus-additional-cni-plugins-ct8th\" (UID: \"924d6e9e-49fd-44b8-9c8c-bc859c8e05cd\") " pod="openshift-multus/multus-additional-cni-plugins-ct8th" May 27 21:06:16.993950 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.993734 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/21c99a62-86e8-4647-b45e-aa4260bdd748-device-dir\") pod \"aws-ebs-csi-driver-node-5g74v\" (UID: \"21c99a62-86e8-4647-b45e-aa4260bdd748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g74v" May 27 21:06:16.993950 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.993768 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-os-release\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.993950 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.993806 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cab49327-f463-431f-b649-e6065ef8df95-serviceca\") pod \"node-ca-22zqb\" (UID: \"cab49327-f463-431f-b649-e6065ef8df95\") " pod="openshift-image-registry/node-ca-22zqb" May 27 21:06:16.993950 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.993808 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/924d6e9e-49fd-44b8-9c8c-bc859c8e05cd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ct8th\" (UID: \"924d6e9e-49fd-44b8-9c8c-bc859c8e05cd\") " pod="openshift-multus/multus-additional-cni-plugins-ct8th" May 27 21:06:16.993950 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.993833 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/924d6e9e-49fd-44b8-9c8c-bc859c8e05cd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ct8th\" (UID: \"924d6e9e-49fd-44b8-9c8c-bc859c8e05cd\") " pod="openshift-multus/multus-additional-cni-plugins-ct8th" May 27 21:06:16.993950 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.993838 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l7gb6\" (UniqueName: \"kubernetes.io/projected/dc7b84ba-5d87-4bc9-b4e7-b4325d811acc-kube-api-access-l7gb6\") pod \"iptables-alerter-ds28t\" (UID: \"dc7b84ba-5d87-4bc9-b4e7-b4325d811acc\") " pod="openshift-network-operator/iptables-alerter-ds28t" May 27 21:06:16.993950 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.993863 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-host-kubelet\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.993950 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.993886 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-cnibin\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.993950 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.993910 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-etc-kubernetes\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.993950 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.993939 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-host-slash\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.994713 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.993962 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb5828e9-6222-41c1-9586-5105d4c9d1f3-tmp-dir\") pod \"node-resolver-d722x\" (UID: \"bb5828e9-6222-41c1-9586-5105d4c9d1f3\") " pod="openshift-dns/node-resolver-d722x" May 27 21:06:16.994713 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.993981 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-host-kubelet\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.994713 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.993984 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-cnibin\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.994713 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.993987 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 27 21:06:16.994713 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994041 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-etc-kubernetes\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.994713 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994082 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-host-slash\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.994713 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994015 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1-metrics-certs\") pod \"network-metrics-daemon-b7dq5\" (UID: \"5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1\") " pod="openshift-multus/network-metrics-daemon-b7dq5" May 27 21:06:16.994713 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994160 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5smtk\" (UniqueName: \"kubernetes.io/projected/5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1-kube-api-access-5smtk\") pod \"network-metrics-daemon-b7dq5\" (UID: \"5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1\") " pod="openshift-multus/network-metrics-daemon-b7dq5" May 27 21:06:16.994713 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994205 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f3da9f32-8d58-45f4-9bdf-c94b603fb597-etc-systemd\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.994713 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994235 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/924d6e9e-49fd-44b8-9c8c-bc859c8e05cd-cni-binary-copy\") pod \"multus-additional-cni-plugins-ct8th\" (UID: \"924d6e9e-49fd-44b8-9c8c-bc859c8e05cd\") " pod="openshift-multus/multus-additional-cni-plugins-ct8th" May 27 21:06:16.994713 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994266 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f3da9f32-8d58-45f4-9bdf-c94b603fb597-etc-systemd\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.994713 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994272 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ndpt\" (UniqueName: \"kubernetes.io/projected/aa70e273-d17b-4a4d-af0c-ccaaf3c319ec-kube-api-access-2ndpt\") pod \"network-check-target-h5lwv\" (UID: \"aa70e273-d17b-4a4d-af0c-ccaaf3c319ec\") " pod="openshift-network-diagnostics/network-check-target-h5lwv" May 27 21:06:16.994713 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994283 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb5828e9-6222-41c1-9586-5105d4c9d1f3-tmp-dir\") pod \"node-resolver-d722x\" (UID: \"bb5828e9-6222-41c1-9586-5105d4c9d1f3\") " pod="openshift-dns/node-resolver-d722x" May 27 21:06:16.994713 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994299 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f3da9f32-8d58-45f4-9bdf-c94b603fb597-etc-sysctl-d\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.994713 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994335 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c5de23b-1792-4e5c-86a5-b2964c551b92-cni-binary-copy\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.994713 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994364 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-hostroot\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.994713 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994367 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/924d6e9e-49fd-44b8-9c8c-bc859c8e05cd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ct8th\" (UID: \"924d6e9e-49fd-44b8-9c8c-bc859c8e05cd\") " pod="openshift-multus/multus-additional-cni-plugins-ct8th" May 27 21:06:16.994713 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994393 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/21c99a62-86e8-4647-b45e-aa4260bdd748-registration-dir\") pod \"aws-ebs-csi-driver-node-5g74v\" (UID: \"21c99a62-86e8-4647-b45e-aa4260bdd748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g74v" May 27 21:06:16.995519 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994433 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-hostroot\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.995519 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994435 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/924d6e9e-49fd-44b8-9c8c-bc859c8e05cd-system-cni-dir\") pod \"multus-additional-cni-plugins-ct8th\" (UID: \"924d6e9e-49fd-44b8-9c8c-bc859c8e05cd\") " pod="openshift-multus/multus-additional-cni-plugins-ct8th" May 27 21:06:16.995519 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994446 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f3da9f32-8d58-45f4-9bdf-c94b603fb597-etc-sysctl-d\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.995519 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994470 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/21c99a62-86e8-4647-b45e-aa4260bdd748-registration-dir\") pod \"aws-ebs-csi-driver-node-5g74v\" (UID: \"21c99a62-86e8-4647-b45e-aa4260bdd748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g74v" May 27 21:06:16.995519 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994464 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-etc-openvswitch\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.995519 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994494 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/924d6e9e-49fd-44b8-9c8c-bc859c8e05cd-system-cni-dir\") pod \"multus-additional-cni-plugins-ct8th\" (UID: \"924d6e9e-49fd-44b8-9c8c-bc859c8e05cd\") " pod="openshift-multus/multus-additional-cni-plugins-ct8th" May 27 21:06:16.995519 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994500 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-run-openvswitch\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.995519 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994524 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-run-ovn\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.995519 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994542 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-etc-openvswitch\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.995519 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994549 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/650f3617-9cba-4404-b65b-8d6a46ab3604-env-overrides\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.995519 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994584 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-run-openvswitch\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.995519 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994579 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-run-ovn\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.995519 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994609 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/650f3617-9cba-4404-b65b-8d6a46ab3604-ovnkube-script-lib\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.995519 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994634 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/924d6e9e-49fd-44b8-9c8c-bc859c8e05cd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ct8th\" (UID: \"924d6e9e-49fd-44b8-9c8c-bc859c8e05cd\") " pod="openshift-multus/multus-additional-cni-plugins-ct8th" May 27 21:06:16.995519 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994663 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7gn29\" (UniqueName: \"kubernetes.io/projected/924d6e9e-49fd-44b8-9c8c-bc859c8e05cd-kube-api-access-7gn29\") pod \"multus-additional-cni-plugins-ct8th\" (UID: \"924d6e9e-49fd-44b8-9c8c-bc859c8e05cd\") " pod="openshift-multus/multus-additional-cni-plugins-ct8th" May 27 21:06:16.995519 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994692 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0fed42af-d37a-40b7-a34e-d4a611de1479-konnectivity-ca\") pod \"konnectivity-agent-6mrqq\" (UID: \"0fed42af-d37a-40b7-a34e-d4a611de1479\") " pod="kube-system/konnectivity-agent-6mrqq" May 27 21:06:16.995519 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994716 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/21c99a62-86e8-4647-b45e-aa4260bdd748-sys-fs\") pod \"aws-ebs-csi-driver-node-5g74v\" (UID: \"21c99a62-86e8-4647-b45e-aa4260bdd748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g74v" May 27 21:06:16.996291 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994746 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f3da9f32-8d58-45f4-9bdf-c94b603fb597-host\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.996291 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994768 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/924d6e9e-49fd-44b8-9c8c-bc859c8e05cd-cni-binary-copy\") pod \"multus-additional-cni-plugins-ct8th\" (UID: \"924d6e9e-49fd-44b8-9c8c-bc859c8e05cd\") " pod="openshift-multus/multus-additional-cni-plugins-ct8th" May 27 21:06:16.996291 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994802 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6c5de23b-1792-4e5c-86a5-b2964c551b92-multus-daemon-config\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.996291 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994848 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5tr9h\" (UniqueName: \"kubernetes.io/projected/6c5de23b-1792-4e5c-86a5-b2964c551b92-kube-api-access-5tr9h\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.996291 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994864 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/21c99a62-86e8-4647-b45e-aa4260bdd748-sys-fs\") pod \"aws-ebs-csi-driver-node-5g74v\" (UID: \"21c99a62-86e8-4647-b45e-aa4260bdd748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g74v" May 27 21:06:16.996291 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994872 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cab49327-f463-431f-b649-e6065ef8df95-host\") pod \"node-ca-22zqb\" (UID: \"cab49327-f463-431f-b649-e6065ef8df95\") " pod="openshift-image-registry/node-ca-22zqb" May 27 21:06:16.996291 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994899 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/21c99a62-86e8-4647-b45e-aa4260bdd748-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5g74v\" (UID: \"21c99a62-86e8-4647-b45e-aa4260bdd748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g74v" May 27 21:06:16.996291 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994926 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/21c99a62-86e8-4647-b45e-aa4260bdd748-socket-dir\") pod \"aws-ebs-csi-driver-node-5g74v\" (UID: \"21c99a62-86e8-4647-b45e-aa4260bdd748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g74v" May 27 21:06:16.996291 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994936 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c5de23b-1792-4e5c-86a5-b2964c551b92-cni-binary-copy\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.996291 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994950 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f3da9f32-8d58-45f4-9bdf-c94b603fb597-etc-modprobe-d\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.996291 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.994975 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f3da9f32-8d58-45f4-9bdf-c94b603fb597-etc-sysctl-conf\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.996291 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995001 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f3da9f32-8d58-45f4-9bdf-c94b603fb597-etc-tuned\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.996291 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995047 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vwq99\" (UniqueName: \"kubernetes.io/projected/cab49327-f463-431f-b649-e6065ef8df95-kube-api-access-vwq99\") pod \"node-ca-22zqb\" (UID: \"cab49327-f463-431f-b649-e6065ef8df95\") " pod="openshift-image-registry/node-ca-22zqb" May 27 21:06:16.996291 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995074 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-host-run-netns\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.996291 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995095 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/650f3617-9cba-4404-b65b-8d6a46ab3604-env-overrides\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.996291 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995098 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/650f3617-9cba-4404-b65b-8d6a46ab3604-ovnkube-config\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.996291 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995153 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-host-run-k8s-cni-cncf-io\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.997058 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995183 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-host-var-lib-cni-multus\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.997058 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995208 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-host-run-ovn-kubernetes\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.997058 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995233 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2nq6p\" (UniqueName: \"kubernetes.io/projected/650f3617-9cba-4404-b65b-8d6a46ab3604-kube-api-access-2nq6p\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.997058 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995263 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hzfg8\" (UniqueName: \"kubernetes.io/projected/bb5828e9-6222-41c1-9586-5105d4c9d1f3-kube-api-access-hzfg8\") pod \"node-resolver-d722x\" (UID: \"bb5828e9-6222-41c1-9586-5105d4c9d1f3\") " pod="openshift-dns/node-resolver-d722x" May 27 21:06:16.997058 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995294 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/21c99a62-86e8-4647-b45e-aa4260bdd748-etc-selinux\") pod \"aws-ebs-csi-driver-node-5g74v\" (UID: \"21c99a62-86e8-4647-b45e-aa4260bdd748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g74v" May 27 21:06:16.997058 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995321 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-multus-cni-dir\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.997058 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995346 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/924d6e9e-49fd-44b8-9c8c-bc859c8e05cd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ct8th\" (UID: \"924d6e9e-49fd-44b8-9c8c-bc859c8e05cd\") " pod="openshift-multus/multus-additional-cni-plugins-ct8th" May 27 21:06:16.997058 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995399 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-host-var-lib-cni-multus\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.997058 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995357 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/650f3617-9cba-4404-b65b-8d6a46ab3604-ovnkube-script-lib\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.997058 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995217 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-host-run-k8s-cni-cncf-io\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.997058 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995454 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6c5de23b-1792-4e5c-86a5-b2964c551b92-multus-daemon-config\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.997058 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995467 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f3da9f32-8d58-45f4-9bdf-c94b603fb597-etc-modprobe-d\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.997058 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995468 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-host-run-ovn-kubernetes\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.997058 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995479 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0fed42af-d37a-40b7-a34e-d4a611de1479-konnectivity-ca\") pod \"konnectivity-agent-6mrqq\" (UID: \"0fed42af-d37a-40b7-a34e-d4a611de1479\") " pod="kube-system/konnectivity-agent-6mrqq" May 27 21:06:16.997058 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995526 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f3da9f32-8d58-45f4-9bdf-c94b603fb597-host\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.997058 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995560 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/21c99a62-86e8-4647-b45e-aa4260bdd748-etc-selinux\") pod \"aws-ebs-csi-driver-node-5g74v\" (UID: \"21c99a62-86e8-4647-b45e-aa4260bdd748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g74v" May 27 21:06:16.997058 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995566 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/21c99a62-86e8-4647-b45e-aa4260bdd748-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5g74v\" (UID: \"21c99a62-86e8-4647-b45e-aa4260bdd748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g74v" May 27 21:06:16.997813 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995584 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-multus-cni-dir\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.997813 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995619 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/21c99a62-86e8-4647-b45e-aa4260bdd748-socket-dir\") pod \"aws-ebs-csi-driver-node-5g74v\" (UID: \"21c99a62-86e8-4647-b45e-aa4260bdd748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g74v" May 27 21:06:16.997813 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995526 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cab49327-f463-431f-b649-e6065ef8df95-host\") pod \"node-ca-22zqb\" (UID: \"cab49327-f463-431f-b649-e6065ef8df95\") " pod="openshift-image-registry/node-ca-22zqb" May 27 21:06:16.997813 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995346 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3da9f32-8d58-45f4-9bdf-c94b603fb597-tmp\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.997813 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995678 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-host-var-lib-cni-bin\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.997813 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995679 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/650f3617-9cba-4404-b65b-8d6a46ab3604-ovnkube-config\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.997813 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995707 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-run-systemd\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.997813 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995739 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-run-systemd\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.997813 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995767 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-node-log\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.997813 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995774 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-host-var-lib-cni-bin\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.997813 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995785 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-host-run-netns\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.997813 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995729 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f3da9f32-8d58-45f4-9bdf-c94b603fb597-etc-sysctl-conf\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.997813 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995800 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dx969\" (UniqueName: \"kubernetes.io/projected/f3da9f32-8d58-45f4-9bdf-c94b603fb597-kube-api-access-dx969\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.997813 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995827 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-host-var-lib-kubelet\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.997813 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995821 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-node-log\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.997813 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995876 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-host-run-multus-certs\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.997813 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995891 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-host-var-lib-kubelet\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.997813 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.995986 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-host-run-multus-certs\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.998401 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.996053 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-var-lib-openvswitch\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.998401 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.996080 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-host-cni-netd\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.998401 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.996105 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/650f3617-9cba-4404-b65b-8d6a46ab3604-ovn-node-metrics-cert\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.998401 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.996116 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-var-lib-openvswitch\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.998401 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.996146 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-host-cni-netd\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.998401 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.996158 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3da9f32-8d58-45f4-9bdf-c94b603fb597-etc-kubernetes\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.998401 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.996209 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.998401 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.996250 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3da9f32-8d58-45f4-9bdf-c94b603fb597-etc-kubernetes\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.998401 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.996249 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f3da9f32-8d58-45f4-9bdf-c94b603fb597-etc-sysconfig\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.998401 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.996322 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.998401 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.996361 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f3da9f32-8d58-45f4-9bdf-c94b603fb597-lib-modules\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.998401 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.996378 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f3da9f32-8d58-45f4-9bdf-c94b603fb597-etc-sysconfig\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.998401 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.996388 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-multus-socket-dir-parent\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.998401 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.996423 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6skzk\" (UniqueName: \"kubernetes.io/projected/21c99a62-86e8-4647-b45e-aa4260bdd748-kube-api-access-6skzk\") pod \"aws-ebs-csi-driver-node-5g74v\" (UID: \"21c99a62-86e8-4647-b45e-aa4260bdd748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g74v" May 27 21:06:16.998401 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.996470 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-host-cni-bin\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.998401 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.996499 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f3da9f32-8d58-45f4-9bdf-c94b603fb597-lib-modules\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.998401 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.996501 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3da9f32-8d58-45f4-9bdf-c94b603fb597-sys\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.999084 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.996548 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3da9f32-8d58-45f4-9bdf-c94b603fb597-sys\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.999084 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.996547 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3da9f32-8d58-45f4-9bdf-c94b603fb597-var-lib-kubelet\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.999084 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.996586 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-system-cni-dir\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.999084 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.996596 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3da9f32-8d58-45f4-9bdf-c94b603fb597-var-lib-kubelet\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.999084 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.996611 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dc7b84ba-5d87-4bc9-b4e7-b4325d811acc-iptables-alerter-script\") pod \"iptables-alerter-ds28t\" (UID: \"dc7b84ba-5d87-4bc9-b4e7-b4325d811acc\") " pod="openshift-network-operator/iptables-alerter-ds28t" May 27 21:06:16.999084 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.996634 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-systemd-units\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.999084 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.996662 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-log-socket\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.999084 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.996686 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bb5828e9-6222-41c1-9586-5105d4c9d1f3-hosts-file\") pod \"node-resolver-d722x\" (UID: \"bb5828e9-6222-41c1-9586-5105d4c9d1f3\") " pod="openshift-dns/node-resolver-d722x" May 27 21:06:16.999084 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.996694 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-multus-socket-dir-parent\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.999084 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.996807 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-host-cni-bin\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.999084 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.996868 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c5de23b-1792-4e5c-86a5-b2964c551b92-system-cni-dir\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:16.999084 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.996965 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-log-socket\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.999084 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.997015 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/650f3617-9cba-4404-b65b-8d6a46ab3604-systemd-units\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.999084 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.997206 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bb5828e9-6222-41c1-9586-5105d4c9d1f3-hosts-file\") pod \"node-resolver-d722x\" (UID: \"bb5828e9-6222-41c1-9586-5105d4c9d1f3\") " pod="openshift-dns/node-resolver-d722x" May 27 21:06:16.999084 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.997441 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dc7b84ba-5d87-4bc9-b4e7-b4325d811acc-iptables-alerter-script\") pod \"iptables-alerter-ds28t\" (UID: \"dc7b84ba-5d87-4bc9-b4e7-b4325d811acc\") " pod="openshift-network-operator/iptables-alerter-ds28t" May 27 21:06:16.999084 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.998609 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3da9f32-8d58-45f4-9bdf-c94b603fb597-tmp\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.999084 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.998701 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f3da9f32-8d58-45f4-9bdf-c94b603fb597-etc-tuned\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:16.999084 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.998805 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/650f3617-9cba-4404-b65b-8d6a46ab3604-ovn-node-metrics-cert\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:16.999557 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:16.998988 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0fed42af-d37a-40b7-a34e-d4a611de1479-agent-certs\") pod \"konnectivity-agent-6mrqq\" (UID: \"0fed42af-d37a-40b7-a34e-d4a611de1479\") " pod="kube-system/konnectivity-agent-6mrqq" May 27 21:06:17.000796 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:17.000782 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 21:06:17.000856 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:17.000810 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 21:06:17.000856 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:17.000819 2566 projected.go:194] Error preparing data for projected volume kube-api-access-2ndpt for pod openshift-network-diagnostics/network-check-target-h5lwv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:06:17.000929 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:17.000869 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa70e273-d17b-4a4d-af0c-ccaaf3c319ec-kube-api-access-2ndpt podName:aa70e273-d17b-4a4d-af0c-ccaaf3c319ec nodeName:}" failed. No retries permitted until 2026-05-27 21:06:17.500846607 +0000 UTC m=+2.120232389 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2ndpt" (UniqueName: "kubernetes.io/projected/aa70e273-d17b-4a4d-af0c-ccaaf3c319ec-kube-api-access-2ndpt") pod "network-check-target-h5lwv" (UID: "aa70e273-d17b-4a4d-af0c-ccaaf3c319ec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:06:17.002532 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:17.002511 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7gb6\" (UniqueName: \"kubernetes.io/projected/dc7b84ba-5d87-4bc9-b4e7-b4325d811acc-kube-api-access-l7gb6\") pod \"iptables-alerter-ds28t\" (UID: \"dc7b84ba-5d87-4bc9-b4e7-b4325d811acc\") " pod="openshift-network-operator/iptables-alerter-ds28t" May 27 21:06:17.003360 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:17.003335 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gn29\" (UniqueName: \"kubernetes.io/projected/924d6e9e-49fd-44b8-9c8c-bc859c8e05cd-kube-api-access-7gn29\") pod \"multus-additional-cni-plugins-ct8th\" (UID: \"924d6e9e-49fd-44b8-9c8c-bc859c8e05cd\") " pod="openshift-multus/multus-additional-cni-plugins-ct8th" May 27 21:06:17.005135 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:17.005108 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzfg8\" (UniqueName: \"kubernetes.io/projected/bb5828e9-6222-41c1-9586-5105d4c9d1f3-kube-api-access-hzfg8\") pod \"node-resolver-d722x\" (UID: \"bb5828e9-6222-41c1-9586-5105d4c9d1f3\") " pod="openshift-dns/node-resolver-d722x" May 27 21:06:17.005263 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:17.005237 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwq99\" (UniqueName: \"kubernetes.io/projected/cab49327-f463-431f-b649-e6065ef8df95-kube-api-access-vwq99\") pod \"node-ca-22zqb\" (UID: \"cab49327-f463-431f-b649-e6065ef8df95\") " pod="openshift-image-registry/node-ca-22zqb" May 27 21:06:17.005346 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:17.005295 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx969\" (UniqueName: \"kubernetes.io/projected/f3da9f32-8d58-45f4-9bdf-c94b603fb597-kube-api-access-dx969\") pod \"tuned-mk9vt\" (UID: \"f3da9f32-8d58-45f4-9bdf-c94b603fb597\") " pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:17.005346 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:17.005326 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tr9h\" (UniqueName: \"kubernetes.io/projected/6c5de23b-1792-4e5c-86a5-b2964c551b92-kube-api-access-5tr9h\") pod \"multus-f577f\" (UID: \"6c5de23b-1792-4e5c-86a5-b2964c551b92\") " pod="openshift-multus/multus-f577f" May 27 21:06:17.006478 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:17.006443 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6skzk\" (UniqueName: \"kubernetes.io/projected/21c99a62-86e8-4647-b45e-aa4260bdd748-kube-api-access-6skzk\") pod \"aws-ebs-csi-driver-node-5g74v\" (UID: \"21c99a62-86e8-4647-b45e-aa4260bdd748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g74v" May 27 21:06:17.007000 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:17.006981 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nq6p\" (UniqueName: \"kubernetes.io/projected/650f3617-9cba-4404-b65b-8d6a46ab3604-kube-api-access-2nq6p\") pod \"ovnkube-node-7tlfn\" (UID: \"650f3617-9cba-4404-b65b-8d6a46ab3604\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:17.027912 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:17.027877 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal" event={"ID":"44a5d7b26b94d2de0850a5f86408116e","Type":"ContainerStarted","Data":"487d0dcede096a79dbe3d3c2a672169bdfaacf54309df51140ab26f57c5c8583"} May 27 21:06:17.028802 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:17.028774 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-116.ec2.internal" event={"ID":"cbb190866593adbdc91ba8af1639e9f3","Type":"ContainerStarted","Data":"adda46f99c4d92ebae56e36db0a97db332554e9fc86df1098cda40826935a671"} May 27 21:06:17.097808 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:17.097778 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1-metrics-certs\") pod \"network-metrics-daemon-b7dq5\" (UID: \"5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1\") " pod="openshift-multus/network-metrics-daemon-b7dq5" May 27 21:06:17.097808 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:17.097807 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5smtk\" (UniqueName: \"kubernetes.io/projected/5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1-kube-api-access-5smtk\") pod \"network-metrics-daemon-b7dq5\" (UID: \"5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1\") " pod="openshift-multus/network-metrics-daemon-b7dq5" May 27 21:06:17.097947 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:17.097911 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:06:17.097978 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:17.097972 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1-metrics-certs podName:5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1 nodeName:}" failed. No retries permitted until 2026-05-27 21:06:17.597956932 +0000 UTC m=+2.217342721 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1-metrics-certs") pod "network-metrics-daemon-b7dq5" (UID: "5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:06:17.108940 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:17.108882 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5smtk\" (UniqueName: \"kubernetes.io/projected/5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1-kube-api-access-5smtk\") pod \"network-metrics-daemon-b7dq5\" (UID: \"5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1\") " pod="openshift-multus/network-metrics-daemon-b7dq5" May 27 21:06:17.190268 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:17.190246 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ds28t" May 27 21:06:17.196719 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:17.196697 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc7b84ba_5d87_4bc9_b4e7_b4325d811acc.slice/crio-41f1a0f52699599c1e9e137c85b6edf33b8f445ca7e0ca02120c200a70eef0bc WatchSource:0}: Error finding container 41f1a0f52699599c1e9e137c85b6edf33b8f445ca7e0ca02120c200a70eef0bc: Status 404 returned error can't find the container with id 41f1a0f52699599c1e9e137c85b6edf33b8f445ca7e0ca02120c200a70eef0bc May 27 21:06:17.207840 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:17.207819 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:17.213200 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:17.213182 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod650f3617_9cba_4404_b65b_8d6a46ab3604.slice/crio-f00055842fe18703a2269ddb83ce05f4d465f1db9b3c177c777d5229bacc50ce WatchSource:0}: Error finding container f00055842fe18703a2269ddb83ce05f4d465f1db9b3c177c777d5229bacc50ce: Status 404 returned error can't find the container with id f00055842fe18703a2269ddb83ce05f4d465f1db9b3c177c777d5229bacc50ce May 27 21:06:17.214747 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:17.214730 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6mrqq" May 27 21:06:17.219842 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:17.219821 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fed42af_d37a_40b7_a34e_d4a611de1479.slice/crio-68d0841dfb1c80be9270b3d8f0520a7a2f1c1c40034e4afca28b3ab4a6d4821d WatchSource:0}: Error finding container 68d0841dfb1c80be9270b3d8f0520a7a2f1c1c40034e4afca28b3ab4a6d4821d: Status 404 returned error can't find the container with id 68d0841dfb1c80be9270b3d8f0520a7a2f1c1c40034e4afca28b3ab4a6d4821d May 27 21:06:17.230362 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:17.230345 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g74v" May 27 21:06:17.235997 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:17.235978 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21c99a62_86e8_4647_b45e_aa4260bdd748.slice/crio-5764e8ee6ee6d519c9a65dcd8aa3c73d09a65cb61903a67734eee6de13a1cb0b WatchSource:0}: Error finding container 5764e8ee6ee6d519c9a65dcd8aa3c73d09a65cb61903a67734eee6de13a1cb0b: Status 404 returned error can't find the container with id 5764e8ee6ee6d519c9a65dcd8aa3c73d09a65cb61903a67734eee6de13a1cb0b May 27 21:06:17.244403 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:17.244387 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" May 27 21:06:17.249288 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:17.249269 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3da9f32_8d58_45f4_9bdf_c94b603fb597.slice/crio-532f4af8f36612747e728198f04e6841b1455d2956e6088cab50d0258c55ea3b WatchSource:0}: Error finding container 532f4af8f36612747e728198f04e6841b1455d2956e6088cab50d0258c55ea3b: Status 404 returned error can't find the container with id 532f4af8f36612747e728198f04e6841b1455d2956e6088cab50d0258c55ea3b May 27 21:06:17.267774 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:17.267754 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f577f" May 27 21:06:17.273203 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:17.273173 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c5de23b_1792_4e5c_86a5_b2964c551b92.slice/crio-5a79ef79fc0b54e72a406f43d9c04d834f707e6da1c39158ac1ba7e628a34cf5 WatchSource:0}: Error finding container 5a79ef79fc0b54e72a406f43d9c04d834f707e6da1c39158ac1ba7e628a34cf5: Status 404 returned error can't find the container with id 5a79ef79fc0b54e72a406f43d9c04d834f707e6da1c39158ac1ba7e628a34cf5 May 27 21:06:17.273765 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:17.273743 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-d722x" May 27 21:06:17.279097 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:17.279077 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-22zqb" May 27 21:06:17.282191 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:17.282158 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb5828e9_6222_41c1_9586_5105d4c9d1f3.slice/crio-32baf50c86bd022f6a6be2d7d943a022559646fc734ae99e21bc43f6f49937fa WatchSource:0}: Error finding container 32baf50c86bd022f6a6be2d7d943a022559646fc734ae99e21bc43f6f49937fa: Status 404 returned error can't find the container with id 32baf50c86bd022f6a6be2d7d943a022559646fc734ae99e21bc43f6f49937fa May 27 21:06:17.283299 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:17.283278 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ct8th" May 27 21:06:17.288092 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:17.288068 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcab49327_f463_431f_b649_e6065ef8df95.slice/crio-eba08eaf24e50d4c99bd8cfdca8daa981fdc5a822aa2fbda6a8575557e6547be WatchSource:0}: Error finding container eba08eaf24e50d4c99bd8cfdca8daa981fdc5a822aa2fbda6a8575557e6547be: Status 404 returned error can't find the container with id eba08eaf24e50d4c99bd8cfdca8daa981fdc5a822aa2fbda6a8575557e6547be May 27 21:06:17.290565 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:06:17.290546 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod924d6e9e_49fd_44b8_9c8c_bc859c8e05cd.slice/crio-b42ffbf4b84d9f86f6b7937bb824fed5c912fcc8adc823a331a4f9c800eaf6e8 WatchSource:0}: Error finding container b42ffbf4b84d9f86f6b7937bb824fed5c912fcc8adc823a331a4f9c800eaf6e8: Status 404 returned error can't find the container with id b42ffbf4b84d9f86f6b7937bb824fed5c912fcc8adc823a331a4f9c800eaf6e8 May 27 21:06:17.368217 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:17.368137 2566 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 27 21:06:17.601975 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:17.601941 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1-metrics-certs\") pod \"network-metrics-daemon-b7dq5\" (UID: \"5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1\") " pod="openshift-multus/network-metrics-daemon-b7dq5" May 27 21:06:17.602165 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:17.601989 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ndpt\" (UniqueName: \"kubernetes.io/projected/aa70e273-d17b-4a4d-af0c-ccaaf3c319ec-kube-api-access-2ndpt\") pod \"network-check-target-h5lwv\" (UID: \"aa70e273-d17b-4a4d-af0c-ccaaf3c319ec\") " pod="openshift-network-diagnostics/network-check-target-h5lwv" May 27 21:06:17.602165 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:17.602098 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:06:17.602165 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:17.602149 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 21:06:17.602165 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:17.602161 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1-metrics-certs podName:5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1 nodeName:}" failed. No retries permitted until 2026-05-27 21:06:18.602141383 +0000 UTC m=+3.221527159 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1-metrics-certs") pod "network-metrics-daemon-b7dq5" (UID: "5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:06:17.602165 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:17.602163 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 21:06:17.602429 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:17.602189 2566 projected.go:194] Error preparing data for projected volume kube-api-access-2ndpt for pod openshift-network-diagnostics/network-check-target-h5lwv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:06:17.602429 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:17.602223 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa70e273-d17b-4a4d-af0c-ccaaf3c319ec-kube-api-access-2ndpt podName:aa70e273-d17b-4a4d-af0c-ccaaf3c319ec nodeName:}" failed. No retries permitted until 2026-05-27 21:06:18.602213028 +0000 UTC m=+3.221598792 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2ndpt" (UniqueName: "kubernetes.io/projected/aa70e273-d17b-4a4d-af0c-ccaaf3c319ec-kube-api-access-2ndpt") pod "network-check-target-h5lwv" (UID: "aa70e273-d17b-4a4d-af0c-ccaaf3c319ec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:06:17.767755 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:17.767671 2566 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 27 21:06:17.979290 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:17.979237 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 21:01:16 +0000 UTC" deadline="2028-03-04 20:02:05.413947034 +0000 UTC" May 27 21:06:17.979290 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:17.979288 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15526h55m47.434663756s" May 27 21:06:18.028297 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:18.028224 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dq5" May 27 21:06:18.028456 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:18.028362 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dq5" podUID="5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1" May 27 21:06:18.047956 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:18.047920 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-d722x" event={"ID":"bb5828e9-6222-41c1-9586-5105d4c9d1f3","Type":"ContainerStarted","Data":"32baf50c86bd022f6a6be2d7d943a022559646fc734ae99e21bc43f6f49937fa"} May 27 21:06:18.059748 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:18.059715 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f577f" event={"ID":"6c5de23b-1792-4e5c-86a5-b2964c551b92","Type":"ContainerStarted","Data":"5a79ef79fc0b54e72a406f43d9c04d834f707e6da1c39158ac1ba7e628a34cf5"} May 27 21:06:18.069431 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:18.069397 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6mrqq" event={"ID":"0fed42af-d37a-40b7-a34e-d4a611de1479","Type":"ContainerStarted","Data":"68d0841dfb1c80be9270b3d8f0520a7a2f1c1c40034e4afca28b3ab4a6d4821d"} May 27 21:06:18.082904 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:18.082854 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" event={"ID":"650f3617-9cba-4404-b65b-8d6a46ab3604","Type":"ContainerStarted","Data":"f00055842fe18703a2269ddb83ce05f4d465f1db9b3c177c777d5229bacc50ce"} May 27 21:06:18.120142 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:18.120108 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ds28t" event={"ID":"dc7b84ba-5d87-4bc9-b4e7-b4325d811acc","Type":"ContainerStarted","Data":"41f1a0f52699599c1e9e137c85b6edf33b8f445ca7e0ca02120c200a70eef0bc"} May 27 21:06:18.167061 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:18.167006 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" event={"ID":"f3da9f32-8d58-45f4-9bdf-c94b603fb597","Type":"ContainerStarted","Data":"532f4af8f36612747e728198f04e6841b1455d2956e6088cab50d0258c55ea3b"} May 27 21:06:18.175330 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:18.175300 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g74v" event={"ID":"21c99a62-86e8-4647-b45e-aa4260bdd748","Type":"ContainerStarted","Data":"5764e8ee6ee6d519c9a65dcd8aa3c73d09a65cb61903a67734eee6de13a1cb0b"} May 27 21:06:18.180655 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:18.180555 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ct8th" event={"ID":"924d6e9e-49fd-44b8-9c8c-bc859c8e05cd","Type":"ContainerStarted","Data":"b42ffbf4b84d9f86f6b7937bb824fed5c912fcc8adc823a331a4f9c800eaf6e8"} May 27 21:06:18.190476 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:18.190411 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-22zqb" event={"ID":"cab49327-f463-431f-b649-e6065ef8df95","Type":"ContainerStarted","Data":"eba08eaf24e50d4c99bd8cfdca8daa981fdc5a822aa2fbda6a8575557e6547be"} May 27 21:06:18.610560 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:18.610526 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1-metrics-certs\") pod \"network-metrics-daemon-b7dq5\" (UID: \"5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1\") " pod="openshift-multus/network-metrics-daemon-b7dq5" May 27 21:06:18.610801 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:18.610578 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ndpt\" (UniqueName: \"kubernetes.io/projected/aa70e273-d17b-4a4d-af0c-ccaaf3c319ec-kube-api-access-2ndpt\") pod \"network-check-target-h5lwv\" (UID: \"aa70e273-d17b-4a4d-af0c-ccaaf3c319ec\") " pod="openshift-network-diagnostics/network-check-target-h5lwv" May 27 21:06:18.610801 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:18.610733 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 21:06:18.610801 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:18.610756 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 21:06:18.610801 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:18.610768 2566 projected.go:194] Error preparing data for projected volume kube-api-access-2ndpt for pod openshift-network-diagnostics/network-check-target-h5lwv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:06:18.611047 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:18.610837 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa70e273-d17b-4a4d-af0c-ccaaf3c319ec-kube-api-access-2ndpt podName:aa70e273-d17b-4a4d-af0c-ccaaf3c319ec nodeName:}" failed. No retries permitted until 2026-05-27 21:06:20.610817749 +0000 UTC m=+5.230203527 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2ndpt" (UniqueName: "kubernetes.io/projected/aa70e273-d17b-4a4d-af0c-ccaaf3c319ec-kube-api-access-2ndpt") pod "network-check-target-h5lwv" (UID: "aa70e273-d17b-4a4d-af0c-ccaaf3c319ec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:06:18.611199 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:18.611179 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:06:18.611346 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:18.611248 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1-metrics-certs podName:5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1 nodeName:}" failed. No retries permitted until 2026-05-27 21:06:20.611232881 +0000 UTC m=+5.230618650 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1-metrics-certs") pod "network-metrics-daemon-b7dq5" (UID: "5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:06:18.980419 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:18.980281 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 21:01:16 +0000 UTC" deadline="2027-10-25 07:26:51.088547571 +0000 UTC" May 27 21:06:18.980419 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:18.980322 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12370h20m32.108228764s" May 27 21:06:19.026158 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:19.026126 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5lwv" May 27 21:06:19.026332 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:19.026257 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h5lwv" podUID="aa70e273-d17b-4a4d-af0c-ccaaf3c319ec" May 27 21:06:19.587763 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:19.587726 2566 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 27 21:06:20.029176 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:20.028602 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dq5" May 27 21:06:20.029176 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:20.028743 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dq5" podUID="5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1" May 27 21:06:20.629328 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:20.629254 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1-metrics-certs\") pod \"network-metrics-daemon-b7dq5\" (UID: \"5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1\") " pod="openshift-multus/network-metrics-daemon-b7dq5" May 27 21:06:20.629328 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:20.629313 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ndpt\" (UniqueName: \"kubernetes.io/projected/aa70e273-d17b-4a4d-af0c-ccaaf3c319ec-kube-api-access-2ndpt\") pod \"network-check-target-h5lwv\" (UID: \"aa70e273-d17b-4a4d-af0c-ccaaf3c319ec\") " pod="openshift-network-diagnostics/network-check-target-h5lwv" May 27 21:06:20.629563 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:20.629483 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 21:06:20.629563 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:20.629501 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 21:06:20.629563 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:20.629514 2566 projected.go:194] Error preparing data for projected volume kube-api-access-2ndpt for pod openshift-network-diagnostics/network-check-target-h5lwv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:06:20.629706 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:20.629571 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa70e273-d17b-4a4d-af0c-ccaaf3c319ec-kube-api-access-2ndpt podName:aa70e273-d17b-4a4d-af0c-ccaaf3c319ec nodeName:}" failed. No retries permitted until 2026-05-27 21:06:24.629552956 +0000 UTC m=+9.248938732 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2ndpt" (UniqueName: "kubernetes.io/projected/aa70e273-d17b-4a4d-af0c-ccaaf3c319ec-kube-api-access-2ndpt") pod "network-check-target-h5lwv" (UID: "aa70e273-d17b-4a4d-af0c-ccaaf3c319ec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:06:20.630012 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:20.629986 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:06:20.630138 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:20.630061 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1-metrics-certs podName:5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1 nodeName:}" failed. No retries permitted until 2026-05-27 21:06:24.630045277 +0000 UTC m=+9.249431045 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1-metrics-certs") pod "network-metrics-daemon-b7dq5" (UID: "5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:06:21.026434 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:21.026100 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5lwv" May 27 21:06:21.026434 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:21.026242 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h5lwv" podUID="aa70e273-d17b-4a4d-af0c-ccaaf3c319ec" May 27 21:06:22.026115 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:22.026077 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dq5" May 27 21:06:22.026555 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:22.026245 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dq5" podUID="5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1" May 27 21:06:23.026223 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:23.026173 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5lwv" May 27 21:06:23.026676 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:23.026307 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h5lwv" podUID="aa70e273-d17b-4a4d-af0c-ccaaf3c319ec" May 27 21:06:24.026136 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:24.026097 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dq5" May 27 21:06:24.026316 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:24.026258 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dq5" podUID="5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1" May 27 21:06:24.665089 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:24.665023 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1-metrics-certs\") pod \"network-metrics-daemon-b7dq5\" (UID: \"5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1\") " pod="openshift-multus/network-metrics-daemon-b7dq5" May 27 21:06:24.665266 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:24.665096 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ndpt\" (UniqueName: \"kubernetes.io/projected/aa70e273-d17b-4a4d-af0c-ccaaf3c319ec-kube-api-access-2ndpt\") pod \"network-check-target-h5lwv\" (UID: \"aa70e273-d17b-4a4d-af0c-ccaaf3c319ec\") " pod="openshift-network-diagnostics/network-check-target-h5lwv" May 27 21:06:24.665266 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:24.665254 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 21:06:24.665388 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:24.665273 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 21:06:24.665388 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:24.665286 2566 projected.go:194] Error preparing data for projected volume kube-api-access-2ndpt for pod openshift-network-diagnostics/network-check-target-h5lwv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:06:24.665388 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:24.665340 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa70e273-d17b-4a4d-af0c-ccaaf3c319ec-kube-api-access-2ndpt podName:aa70e273-d17b-4a4d-af0c-ccaaf3c319ec nodeName:}" failed. No retries permitted until 2026-05-27 21:06:32.665320613 +0000 UTC m=+17.284706396 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2ndpt" (UniqueName: "kubernetes.io/projected/aa70e273-d17b-4a4d-af0c-ccaaf3c319ec-kube-api-access-2ndpt") pod "network-check-target-h5lwv" (UID: "aa70e273-d17b-4a4d-af0c-ccaaf3c319ec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:06:24.665764 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:24.665743 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:06:24.665895 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:24.665795 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1-metrics-certs podName:5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1 nodeName:}" failed. No retries permitted until 2026-05-27 21:06:32.665783258 +0000 UTC m=+17.285169021 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1-metrics-certs") pod "network-metrics-daemon-b7dq5" (UID: "5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:06:25.026390 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:25.026297 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5lwv" May 27 21:06:25.026854 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:25.026445 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h5lwv" podUID="aa70e273-d17b-4a4d-af0c-ccaaf3c319ec" May 27 21:06:26.027003 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:26.026669 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dq5" May 27 21:06:26.027003 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:26.026799 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dq5" podUID="5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1" May 27 21:06:27.025559 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:27.025350 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5lwv" May 27 21:06:27.025729 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:27.025666 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h5lwv" podUID="aa70e273-d17b-4a4d-af0c-ccaaf3c319ec" May 27 21:06:28.026287 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:28.026250 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dq5" May 27 21:06:28.026716 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:28.026386 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dq5" podUID="5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1" May 27 21:06:29.026001 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:29.025969 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5lwv" May 27 21:06:29.026283 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:29.026086 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h5lwv" podUID="aa70e273-d17b-4a4d-af0c-ccaaf3c319ec" May 27 21:06:30.026206 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:30.026158 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dq5" May 27 21:06:30.026553 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:30.026284 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dq5" podUID="5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1" May 27 21:06:31.026349 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:31.026315 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5lwv" May 27 21:06:31.026745 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:31.026430 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h5lwv" podUID="aa70e273-d17b-4a4d-af0c-ccaaf3c319ec" May 27 21:06:32.028524 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:32.028489 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dq5" May 27 21:06:32.028899 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:32.028626 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dq5" podUID="5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1" May 27 21:06:32.724091 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:32.724051 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1-metrics-certs\") pod \"network-metrics-daemon-b7dq5\" (UID: \"5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1\") " pod="openshift-multus/network-metrics-daemon-b7dq5" May 27 21:06:32.724314 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:32.724101 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ndpt\" (UniqueName: \"kubernetes.io/projected/aa70e273-d17b-4a4d-af0c-ccaaf3c319ec-kube-api-access-2ndpt\") pod \"network-check-target-h5lwv\" (UID: \"aa70e273-d17b-4a4d-af0c-ccaaf3c319ec\") " pod="openshift-network-diagnostics/network-check-target-h5lwv" May 27 21:06:32.724314 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:32.724217 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:06:32.724314 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:32.724227 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 21:06:32.724314 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:32.724243 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 21:06:32.724314 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:32.724252 2566 projected.go:194] Error preparing data for projected volume kube-api-access-2ndpt for pod openshift-network-diagnostics/network-check-target-h5lwv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:06:32.724314 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:32.724296 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1-metrics-certs podName:5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1 nodeName:}" failed. No retries permitted until 2026-05-27 21:06:48.724272683 +0000 UTC m=+33.343658460 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1-metrics-certs") pod "network-metrics-daemon-b7dq5" (UID: "5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:06:32.724314 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:32.724316 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa70e273-d17b-4a4d-af0c-ccaaf3c319ec-kube-api-access-2ndpt podName:aa70e273-d17b-4a4d-af0c-ccaaf3c319ec nodeName:}" failed. No retries permitted until 2026-05-27 21:06:48.724305899 +0000 UTC m=+33.343691664 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2ndpt" (UniqueName: "kubernetes.io/projected/aa70e273-d17b-4a4d-af0c-ccaaf3c319ec-kube-api-access-2ndpt") pod "network-check-target-h5lwv" (UID: "aa70e273-d17b-4a4d-af0c-ccaaf3c319ec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:06:33.025917 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:33.025839 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5lwv" May 27 21:06:33.026057 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:33.025948 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h5lwv" podUID="aa70e273-d17b-4a4d-af0c-ccaaf3c319ec" May 27 21:06:34.028148 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:34.028115 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dq5" May 27 21:06:34.028544 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:34.028227 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dq5" podUID="5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1" May 27 21:06:35.025908 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:35.025872 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5lwv" May 27 21:06:35.026110 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:35.025975 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h5lwv" podUID="aa70e273-d17b-4a4d-af0c-ccaaf3c319ec" May 27 21:06:36.027893 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:36.027868 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dq5" May 27 21:06:36.028238 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:36.027959 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dq5" podUID="5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1" May 27 21:06:37.026492 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:37.025973 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5lwv" May 27 21:06:37.026572 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:37.026513 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h5lwv" podUID="aa70e273-d17b-4a4d-af0c-ccaaf3c319ec" May 27 21:06:37.239546 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:37.239515 2566 generic.go:358] "Generic (PLEG): container finished" podID="924d6e9e-49fd-44b8-9c8c-bc859c8e05cd" containerID="c60df1a7490b12770ca0816b49bfbcef3951a78110dc08807fe3814a83716ef4" exitCode=0 May 27 21:06:37.240199 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:37.239596 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ct8th" event={"ID":"924d6e9e-49fd-44b8-9c8c-bc859c8e05cd","Type":"ContainerDied","Data":"c60df1a7490b12770ca0816b49bfbcef3951a78110dc08807fe3814a83716ef4"} May 27 21:06:37.242015 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:37.241991 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-22zqb" event={"ID":"cab49327-f463-431f-b649-e6065ef8df95","Type":"ContainerStarted","Data":"880c1e52cb06757a991bd04744b9acedf019f981e2b568eb41507af8e4275ce5"} May 27 21:06:37.243523 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:37.243477 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-d722x" event={"ID":"bb5828e9-6222-41c1-9586-5105d4c9d1f3","Type":"ContainerStarted","Data":"5612a5c39bd7963112ad4bf1d74afefb8e5dbde98e7b7a1039a0b01e9068036a"} May 27 21:06:37.244988 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:37.244965 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f577f" event={"ID":"6c5de23b-1792-4e5c-86a5-b2964c551b92","Type":"ContainerStarted","Data":"a35f681dd7f426f27ba02094835b08d501638e81e9cccd4df74a05059fe4e77c"} May 27 21:06:37.246259 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:37.246241 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6mrqq" event={"ID":"0fed42af-d37a-40b7-a34e-d4a611de1479","Type":"ContainerStarted","Data":"dee25b7d07e10f7f4b6b13a3878dc4f2dbbdf9bdd25ae791342b91b850ad41e4"} May 27 21:06:37.248441 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:37.248420 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" event={"ID":"650f3617-9cba-4404-b65b-8d6a46ab3604","Type":"ContainerStarted","Data":"824d342dda523e7dfcf53b8c4986a339b4bb4c67164d9cd6f1cb78f2a0c495e8"} May 27 21:06:37.248524 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:37.248447 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" event={"ID":"650f3617-9cba-4404-b65b-8d6a46ab3604","Type":"ContainerStarted","Data":"a65e41d43e5f35c9da0e78227a559c3ff5db5526b274e97f65147dab92e99773"} May 27 21:06:37.248524 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:37.248463 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" event={"ID":"650f3617-9cba-4404-b65b-8d6a46ab3604","Type":"ContainerStarted","Data":"d31146c35adc8dc5c2a58bba4139879919f06361ceac44383f94ea42a7e0162f"} May 27 21:06:37.248524 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:37.248475 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" event={"ID":"650f3617-9cba-4404-b65b-8d6a46ab3604","Type":"ContainerStarted","Data":"67a2a7d61a527b096158f9074c945d157e1d292430cdbc9b222e20e86e9d2588"} May 27 21:06:37.248524 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:37.248487 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" event={"ID":"650f3617-9cba-4404-b65b-8d6a46ab3604","Type":"ContainerStarted","Data":"396585edd0e6560db21c09dcb6b5c4429558490f7d8fa121ee1eb6f0f281c989"} May 27 21:06:37.249575 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:37.249554 2566 generic.go:358] "Generic (PLEG): container finished" podID="44a5d7b26b94d2de0850a5f86408116e" containerID="d8f8f3990026d1bd739d5f6509dd80fb48b7ec1bae4bc4223dffd01d56601e24" exitCode=0 May 27 21:06:37.249656 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:37.249612 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal" event={"ID":"44a5d7b26b94d2de0850a5f86408116e","Type":"ContainerDied","Data":"d8f8f3990026d1bd739d5f6509dd80fb48b7ec1bae4bc4223dffd01d56601e24"} May 27 21:06:37.250861 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:37.250833 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-116.ec2.internal" event={"ID":"cbb190866593adbdc91ba8af1639e9f3","Type":"ContainerStarted","Data":"15fe77cb5ca1fa9938242f436eb3ac256edaa896ed01fb9d450fb166cefb919b"} May 27 21:06:37.252250 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:37.252226 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" event={"ID":"f3da9f32-8d58-45f4-9bdf-c94b603fb597","Type":"ContainerStarted","Data":"e63c621c22282fd30c9d5105ad570eae479324c95a257d2d84856747e3b4b2f2"} May 27 21:06:37.253397 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:37.253379 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g74v" event={"ID":"21c99a62-86e8-4647-b45e-aa4260bdd748","Type":"ContainerStarted","Data":"50c5ef00b8384351b2362287982915b881c0c9ddfc2e7332e86fda2a2b7cd9f1"} May 27 21:06:37.301440 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:37.300459 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-f577f" podStartSLOduration=2.457337807 podStartE2EDuration="21.300442885s" podCreationTimestamp="2026-05-27 21:06:16 +0000 UTC" firstStartedPulling="2026-05-27 21:06:17.274694236 +0000 UTC m=+1.894079999" lastFinishedPulling="2026-05-27 21:06:36.117799314 +0000 UTC m=+20.737185077" observedRunningTime="2026-05-27 21:06:37.286234067 +0000 UTC m=+21.905619852" watchObservedRunningTime="2026-05-27 21:06:37.300442885 +0000 UTC m=+21.919828671" May 27 21:06:37.315217 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:37.315174 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-d722x" podStartSLOduration=2.515466979 podStartE2EDuration="21.31515798s" podCreationTimestamp="2026-05-27 21:06:16 +0000 UTC" firstStartedPulling="2026-05-27 21:06:17.284328925 +0000 UTC m=+1.903714693" lastFinishedPulling="2026-05-27 21:06:36.084019917 +0000 UTC m=+20.703405694" observedRunningTime="2026-05-27 21:06:37.301324876 +0000 UTC m=+21.920710663" watchObservedRunningTime="2026-05-27 21:06:37.31515798 +0000 UTC m=+21.934543766" May 27 21:06:37.329461 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:37.329415 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-22zqb" podStartSLOduration=2.504963768 podStartE2EDuration="21.32939971s" podCreationTimestamp="2026-05-27 21:06:16 +0000 UTC" firstStartedPulling="2026-05-27 21:06:17.28967599 +0000 UTC m=+1.909061756" lastFinishedPulling="2026-05-27 21:06:36.114111917 +0000 UTC m=+20.733497698" observedRunningTime="2026-05-27 21:06:37.315987711 +0000 UTC m=+21.935373496" watchObservedRunningTime="2026-05-27 21:06:37.32939971 +0000 UTC m=+21.948785495" May 27 21:06:37.346717 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:37.346664 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6mrqq" podStartSLOduration=10.763659327 podStartE2EDuration="21.346650626s" podCreationTimestamp="2026-05-27 21:06:16 +0000 UTC" firstStartedPulling="2026-05-27 21:06:17.221332878 +0000 UTC m=+1.840718645" lastFinishedPulling="2026-05-27 21:06:27.804324168 +0000 UTC m=+12.423709944" observedRunningTime="2026-05-27 21:06:37.346567613 +0000 UTC m=+21.965953400" watchObservedRunningTime="2026-05-27 21:06:37.346650626 +0000 UTC m=+21.966036411" May 27 21:06:37.346816 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:37.346772 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-116.ec2.internal" podStartSLOduration=21.346764735 podStartE2EDuration="21.346764735s" podCreationTimestamp="2026-05-27 21:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:06:37.329653495 +0000 UTC m=+21.949039283" watchObservedRunningTime="2026-05-27 21:06:37.346764735 +0000 UTC m=+21.966150522" May 27 21:06:37.365819 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:37.365740 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mk9vt" podStartSLOduration=2.50167583 podStartE2EDuration="21.365725989s" podCreationTimestamp="2026-05-27 21:06:16 +0000 UTC" firstStartedPulling="2026-05-27 21:06:17.250590689 +0000 UTC m=+1.869976452" lastFinishedPulling="2026-05-27 21:06:36.114640847 +0000 UTC m=+20.734026611" observedRunningTime="2026-05-27 21:06:37.365582001 +0000 UTC m=+21.984967785" watchObservedRunningTime="2026-05-27 21:06:37.365725989 +0000 UTC m=+21.985111774" May 27 21:06:37.846876 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:37.846829 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 27 21:06:37.963255 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:37.963163 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-27T21:06:37.846852202Z","UUID":"d9b0ea19-758f-4c48-8f0a-d43fb804dba3","Handler":null,"Name":"","Endpoint":""} May 27 21:06:37.964758 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:37.964736 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 27 21:06:37.964895 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:37.964764 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 27 21:06:38.029138 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:38.029070 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dq5" May 27 21:06:38.029276 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:38.029218 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dq5" podUID="5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1" May 27 21:06:38.257294 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:38.257256 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g74v" event={"ID":"21c99a62-86e8-4647-b45e-aa4260bdd748","Type":"ContainerStarted","Data":"1251154b4477c9d98d953dd36b41eacbefd3ccbd6ede5d4ee3c5ece1bbb2d745"} May 27 21:06:38.260337 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:38.260298 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" event={"ID":"650f3617-9cba-4404-b65b-8d6a46ab3604","Type":"ContainerStarted","Data":"8d31650e3f7a7919bbb2af637d9e21640edeca7c29484ef1e4f6cdddfa37a076"} May 27 21:06:38.261990 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:38.261958 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ds28t" event={"ID":"dc7b84ba-5d87-4bc9-b4e7-b4325d811acc","Type":"ContainerStarted","Data":"0e65042d9ee53a4a4986c16dd379358235c5b9a53d4bc7494916226f45cf4ac7"} May 27 21:06:38.264691 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:38.264290 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal" event={"ID":"44a5d7b26b94d2de0850a5f86408116e","Type":"ContainerStarted","Data":"58d3d15d1d0bfac66477b4da5dcebf580d238ee3e4077745afb398675d6eb0cf"} May 27 21:06:38.275867 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:38.275485 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ds28t" podStartSLOduration=3.389233492 podStartE2EDuration="22.275468545s" podCreationTimestamp="2026-05-27 21:06:16 +0000 UTC" firstStartedPulling="2026-05-27 21:06:17.198150573 +0000 UTC m=+1.817536336" lastFinishedPulling="2026-05-27 21:06:36.084385613 +0000 UTC m=+20.703771389" observedRunningTime="2026-05-27 21:06:38.275162831 +0000 UTC m=+22.894548629" watchObservedRunningTime="2026-05-27 21:06:38.275468545 +0000 UTC m=+22.894854328" May 27 21:06:38.288453 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:38.288360 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal" podStartSLOduration=22.288345588 podStartE2EDuration="22.288345588s" podCreationTimestamp="2026-05-27 21:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:06:38.287776065 +0000 UTC m=+22.907161853" watchObservedRunningTime="2026-05-27 21:06:38.288345588 +0000 UTC m=+22.907731373" May 27 21:06:39.025828 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:39.025802 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5lwv" May 27 21:06:39.025955 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:39.025926 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h5lwv" podUID="aa70e273-d17b-4a4d-af0c-ccaaf3c319ec" May 27 21:06:39.272693 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:39.272609 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g74v" event={"ID":"21c99a62-86e8-4647-b45e-aa4260bdd748","Type":"ContainerStarted","Data":"718fee0f0ea0264f7a6dcf0baeb3da28d97d91b5d35e8107568533092084f95e"} May 27 21:06:39.310479 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:39.310430 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g74v" podStartSLOduration=1.6175921519999998 podStartE2EDuration="23.310416334s" podCreationTimestamp="2026-05-27 21:06:16 +0000 UTC" firstStartedPulling="2026-05-27 21:06:17.237584803 +0000 UTC m=+1.856970579" lastFinishedPulling="2026-05-27 21:06:38.930408995 +0000 UTC m=+23.549794761" observedRunningTime="2026-05-27 21:06:39.310353372 +0000 UTC m=+23.929739216" watchObservedRunningTime="2026-05-27 21:06:39.310416334 +0000 UTC m=+23.929802119" May 27 21:06:40.025445 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:40.025416 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dq5" May 27 21:06:40.025629 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:40.025543 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dq5" podUID="5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1" May 27 21:06:40.278054 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:40.277962 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" event={"ID":"650f3617-9cba-4404-b65b-8d6a46ab3604","Type":"ContainerStarted","Data":"c8feed5a21a5a0fd0ab1e45570faaf7916afadaeaf58914bd8bc1d930e0c2425"} May 27 21:06:41.025992 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:41.025961 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5lwv" May 27 21:06:41.026184 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:41.026091 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h5lwv" podUID="aa70e273-d17b-4a4d-af0c-ccaaf3c319ec" May 27 21:06:41.139484 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:41.139449 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6mrqq" May 27 21:06:41.140181 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:41.140156 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6mrqq" May 27 21:06:41.279203 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:41.279182 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6mrqq" May 27 21:06:41.279625 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:41.279612 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6mrqq" May 27 21:06:42.028322 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:42.028298 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dq5" May 27 21:06:42.028556 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:42.028391 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dq5" podUID="5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1" May 27 21:06:42.284863 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:42.284750 2566 generic.go:358] "Generic (PLEG): container finished" podID="924d6e9e-49fd-44b8-9c8c-bc859c8e05cd" containerID="25ef80701c6530b7dd37caa4660b45745e7486fba6177b63207f7833e447abea" exitCode=0 May 27 21:06:42.284863 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:42.284834 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ct8th" event={"ID":"924d6e9e-49fd-44b8-9c8c-bc859c8e05cd","Type":"ContainerDied","Data":"25ef80701c6530b7dd37caa4660b45745e7486fba6177b63207f7833e447abea"} May 27 21:06:42.289334 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:42.289305 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" event={"ID":"650f3617-9cba-4404-b65b-8d6a46ab3604","Type":"ContainerStarted","Data":"04f2432f219ee438d4b5cdba07c68fc6e7b5d47ee9c958b1534cdf3190c8b938"} May 27 21:06:42.289793 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:42.289775 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:42.305388 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:42.305370 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:42.346522 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:42.346484 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" podStartSLOduration=6.982143804 podStartE2EDuration="26.346472816s" podCreationTimestamp="2026-05-27 21:06:16 +0000 UTC" firstStartedPulling="2026-05-27 21:06:17.214652494 +0000 UTC m=+1.834038257" lastFinishedPulling="2026-05-27 21:06:36.578981492 +0000 UTC m=+21.198367269" observedRunningTime="2026-05-27 21:06:42.346327391 +0000 UTC m=+26.965713176" watchObservedRunningTime="2026-05-27 21:06:42.346472816 +0000 UTC m=+26.965858600" May 27 21:06:43.025728 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:43.025699 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5lwv" May 27 21:06:43.025837 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:43.025798 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h5lwv" podUID="aa70e273-d17b-4a4d-af0c-ccaaf3c319ec" May 27 21:06:43.293570 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:43.293475 2566 generic.go:358] "Generic (PLEG): container finished" podID="924d6e9e-49fd-44b8-9c8c-bc859c8e05cd" containerID="298d2a57cd5ae1f7e46a4bac5ebc775721272d7e4eedcede2cd8e80767f2e354" exitCode=0 May 27 21:06:43.293978 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:43.293574 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ct8th" event={"ID":"924d6e9e-49fd-44b8-9c8c-bc859c8e05cd","Type":"ContainerDied","Data":"298d2a57cd5ae1f7e46a4bac5ebc775721272d7e4eedcede2cd8e80767f2e354"} May 27 21:06:43.294860 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:43.294530 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:43.294860 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:43.294558 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:43.311697 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:43.311663 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:06:43.547097 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:43.547007 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b7dq5"] May 27 21:06:43.547241 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:43.547158 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dq5" May 27 21:06:43.547283 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:43.547245 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dq5" podUID="5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1" May 27 21:06:43.549043 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:43.549001 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h5lwv"] May 27 21:06:43.549175 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:43.549091 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5lwv" May 27 21:06:43.549175 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:43.549159 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h5lwv" podUID="aa70e273-d17b-4a4d-af0c-ccaaf3c319ec" May 27 21:06:45.025665 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:45.025493 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5lwv" May 27 21:06:45.026057 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:45.025526 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dq5" May 27 21:06:45.026057 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:45.025736 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h5lwv" podUID="aa70e273-d17b-4a4d-af0c-ccaaf3c319ec" May 27 21:06:45.026057 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:45.025813 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dq5" podUID="5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1" May 27 21:06:45.299125 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:45.299018 2566 generic.go:358] "Generic (PLEG): container finished" podID="924d6e9e-49fd-44b8-9c8c-bc859c8e05cd" containerID="1c3020de9faef0b3e8a32ad2b6cacb853da616f3540b669c1285104cf7dc7fc4" exitCode=0 May 27 21:06:45.299125 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:45.299118 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ct8th" event={"ID":"924d6e9e-49fd-44b8-9c8c-bc859c8e05cd","Type":"ContainerDied","Data":"1c3020de9faef0b3e8a32ad2b6cacb853da616f3540b669c1285104cf7dc7fc4"} May 27 21:06:47.025708 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:47.025668 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5lwv" May 27 21:06:47.026213 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:47.025669 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dq5" May 27 21:06:47.026213 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:47.025800 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h5lwv" podUID="aa70e273-d17b-4a4d-af0c-ccaaf3c319ec" May 27 21:06:47.026213 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:47.025859 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dq5" podUID="5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1" May 27 21:06:48.741671 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:48.741640 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1-metrics-certs\") pod \"network-metrics-daemon-b7dq5\" (UID: \"5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1\") " pod="openshift-multus/network-metrics-daemon-b7dq5" May 27 21:06:48.741671 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:48.741673 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ndpt\" (UniqueName: \"kubernetes.io/projected/aa70e273-d17b-4a4d-af0c-ccaaf3c319ec-kube-api-access-2ndpt\") pod \"network-check-target-h5lwv\" (UID: \"aa70e273-d17b-4a4d-af0c-ccaaf3c319ec\") " pod="openshift-network-diagnostics/network-check-target-h5lwv" May 27 21:06:48.742193 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:48.741775 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:06:48.742193 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:48.741790 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 21:06:48.742193 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:48.741801 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 21:06:48.742193 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:48.741810 2566 projected.go:194] Error preparing data for projected volume kube-api-access-2ndpt for pod openshift-network-diagnostics/network-check-target-h5lwv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:06:48.742193 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:48.741831 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1-metrics-certs podName:5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1 nodeName:}" failed. No retries permitted until 2026-05-27 21:07:20.741815844 +0000 UTC m=+65.361201612 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1-metrics-certs") pod "network-metrics-daemon-b7dq5" (UID: "5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:06:48.742193 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:48.741844 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa70e273-d17b-4a4d-af0c-ccaaf3c319ec-kube-api-access-2ndpt podName:aa70e273-d17b-4a4d-af0c-ccaaf3c319ec nodeName:}" failed. No retries permitted until 2026-05-27 21:07:20.741838536 +0000 UTC m=+65.361224299 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2ndpt" (UniqueName: "kubernetes.io/projected/aa70e273-d17b-4a4d-af0c-ccaaf3c319ec-kube-api-access-2ndpt") pod "network-check-target-h5lwv" (UID: "aa70e273-d17b-4a4d-af0c-ccaaf3c319ec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:06:49.025432 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:49.025349 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5lwv" May 27 21:06:49.025586 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:49.025357 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dq5" May 27 21:06:49.025586 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:49.025457 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h5lwv" podUID="aa70e273-d17b-4a4d-af0c-ccaaf3c319ec" May 27 21:06:49.025586 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:49.025546 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dq5" podUID="5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1" May 27 21:06:50.159606 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:50.159577 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeReady" May 27 21:06:50.160175 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:50.159720 2566 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 27 21:06:50.214789 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:50.214690 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-n4mw8"] May 27 21:06:50.249562 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:50.249533 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-j2sdl"] May 27 21:06:50.249738 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:50.249716 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n4mw8" May 27 21:06:50.253736 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:50.253711 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 27 21:06:50.254671 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:50.254112 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 27 21:06:50.255838 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:50.255375 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r8bdp\"" May 27 21:06:50.263700 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:50.263680 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n4mw8"] May 27 21:06:50.263774 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:50.263710 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j2sdl"] May 27 21:06:50.263826 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:50.263815 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j2sdl" May 27 21:06:50.266198 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:50.266176 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 27 21:06:50.266982 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:50.266960 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 27 21:06:50.267079 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:50.266960 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 27 21:06:50.267079 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:50.266996 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p6pfz\"" May 27 21:06:50.351742 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:50.351706 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac701952-aba5-4b19-8037-2e1b598413ce-metrics-tls\") pod \"dns-default-n4mw8\" (UID: \"ac701952-aba5-4b19-8037-2e1b598413ce\") " pod="openshift-dns/dns-default-n4mw8" May 27 21:06:50.351916 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:50.351770 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac701952-aba5-4b19-8037-2e1b598413ce-tmp-dir\") pod \"dns-default-n4mw8\" (UID: \"ac701952-aba5-4b19-8037-2e1b598413ce\") " pod="openshift-dns/dns-default-n4mw8" May 27 21:06:50.351916 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:50.351798 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gstn6\" (UniqueName: \"kubernetes.io/projected/ac701952-aba5-4b19-8037-2e1b598413ce-kube-api-access-gstn6\") pod \"dns-default-n4mw8\" (UID: \"ac701952-aba5-4b19-8037-2e1b598413ce\") " pod="openshift-dns/dns-default-n4mw8" May 27 21:06:50.351916 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:50.351878 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5908789d-9a0e-402a-af5b-9cece18e09cb-cert\") pod \"ingress-canary-j2sdl\" (UID: \"5908789d-9a0e-402a-af5b-9cece18e09cb\") " pod="openshift-ingress-canary/ingress-canary-j2sdl" May 27 21:06:50.351916 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:50.351911 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqb72\" (UniqueName: \"kubernetes.io/projected/5908789d-9a0e-402a-af5b-9cece18e09cb-kube-api-access-tqb72\") pod \"ingress-canary-j2sdl\" (UID: \"5908789d-9a0e-402a-af5b-9cece18e09cb\") " pod="openshift-ingress-canary/ingress-canary-j2sdl" May 27 21:06:50.352209 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:50.351934 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ac701952-aba5-4b19-8037-2e1b598413ce-config-volume\") pod \"dns-default-n4mw8\" (UID: \"ac701952-aba5-4b19-8037-2e1b598413ce\") " pod="openshift-dns/dns-default-n4mw8" May 27 21:06:50.452725 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:50.452686 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac701952-aba5-4b19-8037-2e1b598413ce-metrics-tls\") pod \"dns-default-n4mw8\" (UID: \"ac701952-aba5-4b19-8037-2e1b598413ce\") " pod="openshift-dns/dns-default-n4mw8" May 27 21:06:50.452905 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:50.452753 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac701952-aba5-4b19-8037-2e1b598413ce-tmp-dir\") pod \"dns-default-n4mw8\" (UID: \"ac701952-aba5-4b19-8037-2e1b598413ce\") " pod="openshift-dns/dns-default-n4mw8" May 27 21:06:50.452905 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:50.452781 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gstn6\" (UniqueName: \"kubernetes.io/projected/ac701952-aba5-4b19-8037-2e1b598413ce-kube-api-access-gstn6\") pod \"dns-default-n4mw8\" (UID: \"ac701952-aba5-4b19-8037-2e1b598413ce\") " pod="openshift-dns/dns-default-n4mw8" May 27 21:06:50.452905 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:50.452810 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5908789d-9a0e-402a-af5b-9cece18e09cb-cert\") pod \"ingress-canary-j2sdl\" (UID: \"5908789d-9a0e-402a-af5b-9cece18e09cb\") " pod="openshift-ingress-canary/ingress-canary-j2sdl" May 27 21:06:50.452905 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:50.452832 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tqb72\" (UniqueName: \"kubernetes.io/projected/5908789d-9a0e-402a-af5b-9cece18e09cb-kube-api-access-tqb72\") pod \"ingress-canary-j2sdl\" (UID: \"5908789d-9a0e-402a-af5b-9cece18e09cb\") " pod="openshift-ingress-canary/ingress-canary-j2sdl" May 27 21:06:50.452905 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:50.452853 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ac701952-aba5-4b19-8037-2e1b598413ce-config-volume\") pod \"dns-default-n4mw8\" (UID: \"ac701952-aba5-4b19-8037-2e1b598413ce\") " pod="openshift-dns/dns-default-n4mw8" May 27 21:06:50.452905 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:50.452870 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 21:06:50.453250 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:50.452944 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac701952-aba5-4b19-8037-2e1b598413ce-metrics-tls podName:ac701952-aba5-4b19-8037-2e1b598413ce nodeName:}" failed. No retries permitted until 2026-05-27 21:06:50.952923522 +0000 UTC m=+35.572309298 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac701952-aba5-4b19-8037-2e1b598413ce-metrics-tls") pod "dns-default-n4mw8" (UID: "ac701952-aba5-4b19-8037-2e1b598413ce") : secret "dns-default-metrics-tls" not found May 27 21:06:50.453250 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:50.453163 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 21:06:50.453250 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:50.453188 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac701952-aba5-4b19-8037-2e1b598413ce-tmp-dir\") pod \"dns-default-n4mw8\" (UID: \"ac701952-aba5-4b19-8037-2e1b598413ce\") " pod="openshift-dns/dns-default-n4mw8" May 27 21:06:50.453250 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:50.453210 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5908789d-9a0e-402a-af5b-9cece18e09cb-cert podName:5908789d-9a0e-402a-af5b-9cece18e09cb nodeName:}" failed. No retries permitted until 2026-05-27 21:06:50.953195767 +0000 UTC m=+35.572581544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5908789d-9a0e-402a-af5b-9cece18e09cb-cert") pod "ingress-canary-j2sdl" (UID: "5908789d-9a0e-402a-af5b-9cece18e09cb") : secret "canary-serving-cert" not found May 27 21:06:50.464104 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:50.464078 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ac701952-aba5-4b19-8037-2e1b598413ce-config-volume\") pod \"dns-default-n4mw8\" (UID: \"ac701952-aba5-4b19-8037-2e1b598413ce\") " pod="openshift-dns/dns-default-n4mw8" May 27 21:06:50.472378 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:50.472320 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gstn6\" (UniqueName: \"kubernetes.io/projected/ac701952-aba5-4b19-8037-2e1b598413ce-kube-api-access-gstn6\") pod \"dns-default-n4mw8\" (UID: \"ac701952-aba5-4b19-8037-2e1b598413ce\") " pod="openshift-dns/dns-default-n4mw8" May 27 21:06:50.473530 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:50.473505 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqb72\" (UniqueName: \"kubernetes.io/projected/5908789d-9a0e-402a-af5b-9cece18e09cb-kube-api-access-tqb72\") pod \"ingress-canary-j2sdl\" (UID: \"5908789d-9a0e-402a-af5b-9cece18e09cb\") " pod="openshift-ingress-canary/ingress-canary-j2sdl" May 27 21:06:50.957081 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:50.957048 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac701952-aba5-4b19-8037-2e1b598413ce-metrics-tls\") pod \"dns-default-n4mw8\" (UID: \"ac701952-aba5-4b19-8037-2e1b598413ce\") " pod="openshift-dns/dns-default-n4mw8" May 27 21:06:50.957226 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:50.957111 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5908789d-9a0e-402a-af5b-9cece18e09cb-cert\") pod \"ingress-canary-j2sdl\" (UID: \"5908789d-9a0e-402a-af5b-9cece18e09cb\") " pod="openshift-ingress-canary/ingress-canary-j2sdl" May 27 21:06:50.957226 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:50.957165 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 21:06:50.957226 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:50.957183 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 21:06:50.957226 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:50.957221 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac701952-aba5-4b19-8037-2e1b598413ce-metrics-tls podName:ac701952-aba5-4b19-8037-2e1b598413ce nodeName:}" failed. No retries permitted until 2026-05-27 21:06:51.957205979 +0000 UTC m=+36.576591747 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac701952-aba5-4b19-8037-2e1b598413ce-metrics-tls") pod "dns-default-n4mw8" (UID: "ac701952-aba5-4b19-8037-2e1b598413ce") : secret "dns-default-metrics-tls" not found May 27 21:06:50.957354 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:50.957234 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5908789d-9a0e-402a-af5b-9cece18e09cb-cert podName:5908789d-9a0e-402a-af5b-9cece18e09cb nodeName:}" failed. No retries permitted until 2026-05-27 21:06:51.957228046 +0000 UTC m=+36.576613809 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5908789d-9a0e-402a-af5b-9cece18e09cb-cert") pod "ingress-canary-j2sdl" (UID: "5908789d-9a0e-402a-af5b-9cece18e09cb") : secret "canary-serving-cert" not found May 27 21:06:51.025632 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:51.025610 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5lwv" May 27 21:06:51.025746 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:51.025614 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dq5" May 27 21:06:51.028915 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:51.028893 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gx2x6\"" May 27 21:06:51.029063 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:51.028958 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 27 21:06:51.029063 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:51.028967 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 27 21:06:51.029063 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:51.028973 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nvnhn\"" May 27 21:06:51.029063 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:51.028957 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 27 21:06:51.964375 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:51.964346 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac701952-aba5-4b19-8037-2e1b598413ce-metrics-tls\") pod \"dns-default-n4mw8\" (UID: \"ac701952-aba5-4b19-8037-2e1b598413ce\") " pod="openshift-dns/dns-default-n4mw8" May 27 21:06:51.964777 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:51.964398 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5908789d-9a0e-402a-af5b-9cece18e09cb-cert\") pod \"ingress-canary-j2sdl\" (UID: \"5908789d-9a0e-402a-af5b-9cece18e09cb\") " pod="openshift-ingress-canary/ingress-canary-j2sdl" May 27 21:06:51.964777 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:51.964485 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 21:06:51.964777 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:51.964487 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 21:06:51.964777 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:51.964534 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5908789d-9a0e-402a-af5b-9cece18e09cb-cert podName:5908789d-9a0e-402a-af5b-9cece18e09cb nodeName:}" failed. No retries permitted until 2026-05-27 21:06:53.964520797 +0000 UTC m=+38.583906560 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5908789d-9a0e-402a-af5b-9cece18e09cb-cert") pod "ingress-canary-j2sdl" (UID: "5908789d-9a0e-402a-af5b-9cece18e09cb") : secret "canary-serving-cert" not found May 27 21:06:51.964777 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:51.964546 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac701952-aba5-4b19-8037-2e1b598413ce-metrics-tls podName:ac701952-aba5-4b19-8037-2e1b598413ce nodeName:}" failed. No retries permitted until 2026-05-27 21:06:53.964540477 +0000 UTC m=+38.583926240 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac701952-aba5-4b19-8037-2e1b598413ce-metrics-tls") pod "dns-default-n4mw8" (UID: "ac701952-aba5-4b19-8037-2e1b598413ce") : secret "dns-default-metrics-tls" not found May 27 21:06:52.313285 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:52.313259 2566 generic.go:358] "Generic (PLEG): container finished" podID="924d6e9e-49fd-44b8-9c8c-bc859c8e05cd" containerID="4a4347d6bc894db5781d1ea47d94eeb5b8b92f73982392678ee44f5d39efde8d" exitCode=0 May 27 21:06:52.313411 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:52.313308 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ct8th" event={"ID":"924d6e9e-49fd-44b8-9c8c-bc859c8e05cd","Type":"ContainerDied","Data":"4a4347d6bc894db5781d1ea47d94eeb5b8b92f73982392678ee44f5d39efde8d"} May 27 21:06:53.317869 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:53.317837 2566 generic.go:358] "Generic (PLEG): container finished" podID="924d6e9e-49fd-44b8-9c8c-bc859c8e05cd" containerID="10ea9a4e6f9953893462a81ec3d8fa9d409bc062b5cbb868e90a396236116f04" exitCode=0 May 27 21:06:53.318329 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:53.317879 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ct8th" event={"ID":"924d6e9e-49fd-44b8-9c8c-bc859c8e05cd","Type":"ContainerDied","Data":"10ea9a4e6f9953893462a81ec3d8fa9d409bc062b5cbb868e90a396236116f04"} May 27 21:06:53.980209 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:53.980183 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5908789d-9a0e-402a-af5b-9cece18e09cb-cert\") pod \"ingress-canary-j2sdl\" (UID: \"5908789d-9a0e-402a-af5b-9cece18e09cb\") " pod="openshift-ingress-canary/ingress-canary-j2sdl" May 27 21:06:53.980350 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:53.980226 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac701952-aba5-4b19-8037-2e1b598413ce-metrics-tls\") pod \"dns-default-n4mw8\" (UID: \"ac701952-aba5-4b19-8037-2e1b598413ce\") " pod="openshift-dns/dns-default-n4mw8" May 27 21:06:53.980350 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:53.980326 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 21:06:53.980350 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:53.980334 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 21:06:53.980435 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:53.980382 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac701952-aba5-4b19-8037-2e1b598413ce-metrics-tls podName:ac701952-aba5-4b19-8037-2e1b598413ce nodeName:}" failed. No retries permitted until 2026-05-27 21:06:57.980366155 +0000 UTC m=+42.599751920 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac701952-aba5-4b19-8037-2e1b598413ce-metrics-tls") pod "dns-default-n4mw8" (UID: "ac701952-aba5-4b19-8037-2e1b598413ce") : secret "dns-default-metrics-tls" not found May 27 21:06:53.980435 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:53.980395 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5908789d-9a0e-402a-af5b-9cece18e09cb-cert podName:5908789d-9a0e-402a-af5b-9cece18e09cb nodeName:}" failed. No retries permitted until 2026-05-27 21:06:57.980389331 +0000 UTC m=+42.599775093 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5908789d-9a0e-402a-af5b-9cece18e09cb-cert") pod "ingress-canary-j2sdl" (UID: "5908789d-9a0e-402a-af5b-9cece18e09cb") : secret "canary-serving-cert" not found May 27 21:06:54.323046 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:54.323001 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ct8th" event={"ID":"924d6e9e-49fd-44b8-9c8c-bc859c8e05cd","Type":"ContainerStarted","Data":"6961cf2aaa935e191385544de42656feb0273fac2589b8551e886f22a00ce701"} May 27 21:06:54.345531 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:54.345481 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ct8th" podStartSLOduration=4.361606424 podStartE2EDuration="38.345465695s" podCreationTimestamp="2026-05-27 21:06:16 +0000 UTC" firstStartedPulling="2026-05-27 21:06:17.292444321 +0000 UTC m=+1.911830084" lastFinishedPulling="2026-05-27 21:06:51.276303589 +0000 UTC m=+35.895689355" observedRunningTime="2026-05-27 21:06:54.345334757 +0000 UTC m=+38.964720542" watchObservedRunningTime="2026-05-27 21:06:54.345465695 +0000 UTC m=+38.964851507" May 27 21:06:58.006447 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:58.006410 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5908789d-9a0e-402a-af5b-9cece18e09cb-cert\") pod \"ingress-canary-j2sdl\" (UID: \"5908789d-9a0e-402a-af5b-9cece18e09cb\") " pod="openshift-ingress-canary/ingress-canary-j2sdl" May 27 21:06:58.006906 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:06:58.006463 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac701952-aba5-4b19-8037-2e1b598413ce-metrics-tls\") pod \"dns-default-n4mw8\" (UID: \"ac701952-aba5-4b19-8037-2e1b598413ce\") " pod="openshift-dns/dns-default-n4mw8" May 27 21:06:58.006906 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:58.006542 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 21:06:58.006906 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:58.006556 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 21:06:58.006906 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:58.006593 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac701952-aba5-4b19-8037-2e1b598413ce-metrics-tls podName:ac701952-aba5-4b19-8037-2e1b598413ce nodeName:}" failed. No retries permitted until 2026-05-27 21:07:06.006580131 +0000 UTC m=+50.625965894 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac701952-aba5-4b19-8037-2e1b598413ce-metrics-tls") pod "dns-default-n4mw8" (UID: "ac701952-aba5-4b19-8037-2e1b598413ce") : secret "dns-default-metrics-tls" not found May 27 21:06:58.006906 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:06:58.006678 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5908789d-9a0e-402a-af5b-9cece18e09cb-cert podName:5908789d-9a0e-402a-af5b-9cece18e09cb nodeName:}" failed. No retries permitted until 2026-05-27 21:07:06.006647537 +0000 UTC m=+50.626033305 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5908789d-9a0e-402a-af5b-9cece18e09cb-cert") pod "ingress-canary-j2sdl" (UID: "5908789d-9a0e-402a-af5b-9cece18e09cb") : secret "canary-serving-cert" not found May 27 21:07:06.064836 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:07:06.064803 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac701952-aba5-4b19-8037-2e1b598413ce-metrics-tls\") pod \"dns-default-n4mw8\" (UID: \"ac701952-aba5-4b19-8037-2e1b598413ce\") " pod="openshift-dns/dns-default-n4mw8" May 27 21:07:06.065342 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:07:06.064858 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5908789d-9a0e-402a-af5b-9cece18e09cb-cert\") pod \"ingress-canary-j2sdl\" (UID: \"5908789d-9a0e-402a-af5b-9cece18e09cb\") " pod="openshift-ingress-canary/ingress-canary-j2sdl" May 27 21:07:06.065342 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:07:06.064937 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 21:07:06.065342 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:07:06.064953 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 21:07:06.065342 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:07:06.064990 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5908789d-9a0e-402a-af5b-9cece18e09cb-cert podName:5908789d-9a0e-402a-af5b-9cece18e09cb nodeName:}" failed. No retries permitted until 2026-05-27 21:07:22.064978403 +0000 UTC m=+66.684364166 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5908789d-9a0e-402a-af5b-9cece18e09cb-cert") pod "ingress-canary-j2sdl" (UID: "5908789d-9a0e-402a-af5b-9cece18e09cb") : secret "canary-serving-cert" not found May 27 21:07:06.065342 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:07:06.065013 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac701952-aba5-4b19-8037-2e1b598413ce-metrics-tls podName:ac701952-aba5-4b19-8037-2e1b598413ce nodeName:}" failed. No retries permitted until 2026-05-27 21:07:22.064995639 +0000 UTC m=+66.684381417 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac701952-aba5-4b19-8037-2e1b598413ce-metrics-tls") pod "dns-default-n4mw8" (UID: "ac701952-aba5-4b19-8037-2e1b598413ce") : secret "dns-default-metrics-tls" not found May 27 21:07:15.314287 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:07:15.314256 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7tlfn" May 27 21:07:20.757563 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:07:20.757517 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1-metrics-certs\") pod \"network-metrics-daemon-b7dq5\" (UID: \"5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1\") " pod="openshift-multus/network-metrics-daemon-b7dq5" May 27 21:07:20.757563 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:07:20.757574 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ndpt\" (UniqueName: \"kubernetes.io/projected/aa70e273-d17b-4a4d-af0c-ccaaf3c319ec-kube-api-access-2ndpt\") pod \"network-check-target-h5lwv\" (UID: \"aa70e273-d17b-4a4d-af0c-ccaaf3c319ec\") " pod="openshift-network-diagnostics/network-check-target-h5lwv" May 27 21:07:20.760156 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:07:20.760137 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 27 21:07:20.760250 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:07:20.760157 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 27 21:07:20.768225 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:07:20.768198 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 27 21:07:20.768324 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:07:20.768261 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1-metrics-certs podName:5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1 nodeName:}" failed. No retries permitted until 2026-05-27 21:08:24.768245789 +0000 UTC m=+129.387631556 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1-metrics-certs") pod "network-metrics-daemon-b7dq5" (UID: "5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1") : secret "metrics-daemon-secret" not found May 27 21:07:20.770617 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:07:20.770600 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 27 21:07:20.781837 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:07:20.781814 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ndpt\" (UniqueName: \"kubernetes.io/projected/aa70e273-d17b-4a4d-af0c-ccaaf3c319ec-kube-api-access-2ndpt\") pod \"network-check-target-h5lwv\" (UID: \"aa70e273-d17b-4a4d-af0c-ccaaf3c319ec\") " pod="openshift-network-diagnostics/network-check-target-h5lwv" May 27 21:07:21.038179 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:07:21.038116 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gx2x6\"" May 27 21:07:21.046564 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:07:21.046544 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h5lwv" May 27 21:07:21.168298 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:07:21.168270 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h5lwv"] May 27 21:07:21.172349 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:07:21.172315 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa70e273_d17b_4a4d_af0c_ccaaf3c319ec.slice/crio-17c77f606f0436e5c7400c2ad557de2390bc9666a4a9421a679d0531e26b9f28 WatchSource:0}: Error finding container 17c77f606f0436e5c7400c2ad557de2390bc9666a4a9421a679d0531e26b9f28: Status 404 returned error can't find the container with id 17c77f606f0436e5c7400c2ad557de2390bc9666a4a9421a679d0531e26b9f28 May 27 21:07:21.373735 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:07:21.373697 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h5lwv" event={"ID":"aa70e273-d17b-4a4d-af0c-ccaaf3c319ec","Type":"ContainerStarted","Data":"17c77f606f0436e5c7400c2ad557de2390bc9666a4a9421a679d0531e26b9f28"} May 27 21:07:22.065536 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:07:22.065498 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac701952-aba5-4b19-8037-2e1b598413ce-metrics-tls\") pod \"dns-default-n4mw8\" (UID: \"ac701952-aba5-4b19-8037-2e1b598413ce\") " pod="openshift-dns/dns-default-n4mw8" May 27 21:07:22.066010 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:07:22.065561 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5908789d-9a0e-402a-af5b-9cece18e09cb-cert\") pod \"ingress-canary-j2sdl\" (UID: \"5908789d-9a0e-402a-af5b-9cece18e09cb\") " pod="openshift-ingress-canary/ingress-canary-j2sdl" May 27 21:07:22.066010 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:07:22.065657 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 21:07:22.066010 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:07:22.065667 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 21:07:22.066010 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:07:22.065749 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac701952-aba5-4b19-8037-2e1b598413ce-metrics-tls podName:ac701952-aba5-4b19-8037-2e1b598413ce nodeName:}" failed. No retries permitted until 2026-05-27 21:07:54.065724759 +0000 UTC m=+98.685110527 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac701952-aba5-4b19-8037-2e1b598413ce-metrics-tls") pod "dns-default-n4mw8" (UID: "ac701952-aba5-4b19-8037-2e1b598413ce") : secret "dns-default-metrics-tls" not found May 27 21:07:22.066010 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:07:22.065772 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5908789d-9a0e-402a-af5b-9cece18e09cb-cert podName:5908789d-9a0e-402a-af5b-9cece18e09cb nodeName:}" failed. No retries permitted until 2026-05-27 21:07:54.065761029 +0000 UTC m=+98.685146792 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5908789d-9a0e-402a-af5b-9cece18e09cb-cert") pod "ingress-canary-j2sdl" (UID: "5908789d-9a0e-402a-af5b-9cece18e09cb") : secret "canary-serving-cert" not found May 27 21:07:24.380531 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:07:24.380500 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h5lwv" event={"ID":"aa70e273-d17b-4a4d-af0c-ccaaf3c319ec","Type":"ContainerStarted","Data":"2d194c79a902a50ec4157f4f024e700fb2c43ff0a53f13f878e3ef281be34ab8"} May 27 21:07:24.380957 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:07:24.380635 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-h5lwv" May 27 21:07:24.397544 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:07:24.397498 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-h5lwv" podStartSLOduration=65.341062613 podStartE2EDuration="1m8.397483907s" podCreationTimestamp="2026-05-27 21:06:16 +0000 UTC" firstStartedPulling="2026-05-27 21:07:21.174501307 +0000 UTC m=+65.793887070" lastFinishedPulling="2026-05-27 21:07:24.230922596 +0000 UTC m=+68.850308364" observedRunningTime="2026-05-27 21:07:24.396361937 +0000 UTC m=+69.015747722" watchObservedRunningTime="2026-05-27 21:07:24.397483907 +0000 UTC m=+69.016869685" May 27 21:07:54.084768 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:07:54.084734 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5908789d-9a0e-402a-af5b-9cece18e09cb-cert\") pod \"ingress-canary-j2sdl\" (UID: \"5908789d-9a0e-402a-af5b-9cece18e09cb\") " pod="openshift-ingress-canary/ingress-canary-j2sdl" May 27 21:07:54.085269 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:07:54.084784 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac701952-aba5-4b19-8037-2e1b598413ce-metrics-tls\") pod \"dns-default-n4mw8\" (UID: \"ac701952-aba5-4b19-8037-2e1b598413ce\") " pod="openshift-dns/dns-default-n4mw8" May 27 21:07:54.085269 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:07:54.084879 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 21:07:54.085269 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:07:54.084890 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 21:07:54.085269 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:07:54.084938 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac701952-aba5-4b19-8037-2e1b598413ce-metrics-tls podName:ac701952-aba5-4b19-8037-2e1b598413ce nodeName:}" failed. No retries permitted until 2026-05-27 21:08:58.08492419 +0000 UTC m=+162.704309953 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac701952-aba5-4b19-8037-2e1b598413ce-metrics-tls") pod "dns-default-n4mw8" (UID: "ac701952-aba5-4b19-8037-2e1b598413ce") : secret "dns-default-metrics-tls" not found May 27 21:07:54.085269 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:07:54.084963 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5908789d-9a0e-402a-af5b-9cece18e09cb-cert podName:5908789d-9a0e-402a-af5b-9cece18e09cb nodeName:}" failed. No retries permitted until 2026-05-27 21:08:58.08494634 +0000 UTC m=+162.704332120 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5908789d-9a0e-402a-af5b-9cece18e09cb-cert") pod "ingress-canary-j2sdl" (UID: "5908789d-9a0e-402a-af5b-9cece18e09cb") : secret "canary-serving-cert" not found May 27 21:07:55.385181 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:07:55.385143 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-h5lwv" May 27 21:08:16.988397 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:16.988357 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-vq5t6"] May 27 21:08:16.991655 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:16.991631 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-vq5t6" May 27 21:08:16.994187 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:16.994167 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 27 21:08:16.994308 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:16.994289 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 27 21:08:16.994897 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:16.994879 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-wnj85\"" May 27 21:08:16.994992 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:16.994885 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 27 21:08:16.994992 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:16.994910 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 27 21:08:16.999519 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:16.999497 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-vq5t6"] May 27 21:08:17.000691 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:17.000670 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 27 21:08:17.043667 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:17.043633 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec6a5a07-1a2d-4f45-8146-ba0d534d28ea-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-vq5t6\" (UID: \"ec6a5a07-1a2d-4f45-8146-ba0d534d28ea\") " pod="openshift-insights/insights-operator-78bdfb888c-vq5t6" May 27 21:08:17.043667 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:17.043668 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec6a5a07-1a2d-4f45-8146-ba0d534d28ea-service-ca-bundle\") pod \"insights-operator-78bdfb888c-vq5t6\" (UID: \"ec6a5a07-1a2d-4f45-8146-ba0d534d28ea\") " pod="openshift-insights/insights-operator-78bdfb888c-vq5t6" May 27 21:08:17.043849 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:17.043690 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ec6a5a07-1a2d-4f45-8146-ba0d534d28ea-serving-cert\") pod \"insights-operator-78bdfb888c-vq5t6\" (UID: \"ec6a5a07-1a2d-4f45-8146-ba0d534d28ea\") " pod="openshift-insights/insights-operator-78bdfb888c-vq5t6" May 27 21:08:17.043849 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:17.043780 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ec6a5a07-1a2d-4f45-8146-ba0d534d28ea-snapshots\") pod \"insights-operator-78bdfb888c-vq5t6\" (UID: \"ec6a5a07-1a2d-4f45-8146-ba0d534d28ea\") " pod="openshift-insights/insights-operator-78bdfb888c-vq5t6" May 27 21:08:17.043849 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:17.043818 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec6a5a07-1a2d-4f45-8146-ba0d534d28ea-tmp\") pod \"insights-operator-78bdfb888c-vq5t6\" (UID: \"ec6a5a07-1a2d-4f45-8146-ba0d534d28ea\") " pod="openshift-insights/insights-operator-78bdfb888c-vq5t6" May 27 21:08:17.043849 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:17.043839 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z752\" (UniqueName: \"kubernetes.io/projected/ec6a5a07-1a2d-4f45-8146-ba0d534d28ea-kube-api-access-2z752\") pod \"insights-operator-78bdfb888c-vq5t6\" (UID: \"ec6a5a07-1a2d-4f45-8146-ba0d534d28ea\") " pod="openshift-insights/insights-operator-78bdfb888c-vq5t6" May 27 21:08:17.144169 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:17.144113 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec6a5a07-1a2d-4f45-8146-ba0d534d28ea-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-vq5t6\" (UID: \"ec6a5a07-1a2d-4f45-8146-ba0d534d28ea\") " pod="openshift-insights/insights-operator-78bdfb888c-vq5t6" May 27 21:08:17.144169 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:17.144173 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec6a5a07-1a2d-4f45-8146-ba0d534d28ea-service-ca-bundle\") pod \"insights-operator-78bdfb888c-vq5t6\" (UID: \"ec6a5a07-1a2d-4f45-8146-ba0d534d28ea\") " pod="openshift-insights/insights-operator-78bdfb888c-vq5t6" May 27 21:08:17.144432 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:17.144195 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ec6a5a07-1a2d-4f45-8146-ba0d534d28ea-serving-cert\") pod \"insights-operator-78bdfb888c-vq5t6\" (UID: \"ec6a5a07-1a2d-4f45-8146-ba0d534d28ea\") " pod="openshift-insights/insights-operator-78bdfb888c-vq5t6" May 27 21:08:17.144432 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:17.144246 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ec6a5a07-1a2d-4f45-8146-ba0d534d28ea-snapshots\") pod \"insights-operator-78bdfb888c-vq5t6\" (UID: \"ec6a5a07-1a2d-4f45-8146-ba0d534d28ea\") " pod="openshift-insights/insights-operator-78bdfb888c-vq5t6" May 27 21:08:17.144432 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:17.144271 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec6a5a07-1a2d-4f45-8146-ba0d534d28ea-tmp\") pod \"insights-operator-78bdfb888c-vq5t6\" (UID: \"ec6a5a07-1a2d-4f45-8146-ba0d534d28ea\") " pod="openshift-insights/insights-operator-78bdfb888c-vq5t6" May 27 21:08:17.144432 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:17.144296 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2z752\" (UniqueName: \"kubernetes.io/projected/ec6a5a07-1a2d-4f45-8146-ba0d534d28ea-kube-api-access-2z752\") pod \"insights-operator-78bdfb888c-vq5t6\" (UID: \"ec6a5a07-1a2d-4f45-8146-ba0d534d28ea\") " pod="openshift-insights/insights-operator-78bdfb888c-vq5t6" May 27 21:08:17.144924 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:17.144892 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec6a5a07-1a2d-4f45-8146-ba0d534d28ea-tmp\") pod \"insights-operator-78bdfb888c-vq5t6\" (UID: \"ec6a5a07-1a2d-4f45-8146-ba0d534d28ea\") " pod="openshift-insights/insights-operator-78bdfb888c-vq5t6" May 27 21:08:17.145066 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:17.144956 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ec6a5a07-1a2d-4f45-8146-ba0d534d28ea-snapshots\") pod \"insights-operator-78bdfb888c-vq5t6\" (UID: \"ec6a5a07-1a2d-4f45-8146-ba0d534d28ea\") " pod="openshift-insights/insights-operator-78bdfb888c-vq5t6" May 27 21:08:17.145066 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:17.144951 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec6a5a07-1a2d-4f45-8146-ba0d534d28ea-service-ca-bundle\") pod \"insights-operator-78bdfb888c-vq5t6\" (UID: \"ec6a5a07-1a2d-4f45-8146-ba0d534d28ea\") " pod="openshift-insights/insights-operator-78bdfb888c-vq5t6" May 27 21:08:17.145181 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:17.145162 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec6a5a07-1a2d-4f45-8146-ba0d534d28ea-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-vq5t6\" (UID: \"ec6a5a07-1a2d-4f45-8146-ba0d534d28ea\") " pod="openshift-insights/insights-operator-78bdfb888c-vq5t6" May 27 21:08:17.146730 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:17.146710 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ec6a5a07-1a2d-4f45-8146-ba0d534d28ea-serving-cert\") pod \"insights-operator-78bdfb888c-vq5t6\" (UID: \"ec6a5a07-1a2d-4f45-8146-ba0d534d28ea\") " pod="openshift-insights/insights-operator-78bdfb888c-vq5t6" May 27 21:08:17.152813 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:17.152794 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z752\" (UniqueName: \"kubernetes.io/projected/ec6a5a07-1a2d-4f45-8146-ba0d534d28ea-kube-api-access-2z752\") pod \"insights-operator-78bdfb888c-vq5t6\" (UID: \"ec6a5a07-1a2d-4f45-8146-ba0d534d28ea\") " pod="openshift-insights/insights-operator-78bdfb888c-vq5t6" May 27 21:08:17.302498 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:17.302404 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-vq5t6" May 27 21:08:17.418895 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:17.418866 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-vq5t6"] May 27 21:08:17.422462 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:08:17.422434 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec6a5a07_1a2d_4f45_8146_ba0d534d28ea.slice/crio-172a483098fccf42892e5f6fb3b146534b32ba3d693bc7cabb829558dca26d26 WatchSource:0}: Error finding container 172a483098fccf42892e5f6fb3b146534b32ba3d693bc7cabb829558dca26d26: Status 404 returned error can't find the container with id 172a483098fccf42892e5f6fb3b146534b32ba3d693bc7cabb829558dca26d26 May 27 21:08:17.479388 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:17.479357 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-vq5t6" event={"ID":"ec6a5a07-1a2d-4f45-8146-ba0d534d28ea","Type":"ContainerStarted","Data":"172a483098fccf42892e5f6fb3b146534b32ba3d693bc7cabb829558dca26d26"} May 27 21:08:19.484579 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:19.484540 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-vq5t6" event={"ID":"ec6a5a07-1a2d-4f45-8146-ba0d534d28ea","Type":"ContainerStarted","Data":"17dba38e008015347f85a6d1067e9ccedca07f1c87f114ca9f18700afeaf013d"} May 27 21:08:19.504581 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:19.504532 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-vq5t6" podStartSLOduration=1.5421862819999999 podStartE2EDuration="3.504517308s" podCreationTimestamp="2026-05-27 21:08:16 +0000 UTC" firstStartedPulling="2026-05-27 21:08:17.424767558 +0000 UTC m=+122.044153324" lastFinishedPulling="2026-05-27 21:08:19.387098581 +0000 UTC m=+124.006484350" observedRunningTime="2026-05-27 21:08:19.503969264 +0000 UTC m=+124.123355048" watchObservedRunningTime="2026-05-27 21:08:19.504517308 +0000 UTC m=+124.123903092" May 27 21:08:22.588311 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:22.588280 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-d722x_bb5828e9-6222-41c1-9586-5105d4c9d1f3/dns-node-resolver/0.log" May 27 21:08:23.188254 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:23.188221 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-22zqb_cab49327-f463-431f-b649-e6065ef8df95/node-ca/0.log" May 27 21:08:24.802287 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:24.802253 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1-metrics-certs\") pod \"network-metrics-daemon-b7dq5\" (UID: \"5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1\") " pod="openshift-multus/network-metrics-daemon-b7dq5" May 27 21:08:24.802678 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:08:24.802399 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 27 21:08:24.802678 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:08:24.802502 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1-metrics-certs podName:5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1 nodeName:}" failed. No retries permitted until 2026-05-27 21:10:26.802484308 +0000 UTC m=+251.421870072 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1-metrics-certs") pod "network-metrics-daemon-b7dq5" (UID: "5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1") : secret "metrics-daemon-secret" not found May 27 21:08:26.906431 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:26.906398 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-bl9ns"] May 27 21:08:26.909511 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:26.909495 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bl9ns" May 27 21:08:26.911714 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:26.911691 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 27 21:08:26.911714 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:26.911705 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 27 21:08:26.911874 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:26.911800 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-bjz5s\"" May 27 21:08:26.912432 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:26.912415 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 27 21:08:26.912510 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:26.912440 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 27 21:08:26.916273 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:26.916255 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-bl9ns"] May 27 21:08:27.008953 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.008921 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-cjclm"] May 27 21:08:27.011777 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.011724 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wwsch"] May 27 21:08:27.011920 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.011861 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-cjclm" May 27 21:08:27.014487 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.014440 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 27 21:08:27.014618 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.014597 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 27 21:08:27.014710 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.014630 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-fvw7h"] May 27 21:08:27.014839 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.014821 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wwsch" May 27 21:08:27.014960 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.014823 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-vgnkt\"" May 27 21:08:27.016925 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.016903 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 27 21:08:27.017313 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.017267 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 27 21:08:27.017414 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.017321 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 27 21:08:27.017470 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.017440 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 27 21:08:27.017692 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.017671 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-br8sw\"" May 27 21:08:27.017799 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.017783 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-fvw7h" May 27 21:08:27.017912 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.017895 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/df4cc3b6-d37e-4739-a2c4-b4a49d264118-serving-cert\") pod \"service-ca-operator-57b5b68b8-bl9ns\" (UID: \"df4cc3b6-d37e-4739-a2c4-b4a49d264118\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bl9ns" May 27 21:08:27.018022 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.017949 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/df4cc3b6-d37e-4739-a2c4-b4a49d264118-config\") pod \"service-ca-operator-57b5b68b8-bl9ns\" (UID: \"df4cc3b6-d37e-4739-a2c4-b4a49d264118\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bl9ns" May 27 21:08:27.018022 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.018011 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s4bv\" (UniqueName: \"kubernetes.io/projected/df4cc3b6-d37e-4739-a2c4-b4a49d264118-kube-api-access-4s4bv\") pod \"service-ca-operator-57b5b68b8-bl9ns\" (UID: \"df4cc3b6-d37e-4739-a2c4-b4a49d264118\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bl9ns" May 27 21:08:27.020040 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.020009 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 27 21:08:27.020141 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.020056 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 27 21:08:27.020141 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.020079 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-zvtnh\"" May 27 21:08:27.020141 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.020090 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 27 21:08:27.020304 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.020144 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 27 21:08:27.022367 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.022349 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-cjclm"] May 27 21:08:27.026257 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.026081 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 27 21:08:27.026591 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.026559 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-fvw7h"] May 27 21:08:27.027618 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.027602 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wwsch"] May 27 21:08:27.119134 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.119099 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcw7m\" (UniqueName: \"kubernetes.io/projected/d33788ba-035e-4978-ac0a-88f2777a3401-kube-api-access-pcw7m\") pod \"kube-storage-version-migrator-operator-565644f49-wwsch\" (UID: \"d33788ba-035e-4978-ac0a-88f2777a3401\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wwsch" May 27 21:08:27.119290 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.119146 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx4pr\" (UniqueName: \"kubernetes.io/projected/0a60edfe-34bf-4d4f-8244-f08a7a0f3f06-kube-api-access-tx4pr\") pod \"console-operator-76dff48d59-fvw7h\" (UID: \"0a60edfe-34bf-4d4f-8244-f08a7a0f3f06\") " pod="openshift-console-operator/console-operator-76dff48d59-fvw7h" May 27 21:08:27.119290 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.119179 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d33788ba-035e-4978-ac0a-88f2777a3401-config\") pod \"kube-storage-version-migrator-operator-565644f49-wwsch\" (UID: \"d33788ba-035e-4978-ac0a-88f2777a3401\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wwsch" May 27 21:08:27.119290 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.119211 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/df4cc3b6-d37e-4739-a2c4-b4a49d264118-config\") pod \"service-ca-operator-57b5b68b8-bl9ns\" (UID: \"df4cc3b6-d37e-4739-a2c4-b4a49d264118\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bl9ns" May 27 21:08:27.119290 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.119236 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0a60edfe-34bf-4d4f-8244-f08a7a0f3f06-trusted-ca\") pod \"console-operator-76dff48d59-fvw7h\" (UID: \"0a60edfe-34bf-4d4f-8244-f08a7a0f3f06\") " pod="openshift-console-operator/console-operator-76dff48d59-fvw7h" May 27 21:08:27.119417 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.119323 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4s4bv\" (UniqueName: \"kubernetes.io/projected/df4cc3b6-d37e-4739-a2c4-b4a49d264118-kube-api-access-4s4bv\") pod \"service-ca-operator-57b5b68b8-bl9ns\" (UID: \"df4cc3b6-d37e-4739-a2c4-b4a49d264118\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bl9ns" May 27 21:08:27.119417 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.119344 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0a60edfe-34bf-4d4f-8244-f08a7a0f3f06-config\") pod \"console-operator-76dff48d59-fvw7h\" (UID: \"0a60edfe-34bf-4d4f-8244-f08a7a0f3f06\") " pod="openshift-console-operator/console-operator-76dff48d59-fvw7h" May 27 21:08:27.119417 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.119364 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0a60edfe-34bf-4d4f-8244-f08a7a0f3f06-serving-cert\") pod \"console-operator-76dff48d59-fvw7h\" (UID: \"0a60edfe-34bf-4d4f-8244-f08a7a0f3f06\") " pod="openshift-console-operator/console-operator-76dff48d59-fvw7h" May 27 21:08:27.119501 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.119429 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pj55\" (UniqueName: \"kubernetes.io/projected/e6ac89f5-855d-4800-ab27-5f75d8d2d32f-kube-api-access-4pj55\") pod \"volume-data-source-validator-5cf8c89d64-cjclm\" (UID: \"e6ac89f5-855d-4800-ab27-5f75d8d2d32f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-cjclm" May 27 21:08:27.119577 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.119563 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d33788ba-035e-4978-ac0a-88f2777a3401-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-wwsch\" (UID: \"d33788ba-035e-4978-ac0a-88f2777a3401\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wwsch" May 27 21:08:27.119614 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.119592 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/df4cc3b6-d37e-4739-a2c4-b4a49d264118-serving-cert\") pod \"service-ca-operator-57b5b68b8-bl9ns\" (UID: \"df4cc3b6-d37e-4739-a2c4-b4a49d264118\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bl9ns" May 27 21:08:27.119726 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.119711 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/df4cc3b6-d37e-4739-a2c4-b4a49d264118-config\") pod \"service-ca-operator-57b5b68b8-bl9ns\" (UID: \"df4cc3b6-d37e-4739-a2c4-b4a49d264118\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bl9ns" May 27 21:08:27.121665 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.121636 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/df4cc3b6-d37e-4739-a2c4-b4a49d264118-serving-cert\") pod \"service-ca-operator-57b5b68b8-bl9ns\" (UID: \"df4cc3b6-d37e-4739-a2c4-b4a49d264118\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bl9ns" May 27 21:08:27.127179 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.127157 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s4bv\" (UniqueName: \"kubernetes.io/projected/df4cc3b6-d37e-4739-a2c4-b4a49d264118-kube-api-access-4s4bv\") pod \"service-ca-operator-57b5b68b8-bl9ns\" (UID: \"df4cc3b6-d37e-4739-a2c4-b4a49d264118\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bl9ns" May 27 21:08:27.218414 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.218339 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bl9ns" May 27 21:08:27.220139 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.220113 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0a60edfe-34bf-4d4f-8244-f08a7a0f3f06-trusted-ca\") pod \"console-operator-76dff48d59-fvw7h\" (UID: \"0a60edfe-34bf-4d4f-8244-f08a7a0f3f06\") " pod="openshift-console-operator/console-operator-76dff48d59-fvw7h" May 27 21:08:27.220194 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.220171 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0a60edfe-34bf-4d4f-8244-f08a7a0f3f06-config\") pod \"console-operator-76dff48d59-fvw7h\" (UID: \"0a60edfe-34bf-4d4f-8244-f08a7a0f3f06\") " pod="openshift-console-operator/console-operator-76dff48d59-fvw7h" May 27 21:08:27.220227 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.220189 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0a60edfe-34bf-4d4f-8244-f08a7a0f3f06-serving-cert\") pod \"console-operator-76dff48d59-fvw7h\" (UID: \"0a60edfe-34bf-4d4f-8244-f08a7a0f3f06\") " pod="openshift-console-operator/console-operator-76dff48d59-fvw7h" May 27 21:08:27.220269 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.220227 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4pj55\" (UniqueName: \"kubernetes.io/projected/e6ac89f5-855d-4800-ab27-5f75d8d2d32f-kube-api-access-4pj55\") pod \"volume-data-source-validator-5cf8c89d64-cjclm\" (UID: \"e6ac89f5-855d-4800-ab27-5f75d8d2d32f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-cjclm" May 27 21:08:27.220269 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.220249 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d33788ba-035e-4978-ac0a-88f2777a3401-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-wwsch\" (UID: \"d33788ba-035e-4978-ac0a-88f2777a3401\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wwsch" May 27 21:08:27.220363 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.220284 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pcw7m\" (UniqueName: \"kubernetes.io/projected/d33788ba-035e-4978-ac0a-88f2777a3401-kube-api-access-pcw7m\") pod \"kube-storage-version-migrator-operator-565644f49-wwsch\" (UID: \"d33788ba-035e-4978-ac0a-88f2777a3401\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wwsch" May 27 21:08:27.220363 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.220314 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tx4pr\" (UniqueName: \"kubernetes.io/projected/0a60edfe-34bf-4d4f-8244-f08a7a0f3f06-kube-api-access-tx4pr\") pod \"console-operator-76dff48d59-fvw7h\" (UID: \"0a60edfe-34bf-4d4f-8244-f08a7a0f3f06\") " pod="openshift-console-operator/console-operator-76dff48d59-fvw7h" May 27 21:08:27.220363 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.220344 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d33788ba-035e-4978-ac0a-88f2777a3401-config\") pod \"kube-storage-version-migrator-operator-565644f49-wwsch\" (UID: \"d33788ba-035e-4978-ac0a-88f2777a3401\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wwsch" May 27 21:08:27.220962 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.220922 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d33788ba-035e-4978-ac0a-88f2777a3401-config\") pod \"kube-storage-version-migrator-operator-565644f49-wwsch\" (UID: \"d33788ba-035e-4978-ac0a-88f2777a3401\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wwsch" May 27 21:08:27.220962 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.220941 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0a60edfe-34bf-4d4f-8244-f08a7a0f3f06-config\") pod \"console-operator-76dff48d59-fvw7h\" (UID: \"0a60edfe-34bf-4d4f-8244-f08a7a0f3f06\") " pod="openshift-console-operator/console-operator-76dff48d59-fvw7h" May 27 21:08:27.221217 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.221194 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0a60edfe-34bf-4d4f-8244-f08a7a0f3f06-trusted-ca\") pod \"console-operator-76dff48d59-fvw7h\" (UID: \"0a60edfe-34bf-4d4f-8244-f08a7a0f3f06\") " pod="openshift-console-operator/console-operator-76dff48d59-fvw7h" May 27 21:08:27.223279 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.223259 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d33788ba-035e-4978-ac0a-88f2777a3401-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-wwsch\" (UID: \"d33788ba-035e-4978-ac0a-88f2777a3401\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wwsch" May 27 21:08:27.223382 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.223359 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0a60edfe-34bf-4d4f-8244-f08a7a0f3f06-serving-cert\") pod \"console-operator-76dff48d59-fvw7h\" (UID: \"0a60edfe-34bf-4d4f-8244-f08a7a0f3f06\") " pod="openshift-console-operator/console-operator-76dff48d59-fvw7h" May 27 21:08:27.229049 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.229003 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pj55\" (UniqueName: \"kubernetes.io/projected/e6ac89f5-855d-4800-ab27-5f75d8d2d32f-kube-api-access-4pj55\") pod \"volume-data-source-validator-5cf8c89d64-cjclm\" (UID: \"e6ac89f5-855d-4800-ab27-5f75d8d2d32f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-cjclm" May 27 21:08:27.230853 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.230827 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx4pr\" (UniqueName: \"kubernetes.io/projected/0a60edfe-34bf-4d4f-8244-f08a7a0f3f06-kube-api-access-tx4pr\") pod \"console-operator-76dff48d59-fvw7h\" (UID: \"0a60edfe-34bf-4d4f-8244-f08a7a0f3f06\") " pod="openshift-console-operator/console-operator-76dff48d59-fvw7h" May 27 21:08:27.235931 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.235908 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcw7m\" (UniqueName: \"kubernetes.io/projected/d33788ba-035e-4978-ac0a-88f2777a3401-kube-api-access-pcw7m\") pod \"kube-storage-version-migrator-operator-565644f49-wwsch\" (UID: \"d33788ba-035e-4978-ac0a-88f2777a3401\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wwsch" May 27 21:08:27.322619 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.322587 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-cjclm" May 27 21:08:27.331439 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.331415 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wwsch" May 27 21:08:27.336197 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.336164 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-fvw7h" May 27 21:08:27.343163 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.343133 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-bl9ns"] May 27 21:08:27.346569 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:08:27.346539 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf4cc3b6_d37e_4739_a2c4_b4a49d264118.slice/crio-05d24275931a8f35d3ec29d3884b7b47efee81590d9dad6ae512d3746b596fc7 WatchSource:0}: Error finding container 05d24275931a8f35d3ec29d3884b7b47efee81590d9dad6ae512d3746b596fc7: Status 404 returned error can't find the container with id 05d24275931a8f35d3ec29d3884b7b47efee81590d9dad6ae512d3746b596fc7 May 27 21:08:27.465538 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.465508 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-cjclm"] May 27 21:08:27.469343 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:08:27.469283 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6ac89f5_855d_4800_ab27_5f75d8d2d32f.slice/crio-98532c935b48163eb25eda19e28e2e2b2939b4832ae3f5f99148c9fa24df6770 WatchSource:0}: Error finding container 98532c935b48163eb25eda19e28e2e2b2939b4832ae3f5f99148c9fa24df6770: Status 404 returned error can't find the container with id 98532c935b48163eb25eda19e28e2e2b2939b4832ae3f5f99148c9fa24df6770 May 27 21:08:27.500226 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.500195 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bl9ns" event={"ID":"df4cc3b6-d37e-4739-a2c4-b4a49d264118","Type":"ContainerStarted","Data":"05d24275931a8f35d3ec29d3884b7b47efee81590d9dad6ae512d3746b596fc7"} May 27 21:08:27.501120 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.501093 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-cjclm" event={"ID":"e6ac89f5-855d-4800-ab27-5f75d8d2d32f","Type":"ContainerStarted","Data":"98532c935b48163eb25eda19e28e2e2b2939b4832ae3f5f99148c9fa24df6770"} May 27 21:08:27.688706 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.688669 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wwsch"] May 27 21:08:27.691293 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:27.691258 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-fvw7h"] May 27 21:08:27.691420 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:08:27.691349 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd33788ba_035e_4978_ac0a_88f2777a3401.slice/crio-031e72b61f4691b9be6cd5347346f57433e562053b12d03d629285d09b6f48eb WatchSource:0}: Error finding container 031e72b61f4691b9be6cd5347346f57433e562053b12d03d629285d09b6f48eb: Status 404 returned error can't find the container with id 031e72b61f4691b9be6cd5347346f57433e562053b12d03d629285d09b6f48eb May 27 21:08:27.694362 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:08:27.694340 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a60edfe_34bf_4d4f_8244_f08a7a0f3f06.slice/crio-a8b5c2897d3ea9928071b65121f11925032f940694884d3e5de96d1d7503264d WatchSource:0}: Error finding container a8b5c2897d3ea9928071b65121f11925032f940694884d3e5de96d1d7503264d: Status 404 returned error can't find the container with id a8b5c2897d3ea9928071b65121f11925032f940694884d3e5de96d1d7503264d May 27 21:08:28.505504 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:28.505456 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-fvw7h" event={"ID":"0a60edfe-34bf-4d4f-8244-f08a7a0f3f06","Type":"ContainerStarted","Data":"a8b5c2897d3ea9928071b65121f11925032f940694884d3e5de96d1d7503264d"} May 27 21:08:28.506903 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:28.506854 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wwsch" event={"ID":"d33788ba-035e-4978-ac0a-88f2777a3401","Type":"ContainerStarted","Data":"031e72b61f4691b9be6cd5347346f57433e562053b12d03d629285d09b6f48eb"} May 27 21:08:29.510950 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:29.510915 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-cjclm" event={"ID":"e6ac89f5-855d-4800-ab27-5f75d8d2d32f","Type":"ContainerStarted","Data":"4374a4f0656778ae18f519373c3c9a766641309bdfd28724be4be00a277c9d9d"} May 27 21:08:29.527188 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:29.527136 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-cjclm" podStartSLOduration=1.710560825 podStartE2EDuration="3.527119198s" podCreationTimestamp="2026-05-27 21:08:26 +0000 UTC" firstStartedPulling="2026-05-27 21:08:27.471497063 +0000 UTC m=+132.090882828" lastFinishedPulling="2026-05-27 21:08:29.288055435 +0000 UTC m=+133.907441201" observedRunningTime="2026-05-27 21:08:29.526169737 +0000 UTC m=+134.145555523" watchObservedRunningTime="2026-05-27 21:08:29.527119198 +0000 UTC m=+134.146504982" May 27 21:08:31.517172 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:31.517134 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bl9ns" event={"ID":"df4cc3b6-d37e-4739-a2c4-b4a49d264118","Type":"ContainerStarted","Data":"aaa77a224deab1a7b27ed543571e337cc8795a06f72c70aa0c99a004adae5621"} May 27 21:08:31.518683 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:31.518665 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fvw7h_0a60edfe-34bf-4d4f-8244-f08a7a0f3f06/console-operator/0.log" May 27 21:08:31.518788 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:31.518698 2566 generic.go:358] "Generic (PLEG): container finished" podID="0a60edfe-34bf-4d4f-8244-f08a7a0f3f06" containerID="82a06a0b937a962aaaa47deddb450cfc7940ed72af2eadcf53302cbb902b1975" exitCode=255 May 27 21:08:31.518865 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:31.518790 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-fvw7h" event={"ID":"0a60edfe-34bf-4d4f-8244-f08a7a0f3f06","Type":"ContainerDied","Data":"82a06a0b937a962aaaa47deddb450cfc7940ed72af2eadcf53302cbb902b1975"} May 27 21:08:31.519011 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:31.518995 2566 scope.go:117] "RemoveContainer" containerID="82a06a0b937a962aaaa47deddb450cfc7940ed72af2eadcf53302cbb902b1975" May 27 21:08:31.520040 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:31.520008 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wwsch" event={"ID":"d33788ba-035e-4978-ac0a-88f2777a3401","Type":"ContainerStarted","Data":"994b079e4c299edcf9aa7696e1d321368a127cc5d1ddc7afc4ef379ccf3f7415"} May 27 21:08:31.532847 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:31.532803 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bl9ns" podStartSLOduration=1.903830735 podStartE2EDuration="5.532788453s" podCreationTimestamp="2026-05-27 21:08:26 +0000 UTC" firstStartedPulling="2026-05-27 21:08:27.348761395 +0000 UTC m=+131.968147157" lastFinishedPulling="2026-05-27 21:08:30.977719096 +0000 UTC m=+135.597104875" observedRunningTime="2026-05-27 21:08:31.532104989 +0000 UTC m=+136.151490780" watchObservedRunningTime="2026-05-27 21:08:31.532788453 +0000 UTC m=+136.152174239" May 27 21:08:31.547757 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:31.547716 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wwsch" podStartSLOduration=2.262426805 podStartE2EDuration="5.547700121s" podCreationTimestamp="2026-05-27 21:08:26 +0000 UTC" firstStartedPulling="2026-05-27 21:08:27.693523819 +0000 UTC m=+132.312909585" lastFinishedPulling="2026-05-27 21:08:30.978797135 +0000 UTC m=+135.598182901" observedRunningTime="2026-05-27 21:08:31.547283675 +0000 UTC m=+136.166669461" watchObservedRunningTime="2026-05-27 21:08:31.547700121 +0000 UTC m=+136.167085907" May 27 21:08:32.523753 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:32.523727 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fvw7h_0a60edfe-34bf-4d4f-8244-f08a7a0f3f06/console-operator/1.log" May 27 21:08:32.524171 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:32.524152 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fvw7h_0a60edfe-34bf-4d4f-8244-f08a7a0f3f06/console-operator/0.log" May 27 21:08:32.524237 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:32.524209 2566 generic.go:358] "Generic (PLEG): container finished" podID="0a60edfe-34bf-4d4f-8244-f08a7a0f3f06" containerID="ee20e064d2cccf5ff218eb318403d9bf81c92560cd094dd4f8ab7d9f9a1095bf" exitCode=255 May 27 21:08:32.524356 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:32.524319 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-fvw7h" event={"ID":"0a60edfe-34bf-4d4f-8244-f08a7a0f3f06","Type":"ContainerDied","Data":"ee20e064d2cccf5ff218eb318403d9bf81c92560cd094dd4f8ab7d9f9a1095bf"} May 27 21:08:32.524496 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:32.524375 2566 scope.go:117] "RemoveContainer" containerID="82a06a0b937a962aaaa47deddb450cfc7940ed72af2eadcf53302cbb902b1975" May 27 21:08:32.524636 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:32.524615 2566 scope.go:117] "RemoveContainer" containerID="ee20e064d2cccf5ff218eb318403d9bf81c92560cd094dd4f8ab7d9f9a1095bf" May 27 21:08:32.524876 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:08:32.524847 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-fvw7h_openshift-console-operator(0a60edfe-34bf-4d4f-8244-f08a7a0f3f06)\"" pod="openshift-console-operator/console-operator-76dff48d59-fvw7h" podUID="0a60edfe-34bf-4d4f-8244-f08a7a0f3f06" May 27 21:08:33.527622 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:33.527593 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fvw7h_0a60edfe-34bf-4d4f-8244-f08a7a0f3f06/console-operator/1.log" May 27 21:08:33.528002 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:33.527942 2566 scope.go:117] "RemoveContainer" containerID="ee20e064d2cccf5ff218eb318403d9bf81c92560cd094dd4f8ab7d9f9a1095bf" May 27 21:08:33.528149 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:08:33.528130 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-fvw7h_openshift-console-operator(0a60edfe-34bf-4d4f-8244-f08a7a0f3f06)\"" pod="openshift-console-operator/console-operator-76dff48d59-fvw7h" podUID="0a60edfe-34bf-4d4f-8244-f08a7a0f3f06" May 27 21:08:33.593229 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:33.593192 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-rrcjv"] May 27 21:08:33.597393 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:33.597374 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-rrcjv" May 27 21:08:33.600086 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:33.600061 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 27 21:08:33.600324 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:33.600308 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-hnlq4\"" May 27 21:08:33.600495 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:33.600468 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 27 21:08:33.606740 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:33.606715 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-rrcjv"] May 27 21:08:33.675441 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:33.675398 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fctvh\" (UniqueName: \"kubernetes.io/projected/e52f464a-d258-43ed-8f4f-9605f15b3c4f-kube-api-access-fctvh\") pod \"migrator-b985f5d89-rrcjv\" (UID: \"e52f464a-d258-43ed-8f4f-9605f15b3c4f\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-rrcjv" May 27 21:08:33.777015 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:33.776971 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fctvh\" (UniqueName: \"kubernetes.io/projected/e52f464a-d258-43ed-8f4f-9605f15b3c4f-kube-api-access-fctvh\") pod \"migrator-b985f5d89-rrcjv\" (UID: \"e52f464a-d258-43ed-8f4f-9605f15b3c4f\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-rrcjv" May 27 21:08:33.786448 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:33.786392 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fctvh\" (UniqueName: \"kubernetes.io/projected/e52f464a-d258-43ed-8f4f-9605f15b3c4f-kube-api-access-fctvh\") pod \"migrator-b985f5d89-rrcjv\" (UID: \"e52f464a-d258-43ed-8f4f-9605f15b3c4f\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-rrcjv" May 27 21:08:33.907061 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:33.907010 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-rrcjv" May 27 21:08:34.031861 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:34.031830 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-t6s72"] May 27 21:08:34.035936 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:34.035920 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t6s72" May 27 21:08:34.037853 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:34.037794 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-rrcjv"] May 27 21:08:34.038659 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:34.038637 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 27 21:08:34.038773 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:34.038686 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-96bzc\"" May 27 21:08:34.038773 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:34.038699 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 27 21:08:34.041779 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:08:34.041754 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode52f464a_d258_43ed_8f4f_9605f15b3c4f.slice/crio-d72e08dd074f779b610054b51c2b7f9cf7a4066b8afb12190643808ed2aa5245 WatchSource:0}: Error finding container d72e08dd074f779b610054b51c2b7f9cf7a4066b8afb12190643808ed2aa5245: Status 404 returned error can't find the container with id d72e08dd074f779b610054b51c2b7f9cf7a4066b8afb12190643808ed2aa5245 May 27 21:08:34.048868 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:34.048847 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t6s72"] May 27 21:08:34.180837 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:34.180804 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc474e67-135e-4c91-856e-afec7398384e-data-volume\") pod \"insights-runtime-extractor-t6s72\" (UID: \"fc474e67-135e-4c91-856e-afec7398384e\") " pod="openshift-insights/insights-runtime-extractor-t6s72" May 27 21:08:34.180837 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:34.180838 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc474e67-135e-4c91-856e-afec7398384e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t6s72\" (UID: \"fc474e67-135e-4c91-856e-afec7398384e\") " pod="openshift-insights/insights-runtime-extractor-t6s72" May 27 21:08:34.181068 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:34.180863 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fc474e67-135e-4c91-856e-afec7398384e-crio-socket\") pod \"insights-runtime-extractor-t6s72\" (UID: \"fc474e67-135e-4c91-856e-afec7398384e\") " pod="openshift-insights/insights-runtime-extractor-t6s72" May 27 21:08:34.181068 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:34.180914 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc474e67-135e-4c91-856e-afec7398384e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t6s72\" (UID: \"fc474e67-135e-4c91-856e-afec7398384e\") " pod="openshift-insights/insights-runtime-extractor-t6s72" May 27 21:08:34.181068 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:34.181014 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpqtl\" (UniqueName: \"kubernetes.io/projected/fc474e67-135e-4c91-856e-afec7398384e-kube-api-access-cpqtl\") pod \"insights-runtime-extractor-t6s72\" (UID: \"fc474e67-135e-4c91-856e-afec7398384e\") " pod="openshift-insights/insights-runtime-extractor-t6s72" May 27 21:08:34.281863 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:34.281828 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cpqtl\" (UniqueName: \"kubernetes.io/projected/fc474e67-135e-4c91-856e-afec7398384e-kube-api-access-cpqtl\") pod \"insights-runtime-extractor-t6s72\" (UID: \"fc474e67-135e-4c91-856e-afec7398384e\") " pod="openshift-insights/insights-runtime-extractor-t6s72" May 27 21:08:34.281992 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:34.281877 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc474e67-135e-4c91-856e-afec7398384e-data-volume\") pod \"insights-runtime-extractor-t6s72\" (UID: \"fc474e67-135e-4c91-856e-afec7398384e\") " pod="openshift-insights/insights-runtime-extractor-t6s72" May 27 21:08:34.281992 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:34.281895 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc474e67-135e-4c91-856e-afec7398384e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t6s72\" (UID: \"fc474e67-135e-4c91-856e-afec7398384e\") " pod="openshift-insights/insights-runtime-extractor-t6s72" May 27 21:08:34.281992 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:34.281955 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fc474e67-135e-4c91-856e-afec7398384e-crio-socket\") pod \"insights-runtime-extractor-t6s72\" (UID: \"fc474e67-135e-4c91-856e-afec7398384e\") " pod="openshift-insights/insights-runtime-extractor-t6s72" May 27 21:08:34.282160 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:34.281995 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc474e67-135e-4c91-856e-afec7398384e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t6s72\" (UID: \"fc474e67-135e-4c91-856e-afec7398384e\") " pod="openshift-insights/insights-runtime-extractor-t6s72" May 27 21:08:34.282160 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:08:34.282126 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 27 21:08:34.282160 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:34.282127 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fc474e67-135e-4c91-856e-afec7398384e-crio-socket\") pod \"insights-runtime-extractor-t6s72\" (UID: \"fc474e67-135e-4c91-856e-afec7398384e\") " pod="openshift-insights/insights-runtime-extractor-t6s72" May 27 21:08:34.282266 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:34.282187 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc474e67-135e-4c91-856e-afec7398384e-data-volume\") pod \"insights-runtime-extractor-t6s72\" (UID: \"fc474e67-135e-4c91-856e-afec7398384e\") " pod="openshift-insights/insights-runtime-extractor-t6s72" May 27 21:08:34.282266 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:08:34.282191 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc474e67-135e-4c91-856e-afec7398384e-insights-runtime-extractor-tls podName:fc474e67-135e-4c91-856e-afec7398384e nodeName:}" failed. No retries permitted until 2026-05-27 21:08:34.782171242 +0000 UTC m=+139.401557027 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fc474e67-135e-4c91-856e-afec7398384e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t6s72" (UID: "fc474e67-135e-4c91-856e-afec7398384e") : secret "insights-runtime-extractor-tls" not found May 27 21:08:34.282436 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:34.282420 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc474e67-135e-4c91-856e-afec7398384e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t6s72\" (UID: \"fc474e67-135e-4c91-856e-afec7398384e\") " pod="openshift-insights/insights-runtime-extractor-t6s72" May 27 21:08:34.293826 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:34.293774 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpqtl\" (UniqueName: \"kubernetes.io/projected/fc474e67-135e-4c91-856e-afec7398384e-kube-api-access-cpqtl\") pod \"insights-runtime-extractor-t6s72\" (UID: \"fc474e67-135e-4c91-856e-afec7398384e\") " pod="openshift-insights/insights-runtime-extractor-t6s72" May 27 21:08:34.534176 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:34.534141 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-rrcjv" event={"ID":"e52f464a-d258-43ed-8f4f-9605f15b3c4f","Type":"ContainerStarted","Data":"d72e08dd074f779b610054b51c2b7f9cf7a4066b8afb12190643808ed2aa5245"} May 27 21:08:34.787203 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:34.787165 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc474e67-135e-4c91-856e-afec7398384e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t6s72\" (UID: \"fc474e67-135e-4c91-856e-afec7398384e\") " pod="openshift-insights/insights-runtime-extractor-t6s72" May 27 21:08:34.787383 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:08:34.787296 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 27 21:08:34.787383 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:08:34.787365 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc474e67-135e-4c91-856e-afec7398384e-insights-runtime-extractor-tls podName:fc474e67-135e-4c91-856e-afec7398384e nodeName:}" failed. No retries permitted until 2026-05-27 21:08:35.787350707 +0000 UTC m=+140.406736471 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fc474e67-135e-4c91-856e-afec7398384e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t6s72" (UID: "fc474e67-135e-4c91-856e-afec7398384e") : secret "insights-runtime-extractor-tls" not found May 27 21:08:35.537865 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:35.537837 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-rrcjv" event={"ID":"e52f464a-d258-43ed-8f4f-9605f15b3c4f","Type":"ContainerStarted","Data":"51132cc15ce330212aaec8e86642df565ff1e31754840c50b15e683a5c5755fe"} May 27 21:08:35.795567 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:35.795479 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc474e67-135e-4c91-856e-afec7398384e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t6s72\" (UID: \"fc474e67-135e-4c91-856e-afec7398384e\") " pod="openshift-insights/insights-runtime-extractor-t6s72" May 27 21:08:35.795707 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:08:35.795638 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 27 21:08:35.795742 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:08:35.795708 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc474e67-135e-4c91-856e-afec7398384e-insights-runtime-extractor-tls podName:fc474e67-135e-4c91-856e-afec7398384e nodeName:}" failed. No retries permitted until 2026-05-27 21:08:37.795691204 +0000 UTC m=+142.415076972 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fc474e67-135e-4c91-856e-afec7398384e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t6s72" (UID: "fc474e67-135e-4c91-856e-afec7398384e") : secret "insights-runtime-extractor-tls" not found May 27 21:08:36.541657 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:36.541620 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-rrcjv" event={"ID":"e52f464a-d258-43ed-8f4f-9605f15b3c4f","Type":"ContainerStarted","Data":"50ebc22ed2ab5dc69feeee2b6f7b703678b84a554f038c1830eb57ff2eeb5505"} May 27 21:08:36.559648 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:36.559598 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-rrcjv" podStartSLOduration=2.183826838 podStartE2EDuration="3.559583233s" podCreationTimestamp="2026-05-27 21:08:33 +0000 UTC" firstStartedPulling="2026-05-27 21:08:34.043645529 +0000 UTC m=+138.663031291" lastFinishedPulling="2026-05-27 21:08:35.41940192 +0000 UTC m=+140.038787686" observedRunningTime="2026-05-27 21:08:36.559470005 +0000 UTC m=+141.178855804" watchObservedRunningTime="2026-05-27 21:08:36.559583233 +0000 UTC m=+141.178969017" May 27 21:08:37.336845 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:37.336801 2566 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-fvw7h" May 27 21:08:37.336845 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:37.336839 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-fvw7h" May 27 21:08:37.337255 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:37.337241 2566 scope.go:117] "RemoveContainer" containerID="ee20e064d2cccf5ff218eb318403d9bf81c92560cd094dd4f8ab7d9f9a1095bf" May 27 21:08:37.337434 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:08:37.337416 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-fvw7h_openshift-console-operator(0a60edfe-34bf-4d4f-8244-f08a7a0f3f06)\"" pod="openshift-console-operator/console-operator-76dff48d59-fvw7h" podUID="0a60edfe-34bf-4d4f-8244-f08a7a0f3f06" May 27 21:08:37.810550 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:37.810518 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc474e67-135e-4c91-856e-afec7398384e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t6s72\" (UID: \"fc474e67-135e-4c91-856e-afec7398384e\") " pod="openshift-insights/insights-runtime-extractor-t6s72" May 27 21:08:37.810956 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:08:37.810675 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 27 21:08:37.810956 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:08:37.810748 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc474e67-135e-4c91-856e-afec7398384e-insights-runtime-extractor-tls podName:fc474e67-135e-4c91-856e-afec7398384e nodeName:}" failed. No retries permitted until 2026-05-27 21:08:41.810731471 +0000 UTC m=+146.430117234 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fc474e67-135e-4c91-856e-afec7398384e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t6s72" (UID: "fc474e67-135e-4c91-856e-afec7398384e") : secret "insights-runtime-extractor-tls" not found May 27 21:08:41.842932 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:41.842886 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc474e67-135e-4c91-856e-afec7398384e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t6s72\" (UID: \"fc474e67-135e-4c91-856e-afec7398384e\") " pod="openshift-insights/insights-runtime-extractor-t6s72" May 27 21:08:41.843328 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:08:41.843059 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 27 21:08:41.843328 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:08:41.843122 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc474e67-135e-4c91-856e-afec7398384e-insights-runtime-extractor-tls podName:fc474e67-135e-4c91-856e-afec7398384e nodeName:}" failed. No retries permitted until 2026-05-27 21:08:49.843104518 +0000 UTC m=+154.462490298 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fc474e67-135e-4c91-856e-afec7398384e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t6s72" (UID: "fc474e67-135e-4c91-856e-afec7398384e") : secret "insights-runtime-extractor-tls" not found May 27 21:08:49.904160 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:49.904099 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc474e67-135e-4c91-856e-afec7398384e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t6s72\" (UID: \"fc474e67-135e-4c91-856e-afec7398384e\") " pod="openshift-insights/insights-runtime-extractor-t6s72" May 27 21:08:49.906435 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:49.906412 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc474e67-135e-4c91-856e-afec7398384e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t6s72\" (UID: \"fc474e67-135e-4c91-856e-afec7398384e\") " pod="openshift-insights/insights-runtime-extractor-t6s72" May 27 21:08:49.951469 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:49.951424 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t6s72" May 27 21:08:50.077675 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:50.077642 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t6s72"] May 27 21:08:50.081290 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:08:50.081256 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc474e67_135e_4c91_856e_afec7398384e.slice/crio-baf2769c8bff28d39affa0348e8e0d3c3715eb863beb7e9c8ca9c6786e982b05 WatchSource:0}: Error finding container baf2769c8bff28d39affa0348e8e0d3c3715eb863beb7e9c8ca9c6786e982b05: Status 404 returned error can't find the container with id baf2769c8bff28d39affa0348e8e0d3c3715eb863beb7e9c8ca9c6786e982b05 May 27 21:08:50.578222 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:50.578172 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t6s72" event={"ID":"fc474e67-135e-4c91-856e-afec7398384e","Type":"ContainerStarted","Data":"db580065d2cbdea7540825abb8130cdc9ced9e13c2323574002e8aad78106508"} May 27 21:08:50.578222 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:50.578226 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t6s72" event={"ID":"fc474e67-135e-4c91-856e-afec7398384e","Type":"ContainerStarted","Data":"baf2769c8bff28d39affa0348e8e0d3c3715eb863beb7e9c8ca9c6786e982b05"} May 27 21:08:51.026527 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:51.026489 2566 scope.go:117] "RemoveContainer" containerID="ee20e064d2cccf5ff218eb318403d9bf81c92560cd094dd4f8ab7d9f9a1095bf" May 27 21:08:51.582633 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:51.582606 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fvw7h_0a60edfe-34bf-4d4f-8244-f08a7a0f3f06/console-operator/1.log" May 27 21:08:51.582840 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:51.582740 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-fvw7h" event={"ID":"0a60edfe-34bf-4d4f-8244-f08a7a0f3f06","Type":"ContainerStarted","Data":"df9865a7af5e002d7cfffdf0e8b607d6397af2ca3705e7193b3af997677f35c4"} May 27 21:08:51.583089 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:51.583066 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-fvw7h" May 27 21:08:51.584632 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:51.584608 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t6s72" event={"ID":"fc474e67-135e-4c91-856e-afec7398384e","Type":"ContainerStarted","Data":"479ea0328ef06e26da6e6ac430b86152b94abca514871112b577c01e46026931"} May 27 21:08:51.587774 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:51.587754 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-fvw7h" May 27 21:08:51.605555 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:51.605508 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-fvw7h" podStartSLOduration=22.329548161 podStartE2EDuration="25.605495599s" podCreationTimestamp="2026-05-27 21:08:26 +0000 UTC" firstStartedPulling="2026-05-27 21:08:27.696205523 +0000 UTC m=+132.315591286" lastFinishedPulling="2026-05-27 21:08:30.972152949 +0000 UTC m=+135.591538724" observedRunningTime="2026-05-27 21:08:51.605253881 +0000 UTC m=+156.224639667" watchObservedRunningTime="2026-05-27 21:08:51.605495599 +0000 UTC m=+156.224881385" May 27 21:08:52.588940 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:52.588900 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t6s72" event={"ID":"fc474e67-135e-4c91-856e-afec7398384e","Type":"ContainerStarted","Data":"dc795cd4a276efd07d60a53b7a742bf28f869dd0fa330d8378f2ff2aad36e278"} May 27 21:08:52.612720 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:52.612674 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-t6s72" podStartSLOduration=16.485675131 podStartE2EDuration="18.612658291s" podCreationTimestamp="2026-05-27 21:08:34 +0000 UTC" firstStartedPulling="2026-05-27 21:08:50.138542734 +0000 UTC m=+154.757928496" lastFinishedPulling="2026-05-27 21:08:52.265525893 +0000 UTC m=+156.884911656" observedRunningTime="2026-05-27 21:08:52.612313156 +0000 UTC m=+157.231698941" watchObservedRunningTime="2026-05-27 21:08:52.612658291 +0000 UTC m=+157.232044076" May 27 21:08:53.261935 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:08:53.261887 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-n4mw8" podUID="ac701952-aba5-4b19-8037-2e1b598413ce" May 27 21:08:53.274079 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:08:53.274044 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-j2sdl" podUID="5908789d-9a0e-402a-af5b-9cece18e09cb" May 27 21:08:53.591186 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:53.591144 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n4mw8" May 27 21:08:54.039944 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:08:54.039857 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-b7dq5" podUID="5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1" May 27 21:08:55.301314 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.301281 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-78fc6f67d8-6s6ws"] May 27 21:08:55.304168 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.304143 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78fc6f67d8-6s6ws" May 27 21:08:55.310702 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.310164 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 27 21:08:55.310702 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.310234 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 27 21:08:55.310850 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.310772 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xgcft\"" May 27 21:08:55.310958 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.310940 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 27 21:08:55.321302 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.321274 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78fc6f67d8-6s6ws"] May 27 21:08:55.324865 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.324841 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 27 21:08:55.339723 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.339696 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dfeec37d-fd68-4fd3-8049-88baf0126e0b-bound-sa-token\") pod \"image-registry-78fc6f67d8-6s6ws\" (UID: \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\") " pod="openshift-image-registry/image-registry-78fc6f67d8-6s6ws" May 27 21:08:55.339866 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.339739 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dfeec37d-fd68-4fd3-8049-88baf0126e0b-trusted-ca\") pod \"image-registry-78fc6f67d8-6s6ws\" (UID: \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\") " pod="openshift-image-registry/image-registry-78fc6f67d8-6s6ws" May 27 21:08:55.339866 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.339829 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dfeec37d-fd68-4fd3-8049-88baf0126e0b-registry-tls\") pod \"image-registry-78fc6f67d8-6s6ws\" (UID: \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\") " pod="openshift-image-registry/image-registry-78fc6f67d8-6s6ws" May 27 21:08:55.339941 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.339874 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc7wt\" (UniqueName: \"kubernetes.io/projected/dfeec37d-fd68-4fd3-8049-88baf0126e0b-kube-api-access-dc7wt\") pod \"image-registry-78fc6f67d8-6s6ws\" (UID: \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\") " pod="openshift-image-registry/image-registry-78fc6f67d8-6s6ws" May 27 21:08:55.339941 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.339900 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dfeec37d-fd68-4fd3-8049-88baf0126e0b-installation-pull-secrets\") pod \"image-registry-78fc6f67d8-6s6ws\" (UID: \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\") " pod="openshift-image-registry/image-registry-78fc6f67d8-6s6ws" May 27 21:08:55.339941 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.339933 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dfeec37d-fd68-4fd3-8049-88baf0126e0b-ca-trust-extracted\") pod \"image-registry-78fc6f67d8-6s6ws\" (UID: \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\") " pod="openshift-image-registry/image-registry-78fc6f67d8-6s6ws" May 27 21:08:55.340059 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.339952 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dfeec37d-fd68-4fd3-8049-88baf0126e0b-image-registry-private-configuration\") pod \"image-registry-78fc6f67d8-6s6ws\" (UID: \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\") " pod="openshift-image-registry/image-registry-78fc6f67d8-6s6ws" May 27 21:08:55.340059 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.339972 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dfeec37d-fd68-4fd3-8049-88baf0126e0b-registry-certificates\") pod \"image-registry-78fc6f67d8-6s6ws\" (UID: \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\") " pod="openshift-image-registry/image-registry-78fc6f67d8-6s6ws" May 27 21:08:55.342180 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.342156 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78fc6f67d8-6s6ws"] May 27 21:08:55.342346 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:08:55.342325 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-dc7wt registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-78fc6f67d8-6s6ws" podUID="dfeec37d-fd68-4fd3-8049-88baf0126e0b" May 27 21:08:55.400609 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.400572 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-xw8r7"] May 27 21:08:55.402250 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.402233 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-z7ztr"] May 27 21:08:55.402399 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.402381 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-xw8r7" May 27 21:08:55.403841 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.403823 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-z7ztr" May 27 21:08:55.404840 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.404825 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 27 21:08:55.405932 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.405919 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 27 21:08:55.406186 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.406168 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-64ssc\"" May 27 21:08:55.408626 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.408601 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-td8tf\"" May 27 21:08:55.420383 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.420359 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-z7ztr"] May 27 21:08:55.421624 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.421604 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-xw8r7"] May 27 21:08:55.440750 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.440714 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dfeec37d-fd68-4fd3-8049-88baf0126e0b-registry-tls\") pod \"image-registry-78fc6f67d8-6s6ws\" (UID: \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\") " pod="openshift-image-registry/image-registry-78fc6f67d8-6s6ws" May 27 21:08:55.440888 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.440773 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dc7wt\" (UniqueName: \"kubernetes.io/projected/dfeec37d-fd68-4fd3-8049-88baf0126e0b-kube-api-access-dc7wt\") pod \"image-registry-78fc6f67d8-6s6ws\" (UID: \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\") " pod="openshift-image-registry/image-registry-78fc6f67d8-6s6ws" May 27 21:08:55.440888 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.440812 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dfeec37d-fd68-4fd3-8049-88baf0126e0b-installation-pull-secrets\") pod \"image-registry-78fc6f67d8-6s6ws\" (UID: \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\") " pod="openshift-image-registry/image-registry-78fc6f67d8-6s6ws" May 27 21:08:55.440888 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.440847 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dfeec37d-fd68-4fd3-8049-88baf0126e0b-ca-trust-extracted\") pod \"image-registry-78fc6f67d8-6s6ws\" (UID: \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\") " pod="openshift-image-registry/image-registry-78fc6f67d8-6s6ws" May 27 21:08:55.440888 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.440867 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dfeec37d-fd68-4fd3-8049-88baf0126e0b-image-registry-private-configuration\") pod \"image-registry-78fc6f67d8-6s6ws\" (UID: \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\") " pod="openshift-image-registry/image-registry-78fc6f67d8-6s6ws" May 27 21:08:55.440888 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.440887 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dfeec37d-fd68-4fd3-8049-88baf0126e0b-registry-certificates\") pod \"image-registry-78fc6f67d8-6s6ws\" (UID: \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\") " pod="openshift-image-registry/image-registry-78fc6f67d8-6s6ws" May 27 21:08:55.441158 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.440917 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-627zg\" (UniqueName: \"kubernetes.io/projected/1a908ff9-383e-4537-9b2b-47c98cb684bc-kube-api-access-627zg\") pod \"network-check-source-7f44b6dd87-z7ztr\" (UID: \"1a908ff9-383e-4537-9b2b-47c98cb684bc\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-z7ztr" May 27 21:08:55.441158 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.441002 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dfeec37d-fd68-4fd3-8049-88baf0126e0b-bound-sa-token\") pod \"image-registry-78fc6f67d8-6s6ws\" (UID: \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\") " pod="openshift-image-registry/image-registry-78fc6f67d8-6s6ws" May 27 21:08:55.441250 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.441165 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dfeec37d-fd68-4fd3-8049-88baf0126e0b-trusted-ca\") pod \"image-registry-78fc6f67d8-6s6ws\" (UID: \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\") " pod="openshift-image-registry/image-registry-78fc6f67d8-6s6ws" May 27 21:08:55.441315 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.441285 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dfeec37d-fd68-4fd3-8049-88baf0126e0b-ca-trust-extracted\") pod \"image-registry-78fc6f67d8-6s6ws\" (UID: \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\") " pod="openshift-image-registry/image-registry-78fc6f67d8-6s6ws" May 27 21:08:55.441889 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.441861 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dfeec37d-fd68-4fd3-8049-88baf0126e0b-registry-certificates\") pod \"image-registry-78fc6f67d8-6s6ws\" (UID: \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\") " pod="openshift-image-registry/image-registry-78fc6f67d8-6s6ws" May 27 21:08:55.442343 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.442323 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dfeec37d-fd68-4fd3-8049-88baf0126e0b-trusted-ca\") pod \"image-registry-78fc6f67d8-6s6ws\" (UID: \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\") " pod="openshift-image-registry/image-registry-78fc6f67d8-6s6ws" May 27 21:08:55.443597 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.443573 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dfeec37d-fd68-4fd3-8049-88baf0126e0b-installation-pull-secrets\") pod \"image-registry-78fc6f67d8-6s6ws\" (UID: \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\") " pod="openshift-image-registry/image-registry-78fc6f67d8-6s6ws" May 27 21:08:55.443682 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.443597 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dfeec37d-fd68-4fd3-8049-88baf0126e0b-registry-tls\") pod \"image-registry-78fc6f67d8-6s6ws\" (UID: \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\") " pod="openshift-image-registry/image-registry-78fc6f67d8-6s6ws" May 27 21:08:55.443731 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.443716 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dfeec37d-fd68-4fd3-8049-88baf0126e0b-image-registry-private-configuration\") pod \"image-registry-78fc6f67d8-6s6ws\" (UID: \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\") " pod="openshift-image-registry/image-registry-78fc6f67d8-6s6ws" May 27 21:08:55.462958 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.462922 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc7wt\" (UniqueName: \"kubernetes.io/projected/dfeec37d-fd68-4fd3-8049-88baf0126e0b-kube-api-access-dc7wt\") pod \"image-registry-78fc6f67d8-6s6ws\" (UID: \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\") " pod="openshift-image-registry/image-registry-78fc6f67d8-6s6ws" May 27 21:08:55.463101 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.463000 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dfeec37d-fd68-4fd3-8049-88baf0126e0b-bound-sa-token\") pod \"image-registry-78fc6f67d8-6s6ws\" (UID: \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\") " pod="openshift-image-registry/image-registry-78fc6f67d8-6s6ws" May 27 21:08:55.542213 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.542178 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-627zg\" (UniqueName: \"kubernetes.io/projected/1a908ff9-383e-4537-9b2b-47c98cb684bc-kube-api-access-627zg\") pod \"network-check-source-7f44b6dd87-z7ztr\" (UID: \"1a908ff9-383e-4537-9b2b-47c98cb684bc\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-z7ztr" May 27 21:08:55.542400 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.542278 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbmx5\" (UniqueName: \"kubernetes.io/projected/8c01813f-aad3-4011-a23f-2e4e98cb4c26-kube-api-access-kbmx5\") pod \"downloads-57bd96b888-xw8r7\" (UID: \"8c01813f-aad3-4011-a23f-2e4e98cb4c26\") " pod="openshift-console/downloads-57bd96b888-xw8r7" May 27 21:08:55.557500 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.557468 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-627zg\" (UniqueName: \"kubernetes.io/projected/1a908ff9-383e-4537-9b2b-47c98cb684bc-kube-api-access-627zg\") pod \"network-check-source-7f44b6dd87-z7ztr\" (UID: \"1a908ff9-383e-4537-9b2b-47c98cb684bc\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-z7ztr" May 27 21:08:55.597369 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.597332 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78fc6f67d8-6s6ws" May 27 21:08:55.601769 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.601744 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78fc6f67d8-6s6ws" May 27 21:08:55.643314 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.643270 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dfeec37d-fd68-4fd3-8049-88baf0126e0b-image-registry-private-configuration\") pod \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\" (UID: \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\") " May 27 21:08:55.643503 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.643324 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dc7wt\" (UniqueName: \"kubernetes.io/projected/dfeec37d-fd68-4fd3-8049-88baf0126e0b-kube-api-access-dc7wt\") pod \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\" (UID: \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\") " May 27 21:08:55.643503 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.643348 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dfeec37d-fd68-4fd3-8049-88baf0126e0b-registry-certificates\") pod \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\" (UID: \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\") " May 27 21:08:55.643503 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.643375 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dfeec37d-fd68-4fd3-8049-88baf0126e0b-ca-trust-extracted\") pod \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\" (UID: \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\") " May 27 21:08:55.643503 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.643437 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dfeec37d-fd68-4fd3-8049-88baf0126e0b-trusted-ca\") pod \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\" (UID: \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\") " May 27 21:08:55.643503 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.643458 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dfeec37d-fd68-4fd3-8049-88baf0126e0b-registry-tls\") pod \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\" (UID: \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\") " May 27 21:08:55.643503 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.643479 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dfeec37d-fd68-4fd3-8049-88baf0126e0b-installation-pull-secrets\") pod \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\" (UID: \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\") " May 27 21:08:55.643783 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.643503 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dfeec37d-fd68-4fd3-8049-88baf0126e0b-bound-sa-token\") pod \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\" (UID: \"dfeec37d-fd68-4fd3-8049-88baf0126e0b\") " May 27 21:08:55.643783 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.643596 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kbmx5\" (UniqueName: \"kubernetes.io/projected/8c01813f-aad3-4011-a23f-2e4e98cb4c26-kube-api-access-kbmx5\") pod \"downloads-57bd96b888-xw8r7\" (UID: \"8c01813f-aad3-4011-a23f-2e4e98cb4c26\") " pod="openshift-console/downloads-57bd96b888-xw8r7" May 27 21:08:55.643783 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.643743 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfeec37d-fd68-4fd3-8049-88baf0126e0b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "dfeec37d-fd68-4fd3-8049-88baf0126e0b" (UID: "dfeec37d-fd68-4fd3-8049-88baf0126e0b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:08:55.643915 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.643822 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfeec37d-fd68-4fd3-8049-88baf0126e0b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "dfeec37d-fd68-4fd3-8049-88baf0126e0b" (UID: "dfeec37d-fd68-4fd3-8049-88baf0126e0b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:08:55.643915 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.643894 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfeec37d-fd68-4fd3-8049-88baf0126e0b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "dfeec37d-fd68-4fd3-8049-88baf0126e0b" (UID: "dfeec37d-fd68-4fd3-8049-88baf0126e0b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:08:55.645797 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.645767 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfeec37d-fd68-4fd3-8049-88baf0126e0b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "dfeec37d-fd68-4fd3-8049-88baf0126e0b" (UID: "dfeec37d-fd68-4fd3-8049-88baf0126e0b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:08:55.645917 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.645812 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfeec37d-fd68-4fd3-8049-88baf0126e0b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "dfeec37d-fd68-4fd3-8049-88baf0126e0b" (UID: "dfeec37d-fd68-4fd3-8049-88baf0126e0b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:08:55.645917 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.645821 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfeec37d-fd68-4fd3-8049-88baf0126e0b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "dfeec37d-fd68-4fd3-8049-88baf0126e0b" (UID: "dfeec37d-fd68-4fd3-8049-88baf0126e0b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:08:55.646006 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.645921 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfeec37d-fd68-4fd3-8049-88baf0126e0b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "dfeec37d-fd68-4fd3-8049-88baf0126e0b" (UID: "dfeec37d-fd68-4fd3-8049-88baf0126e0b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:08:55.646006 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.645924 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfeec37d-fd68-4fd3-8049-88baf0126e0b-kube-api-access-dc7wt" (OuterVolumeSpecName: "kube-api-access-dc7wt") pod "dfeec37d-fd68-4fd3-8049-88baf0126e0b" (UID: "dfeec37d-fd68-4fd3-8049-88baf0126e0b"). InnerVolumeSpecName "kube-api-access-dc7wt". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:08:55.652870 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.652850 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbmx5\" (UniqueName: \"kubernetes.io/projected/8c01813f-aad3-4011-a23f-2e4e98cb4c26-kube-api-access-kbmx5\") pod \"downloads-57bd96b888-xw8r7\" (UID: \"8c01813f-aad3-4011-a23f-2e4e98cb4c26\") " pod="openshift-console/downloads-57bd96b888-xw8r7" May 27 21:08:55.713095 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.713057 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-xw8r7" May 27 21:08:55.717817 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.717792 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-z7ztr" May 27 21:08:55.744429 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.744390 2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dfeec37d-fd68-4fd3-8049-88baf0126e0b-installation-pull-secrets\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:08:55.744429 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.744434 2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dfeec37d-fd68-4fd3-8049-88baf0126e0b-bound-sa-token\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:08:55.744629 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.744452 2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dfeec37d-fd68-4fd3-8049-88baf0126e0b-image-registry-private-configuration\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:08:55.744629 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.744467 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dc7wt\" (UniqueName: \"kubernetes.io/projected/dfeec37d-fd68-4fd3-8049-88baf0126e0b-kube-api-access-dc7wt\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:08:55.744629 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.744481 2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dfeec37d-fd68-4fd3-8049-88baf0126e0b-registry-certificates\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:08:55.744629 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.744496 2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dfeec37d-fd68-4fd3-8049-88baf0126e0b-ca-trust-extracted\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:08:55.744629 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.744510 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dfeec37d-fd68-4fd3-8049-88baf0126e0b-trusted-ca\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:08:55.744629 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.744524 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dfeec37d-fd68-4fd3-8049-88baf0126e0b-registry-tls\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:08:55.868332 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.868297 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-xw8r7"] May 27 21:08:55.872276 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:08:55.872248 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c01813f_aad3_4011_a23f_2e4e98cb4c26.slice/crio-aec0d826d6287c747b0729ab9fc2acef02857525a9a517e23ea94fae3f9036f5 WatchSource:0}: Error finding container aec0d826d6287c747b0729ab9fc2acef02857525a9a517e23ea94fae3f9036f5: Status 404 returned error can't find the container with id aec0d826d6287c747b0729ab9fc2acef02857525a9a517e23ea94fae3f9036f5 May 27 21:08:55.881834 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:55.881811 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-z7ztr"] May 27 21:08:55.884849 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:08:55.884827 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a908ff9_383e_4537_9b2b_47c98cb684bc.slice/crio-2247677b6b19b39002b503bf3b4e6495625db5639847b6215ddfb020423cc7cc WatchSource:0}: Error finding container 2247677b6b19b39002b503bf3b4e6495625db5639847b6215ddfb020423cc7cc: Status 404 returned error can't find the container with id 2247677b6b19b39002b503bf3b4e6495625db5639847b6215ddfb020423cc7cc May 27 21:08:56.601223 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:56.601188 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-z7ztr" event={"ID":"1a908ff9-383e-4537-9b2b-47c98cb684bc","Type":"ContainerStarted","Data":"04d443f7b1361c082703b7e231613f12b8b6e8eb180586ad478e966d2ae3dc9b"} May 27 21:08:56.601223 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:56.601228 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-z7ztr" event={"ID":"1a908ff9-383e-4537-9b2b-47c98cb684bc","Type":"ContainerStarted","Data":"2247677b6b19b39002b503bf3b4e6495625db5639847b6215ddfb020423cc7cc"} May 27 21:08:56.602269 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:56.602240 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-xw8r7" event={"ID":"8c01813f-aad3-4011-a23f-2e4e98cb4c26","Type":"ContainerStarted","Data":"aec0d826d6287c747b0729ab9fc2acef02857525a9a517e23ea94fae3f9036f5"} May 27 21:08:56.602351 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:56.602257 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78fc6f67d8-6s6ws" May 27 21:08:56.618078 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:56.618011 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-z7ztr" podStartSLOduration=1.617997334 podStartE2EDuration="1.617997334s" podCreationTimestamp="2026-05-27 21:08:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:08:56.617139163 +0000 UTC m=+161.236524949" watchObservedRunningTime="2026-05-27 21:08:56.617997334 +0000 UTC m=+161.237383153" May 27 21:08:56.645968 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:56.645941 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78fc6f67d8-6s6ws"] May 27 21:08:56.656283 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:56.656259 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-78fc6f67d8-6s6ws"] May 27 21:08:57.810058 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:57.809953 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-q7szz"] May 27 21:08:57.812481 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:57.812454 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-q7szz" May 27 21:08:57.814840 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:57.814820 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 27 21:08:57.815573 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:57.815543 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 27 21:08:57.815651 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:57.815576 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 27 21:08:57.815651 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:57.815618 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 27 21:08:57.815651 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:57.815636 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 27 21:08:57.815791 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:57.815636 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-72n65\"" May 27 21:08:57.823636 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:57.823614 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-q7szz"] May 27 21:08:57.859871 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:57.859839 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42805e5a-68b3-424d-80cd-3a0e9597c73e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-q7szz\" (UID: \"42805e5a-68b3-424d-80cd-3a0e9597c73e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-q7szz" May 27 21:08:57.860056 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:57.859903 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzq9g\" (UniqueName: \"kubernetes.io/projected/42805e5a-68b3-424d-80cd-3a0e9597c73e-kube-api-access-vzq9g\") pod \"prometheus-operator-7779bbdd78-q7szz\" (UID: \"42805e5a-68b3-424d-80cd-3a0e9597c73e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-q7szz" May 27 21:08:57.860056 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:57.860009 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/42805e5a-68b3-424d-80cd-3a0e9597c73e-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-q7szz\" (UID: \"42805e5a-68b3-424d-80cd-3a0e9597c73e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-q7szz" May 27 21:08:57.860160 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:57.860098 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42805e5a-68b3-424d-80cd-3a0e9597c73e-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-q7szz\" (UID: \"42805e5a-68b3-424d-80cd-3a0e9597c73e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-q7szz" May 27 21:08:57.960913 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:57.960875 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/42805e5a-68b3-424d-80cd-3a0e9597c73e-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-q7szz\" (UID: \"42805e5a-68b3-424d-80cd-3a0e9597c73e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-q7szz" May 27 21:08:57.961146 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:57.960941 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42805e5a-68b3-424d-80cd-3a0e9597c73e-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-q7szz\" (UID: \"42805e5a-68b3-424d-80cd-3a0e9597c73e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-q7szz" May 27 21:08:57.961146 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:57.960968 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42805e5a-68b3-424d-80cd-3a0e9597c73e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-q7szz\" (UID: \"42805e5a-68b3-424d-80cd-3a0e9597c73e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-q7szz" May 27 21:08:57.961146 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:57.961002 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vzq9g\" (UniqueName: \"kubernetes.io/projected/42805e5a-68b3-424d-80cd-3a0e9597c73e-kube-api-access-vzq9g\") pod \"prometheus-operator-7779bbdd78-q7szz\" (UID: \"42805e5a-68b3-424d-80cd-3a0e9597c73e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-q7szz" May 27 21:08:57.961146 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:08:57.961075 2566 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found May 27 21:08:57.961370 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:08:57.961174 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42805e5a-68b3-424d-80cd-3a0e9597c73e-prometheus-operator-tls podName:42805e5a-68b3-424d-80cd-3a0e9597c73e nodeName:}" failed. No retries permitted until 2026-05-27 21:08:58.461152826 +0000 UTC m=+163.080538606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/42805e5a-68b3-424d-80cd-3a0e9597c73e-prometheus-operator-tls") pod "prometheus-operator-7779bbdd78-q7szz" (UID: "42805e5a-68b3-424d-80cd-3a0e9597c73e") : secret "prometheus-operator-tls" not found May 27 21:08:57.961606 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:57.961588 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42805e5a-68b3-424d-80cd-3a0e9597c73e-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-q7szz\" (UID: \"42805e5a-68b3-424d-80cd-3a0e9597c73e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-q7szz" May 27 21:08:57.963534 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:57.963509 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42805e5a-68b3-424d-80cd-3a0e9597c73e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-q7szz\" (UID: \"42805e5a-68b3-424d-80cd-3a0e9597c73e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-q7szz" May 27 21:08:57.973186 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:57.973158 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzq9g\" (UniqueName: \"kubernetes.io/projected/42805e5a-68b3-424d-80cd-3a0e9597c73e-kube-api-access-vzq9g\") pod \"prometheus-operator-7779bbdd78-q7szz\" (UID: \"42805e5a-68b3-424d-80cd-3a0e9597c73e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-q7szz" May 27 21:08:58.028874 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:58.028838 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfeec37d-fd68-4fd3-8049-88baf0126e0b" path="/var/lib/kubelet/pods/dfeec37d-fd68-4fd3-8049-88baf0126e0b/volumes" May 27 21:08:58.163065 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:58.162963 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac701952-aba5-4b19-8037-2e1b598413ce-metrics-tls\") pod \"dns-default-n4mw8\" (UID: \"ac701952-aba5-4b19-8037-2e1b598413ce\") " pod="openshift-dns/dns-default-n4mw8" May 27 21:08:58.163065 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:58.163016 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5908789d-9a0e-402a-af5b-9cece18e09cb-cert\") pod \"ingress-canary-j2sdl\" (UID: \"5908789d-9a0e-402a-af5b-9cece18e09cb\") " pod="openshift-ingress-canary/ingress-canary-j2sdl" May 27 21:08:58.165437 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:58.165410 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac701952-aba5-4b19-8037-2e1b598413ce-metrics-tls\") pod \"dns-default-n4mw8\" (UID: \"ac701952-aba5-4b19-8037-2e1b598413ce\") " pod="openshift-dns/dns-default-n4mw8" May 27 21:08:58.165569 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:58.165551 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5908789d-9a0e-402a-af5b-9cece18e09cb-cert\") pod \"ingress-canary-j2sdl\" (UID: \"5908789d-9a0e-402a-af5b-9cece18e09cb\") " pod="openshift-ingress-canary/ingress-canary-j2sdl" May 27 21:08:58.395428 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:58.395386 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r8bdp\"" May 27 21:08:58.403340 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:58.403311 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n4mw8" May 27 21:08:58.466598 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:58.466119 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/42805e5a-68b3-424d-80cd-3a0e9597c73e-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-q7szz\" (UID: \"42805e5a-68b3-424d-80cd-3a0e9597c73e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-q7szz" May 27 21:08:58.469131 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:58.469109 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/42805e5a-68b3-424d-80cd-3a0e9597c73e-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-q7szz\" (UID: \"42805e5a-68b3-424d-80cd-3a0e9597c73e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-q7szz" May 27 21:08:58.534591 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:58.534559 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n4mw8"] May 27 21:08:58.537851 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:08:58.537817 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac701952_aba5_4b19_8037_2e1b598413ce.slice/crio-3d76e249ba7dc850c1f90175726024d5dfa80337d52d134802e3ff88791b05c5 WatchSource:0}: Error finding container 3d76e249ba7dc850c1f90175726024d5dfa80337d52d134802e3ff88791b05c5: Status 404 returned error can't find the container with id 3d76e249ba7dc850c1f90175726024d5dfa80337d52d134802e3ff88791b05c5 May 27 21:08:58.607572 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:58.607538 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n4mw8" event={"ID":"ac701952-aba5-4b19-8037-2e1b598413ce","Type":"ContainerStarted","Data":"3d76e249ba7dc850c1f90175726024d5dfa80337d52d134802e3ff88791b05c5"} May 27 21:08:58.724238 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:58.724150 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-q7szz" May 27 21:08:58.858547 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:58.858517 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-q7szz"] May 27 21:08:58.862008 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:08:58.861976 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42805e5a_68b3_424d_80cd_3a0e9597c73e.slice/crio-5dcb165d071d9b58b27c77d1465a7fc6a0a04dbe002fb58be14199c2e9616a03 WatchSource:0}: Error finding container 5dcb165d071d9b58b27c77d1465a7fc6a0a04dbe002fb58be14199c2e9616a03: Status 404 returned error can't find the container with id 5dcb165d071d9b58b27c77d1465a7fc6a0a04dbe002fb58be14199c2e9616a03 May 27 21:08:59.611958 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:08:59.611914 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-q7szz" event={"ID":"42805e5a-68b3-424d-80cd-3a0e9597c73e","Type":"ContainerStarted","Data":"5dcb165d071d9b58b27c77d1465a7fc6a0a04dbe002fb58be14199c2e9616a03"} May 27 21:09:00.616486 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:00.616444 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n4mw8" event={"ID":"ac701952-aba5-4b19-8037-2e1b598413ce","Type":"ContainerStarted","Data":"d38412dd684798a32e5a1e4c39ff60e000917027935d8d977931210234ed9bb0"} May 27 21:09:00.616949 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:00.616494 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n4mw8" event={"ID":"ac701952-aba5-4b19-8037-2e1b598413ce","Type":"ContainerStarted","Data":"4ae5d7766a206fb343709e24c358760c1cd73e7ae852331629d7bff643feb720"} May 27 21:09:00.616949 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:00.616634 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-n4mw8" May 27 21:09:00.635145 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:00.635084 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-n4mw8" podStartSLOduration=129.421326579 podStartE2EDuration="2m10.635064906s" podCreationTimestamp="2026-05-27 21:06:50 +0000 UTC" firstStartedPulling="2026-05-27 21:08:58.539717447 +0000 UTC m=+163.159103211" lastFinishedPulling="2026-05-27 21:08:59.75345576 +0000 UTC m=+164.372841538" observedRunningTime="2026-05-27 21:09:00.63442822 +0000 UTC m=+165.253814006" watchObservedRunningTime="2026-05-27 21:09:00.635064906 +0000 UTC m=+165.254450692" May 27 21:09:01.438338 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:01.438306 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-67b56c68c9-g7lvr"] May 27 21:09:01.440554 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:01.440529 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67b56c68c9-g7lvr" May 27 21:09:01.443556 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:01.443530 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 27 21:09:01.444533 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:01.444514 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rtrd4\"" May 27 21:09:01.444633 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:01.444547 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 27 21:09:01.444633 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:01.444580 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 27 21:09:01.444633 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:01.444514 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 27 21:09:01.444633 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:01.444547 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 27 21:09:01.452200 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:01.452166 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67b56c68c9-g7lvr"] May 27 21:09:01.494593 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:01.494562 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345-oauth-serving-cert\") pod \"console-67b56c68c9-g7lvr\" (UID: \"0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345\") " pod="openshift-console/console-67b56c68c9-g7lvr" May 27 21:09:01.494756 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:01.494610 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345-console-config\") pod \"console-67b56c68c9-g7lvr\" (UID: \"0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345\") " pod="openshift-console/console-67b56c68c9-g7lvr" May 27 21:09:01.494756 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:01.494632 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cprrm\" (UniqueName: \"kubernetes.io/projected/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345-kube-api-access-cprrm\") pod \"console-67b56c68c9-g7lvr\" (UID: \"0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345\") " pod="openshift-console/console-67b56c68c9-g7lvr" May 27 21:09:01.494756 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:01.494712 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345-service-ca\") pod \"console-67b56c68c9-g7lvr\" (UID: \"0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345\") " pod="openshift-console/console-67b56c68c9-g7lvr" May 27 21:09:01.494756 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:01.494744 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345-console-oauth-config\") pod \"console-67b56c68c9-g7lvr\" (UID: \"0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345\") " pod="openshift-console/console-67b56c68c9-g7lvr" May 27 21:09:01.494898 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:01.494804 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345-console-serving-cert\") pod \"console-67b56c68c9-g7lvr\" (UID: \"0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345\") " pod="openshift-console/console-67b56c68c9-g7lvr" May 27 21:09:01.595549 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:01.595512 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345-console-config\") pod \"console-67b56c68c9-g7lvr\" (UID: \"0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345\") " pod="openshift-console/console-67b56c68c9-g7lvr" May 27 21:09:01.595730 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:01.595562 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cprrm\" (UniqueName: \"kubernetes.io/projected/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345-kube-api-access-cprrm\") pod \"console-67b56c68c9-g7lvr\" (UID: \"0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345\") " pod="openshift-console/console-67b56c68c9-g7lvr" May 27 21:09:01.595730 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:01.595593 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345-service-ca\") pod \"console-67b56c68c9-g7lvr\" (UID: \"0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345\") " pod="openshift-console/console-67b56c68c9-g7lvr" May 27 21:09:01.595730 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:01.595610 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345-console-oauth-config\") pod \"console-67b56c68c9-g7lvr\" (UID: \"0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345\") " pod="openshift-console/console-67b56c68c9-g7lvr" May 27 21:09:01.595730 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:01.595661 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345-console-serving-cert\") pod \"console-67b56c68c9-g7lvr\" (UID: \"0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345\") " pod="openshift-console/console-67b56c68c9-g7lvr" May 27 21:09:01.595730 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:01.595703 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345-oauth-serving-cert\") pod \"console-67b56c68c9-g7lvr\" (UID: \"0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345\") " pod="openshift-console/console-67b56c68c9-g7lvr" May 27 21:09:01.596358 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:01.596325 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345-console-config\") pod \"console-67b56c68c9-g7lvr\" (UID: \"0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345\") " pod="openshift-console/console-67b56c68c9-g7lvr" May 27 21:09:01.596477 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:01.596398 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345-oauth-serving-cert\") pod \"console-67b56c68c9-g7lvr\" (UID: \"0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345\") " pod="openshift-console/console-67b56c68c9-g7lvr" May 27 21:09:01.596852 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:01.596774 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345-service-ca\") pod \"console-67b56c68c9-g7lvr\" (UID: \"0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345\") " pod="openshift-console/console-67b56c68c9-g7lvr" May 27 21:09:01.598881 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:01.598858 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345-console-oauth-config\") pod \"console-67b56c68c9-g7lvr\" (UID: \"0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345\") " pod="openshift-console/console-67b56c68c9-g7lvr" May 27 21:09:01.599001 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:01.598965 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345-console-serving-cert\") pod \"console-67b56c68c9-g7lvr\" (UID: \"0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345\") " pod="openshift-console/console-67b56c68c9-g7lvr" May 27 21:09:01.604932 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:01.604899 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cprrm\" (UniqueName: \"kubernetes.io/projected/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345-kube-api-access-cprrm\") pod \"console-67b56c68c9-g7lvr\" (UID: \"0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345\") " pod="openshift-console/console-67b56c68c9-g7lvr" May 27 21:09:01.620041 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:01.620000 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-q7szz" event={"ID":"42805e5a-68b3-424d-80cd-3a0e9597c73e","Type":"ContainerStarted","Data":"2a025c86210b535ca0c8b76ae712c0000b15e27c6b793e4a46684e827c5b2653"} May 27 21:09:01.620381 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:01.620061 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-q7szz" event={"ID":"42805e5a-68b3-424d-80cd-3a0e9597c73e","Type":"ContainerStarted","Data":"f007891339f0d5761ee6fefffef8e18b7270f8992db5a399271741ed066c7f1e"} May 27 21:09:01.639828 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:01.639780 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-q7szz" podStartSLOduration=2.8144087300000002 podStartE2EDuration="4.639765688s" podCreationTimestamp="2026-05-27 21:08:57 +0000 UTC" firstStartedPulling="2026-05-27 21:08:58.864565583 +0000 UTC m=+163.483951345" lastFinishedPulling="2026-05-27 21:09:00.689922528 +0000 UTC m=+165.309308303" observedRunningTime="2026-05-27 21:09:01.638456116 +0000 UTC m=+166.257841912" watchObservedRunningTime="2026-05-27 21:09:01.639765688 +0000 UTC m=+166.259151473" May 27 21:09:01.750688 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:01.750592 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67b56c68c9-g7lvr" May 27 21:09:01.897092 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:01.897058 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67b56c68c9-g7lvr"] May 27 21:09:01.899923 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:09:01.899889 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c7df3dc_5c4d_4ce1_8b96_09dc5c1a9345.slice/crio-61d102c59ee4354131536bf3c85533ecf16107d51849627b676ea78a9cb4fd70 WatchSource:0}: Error finding container 61d102c59ee4354131536bf3c85533ecf16107d51849627b676ea78a9cb4fd70: Status 404 returned error can't find the container with id 61d102c59ee4354131536bf3c85533ecf16107d51849627b676ea78a9cb4fd70 May 27 21:09:02.628831 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:02.628788 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67b56c68c9-g7lvr" event={"ID":"0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345","Type":"ContainerStarted","Data":"61d102c59ee4354131536bf3c85533ecf16107d51849627b676ea78a9cb4fd70"} May 27 21:09:03.174086 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.174023 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-lvnxd"] May 27 21:09:03.176406 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.176385 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-lvnxd" May 27 21:09:03.184114 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.182414 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 27 21:09:03.184114 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.182638 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 27 21:09:03.184114 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.183183 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-tqv2v\"" May 27 21:09:03.190737 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.190712 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-lvnxd"] May 27 21:09:03.211087 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.211054 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkxnt\" (UniqueName: \"kubernetes.io/projected/b878561d-7da1-4f5e-8f2e-1a30d47b68ae-kube-api-access-hkxnt\") pod \"openshift-state-metrics-9c959559f-lvnxd\" (UID: \"b878561d-7da1-4f5e-8f2e-1a30d47b68ae\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-lvnxd" May 27 21:09:03.211212 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.211101 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b878561d-7da1-4f5e-8f2e-1a30d47b68ae-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-lvnxd\" (UID: \"b878561d-7da1-4f5e-8f2e-1a30d47b68ae\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-lvnxd" May 27 21:09:03.211212 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.211120 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b878561d-7da1-4f5e-8f2e-1a30d47b68ae-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-lvnxd\" (UID: \"b878561d-7da1-4f5e-8f2e-1a30d47b68ae\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-lvnxd" May 27 21:09:03.211212 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.211181 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b878561d-7da1-4f5e-8f2e-1a30d47b68ae-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-lvnxd\" (UID: \"b878561d-7da1-4f5e-8f2e-1a30d47b68ae\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-lvnxd" May 27 21:09:03.228200 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.228175 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-48l8d"] May 27 21:09:03.230136 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.230120 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-48l8d" May 27 21:09:03.234987 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:09:03.234948 2566 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-dockercfg-krpk2\" is forbidden: User \"system:node:ip-10-0-130-116.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-130-116.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-krpk2\"" type="*v1.Secret" May 27 21:09:03.235101 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:09:03.235043 2566 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-tls\" is forbidden: User \"system:node:ip-10-0-130-116.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-130-116.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" type="*v1.Secret" May 27 21:09:03.235101 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:09:03.235022 2566 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-kube-rbac-proxy-config\" is forbidden: User \"system:node:ip-10-0-130-116.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-130-116.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" type="*v1.Secret" May 27 21:09:03.235237 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:09:03.235087 2566 reflector.go:200] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"node-exporter-accelerators-collector-config\" is forbidden: User \"system:node:ip-10-0-130-116.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-130-116.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" type="*v1.ConfigMap" May 27 21:09:03.312279 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.312249 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hkxnt\" (UniqueName: \"kubernetes.io/projected/b878561d-7da1-4f5e-8f2e-1a30d47b68ae-kube-api-access-hkxnt\") pod \"openshift-state-metrics-9c959559f-lvnxd\" (UID: \"b878561d-7da1-4f5e-8f2e-1a30d47b68ae\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-lvnxd" May 27 21:09:03.312431 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.312300 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/546b0029-85a2-4623-b927-f815a3725c53-sys\") pod \"node-exporter-48l8d\" (UID: \"546b0029-85a2-4623-b927-f815a3725c53\") " pod="openshift-monitoring/node-exporter-48l8d" May 27 21:09:03.312431 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.312336 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b878561d-7da1-4f5e-8f2e-1a30d47b68ae-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-lvnxd\" (UID: \"b878561d-7da1-4f5e-8f2e-1a30d47b68ae\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-lvnxd" May 27 21:09:03.312431 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.312362 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b878561d-7da1-4f5e-8f2e-1a30d47b68ae-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-lvnxd\" (UID: \"b878561d-7da1-4f5e-8f2e-1a30d47b68ae\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-lvnxd" May 27 21:09:03.312431 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.312389 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/546b0029-85a2-4623-b927-f815a3725c53-node-exporter-wtmp\") pod \"node-exporter-48l8d\" (UID: \"546b0029-85a2-4623-b927-f815a3725c53\") " pod="openshift-monitoring/node-exporter-48l8d" May 27 21:09:03.312686 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.312439 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qt2x\" (UniqueName: \"kubernetes.io/projected/546b0029-85a2-4623-b927-f815a3725c53-kube-api-access-2qt2x\") pod \"node-exporter-48l8d\" (UID: \"546b0029-85a2-4623-b927-f815a3725c53\") " pod="openshift-monitoring/node-exporter-48l8d" May 27 21:09:03.312686 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.312567 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/546b0029-85a2-4623-b927-f815a3725c53-node-exporter-tls\") pod \"node-exporter-48l8d\" (UID: \"546b0029-85a2-4623-b927-f815a3725c53\") " pod="openshift-monitoring/node-exporter-48l8d" May 27 21:09:03.312686 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.312617 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b878561d-7da1-4f5e-8f2e-1a30d47b68ae-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-lvnxd\" (UID: \"b878561d-7da1-4f5e-8f2e-1a30d47b68ae\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-lvnxd" May 27 21:09:03.312832 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.312712 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/546b0029-85a2-4623-b927-f815a3725c53-node-exporter-textfile\") pod \"node-exporter-48l8d\" (UID: \"546b0029-85a2-4623-b927-f815a3725c53\") " pod="openshift-monitoring/node-exporter-48l8d" May 27 21:09:03.312832 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.312759 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/546b0029-85a2-4623-b927-f815a3725c53-metrics-client-ca\") pod \"node-exporter-48l8d\" (UID: \"546b0029-85a2-4623-b927-f815a3725c53\") " pod="openshift-monitoring/node-exporter-48l8d" May 27 21:09:03.312832 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.312824 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/546b0029-85a2-4623-b927-f815a3725c53-node-exporter-accelerators-collector-config\") pod \"node-exporter-48l8d\" (UID: \"546b0029-85a2-4623-b927-f815a3725c53\") " pod="openshift-monitoring/node-exporter-48l8d" May 27 21:09:03.312980 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.312856 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/546b0029-85a2-4623-b927-f815a3725c53-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-48l8d\" (UID: \"546b0029-85a2-4623-b927-f815a3725c53\") " pod="openshift-monitoring/node-exporter-48l8d" May 27 21:09:03.312980 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.312954 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/546b0029-85a2-4623-b927-f815a3725c53-root\") pod \"node-exporter-48l8d\" (UID: \"546b0029-85a2-4623-b927-f815a3725c53\") " pod="openshift-monitoring/node-exporter-48l8d" May 27 21:09:03.313114 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.313099 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b878561d-7da1-4f5e-8f2e-1a30d47b68ae-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-lvnxd\" (UID: \"b878561d-7da1-4f5e-8f2e-1a30d47b68ae\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-lvnxd" May 27 21:09:03.314987 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.314963 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b878561d-7da1-4f5e-8f2e-1a30d47b68ae-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-lvnxd\" (UID: \"b878561d-7da1-4f5e-8f2e-1a30d47b68ae\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-lvnxd" May 27 21:09:03.315212 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.315188 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b878561d-7da1-4f5e-8f2e-1a30d47b68ae-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-lvnxd\" (UID: \"b878561d-7da1-4f5e-8f2e-1a30d47b68ae\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-lvnxd" May 27 21:09:03.327154 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.327130 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkxnt\" (UniqueName: \"kubernetes.io/projected/b878561d-7da1-4f5e-8f2e-1a30d47b68ae-kube-api-access-hkxnt\") pod \"openshift-state-metrics-9c959559f-lvnxd\" (UID: \"b878561d-7da1-4f5e-8f2e-1a30d47b68ae\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-lvnxd" May 27 21:09:03.414234 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.414189 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/546b0029-85a2-4623-b927-f815a3725c53-root\") pod \"node-exporter-48l8d\" (UID: \"546b0029-85a2-4623-b927-f815a3725c53\") " pod="openshift-monitoring/node-exporter-48l8d" May 27 21:09:03.414415 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.414256 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/546b0029-85a2-4623-b927-f815a3725c53-sys\") pod \"node-exporter-48l8d\" (UID: \"546b0029-85a2-4623-b927-f815a3725c53\") " pod="openshift-monitoring/node-exporter-48l8d" May 27 21:09:03.414415 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.414274 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/546b0029-85a2-4623-b927-f815a3725c53-root\") pod \"node-exporter-48l8d\" (UID: \"546b0029-85a2-4623-b927-f815a3725c53\") " pod="openshift-monitoring/node-exporter-48l8d" May 27 21:09:03.414415 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.414294 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/546b0029-85a2-4623-b927-f815a3725c53-node-exporter-wtmp\") pod \"node-exporter-48l8d\" (UID: \"546b0029-85a2-4623-b927-f815a3725c53\") " pod="openshift-monitoring/node-exporter-48l8d" May 27 21:09:03.414415 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.414319 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2qt2x\" (UniqueName: \"kubernetes.io/projected/546b0029-85a2-4623-b927-f815a3725c53-kube-api-access-2qt2x\") pod \"node-exporter-48l8d\" (UID: \"546b0029-85a2-4623-b927-f815a3725c53\") " pod="openshift-monitoring/node-exporter-48l8d" May 27 21:09:03.414415 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.414332 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/546b0029-85a2-4623-b927-f815a3725c53-sys\") pod \"node-exporter-48l8d\" (UID: \"546b0029-85a2-4623-b927-f815a3725c53\") " pod="openshift-monitoring/node-exporter-48l8d" May 27 21:09:03.414415 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.414351 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/546b0029-85a2-4623-b927-f815a3725c53-node-exporter-tls\") pod \"node-exporter-48l8d\" (UID: \"546b0029-85a2-4623-b927-f815a3725c53\") " pod="openshift-monitoring/node-exporter-48l8d" May 27 21:09:03.414415 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.414385 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/546b0029-85a2-4623-b927-f815a3725c53-node-exporter-textfile\") pod \"node-exporter-48l8d\" (UID: \"546b0029-85a2-4623-b927-f815a3725c53\") " pod="openshift-monitoring/node-exporter-48l8d" May 27 21:09:03.414415 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.414412 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/546b0029-85a2-4623-b927-f815a3725c53-metrics-client-ca\") pod \"node-exporter-48l8d\" (UID: \"546b0029-85a2-4623-b927-f815a3725c53\") " pod="openshift-monitoring/node-exporter-48l8d" May 27 21:09:03.414659 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.414450 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/546b0029-85a2-4623-b927-f815a3725c53-node-exporter-wtmp\") pod \"node-exporter-48l8d\" (UID: \"546b0029-85a2-4623-b927-f815a3725c53\") " pod="openshift-monitoring/node-exporter-48l8d" May 27 21:09:03.414659 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.414452 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/546b0029-85a2-4623-b927-f815a3725c53-node-exporter-accelerators-collector-config\") pod \"node-exporter-48l8d\" (UID: \"546b0029-85a2-4623-b927-f815a3725c53\") " pod="openshift-monitoring/node-exporter-48l8d" May 27 21:09:03.414659 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.414482 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/546b0029-85a2-4623-b927-f815a3725c53-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-48l8d\" (UID: \"546b0029-85a2-4623-b927-f815a3725c53\") " pod="openshift-monitoring/node-exporter-48l8d" May 27 21:09:03.414956 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.414923 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/546b0029-85a2-4623-b927-f815a3725c53-node-exporter-textfile\") pod \"node-exporter-48l8d\" (UID: \"546b0029-85a2-4623-b927-f815a3725c53\") " pod="openshift-monitoring/node-exporter-48l8d" May 27 21:09:03.415223 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.415197 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/546b0029-85a2-4623-b927-f815a3725c53-metrics-client-ca\") pod \"node-exporter-48l8d\" (UID: \"546b0029-85a2-4623-b927-f815a3725c53\") " pod="openshift-monitoring/node-exporter-48l8d" May 27 21:09:03.422854 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.422830 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qt2x\" (UniqueName: \"kubernetes.io/projected/546b0029-85a2-4623-b927-f815a3725c53-kube-api-access-2qt2x\") pod \"node-exporter-48l8d\" (UID: \"546b0029-85a2-4623-b927-f815a3725c53\") " pod="openshift-monitoring/node-exporter-48l8d" May 27 21:09:03.490602 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.490521 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-lvnxd" May 27 21:09:03.645708 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:03.645673 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-lvnxd"] May 27 21:09:03.648885 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:09:03.648849 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb878561d_7da1_4f5e_8f2e_1a30d47b68ae.slice/crio-7bd6ff4ad9fb5545a3b9cc22b94a1cfb50f464d2763a119f040f0e6dc46c6f1b WatchSource:0}: Error finding container 7bd6ff4ad9fb5545a3b9cc22b94a1cfb50f464d2763a119f040f0e6dc46c6f1b: Status 404 returned error can't find the container with id 7bd6ff4ad9fb5545a3b9cc22b94a1cfb50f464d2763a119f040f0e6dc46c6f1b May 27 21:09:04.069499 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:04.069472 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 27 21:09:04.075802 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:04.075776 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/546b0029-85a2-4623-b927-f815a3725c53-node-exporter-accelerators-collector-config\") pod \"node-exporter-48l8d\" (UID: \"546b0029-85a2-4623-b927-f815a3725c53\") " pod="openshift-monitoring/node-exporter-48l8d" May 27 21:09:04.177993 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:04.177958 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 27 21:09:04.187695 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:04.187663 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/546b0029-85a2-4623-b927-f815a3725c53-node-exporter-tls\") pod \"node-exporter-48l8d\" (UID: \"546b0029-85a2-4623-b927-f815a3725c53\") " pod="openshift-monitoring/node-exporter-48l8d" May 27 21:09:04.200815 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:04.200777 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-krpk2\"" May 27 21:09:04.415221 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:09:04.415091 2566 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-kube-rbac-proxy-config: failed to sync secret cache: timed out waiting for the condition May 27 21:09:04.415221 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:09:04.415182 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/546b0029-85a2-4623-b927-f815a3725c53-node-exporter-kube-rbac-proxy-config podName:546b0029-85a2-4623-b927-f815a3725c53 nodeName:}" failed. No retries permitted until 2026-05-27 21:09:04.915161483 +0000 UTC m=+169.534547268 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-kube-rbac-proxy-config" (UniqueName: "kubernetes.io/secret/546b0029-85a2-4623-b927-f815a3725c53-node-exporter-kube-rbac-proxy-config") pod "node-exporter-48l8d" (UID: "546b0029-85a2-4623-b927-f815a3725c53") : failed to sync secret cache: timed out waiting for the condition May 27 21:09:04.637106 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:04.637063 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-lvnxd" event={"ID":"b878561d-7da1-4f5e-8f2e-1a30d47b68ae","Type":"ContainerStarted","Data":"41389eb0a61a63e8bc334ed68564fdeacbab58b66d6a9bea4de8f09d9886394e"} May 27 21:09:04.637280 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:04.637112 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-lvnxd" event={"ID":"b878561d-7da1-4f5e-8f2e-1a30d47b68ae","Type":"ContainerStarted","Data":"afbf22e6891d40434ead704e03de58cbb8991401a4cc60e63e0708eed1d9b582"} May 27 21:09:04.637280 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:04.637124 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-lvnxd" event={"ID":"b878561d-7da1-4f5e-8f2e-1a30d47b68ae","Type":"ContainerStarted","Data":"7bd6ff4ad9fb5545a3b9cc22b94a1cfb50f464d2763a119f040f0e6dc46c6f1b"} May 27 21:09:04.701957 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:04.701874 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 27 21:09:04.930167 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:04.930090 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/546b0029-85a2-4623-b927-f815a3725c53-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-48l8d\" (UID: \"546b0029-85a2-4623-b927-f815a3725c53\") " pod="openshift-monitoring/node-exporter-48l8d" May 27 21:09:04.932934 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:04.932898 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/546b0029-85a2-4623-b927-f815a3725c53-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-48l8d\" (UID: \"546b0029-85a2-4623-b927-f815a3725c53\") " pod="openshift-monitoring/node-exporter-48l8d" May 27 21:09:05.039057 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.038977 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-48l8d" May 27 21:09:05.261717 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.261680 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-54f7bff98c-qdrhx"] May 27 21:09:05.280193 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.280168 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-54f7bff98c-qdrhx"] May 27 21:09:05.280335 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.280310 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-54f7bff98c-qdrhx" May 27 21:09:05.283077 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.283051 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 27 21:09:05.284060 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.283776 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 27 21:09:05.284060 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.283790 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 27 21:09:05.284060 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.283858 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-668spl0hfr38t\"" May 27 21:09:05.284060 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.283793 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 27 21:09:05.284324 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.284134 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-fskjj\"" May 27 21:09:05.285452 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.285434 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 27 21:09:05.298075 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:09:05.298051 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod546b0029_85a2_4623_b927_f815a3725c53.slice/crio-0eb3766c93938b985bef0c697969612879f3e42b9efffe9ae6d1687a63313cd1 WatchSource:0}: Error finding container 0eb3766c93938b985bef0c697969612879f3e42b9efffe9ae6d1687a63313cd1: Status 404 returned error can't find the container with id 0eb3766c93938b985bef0c697969612879f3e42b9efffe9ae6d1687a63313cd1 May 27 21:09:05.333795 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.333764 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7088d87-a64b-4f0e-9135-6b7b55fc706e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-54f7bff98c-qdrhx\" (UID: \"a7088d87-a64b-4f0e-9135-6b7b55fc706e\") " pod="openshift-monitoring/thanos-querier-54f7bff98c-qdrhx" May 27 21:09:05.333903 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.333813 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7088d87-a64b-4f0e-9135-6b7b55fc706e-metrics-client-ca\") pod \"thanos-querier-54f7bff98c-qdrhx\" (UID: \"a7088d87-a64b-4f0e-9135-6b7b55fc706e\") " pod="openshift-monitoring/thanos-querier-54f7bff98c-qdrhx" May 27 21:09:05.333903 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.333845 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a7088d87-a64b-4f0e-9135-6b7b55fc706e-secret-grpc-tls\") pod \"thanos-querier-54f7bff98c-qdrhx\" (UID: \"a7088d87-a64b-4f0e-9135-6b7b55fc706e\") " pod="openshift-monitoring/thanos-querier-54f7bff98c-qdrhx" May 27 21:09:05.333903 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.333897 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7088d87-a64b-4f0e-9135-6b7b55fc706e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-54f7bff98c-qdrhx\" (UID: \"a7088d87-a64b-4f0e-9135-6b7b55fc706e\") " pod="openshift-monitoring/thanos-querier-54f7bff98c-qdrhx" May 27 21:09:05.334209 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.333931 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a7088d87-a64b-4f0e-9135-6b7b55fc706e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-54f7bff98c-qdrhx\" (UID: \"a7088d87-a64b-4f0e-9135-6b7b55fc706e\") " pod="openshift-monitoring/thanos-querier-54f7bff98c-qdrhx" May 27 21:09:05.334209 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.333963 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a7088d87-a64b-4f0e-9135-6b7b55fc706e-secret-thanos-querier-tls\") pod \"thanos-querier-54f7bff98c-qdrhx\" (UID: \"a7088d87-a64b-4f0e-9135-6b7b55fc706e\") " pod="openshift-monitoring/thanos-querier-54f7bff98c-qdrhx" May 27 21:09:05.334209 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.333990 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lndh7\" (UniqueName: \"kubernetes.io/projected/a7088d87-a64b-4f0e-9135-6b7b55fc706e-kube-api-access-lndh7\") pod \"thanos-querier-54f7bff98c-qdrhx\" (UID: \"a7088d87-a64b-4f0e-9135-6b7b55fc706e\") " pod="openshift-monitoring/thanos-querier-54f7bff98c-qdrhx" May 27 21:09:05.334209 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.334079 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a7088d87-a64b-4f0e-9135-6b7b55fc706e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-54f7bff98c-qdrhx\" (UID: \"a7088d87-a64b-4f0e-9135-6b7b55fc706e\") " pod="openshift-monitoring/thanos-querier-54f7bff98c-qdrhx" May 27 21:09:05.435108 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.435075 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7088d87-a64b-4f0e-9135-6b7b55fc706e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-54f7bff98c-qdrhx\" (UID: \"a7088d87-a64b-4f0e-9135-6b7b55fc706e\") " pod="openshift-monitoring/thanos-querier-54f7bff98c-qdrhx" May 27 21:09:05.435278 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.435129 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7088d87-a64b-4f0e-9135-6b7b55fc706e-metrics-client-ca\") pod \"thanos-querier-54f7bff98c-qdrhx\" (UID: \"a7088d87-a64b-4f0e-9135-6b7b55fc706e\") " pod="openshift-monitoring/thanos-querier-54f7bff98c-qdrhx" May 27 21:09:05.435278 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.435159 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a7088d87-a64b-4f0e-9135-6b7b55fc706e-secret-grpc-tls\") pod \"thanos-querier-54f7bff98c-qdrhx\" (UID: \"a7088d87-a64b-4f0e-9135-6b7b55fc706e\") " pod="openshift-monitoring/thanos-querier-54f7bff98c-qdrhx" May 27 21:09:05.435278 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.435208 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7088d87-a64b-4f0e-9135-6b7b55fc706e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-54f7bff98c-qdrhx\" (UID: \"a7088d87-a64b-4f0e-9135-6b7b55fc706e\") " pod="openshift-monitoring/thanos-querier-54f7bff98c-qdrhx" May 27 21:09:05.435278 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.435243 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a7088d87-a64b-4f0e-9135-6b7b55fc706e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-54f7bff98c-qdrhx\" (UID: \"a7088d87-a64b-4f0e-9135-6b7b55fc706e\") " pod="openshift-monitoring/thanos-querier-54f7bff98c-qdrhx" May 27 21:09:05.435278 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.435270 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a7088d87-a64b-4f0e-9135-6b7b55fc706e-secret-thanos-querier-tls\") pod \"thanos-querier-54f7bff98c-qdrhx\" (UID: \"a7088d87-a64b-4f0e-9135-6b7b55fc706e\") " pod="openshift-monitoring/thanos-querier-54f7bff98c-qdrhx" May 27 21:09:05.435521 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.435295 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lndh7\" (UniqueName: \"kubernetes.io/projected/a7088d87-a64b-4f0e-9135-6b7b55fc706e-kube-api-access-lndh7\") pod \"thanos-querier-54f7bff98c-qdrhx\" (UID: \"a7088d87-a64b-4f0e-9135-6b7b55fc706e\") " pod="openshift-monitoring/thanos-querier-54f7bff98c-qdrhx" May 27 21:09:05.435521 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.435361 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a7088d87-a64b-4f0e-9135-6b7b55fc706e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-54f7bff98c-qdrhx\" (UID: \"a7088d87-a64b-4f0e-9135-6b7b55fc706e\") " pod="openshift-monitoring/thanos-querier-54f7bff98c-qdrhx" May 27 21:09:05.435998 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.435954 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7088d87-a64b-4f0e-9135-6b7b55fc706e-metrics-client-ca\") pod \"thanos-querier-54f7bff98c-qdrhx\" (UID: \"a7088d87-a64b-4f0e-9135-6b7b55fc706e\") " pod="openshift-monitoring/thanos-querier-54f7bff98c-qdrhx" May 27 21:09:05.437915 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.437883 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a7088d87-a64b-4f0e-9135-6b7b55fc706e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-54f7bff98c-qdrhx\" (UID: \"a7088d87-a64b-4f0e-9135-6b7b55fc706e\") " pod="openshift-monitoring/thanos-querier-54f7bff98c-qdrhx" May 27 21:09:05.438021 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.437936 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a7088d87-a64b-4f0e-9135-6b7b55fc706e-secret-thanos-querier-tls\") pod \"thanos-querier-54f7bff98c-qdrhx\" (UID: \"a7088d87-a64b-4f0e-9135-6b7b55fc706e\") " pod="openshift-monitoring/thanos-querier-54f7bff98c-qdrhx" May 27 21:09:05.438214 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.438196 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7088d87-a64b-4f0e-9135-6b7b55fc706e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-54f7bff98c-qdrhx\" (UID: \"a7088d87-a64b-4f0e-9135-6b7b55fc706e\") " pod="openshift-monitoring/thanos-querier-54f7bff98c-qdrhx" May 27 21:09:05.438283 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.438196 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7088d87-a64b-4f0e-9135-6b7b55fc706e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-54f7bff98c-qdrhx\" (UID: \"a7088d87-a64b-4f0e-9135-6b7b55fc706e\") " pod="openshift-monitoring/thanos-querier-54f7bff98c-qdrhx" May 27 21:09:05.438342 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.438309 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a7088d87-a64b-4f0e-9135-6b7b55fc706e-secret-grpc-tls\") pod \"thanos-querier-54f7bff98c-qdrhx\" (UID: \"a7088d87-a64b-4f0e-9135-6b7b55fc706e\") " pod="openshift-monitoring/thanos-querier-54f7bff98c-qdrhx" May 27 21:09:05.438517 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.438496 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a7088d87-a64b-4f0e-9135-6b7b55fc706e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-54f7bff98c-qdrhx\" (UID: \"a7088d87-a64b-4f0e-9135-6b7b55fc706e\") " pod="openshift-monitoring/thanos-querier-54f7bff98c-qdrhx" May 27 21:09:05.442548 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.442529 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lndh7\" (UniqueName: \"kubernetes.io/projected/a7088d87-a64b-4f0e-9135-6b7b55fc706e-kube-api-access-lndh7\") pod \"thanos-querier-54f7bff98c-qdrhx\" (UID: \"a7088d87-a64b-4f0e-9135-6b7b55fc706e\") " pod="openshift-monitoring/thanos-querier-54f7bff98c-qdrhx" May 27 21:09:05.590666 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.590642 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-54f7bff98c-qdrhx" May 27 21:09:05.642800 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.642761 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-48l8d" event={"ID":"546b0029-85a2-4623-b927-f815a3725c53","Type":"ContainerStarted","Data":"0eb3766c93938b985bef0c697969612879f3e42b9efffe9ae6d1687a63313cd1"} May 27 21:09:05.746518 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:05.746488 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-54f7bff98c-qdrhx"] May 27 21:09:05.750510 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:09:05.750458 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7088d87_a64b_4f0e_9135_6b7b55fc706e.slice/crio-ab777fef4dbf625aca946250d9d733d3ed918f7cc5db95c01fa1c07f96745415 WatchSource:0}: Error finding container ab777fef4dbf625aca946250d9d733d3ed918f7cc5db95c01fa1c07f96745415: Status 404 returned error can't find the container with id ab777fef4dbf625aca946250d9d733d3ed918f7cc5db95c01fa1c07f96745415 May 27 21:09:06.646839 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:06.646803 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54f7bff98c-qdrhx" event={"ID":"a7088d87-a64b-4f0e-9135-6b7b55fc706e","Type":"ContainerStarted","Data":"ab777fef4dbf625aca946250d9d733d3ed918f7cc5db95c01fa1c07f96745415"} May 27 21:09:06.647908 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:06.647885 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67b56c68c9-g7lvr" event={"ID":"0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345","Type":"ContainerStarted","Data":"ccd53c805465eeeb2283f5ed50af54fde60704a28838c599b0396bac22ee0480"} May 27 21:09:06.665942 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:06.665898 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-67b56c68c9-g7lvr" podStartSLOduration=1.982830158 podStartE2EDuration="5.66588391s" podCreationTimestamp="2026-05-27 21:09:01 +0000 UTC" firstStartedPulling="2026-05-27 21:09:01.902286496 +0000 UTC m=+166.521672260" lastFinishedPulling="2026-05-27 21:09:05.585340249 +0000 UTC m=+170.204726012" observedRunningTime="2026-05-27 21:09:06.664251433 +0000 UTC m=+171.283637218" watchObservedRunningTime="2026-05-27 21:09:06.66588391 +0000 UTC m=+171.285269695" May 27 21:09:07.025852 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:07.025821 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j2sdl" May 27 21:09:07.028796 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:07.028698 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p6pfz\"" May 27 21:09:07.036840 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:07.036721 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j2sdl" May 27 21:09:07.188245 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:07.188210 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j2sdl"] May 27 21:09:07.191323 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:09:07.191294 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5908789d_9a0e_402a_af5b_9cece18e09cb.slice/crio-f985f5974a1af00aeb349023f8a24e3b41e57147aa3da8d9de849530d3c564e6 WatchSource:0}: Error finding container f985f5974a1af00aeb349023f8a24e3b41e57147aa3da8d9de849530d3c564e6: Status 404 returned error can't find the container with id f985f5974a1af00aeb349023f8a24e3b41e57147aa3da8d9de849530d3c564e6 May 27 21:09:07.654917 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:07.654828 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-lvnxd" event={"ID":"b878561d-7da1-4f5e-8f2e-1a30d47b68ae","Type":"ContainerStarted","Data":"87ee6a7379d19103625872d1b75598a16e981ef8d747b5e84f89924e704772a3"} May 27 21:09:07.656642 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:07.656585 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j2sdl" event={"ID":"5908789d-9a0e-402a-af5b-9cece18e09cb","Type":"ContainerStarted","Data":"f985f5974a1af00aeb349023f8a24e3b41e57147aa3da8d9de849530d3c564e6"} May 27 21:09:07.658263 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:07.658229 2566 generic.go:358] "Generic (PLEG): container finished" podID="546b0029-85a2-4623-b927-f815a3725c53" containerID="d43f18c9dc99948d16ce538c9e17a1c9c6312ef64f1b94f13d2688808cf2636b" exitCode=0 May 27 21:09:07.659308 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:07.659284 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-48l8d" event={"ID":"546b0029-85a2-4623-b927-f815a3725c53","Type":"ContainerDied","Data":"d43f18c9dc99948d16ce538c9e17a1c9c6312ef64f1b94f13d2688808cf2636b"} May 27 21:09:07.674219 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:07.673822 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-lvnxd" podStartSLOduration=1.650219141 podStartE2EDuration="4.673805602s" podCreationTimestamp="2026-05-27 21:09:03 +0000 UTC" firstStartedPulling="2026-05-27 21:09:03.787106185 +0000 UTC m=+168.406491952" lastFinishedPulling="2026-05-27 21:09:06.81069265 +0000 UTC m=+171.430078413" observedRunningTime="2026-05-27 21:09:07.672766418 +0000 UTC m=+172.292152203" watchObservedRunningTime="2026-05-27 21:09:07.673805602 +0000 UTC m=+172.293191389" May 27 21:09:07.940920 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:07.940723 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-98wmk"] May 27 21:09:07.943368 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:07.943344 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-98wmk" May 27 21:09:07.946193 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:07.946014 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 27 21:09:07.948010 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:07.947386 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-lqbch\"" May 27 21:09:07.956741 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:07.956694 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-98wmk"] May 27 21:09:08.025850 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.025817 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dq5" May 27 21:09:08.065588 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.065553 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bbcc17ba-9d30-4795-bd01-e75cad541472-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-98wmk\" (UID: \"bbcc17ba-9d30-4795-bd01-e75cad541472\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-98wmk" May 27 21:09:08.167098 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.167003 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bbcc17ba-9d30-4795-bd01-e75cad541472-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-98wmk\" (UID: \"bbcc17ba-9d30-4795-bd01-e75cad541472\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-98wmk" May 27 21:09:08.167288 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:09:08.167158 2566 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found May 27 21:09:08.167288 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:09:08.167232 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbcc17ba-9d30-4795-bd01-e75cad541472-monitoring-plugin-cert podName:bbcc17ba-9d30-4795-bd01-e75cad541472 nodeName:}" failed. No retries permitted until 2026-05-27 21:09:08.667210909 +0000 UTC m=+173.286596690 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/bbcc17ba-9d30-4795-bd01-e75cad541472-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-98wmk" (UID: "bbcc17ba-9d30-4795-bd01-e75cad541472") : secret "monitoring-plugin-cert" not found May 27 21:09:08.490170 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.490134 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5c6f8fcdb9-dpq64"] May 27 21:09:08.492842 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.492817 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c6f8fcdb9-dpq64" May 27 21:09:08.495422 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.495293 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" May 27 21:09:08.495422 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.495293 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" May 27 21:09:08.495596 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.495502 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" May 27 21:09:08.495756 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.495735 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" May 27 21:09:08.495839 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.495764 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-vfzxm\"" May 27 21:09:08.496182 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.496154 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" May 27 21:09:08.502618 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.502152 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" May 27 21:09:08.511096 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.510111 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c6f8fcdb9-dpq64"] May 27 21:09:08.571467 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.571415 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53a75dfd-597c-444f-ae01-30a0b49dfd78-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c6f8fcdb9-dpq64\" (UID: \"53a75dfd-597c-444f-ae01-30a0b49dfd78\") " pod="openshift-monitoring/telemeter-client-5c6f8fcdb9-dpq64" May 27 21:09:08.571627 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.571470 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/53a75dfd-597c-444f-ae01-30a0b49dfd78-federate-client-tls\") pod \"telemeter-client-5c6f8fcdb9-dpq64\" (UID: \"53a75dfd-597c-444f-ae01-30a0b49dfd78\") " pod="openshift-monitoring/telemeter-client-5c6f8fcdb9-dpq64" May 27 21:09:08.571627 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.571547 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/53a75dfd-597c-444f-ae01-30a0b49dfd78-secret-telemeter-client\") pod \"telemeter-client-5c6f8fcdb9-dpq64\" (UID: \"53a75dfd-597c-444f-ae01-30a0b49dfd78\") " pod="openshift-monitoring/telemeter-client-5c6f8fcdb9-dpq64" May 27 21:09:08.571627 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.571599 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53a75dfd-597c-444f-ae01-30a0b49dfd78-serving-certs-ca-bundle\") pod \"telemeter-client-5c6f8fcdb9-dpq64\" (UID: \"53a75dfd-597c-444f-ae01-30a0b49dfd78\") " pod="openshift-monitoring/telemeter-client-5c6f8fcdb9-dpq64" May 27 21:09:08.571770 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.571629 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/53a75dfd-597c-444f-ae01-30a0b49dfd78-telemeter-client-tls\") pod \"telemeter-client-5c6f8fcdb9-dpq64\" (UID: \"53a75dfd-597c-444f-ae01-30a0b49dfd78\") " pod="openshift-monitoring/telemeter-client-5c6f8fcdb9-dpq64" May 27 21:09:08.571770 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.571658 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53a75dfd-597c-444f-ae01-30a0b49dfd78-metrics-client-ca\") pod \"telemeter-client-5c6f8fcdb9-dpq64\" (UID: \"53a75dfd-597c-444f-ae01-30a0b49dfd78\") " pod="openshift-monitoring/telemeter-client-5c6f8fcdb9-dpq64" May 27 21:09:08.571770 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.571688 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nckjs\" (UniqueName: \"kubernetes.io/projected/53a75dfd-597c-444f-ae01-30a0b49dfd78-kube-api-access-nckjs\") pod \"telemeter-client-5c6f8fcdb9-dpq64\" (UID: \"53a75dfd-597c-444f-ae01-30a0b49dfd78\") " pod="openshift-monitoring/telemeter-client-5c6f8fcdb9-dpq64" May 27 21:09:08.571770 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.571732 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53a75dfd-597c-444f-ae01-30a0b49dfd78-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c6f8fcdb9-dpq64\" (UID: \"53a75dfd-597c-444f-ae01-30a0b49dfd78\") " pod="openshift-monitoring/telemeter-client-5c6f8fcdb9-dpq64" May 27 21:09:08.664271 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.664217 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-48l8d" event={"ID":"546b0029-85a2-4623-b927-f815a3725c53","Type":"ContainerStarted","Data":"69f53fdbb8a64dde9be53f6cd384dd2a4aab11eb8482cd31d646e18685cccd1b"} May 27 21:09:08.664438 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.664279 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-48l8d" event={"ID":"546b0029-85a2-4623-b927-f815a3725c53","Type":"ContainerStarted","Data":"b1b58a23880399414ee54e3fc4f68bba10ddf200f2de75a9267f534b76232081"} May 27 21:09:08.673144 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.673105 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/53a75dfd-597c-444f-ae01-30a0b49dfd78-secret-telemeter-client\") pod \"telemeter-client-5c6f8fcdb9-dpq64\" (UID: \"53a75dfd-597c-444f-ae01-30a0b49dfd78\") " pod="openshift-monitoring/telemeter-client-5c6f8fcdb9-dpq64" May 27 21:09:08.673301 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.673178 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53a75dfd-597c-444f-ae01-30a0b49dfd78-serving-certs-ca-bundle\") pod \"telemeter-client-5c6f8fcdb9-dpq64\" (UID: \"53a75dfd-597c-444f-ae01-30a0b49dfd78\") " pod="openshift-monitoring/telemeter-client-5c6f8fcdb9-dpq64" May 27 21:09:08.673301 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.673212 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/53a75dfd-597c-444f-ae01-30a0b49dfd78-telemeter-client-tls\") pod \"telemeter-client-5c6f8fcdb9-dpq64\" (UID: \"53a75dfd-597c-444f-ae01-30a0b49dfd78\") " pod="openshift-monitoring/telemeter-client-5c6f8fcdb9-dpq64" May 27 21:09:08.673301 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.673243 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53a75dfd-597c-444f-ae01-30a0b49dfd78-metrics-client-ca\") pod \"telemeter-client-5c6f8fcdb9-dpq64\" (UID: \"53a75dfd-597c-444f-ae01-30a0b49dfd78\") " pod="openshift-monitoring/telemeter-client-5c6f8fcdb9-dpq64" May 27 21:09:08.673301 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.673276 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nckjs\" (UniqueName: \"kubernetes.io/projected/53a75dfd-597c-444f-ae01-30a0b49dfd78-kube-api-access-nckjs\") pod \"telemeter-client-5c6f8fcdb9-dpq64\" (UID: \"53a75dfd-597c-444f-ae01-30a0b49dfd78\") " pod="openshift-monitoring/telemeter-client-5c6f8fcdb9-dpq64" May 27 21:09:08.673523 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.673311 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53a75dfd-597c-444f-ae01-30a0b49dfd78-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c6f8fcdb9-dpq64\" (UID: \"53a75dfd-597c-444f-ae01-30a0b49dfd78\") " pod="openshift-monitoring/telemeter-client-5c6f8fcdb9-dpq64" May 27 21:09:08.673523 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.673385 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bbcc17ba-9d30-4795-bd01-e75cad541472-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-98wmk\" (UID: \"bbcc17ba-9d30-4795-bd01-e75cad541472\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-98wmk" May 27 21:09:08.673523 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.673429 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53a75dfd-597c-444f-ae01-30a0b49dfd78-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c6f8fcdb9-dpq64\" (UID: \"53a75dfd-597c-444f-ae01-30a0b49dfd78\") " pod="openshift-monitoring/telemeter-client-5c6f8fcdb9-dpq64" May 27 21:09:08.673523 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.673456 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/53a75dfd-597c-444f-ae01-30a0b49dfd78-federate-client-tls\") pod \"telemeter-client-5c6f8fcdb9-dpq64\" (UID: \"53a75dfd-597c-444f-ae01-30a0b49dfd78\") " pod="openshift-monitoring/telemeter-client-5c6f8fcdb9-dpq64" May 27 21:09:08.674143 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.674070 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53a75dfd-597c-444f-ae01-30a0b49dfd78-serving-certs-ca-bundle\") pod \"telemeter-client-5c6f8fcdb9-dpq64\" (UID: \"53a75dfd-597c-444f-ae01-30a0b49dfd78\") " pod="openshift-monitoring/telemeter-client-5c6f8fcdb9-dpq64" May 27 21:09:08.674523 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.674451 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53a75dfd-597c-444f-ae01-30a0b49dfd78-metrics-client-ca\") pod \"telemeter-client-5c6f8fcdb9-dpq64\" (UID: \"53a75dfd-597c-444f-ae01-30a0b49dfd78\") " pod="openshift-monitoring/telemeter-client-5c6f8fcdb9-dpq64" May 27 21:09:08.674904 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.674853 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53a75dfd-597c-444f-ae01-30a0b49dfd78-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c6f8fcdb9-dpq64\" (UID: \"53a75dfd-597c-444f-ae01-30a0b49dfd78\") " pod="openshift-monitoring/telemeter-client-5c6f8fcdb9-dpq64" May 27 21:09:08.676362 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.676336 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/53a75dfd-597c-444f-ae01-30a0b49dfd78-telemeter-client-tls\") pod \"telemeter-client-5c6f8fcdb9-dpq64\" (UID: \"53a75dfd-597c-444f-ae01-30a0b49dfd78\") " pod="openshift-monitoring/telemeter-client-5c6f8fcdb9-dpq64" May 27 21:09:08.676478 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.676454 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/53a75dfd-597c-444f-ae01-30a0b49dfd78-secret-telemeter-client\") pod \"telemeter-client-5c6f8fcdb9-dpq64\" (UID: \"53a75dfd-597c-444f-ae01-30a0b49dfd78\") " pod="openshift-monitoring/telemeter-client-5c6f8fcdb9-dpq64" May 27 21:09:08.676717 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.676690 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bbcc17ba-9d30-4795-bd01-e75cad541472-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-98wmk\" (UID: \"bbcc17ba-9d30-4795-bd01-e75cad541472\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-98wmk" May 27 21:09:08.677008 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.676983 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53a75dfd-597c-444f-ae01-30a0b49dfd78-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c6f8fcdb9-dpq64\" (UID: \"53a75dfd-597c-444f-ae01-30a0b49dfd78\") " pod="openshift-monitoring/telemeter-client-5c6f8fcdb9-dpq64" May 27 21:09:08.677118 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.676987 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/53a75dfd-597c-444f-ae01-30a0b49dfd78-federate-client-tls\") pod \"telemeter-client-5c6f8fcdb9-dpq64\" (UID: \"53a75dfd-597c-444f-ae01-30a0b49dfd78\") " pod="openshift-monitoring/telemeter-client-5c6f8fcdb9-dpq64" May 27 21:09:08.681315 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.681292 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nckjs\" (UniqueName: \"kubernetes.io/projected/53a75dfd-597c-444f-ae01-30a0b49dfd78-kube-api-access-nckjs\") pod \"telemeter-client-5c6f8fcdb9-dpq64\" (UID: \"53a75dfd-597c-444f-ae01-30a0b49dfd78\") " pod="openshift-monitoring/telemeter-client-5c6f8fcdb9-dpq64" May 27 21:09:08.684130 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.684074 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-48l8d" podStartSLOduration=4.171904892 podStartE2EDuration="5.684061294s" podCreationTimestamp="2026-05-27 21:09:03 +0000 UTC" firstStartedPulling="2026-05-27 21:09:05.299863775 +0000 UTC m=+169.919249541" lastFinishedPulling="2026-05-27 21:09:06.812020165 +0000 UTC m=+171.431405943" observedRunningTime="2026-05-27 21:09:08.682748746 +0000 UTC m=+173.302134555" watchObservedRunningTime="2026-05-27 21:09:08.684061294 +0000 UTC m=+173.303447079" May 27 21:09:08.810637 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.810604 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c6f8fcdb9-dpq64" May 27 21:09:08.858742 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:08.858704 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-98wmk" May 27 21:09:09.192908 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:09.192659 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c6f8fcdb9-dpq64"] May 27 21:09:09.197747 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:09:09.197713 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53a75dfd_597c_444f_ae01_30a0b49dfd78.slice/crio-a499b884c8e0572d20eec0081e6f6a9523924a3a1fb5e1968c166bd042d6d4fc WatchSource:0}: Error finding container a499b884c8e0572d20eec0081e6f6a9523924a3a1fb5e1968c166bd042d6d4fc: Status 404 returned error can't find the container with id a499b884c8e0572d20eec0081e6f6a9523924a3a1fb5e1968c166bd042d6d4fc May 27 21:09:09.210743 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:09.209391 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-98wmk"] May 27 21:09:09.218566 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:09:09.216173 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbcc17ba_9d30_4795_bd01_e75cad541472.slice/crio-8c8e8c750e1cb9ecbcb62b9e08a3aaf528fc02c3407953f8d6d8fa39281c22b1 WatchSource:0}: Error finding container 8c8e8c750e1cb9ecbcb62b9e08a3aaf528fc02c3407953f8d6d8fa39281c22b1: Status 404 returned error can't find the container with id 8c8e8c750e1cb9ecbcb62b9e08a3aaf528fc02c3407953f8d6d8fa39281c22b1 May 27 21:09:09.669800 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:09.669755 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54f7bff98c-qdrhx" event={"ID":"a7088d87-a64b-4f0e-9135-6b7b55fc706e","Type":"ContainerStarted","Data":"7503d0c4faca4bfb59c0489e5c659ef7d33907ab2844b8c32bbfb0027d445959"} May 27 21:09:09.669986 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:09.669809 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54f7bff98c-qdrhx" event={"ID":"a7088d87-a64b-4f0e-9135-6b7b55fc706e","Type":"ContainerStarted","Data":"cd1de9421d9e40f930696256eded1bbebb86f68713ac1bc308d555c22b95a0dd"} May 27 21:09:09.669986 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:09.669825 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54f7bff98c-qdrhx" event={"ID":"a7088d87-a64b-4f0e-9135-6b7b55fc706e","Type":"ContainerStarted","Data":"f71327b880a02f9935a5ba5c8f7613bafd8f5bfc56dc5a5cce43e01921b1ba1b"} May 27 21:09:09.671102 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:09.671046 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-98wmk" event={"ID":"bbcc17ba-9d30-4795-bd01-e75cad541472","Type":"ContainerStarted","Data":"8c8e8c750e1cb9ecbcb62b9e08a3aaf528fc02c3407953f8d6d8fa39281c22b1"} May 27 21:09:09.673851 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:09.673829 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c6f8fcdb9-dpq64" event={"ID":"53a75dfd-597c-444f-ae01-30a0b49dfd78","Type":"ContainerStarted","Data":"a499b884c8e0572d20eec0081e6f6a9523924a3a1fb5e1968c166bd042d6d4fc"} May 27 21:09:09.675240 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:09.675208 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j2sdl" event={"ID":"5908789d-9a0e-402a-af5b-9cece18e09cb","Type":"ContainerStarted","Data":"2ce5a598d8c66c3c3f8c04b4820201b441afbd0791ff92e334f4418a3401642d"} May 27 21:09:09.694905 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:09.694860 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-j2sdl" podStartSLOduration=137.841192093 podStartE2EDuration="2m19.694846118s" podCreationTimestamp="2026-05-27 21:06:50 +0000 UTC" firstStartedPulling="2026-05-27 21:09:07.193506909 +0000 UTC m=+171.812892676" lastFinishedPulling="2026-05-27 21:09:09.047160932 +0000 UTC m=+173.666546701" observedRunningTime="2026-05-27 21:09:09.693457764 +0000 UTC m=+174.312843551" watchObservedRunningTime="2026-05-27 21:09:09.694846118 +0000 UTC m=+174.314231903" May 27 21:09:10.622608 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:10.622573 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-n4mw8" May 27 21:09:10.681678 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:10.681641 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54f7bff98c-qdrhx" event={"ID":"a7088d87-a64b-4f0e-9135-6b7b55fc706e","Type":"ContainerStarted","Data":"fa1168e5b7e1292bd28e975fce94d6bb3c79485b2d030c36ae30773a61023147"} May 27 21:09:10.681678 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:10.681683 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54f7bff98c-qdrhx" event={"ID":"a7088d87-a64b-4f0e-9135-6b7b55fc706e","Type":"ContainerStarted","Data":"871430b967d706bf8f165cdd371f67cbfbae31694338e26616423d81bbff5c84"} May 27 21:09:10.681910 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:10.681697 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54f7bff98c-qdrhx" event={"ID":"a7088d87-a64b-4f0e-9135-6b7b55fc706e","Type":"ContainerStarted","Data":"458d100295b189217b244ae7e92e08549a8143c5dfa03fefee93d96b543af557"} May 27 21:09:10.722303 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:10.722250 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-54f7bff98c-qdrhx" podStartSLOduration=1.35056055 podStartE2EDuration="5.722229701s" podCreationTimestamp="2026-05-27 21:09:05 +0000 UTC" firstStartedPulling="2026-05-27 21:09:05.759020908 +0000 UTC m=+170.378406686" lastFinishedPulling="2026-05-27 21:09:10.130690075 +0000 UTC m=+174.750075837" observedRunningTime="2026-05-27 21:09:10.71970382 +0000 UTC m=+175.339089606" watchObservedRunningTime="2026-05-27 21:09:10.722229701 +0000 UTC m=+175.341615487" May 27 21:09:11.686934 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:11.686496 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-98wmk" event={"ID":"bbcc17ba-9d30-4795-bd01-e75cad541472","Type":"ContainerStarted","Data":"c4d3fec57acd4239488cff8f333dbcee4a3c333f8516a26119bebc3088eb06ae"} May 27 21:09:11.686934 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:11.686704 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-98wmk" May 27 21:09:11.688956 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:11.688928 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c6f8fcdb9-dpq64" event={"ID":"53a75dfd-597c-444f-ae01-30a0b49dfd78","Type":"ContainerStarted","Data":"b72810639e6fec35fc9ed3d2ab7cba68a533ba94432e1914578005a486a19bb1"} May 27 21:09:11.689403 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:11.689372 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-54f7bff98c-qdrhx" May 27 21:09:11.693002 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:11.692981 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-98wmk" May 27 21:09:11.705392 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:11.705348 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-98wmk" podStartSLOduration=3.224192683 podStartE2EDuration="4.705335454s" podCreationTimestamp="2026-05-27 21:09:07 +0000 UTC" firstStartedPulling="2026-05-27 21:09:09.220789503 +0000 UTC m=+173.840175282" lastFinishedPulling="2026-05-27 21:09:10.701932277 +0000 UTC m=+175.321318053" observedRunningTime="2026-05-27 21:09:11.704045365 +0000 UTC m=+176.323431150" watchObservedRunningTime="2026-05-27 21:09:11.705335454 +0000 UTC m=+176.324721276" May 27 21:09:11.751485 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:11.751456 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67b56c68c9-g7lvr" May 27 21:09:11.751651 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:11.751497 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67b56c68c9-g7lvr" May 27 21:09:11.756268 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:11.756245 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67b56c68c9-g7lvr" May 27 21:09:12.698911 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:12.698883 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67b56c68c9-g7lvr" May 27 21:09:13.699089 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:13.699052 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c6f8fcdb9-dpq64" event={"ID":"53a75dfd-597c-444f-ae01-30a0b49dfd78","Type":"ContainerStarted","Data":"333529519a895e186d40e0895e89595116b05ffa236f65ae377f63779f3e87c1"} May 27 21:09:13.699089 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:13.699091 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c6f8fcdb9-dpq64" event={"ID":"53a75dfd-597c-444f-ae01-30a0b49dfd78","Type":"ContainerStarted","Data":"c5f97de970492f45202f5aafa0d5dbe891a88990e71515724073b6e8768015c6"} May 27 21:09:15.330362 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:15.330305 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5c6f8fcdb9-dpq64" podStartSLOduration=3.8969316579999997 podStartE2EDuration="7.330285573s" podCreationTimestamp="2026-05-27 21:09:08 +0000 UTC" firstStartedPulling="2026-05-27 21:09:09.202270694 +0000 UTC m=+173.821656462" lastFinishedPulling="2026-05-27 21:09:12.635624605 +0000 UTC m=+177.255010377" observedRunningTime="2026-05-27 21:09:13.724440213 +0000 UTC m=+178.343825998" watchObservedRunningTime="2026-05-27 21:09:15.330285573 +0000 UTC m=+179.949671360" May 27 21:09:15.331884 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:15.331855 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-65578dfbd6-7hzwx"] May 27 21:09:15.334135 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:15.334108 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65578dfbd6-7hzwx" May 27 21:09:15.341956 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:15.341934 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 27 21:09:15.345173 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:15.345154 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65578dfbd6-7hzwx"] May 27 21:09:15.438686 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:15.438649 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2mp8\" (UniqueName: \"kubernetes.io/projected/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-kube-api-access-v2mp8\") pod \"console-65578dfbd6-7hzwx\" (UID: \"fc42ee3f-e972-443b-a4eb-97d75d41e8ca\") " pod="openshift-console/console-65578dfbd6-7hzwx" May 27 21:09:15.438832 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:15.438767 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-console-oauth-config\") pod \"console-65578dfbd6-7hzwx\" (UID: \"fc42ee3f-e972-443b-a4eb-97d75d41e8ca\") " pod="openshift-console/console-65578dfbd6-7hzwx" May 27 21:09:15.438832 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:15.438798 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-service-ca\") pod \"console-65578dfbd6-7hzwx\" (UID: \"fc42ee3f-e972-443b-a4eb-97d75d41e8ca\") " pod="openshift-console/console-65578dfbd6-7hzwx" May 27 21:09:15.438925 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:15.438863 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-console-serving-cert\") pod \"console-65578dfbd6-7hzwx\" (UID: \"fc42ee3f-e972-443b-a4eb-97d75d41e8ca\") " pod="openshift-console/console-65578dfbd6-7hzwx" May 27 21:09:15.438925 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:15.438884 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-trusted-ca-bundle\") pod \"console-65578dfbd6-7hzwx\" (UID: \"fc42ee3f-e972-443b-a4eb-97d75d41e8ca\") " pod="openshift-console/console-65578dfbd6-7hzwx" May 27 21:09:15.438925 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:15.438906 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-console-config\") pod \"console-65578dfbd6-7hzwx\" (UID: \"fc42ee3f-e972-443b-a4eb-97d75d41e8ca\") " pod="openshift-console/console-65578dfbd6-7hzwx" May 27 21:09:15.439076 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:15.438936 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-oauth-serving-cert\") pod \"console-65578dfbd6-7hzwx\" (UID: \"fc42ee3f-e972-443b-a4eb-97d75d41e8ca\") " pod="openshift-console/console-65578dfbd6-7hzwx" May 27 21:09:15.540143 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:15.540106 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-console-serving-cert\") pod \"console-65578dfbd6-7hzwx\" (UID: \"fc42ee3f-e972-443b-a4eb-97d75d41e8ca\") " pod="openshift-console/console-65578dfbd6-7hzwx" May 27 21:09:15.540143 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:15.540145 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-trusted-ca-bundle\") pod \"console-65578dfbd6-7hzwx\" (UID: \"fc42ee3f-e972-443b-a4eb-97d75d41e8ca\") " pod="openshift-console/console-65578dfbd6-7hzwx" May 27 21:09:15.540342 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:15.540175 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-console-config\") pod \"console-65578dfbd6-7hzwx\" (UID: \"fc42ee3f-e972-443b-a4eb-97d75d41e8ca\") " pod="openshift-console/console-65578dfbd6-7hzwx" May 27 21:09:15.540342 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:15.540209 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-oauth-serving-cert\") pod \"console-65578dfbd6-7hzwx\" (UID: \"fc42ee3f-e972-443b-a4eb-97d75d41e8ca\") " pod="openshift-console/console-65578dfbd6-7hzwx" May 27 21:09:15.540342 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:15.540229 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v2mp8\" (UniqueName: \"kubernetes.io/projected/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-kube-api-access-v2mp8\") pod \"console-65578dfbd6-7hzwx\" (UID: \"fc42ee3f-e972-443b-a4eb-97d75d41e8ca\") " pod="openshift-console/console-65578dfbd6-7hzwx" May 27 21:09:15.540342 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:15.540317 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-console-oauth-config\") pod \"console-65578dfbd6-7hzwx\" (UID: \"fc42ee3f-e972-443b-a4eb-97d75d41e8ca\") " pod="openshift-console/console-65578dfbd6-7hzwx" May 27 21:09:15.540342 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:15.540340 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-service-ca\") pod \"console-65578dfbd6-7hzwx\" (UID: \"fc42ee3f-e972-443b-a4eb-97d75d41e8ca\") " pod="openshift-console/console-65578dfbd6-7hzwx" May 27 21:09:15.540994 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:15.540962 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-oauth-serving-cert\") pod \"console-65578dfbd6-7hzwx\" (UID: \"fc42ee3f-e972-443b-a4eb-97d75d41e8ca\") " pod="openshift-console/console-65578dfbd6-7hzwx" May 27 21:09:15.541157 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:15.541058 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-trusted-ca-bundle\") pod \"console-65578dfbd6-7hzwx\" (UID: \"fc42ee3f-e972-443b-a4eb-97d75d41e8ca\") " pod="openshift-console/console-65578dfbd6-7hzwx" May 27 21:09:15.541264 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:15.541240 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-console-config\") pod \"console-65578dfbd6-7hzwx\" (UID: \"fc42ee3f-e972-443b-a4eb-97d75d41e8ca\") " pod="openshift-console/console-65578dfbd6-7hzwx" May 27 21:09:15.541331 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:15.541283 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-service-ca\") pod \"console-65578dfbd6-7hzwx\" (UID: \"fc42ee3f-e972-443b-a4eb-97d75d41e8ca\") " pod="openshift-console/console-65578dfbd6-7hzwx" May 27 21:09:15.543096 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:15.543074 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-console-oauth-config\") pod \"console-65578dfbd6-7hzwx\" (UID: \"fc42ee3f-e972-443b-a4eb-97d75d41e8ca\") " pod="openshift-console/console-65578dfbd6-7hzwx" May 27 21:09:15.543177 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:15.543104 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-console-serving-cert\") pod \"console-65578dfbd6-7hzwx\" (UID: \"fc42ee3f-e972-443b-a4eb-97d75d41e8ca\") " pod="openshift-console/console-65578dfbd6-7hzwx" May 27 21:09:15.552877 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:15.552859 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2mp8\" (UniqueName: \"kubernetes.io/projected/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-kube-api-access-v2mp8\") pod \"console-65578dfbd6-7hzwx\" (UID: \"fc42ee3f-e972-443b-a4eb-97d75d41e8ca\") " pod="openshift-console/console-65578dfbd6-7hzwx" May 27 21:09:15.643433 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:15.643359 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65578dfbd6-7hzwx" May 27 21:09:15.784468 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:15.784302 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65578dfbd6-7hzwx"] May 27 21:09:15.787381 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:09:15.787340 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc42ee3f_e972_443b_a4eb_97d75d41e8ca.slice/crio-42297e220f81855718c37e02b1dca7299fed88d7e2e6eb7eea58548019239422 WatchSource:0}: Error finding container 42297e220f81855718c37e02b1dca7299fed88d7e2e6eb7eea58548019239422: Status 404 returned error can't find the container with id 42297e220f81855718c37e02b1dca7299fed88d7e2e6eb7eea58548019239422 May 27 21:09:16.709758 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:16.709720 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65578dfbd6-7hzwx" event={"ID":"fc42ee3f-e972-443b-a4eb-97d75d41e8ca","Type":"ContainerStarted","Data":"9968adcd54225206281581fcb734bb3dc5e8bf61cb3a726a303c4a77e43b6ea2"} May 27 21:09:16.709758 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:16.709762 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65578dfbd6-7hzwx" event={"ID":"fc42ee3f-e972-443b-a4eb-97d75d41e8ca","Type":"ContainerStarted","Data":"42297e220f81855718c37e02b1dca7299fed88d7e2e6eb7eea58548019239422"} May 27 21:09:16.729198 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:16.729153 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-65578dfbd6-7hzwx" podStartSLOduration=1.729140356 podStartE2EDuration="1.729140356s" podCreationTimestamp="2026-05-27 21:09:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:09:16.727789296 +0000 UTC m=+181.347175093" watchObservedRunningTime="2026-05-27 21:09:16.729140356 +0000 UTC m=+181.348526140" May 27 21:09:17.701362 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:17.701331 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-54f7bff98c-qdrhx" May 27 21:09:25.643932 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:25.643890 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65578dfbd6-7hzwx" May 27 21:09:25.643932 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:25.643934 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65578dfbd6-7hzwx" May 27 21:09:25.649820 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:25.649795 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65578dfbd6-7hzwx" May 27 21:09:25.748128 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:25.748086 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-xw8r7" event={"ID":"8c01813f-aad3-4011-a23f-2e4e98cb4c26","Type":"ContainerStarted","Data":"67ab146bdb1e859e8186eb8e94aa317c67896b288ea6af5ccf8df7ae8e1699d3"} May 27 21:09:25.748628 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:25.748520 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-xw8r7" May 27 21:09:25.752762 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:25.752737 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65578dfbd6-7hzwx" May 27 21:09:25.762455 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:25.762427 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-xw8r7" May 27 21:09:25.767644 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:25.767600 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-xw8r7" podStartSLOduration=1.8927730029999998 podStartE2EDuration="30.767586019s" podCreationTimestamp="2026-05-27 21:08:55 +0000 UTC" firstStartedPulling="2026-05-27 21:08:55.8738823 +0000 UTC m=+160.493268064" lastFinishedPulling="2026-05-27 21:09:24.748695314 +0000 UTC m=+189.368081080" observedRunningTime="2026-05-27 21:09:25.767249192 +0000 UTC m=+190.386634978" watchObservedRunningTime="2026-05-27 21:09:25.767586019 +0000 UTC m=+190.386971805" May 27 21:09:25.824814 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:25.824782 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67b56c68c9-g7lvr"] May 27 21:09:45.813173 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:45.813138 2566 generic.go:358] "Generic (PLEG): container finished" podID="ec6a5a07-1a2d-4f45-8146-ba0d534d28ea" containerID="17dba38e008015347f85a6d1067e9ccedca07f1c87f114ca9f18700afeaf013d" exitCode=0 May 27 21:09:45.813618 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:45.813213 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-vq5t6" event={"ID":"ec6a5a07-1a2d-4f45-8146-ba0d534d28ea","Type":"ContainerDied","Data":"17dba38e008015347f85a6d1067e9ccedca07f1c87f114ca9f18700afeaf013d"} May 27 21:09:45.813618 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:45.813526 2566 scope.go:117] "RemoveContainer" containerID="17dba38e008015347f85a6d1067e9ccedca07f1c87f114ca9f18700afeaf013d" May 27 21:09:46.817192 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:46.817161 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-vq5t6" event={"ID":"ec6a5a07-1a2d-4f45-8146-ba0d534d28ea","Type":"ContainerStarted","Data":"6cdd18f512bdd6c54c49c8db4613de3962683f14a4c8ce639b7eaa658a43eaf6"} May 27 21:09:50.851727 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:50.851691 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-67b56c68c9-g7lvr" podUID="0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345" containerName="console" containerID="cri-o://ccd53c805465eeeb2283f5ed50af54fde60704a28838c599b0396bac22ee0480" gracePeriod=15 May 27 21:09:51.083544 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:51.083524 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-67b56c68c9-g7lvr_0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345/console/0.log" May 27 21:09:51.083647 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:51.083583 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67b56c68c9-g7lvr" May 27 21:09:51.150653 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:51.150598 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345-oauth-serving-cert\") pod \"0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345\" (UID: \"0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345\") " May 27 21:09:51.150653 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:51.150640 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345-service-ca\") pod \"0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345\" (UID: \"0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345\") " May 27 21:09:51.150786 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:51.150674 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345-console-oauth-config\") pod \"0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345\" (UID: \"0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345\") " May 27 21:09:51.150822 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:51.150779 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cprrm\" (UniqueName: \"kubernetes.io/projected/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345-kube-api-access-cprrm\") pod \"0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345\" (UID: \"0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345\") " May 27 21:09:51.150822 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:51.150813 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345-console-serving-cert\") pod \"0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345\" (UID: \"0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345\") " May 27 21:09:51.150885 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:51.150866 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345-console-config\") pod \"0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345\" (UID: \"0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345\") " May 27 21:09:51.151064 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:51.151011 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345" (UID: "0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:09:51.151150 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:51.151074 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345-service-ca" (OuterVolumeSpecName: "service-ca") pod "0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345" (UID: "0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:09:51.151290 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:51.151266 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345-oauth-serving-cert\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:09:51.151290 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:51.151289 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345-service-ca\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:09:51.151465 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:51.151346 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345-console-config" (OuterVolumeSpecName: "console-config") pod "0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345" (UID: "0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:09:51.152880 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:51.152846 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345" (UID: "0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:09:51.152953 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:51.152888 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345" (UID: "0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:09:51.152953 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:51.152926 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345-kube-api-access-cprrm" (OuterVolumeSpecName: "kube-api-access-cprrm") pod "0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345" (UID: "0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345"). InnerVolumeSpecName "kube-api-access-cprrm". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:09:51.252650 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:51.252624 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345-console-oauth-config\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:09:51.252650 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:51.252646 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cprrm\" (UniqueName: \"kubernetes.io/projected/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345-kube-api-access-cprrm\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:09:51.252769 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:51.252656 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345-console-serving-cert\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:09:51.252769 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:51.252665 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345-console-config\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:09:51.832914 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:51.832890 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-67b56c68c9-g7lvr_0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345/console/0.log" May 27 21:09:51.833093 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:51.832930 2566 generic.go:358] "Generic (PLEG): container finished" podID="0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345" containerID="ccd53c805465eeeb2283f5ed50af54fde60704a28838c599b0396bac22ee0480" exitCode=2 May 27 21:09:51.833093 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:51.833001 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67b56c68c9-g7lvr" May 27 21:09:51.833093 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:51.833005 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67b56c68c9-g7lvr" event={"ID":"0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345","Type":"ContainerDied","Data":"ccd53c805465eeeb2283f5ed50af54fde60704a28838c599b0396bac22ee0480"} May 27 21:09:51.833093 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:51.833057 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67b56c68c9-g7lvr" event={"ID":"0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345","Type":"ContainerDied","Data":"61d102c59ee4354131536bf3c85533ecf16107d51849627b676ea78a9cb4fd70"} May 27 21:09:51.833093 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:51.833078 2566 scope.go:117] "RemoveContainer" containerID="ccd53c805465eeeb2283f5ed50af54fde60704a28838c599b0396bac22ee0480" May 27 21:09:51.841149 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:51.841134 2566 scope.go:117] "RemoveContainer" containerID="ccd53c805465eeeb2283f5ed50af54fde60704a28838c599b0396bac22ee0480" May 27 21:09:51.841405 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:09:51.841386 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccd53c805465eeeb2283f5ed50af54fde60704a28838c599b0396bac22ee0480\": container with ID starting with ccd53c805465eeeb2283f5ed50af54fde60704a28838c599b0396bac22ee0480 not found: ID does not exist" containerID="ccd53c805465eeeb2283f5ed50af54fde60704a28838c599b0396bac22ee0480" May 27 21:09:51.841451 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:51.841414 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccd53c805465eeeb2283f5ed50af54fde60704a28838c599b0396bac22ee0480"} err="failed to get container status \"ccd53c805465eeeb2283f5ed50af54fde60704a28838c599b0396bac22ee0480\": rpc error: code = NotFound desc = could not find container \"ccd53c805465eeeb2283f5ed50af54fde60704a28838c599b0396bac22ee0480\": container with ID starting with ccd53c805465eeeb2283f5ed50af54fde60704a28838c599b0396bac22ee0480 not found: ID does not exist" May 27 21:09:51.853490 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:51.853468 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67b56c68c9-g7lvr"] May 27 21:09:51.857555 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:51.857535 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67b56c68c9-g7lvr"] May 27 21:09:52.032596 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:52.032544 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345" path="/var/lib/kubelet/pods/0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345/volumes" May 27 21:09:52.836995 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:52.836960 2566 generic.go:358] "Generic (PLEG): container finished" podID="d33788ba-035e-4978-ac0a-88f2777a3401" containerID="994b079e4c299edcf9aa7696e1d321368a127cc5d1ddc7afc4ef379ccf3f7415" exitCode=0 May 27 21:09:52.837197 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:52.837053 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wwsch" event={"ID":"d33788ba-035e-4978-ac0a-88f2777a3401","Type":"ContainerDied","Data":"994b079e4c299edcf9aa7696e1d321368a127cc5d1ddc7afc4ef379ccf3f7415"} May 27 21:09:52.837427 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:52.837409 2566 scope.go:117] "RemoveContainer" containerID="994b079e4c299edcf9aa7696e1d321368a127cc5d1ddc7afc4ef379ccf3f7415" May 27 21:09:53.842648 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:53.842615 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wwsch" event={"ID":"d33788ba-035e-4978-ac0a-88f2777a3401","Type":"ContainerStarted","Data":"6519119efc68bf5598e2a594192aa8bf7fb3d89975a27bd1145abde525047662"} May 27 21:09:56.852980 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:56.852891 2566 generic.go:358] "Generic (PLEG): container finished" podID="df4cc3b6-d37e-4739-a2c4-b4a49d264118" containerID="aaa77a224deab1a7b27ed543571e337cc8795a06f72c70aa0c99a004adae5621" exitCode=0 May 27 21:09:56.853437 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:56.852968 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bl9ns" event={"ID":"df4cc3b6-d37e-4739-a2c4-b4a49d264118","Type":"ContainerDied","Data":"aaa77a224deab1a7b27ed543571e337cc8795a06f72c70aa0c99a004adae5621"} May 27 21:09:56.853504 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:56.853442 2566 scope.go:117] "RemoveContainer" containerID="aaa77a224deab1a7b27ed543571e337cc8795a06f72c70aa0c99a004adae5621" May 27 21:09:57.860491 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:09:57.860452 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bl9ns" event={"ID":"df4cc3b6-d37e-4739-a2c4-b4a49d264118","Type":"ContainerStarted","Data":"0c3d451aff797b7e8a2a051f1f542de1cf18ed09124a02209f2408d7c92dd1f9"} May 27 21:10:21.258289 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:21.258256 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6ff7c89b65-5zdxs"] May 27 21:10:21.258664 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:21.258578 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345" containerName="console" May 27 21:10:21.258664 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:21.258593 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345" containerName="console" May 27 21:10:21.258664 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:21.258654 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="0c7df3dc-5c4d-4ce1-8b96-09dc5c1a9345" containerName="console" May 27 21:10:21.261590 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:21.261563 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ff7c89b65-5zdxs" May 27 21:10:21.279537 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:21.279514 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ff7c89b65-5zdxs"] May 27 21:10:21.394556 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:21.394523 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/52a29fef-828a-41f6-abaa-9a89635489ed-console-serving-cert\") pod \"console-6ff7c89b65-5zdxs\" (UID: \"52a29fef-828a-41f6-abaa-9a89635489ed\") " pod="openshift-console/console-6ff7c89b65-5zdxs" May 27 21:10:21.394556 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:21.394558 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/52a29fef-828a-41f6-abaa-9a89635489ed-oauth-serving-cert\") pod \"console-6ff7c89b65-5zdxs\" (UID: \"52a29fef-828a-41f6-abaa-9a89635489ed\") " pod="openshift-console/console-6ff7c89b65-5zdxs" May 27 21:10:21.394837 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:21.394588 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/52a29fef-828a-41f6-abaa-9a89635489ed-console-oauth-config\") pod \"console-6ff7c89b65-5zdxs\" (UID: \"52a29fef-828a-41f6-abaa-9a89635489ed\") " pod="openshift-console/console-6ff7c89b65-5zdxs" May 27 21:10:21.394837 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:21.394604 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5pzx\" (UniqueName: \"kubernetes.io/projected/52a29fef-828a-41f6-abaa-9a89635489ed-kube-api-access-j5pzx\") pod \"console-6ff7c89b65-5zdxs\" (UID: \"52a29fef-828a-41f6-abaa-9a89635489ed\") " pod="openshift-console/console-6ff7c89b65-5zdxs" May 27 21:10:21.394837 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:21.394645 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52a29fef-828a-41f6-abaa-9a89635489ed-trusted-ca-bundle\") pod \"console-6ff7c89b65-5zdxs\" (UID: \"52a29fef-828a-41f6-abaa-9a89635489ed\") " pod="openshift-console/console-6ff7c89b65-5zdxs" May 27 21:10:21.394837 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:21.394662 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/52a29fef-828a-41f6-abaa-9a89635489ed-console-config\") pod \"console-6ff7c89b65-5zdxs\" (UID: \"52a29fef-828a-41f6-abaa-9a89635489ed\") " pod="openshift-console/console-6ff7c89b65-5zdxs" May 27 21:10:21.394837 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:21.394677 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/52a29fef-828a-41f6-abaa-9a89635489ed-service-ca\") pod \"console-6ff7c89b65-5zdxs\" (UID: \"52a29fef-828a-41f6-abaa-9a89635489ed\") " pod="openshift-console/console-6ff7c89b65-5zdxs" May 27 21:10:21.495535 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:21.495500 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/52a29fef-828a-41f6-abaa-9a89635489ed-console-serving-cert\") pod \"console-6ff7c89b65-5zdxs\" (UID: \"52a29fef-828a-41f6-abaa-9a89635489ed\") " pod="openshift-console/console-6ff7c89b65-5zdxs" May 27 21:10:21.495535 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:21.495536 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/52a29fef-828a-41f6-abaa-9a89635489ed-oauth-serving-cert\") pod \"console-6ff7c89b65-5zdxs\" (UID: \"52a29fef-828a-41f6-abaa-9a89635489ed\") " pod="openshift-console/console-6ff7c89b65-5zdxs" May 27 21:10:21.495783 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:21.495561 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/52a29fef-828a-41f6-abaa-9a89635489ed-console-oauth-config\") pod \"console-6ff7c89b65-5zdxs\" (UID: \"52a29fef-828a-41f6-abaa-9a89635489ed\") " pod="openshift-console/console-6ff7c89b65-5zdxs" May 27 21:10:21.495783 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:21.495576 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j5pzx\" (UniqueName: \"kubernetes.io/projected/52a29fef-828a-41f6-abaa-9a89635489ed-kube-api-access-j5pzx\") pod \"console-6ff7c89b65-5zdxs\" (UID: \"52a29fef-828a-41f6-abaa-9a89635489ed\") " pod="openshift-console/console-6ff7c89b65-5zdxs" May 27 21:10:21.495783 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:21.495608 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52a29fef-828a-41f6-abaa-9a89635489ed-trusted-ca-bundle\") pod \"console-6ff7c89b65-5zdxs\" (UID: \"52a29fef-828a-41f6-abaa-9a89635489ed\") " pod="openshift-console/console-6ff7c89b65-5zdxs" May 27 21:10:21.495783 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:21.495628 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/52a29fef-828a-41f6-abaa-9a89635489ed-console-config\") pod \"console-6ff7c89b65-5zdxs\" (UID: \"52a29fef-828a-41f6-abaa-9a89635489ed\") " pod="openshift-console/console-6ff7c89b65-5zdxs" May 27 21:10:21.495783 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:21.495644 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/52a29fef-828a-41f6-abaa-9a89635489ed-service-ca\") pod \"console-6ff7c89b65-5zdxs\" (UID: \"52a29fef-828a-41f6-abaa-9a89635489ed\") " pod="openshift-console/console-6ff7c89b65-5zdxs" May 27 21:10:21.496342 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:21.496320 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/52a29fef-828a-41f6-abaa-9a89635489ed-oauth-serving-cert\") pod \"console-6ff7c89b65-5zdxs\" (UID: \"52a29fef-828a-41f6-abaa-9a89635489ed\") " pod="openshift-console/console-6ff7c89b65-5zdxs" May 27 21:10:21.496454 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:21.496431 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/52a29fef-828a-41f6-abaa-9a89635489ed-service-ca\") pod \"console-6ff7c89b65-5zdxs\" (UID: \"52a29fef-828a-41f6-abaa-9a89635489ed\") " pod="openshift-console/console-6ff7c89b65-5zdxs" May 27 21:10:21.496517 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:21.496498 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52a29fef-828a-41f6-abaa-9a89635489ed-trusted-ca-bundle\") pod \"console-6ff7c89b65-5zdxs\" (UID: \"52a29fef-828a-41f6-abaa-9a89635489ed\") " pod="openshift-console/console-6ff7c89b65-5zdxs" May 27 21:10:21.496566 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:21.496545 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/52a29fef-828a-41f6-abaa-9a89635489ed-console-config\") pod \"console-6ff7c89b65-5zdxs\" (UID: \"52a29fef-828a-41f6-abaa-9a89635489ed\") " pod="openshift-console/console-6ff7c89b65-5zdxs" May 27 21:10:21.498104 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:21.498072 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/52a29fef-828a-41f6-abaa-9a89635489ed-console-serving-cert\") pod \"console-6ff7c89b65-5zdxs\" (UID: \"52a29fef-828a-41f6-abaa-9a89635489ed\") " pod="openshift-console/console-6ff7c89b65-5zdxs" May 27 21:10:21.498189 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:21.498115 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/52a29fef-828a-41f6-abaa-9a89635489ed-console-oauth-config\") pod \"console-6ff7c89b65-5zdxs\" (UID: \"52a29fef-828a-41f6-abaa-9a89635489ed\") " pod="openshift-console/console-6ff7c89b65-5zdxs" May 27 21:10:21.504665 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:21.504635 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5pzx\" (UniqueName: \"kubernetes.io/projected/52a29fef-828a-41f6-abaa-9a89635489ed-kube-api-access-j5pzx\") pod \"console-6ff7c89b65-5zdxs\" (UID: \"52a29fef-828a-41f6-abaa-9a89635489ed\") " pod="openshift-console/console-6ff7c89b65-5zdxs" May 27 21:10:21.570700 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:21.570682 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ff7c89b65-5zdxs" May 27 21:10:21.698569 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:21.698539 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ff7c89b65-5zdxs"] May 27 21:10:21.702237 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:10:21.702209 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52a29fef_828a_41f6_abaa_9a89635489ed.slice/crio-2f0e890bc6cd02ea1a75728c3089ca36e1f6d2a3f902d358e638bdb1f190dd19 WatchSource:0}: Error finding container 2f0e890bc6cd02ea1a75728c3089ca36e1f6d2a3f902d358e638bdb1f190dd19: Status 404 returned error can't find the container with id 2f0e890bc6cd02ea1a75728c3089ca36e1f6d2a3f902d358e638bdb1f190dd19 May 27 21:10:21.933634 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:21.933556 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ff7c89b65-5zdxs" event={"ID":"52a29fef-828a-41f6-abaa-9a89635489ed","Type":"ContainerStarted","Data":"10bd70493e7329e95780a5279349c10b5f0abbc7b769488064895d98f8558b89"} May 27 21:10:21.933634 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:21.933598 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ff7c89b65-5zdxs" event={"ID":"52a29fef-828a-41f6-abaa-9a89635489ed","Type":"ContainerStarted","Data":"2f0e890bc6cd02ea1a75728c3089ca36e1f6d2a3f902d358e638bdb1f190dd19"} May 27 21:10:21.955266 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:21.955223 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6ff7c89b65-5zdxs" podStartSLOduration=0.955209854 podStartE2EDuration="955.209854ms" podCreationTimestamp="2026-05-27 21:10:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:10:21.954179822 +0000 UTC m=+246.573565609" watchObservedRunningTime="2026-05-27 21:10:21.955209854 +0000 UTC m=+246.574595639" May 27 21:10:25.583840 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.583803 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 21:10:25.586501 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.586482 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.589560 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.589534 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 27 21:10:25.589560 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.589558 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 27 21:10:25.589752 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.589540 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 27 21:10:25.590574 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.590548 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 27 21:10:25.590752 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.590733 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nnc2t\"" May 27 21:10:25.590815 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.590756 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 27 21:10:25.591002 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.590988 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 27 21:10:25.591494 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.591465 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 27 21:10:25.595183 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.595161 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 27 21:10:25.596241 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.596223 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 27 21:10:25.608663 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.608642 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 21:10:25.734343 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.734310 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.734501 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.734354 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.734501 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.734395 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.734501 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.734413 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.734501 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.734431 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-config-out\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.734627 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.734497 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.734627 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.734552 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-web-config\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.734627 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.734579 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.734627 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.734601 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.734745 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.734627 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-config-volume\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.734745 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.734650 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lxh2\" (UniqueName: \"kubernetes.io/projected/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-kube-api-access-2lxh2\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.734745 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.734668 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.734745 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.734686 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.835411 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.835327 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.835411 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.835376 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.835636 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.835442 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.835636 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.835467 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.835636 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.835496 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-config-out\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.835636 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.835535 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.835636 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.835581 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-web-config\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.835636 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.835616 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.835981 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.835653 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.835981 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.835682 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-config-volume\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.835981 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.835710 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2lxh2\" (UniqueName: \"kubernetes.io/projected/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-kube-api-access-2lxh2\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.835981 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.835740 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.835981 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.835769 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.836263 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.836208 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.836263 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.836212 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.836360 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.836275 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.838740 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.838704 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.838947 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.838924 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-web-config\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.839082 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.839053 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.839263 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.839231 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.839263 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.839242 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.839374 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.839302 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.839374 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.839364 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.839661 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.839641 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-config-out\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.840541 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.840525 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-config-volume\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.844663 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.844641 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lxh2\" (UniqueName: \"kubernetes.io/projected/7215fe9f-2bcb-4abd-86f3-449e31b0fe57-kube-api-access-2lxh2\") pod \"alertmanager-main-0\" (UID: \"7215fe9f-2bcb-4abd-86f3-449e31b0fe57\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:25.896348 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:25.896323 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 21:10:26.037179 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:26.037145 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 21:10:26.040391 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:10:26.040366 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7215fe9f_2bcb_4abd_86f3_449e31b0fe57.slice/crio-b5f74c90e26f4654a8841ddf7993517c650c86df2148bd60dc58329043fcc3d9 WatchSource:0}: Error finding container b5f74c90e26f4654a8841ddf7993517c650c86df2148bd60dc58329043fcc3d9: Status 404 returned error can't find the container with id b5f74c90e26f4654a8841ddf7993517c650c86df2148bd60dc58329043fcc3d9 May 27 21:10:26.845219 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:26.845185 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1-metrics-certs\") pod \"network-metrics-daemon-b7dq5\" (UID: \"5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1\") " pod="openshift-multus/network-metrics-daemon-b7dq5" May 27 21:10:26.847587 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:26.847559 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1-metrics-certs\") pod \"network-metrics-daemon-b7dq5\" (UID: \"5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1\") " pod="openshift-multus/network-metrics-daemon-b7dq5" May 27 21:10:26.929623 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:26.929540 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nvnhn\"" May 27 21:10:26.937743 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:26.937723 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dq5" May 27 21:10:26.950758 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:26.950727 2566 generic.go:358] "Generic (PLEG): container finished" podID="7215fe9f-2bcb-4abd-86f3-449e31b0fe57" containerID="5a191b142612fb36feeefa6226d97fa6814cf98684d266850a9f14988bd61518" exitCode=0 May 27 21:10:26.950876 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:26.950801 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7215fe9f-2bcb-4abd-86f3-449e31b0fe57","Type":"ContainerDied","Data":"5a191b142612fb36feeefa6226d97fa6814cf98684d266850a9f14988bd61518"} May 27 21:10:26.950876 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:26.950828 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7215fe9f-2bcb-4abd-86f3-449e31b0fe57","Type":"ContainerStarted","Data":"b5f74c90e26f4654a8841ddf7993517c650c86df2148bd60dc58329043fcc3d9"} May 27 21:10:27.079455 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:27.079407 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b7dq5"] May 27 21:10:27.081919 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:10:27.081890 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5961a7fc_d8b0_43e5_9b3f_f007a3b0baf1.slice/crio-4c746fb7980cd2484d0e32edc57ac8814fbcfcc97a1a9d5ca79dc5436c1669d7 WatchSource:0}: Error finding container 4c746fb7980cd2484d0e32edc57ac8814fbcfcc97a1a9d5ca79dc5436c1669d7: Status 404 returned error can't find the container with id 4c746fb7980cd2484d0e32edc57ac8814fbcfcc97a1a9d5ca79dc5436c1669d7 May 27 21:10:27.955780 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:27.955745 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b7dq5" event={"ID":"5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1","Type":"ContainerStarted","Data":"4c746fb7980cd2484d0e32edc57ac8814fbcfcc97a1a9d5ca79dc5436c1669d7"} May 27 21:10:28.961399 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:28.961301 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b7dq5" event={"ID":"5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1","Type":"ContainerStarted","Data":"0ef257cb1922f4c3df0c5ce3748c17a352d10422ddfec387f10d4cdda4504ebb"} May 27 21:10:28.961399 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:28.961345 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b7dq5" event={"ID":"5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1","Type":"ContainerStarted","Data":"94f148fffbabeedfc1d9a892fd66ccf635e64314da8f75df47f717c9636a4a20"} May 27 21:10:28.964074 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:28.964046 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7215fe9f-2bcb-4abd-86f3-449e31b0fe57","Type":"ContainerStarted","Data":"f0f543c8f26f1509e1fe035e580b72e9cd4413ba87f65834b8a27cb7e801e89e"} May 27 21:10:28.964182 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:28.964080 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7215fe9f-2bcb-4abd-86f3-449e31b0fe57","Type":"ContainerStarted","Data":"79441e766ee5b8f60dc972127a8a4a128d10d40bbb0979bc256a8c51158fbfc4"} May 27 21:10:28.964182 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:28.964095 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7215fe9f-2bcb-4abd-86f3-449e31b0fe57","Type":"ContainerStarted","Data":"13cb1bd02daf78a7e60cdd31e42c4ba85a347760fa186653b6ab1dc7453f6f57"} May 27 21:10:28.964182 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:28.964108 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7215fe9f-2bcb-4abd-86f3-449e31b0fe57","Type":"ContainerStarted","Data":"cf800ccb6dedb11cca0fc0c959b3d1790182d5c676165a5daf39aea26c373797"} May 27 21:10:28.964182 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:28.964119 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7215fe9f-2bcb-4abd-86f3-449e31b0fe57","Type":"ContainerStarted","Data":"80e57bb08566f538a90a28461d172996380e6b0f947675e898e8bc43b5811df9"} May 27 21:10:28.964182 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:28.964131 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7215fe9f-2bcb-4abd-86f3-449e31b0fe57","Type":"ContainerStarted","Data":"05c3c85a29614efa370acb2bee41759c8f38a1a22828af73150e83e4b65ad57e"} May 27 21:10:28.977559 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:28.977499 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-b7dq5" podStartSLOduration=251.633064607 podStartE2EDuration="4m12.97748201s" podCreationTimestamp="2026-05-27 21:06:16 +0000 UTC" firstStartedPulling="2026-05-27 21:10:27.083737984 +0000 UTC m=+251.703123747" lastFinishedPulling="2026-05-27 21:10:28.428155383 +0000 UTC m=+253.047541150" observedRunningTime="2026-05-27 21:10:28.977187746 +0000 UTC m=+253.596573536" watchObservedRunningTime="2026-05-27 21:10:28.97748201 +0000 UTC m=+253.596867797" May 27 21:10:29.004364 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:29.004312 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.525841679 podStartE2EDuration="4.004294004s" podCreationTimestamp="2026-05-27 21:10:25 +0000 UTC" firstStartedPulling="2026-05-27 21:10:26.952079137 +0000 UTC m=+251.571464903" lastFinishedPulling="2026-05-27 21:10:28.430531461 +0000 UTC m=+253.049917228" observedRunningTime="2026-05-27 21:10:29.003232761 +0000 UTC m=+253.622618569" watchObservedRunningTime="2026-05-27 21:10:29.004294004 +0000 UTC m=+253.623679791" May 27 21:10:31.571284 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:31.571243 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6ff7c89b65-5zdxs" May 27 21:10:31.571683 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:31.571340 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6ff7c89b65-5zdxs" May 27 21:10:31.576183 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:31.576167 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6ff7c89b65-5zdxs" May 27 21:10:31.977908 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:31.977825 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6ff7c89b65-5zdxs" May 27 21:10:32.038517 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:32.038486 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65578dfbd6-7hzwx"] May 27 21:10:48.277418 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:48.277381 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-j5q9r"] May 27 21:10:48.280221 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:48.280199 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5q9r" May 27 21:10:48.282554 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:48.282536 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 27 21:10:48.287678 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:48.287396 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j5q9r"] May 27 21:10:48.336606 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:48.336569 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d2e3f4d-6c7c-4922-a7c1-961f9d756d79-original-pull-secret\") pod \"global-pull-secret-syncer-j5q9r\" (UID: \"1d2e3f4d-6c7c-4922-a7c1-961f9d756d79\") " pod="kube-system/global-pull-secret-syncer-j5q9r" May 27 21:10:48.336777 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:48.336640 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1d2e3f4d-6c7c-4922-a7c1-961f9d756d79-dbus\") pod \"global-pull-secret-syncer-j5q9r\" (UID: \"1d2e3f4d-6c7c-4922-a7c1-961f9d756d79\") " pod="kube-system/global-pull-secret-syncer-j5q9r" May 27 21:10:48.336777 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:48.336692 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1d2e3f4d-6c7c-4922-a7c1-961f9d756d79-kubelet-config\") pod \"global-pull-secret-syncer-j5q9r\" (UID: \"1d2e3f4d-6c7c-4922-a7c1-961f9d756d79\") " pod="kube-system/global-pull-secret-syncer-j5q9r" May 27 21:10:48.437622 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:48.437583 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1d2e3f4d-6c7c-4922-a7c1-961f9d756d79-kubelet-config\") pod \"global-pull-secret-syncer-j5q9r\" (UID: \"1d2e3f4d-6c7c-4922-a7c1-961f9d756d79\") " pod="kube-system/global-pull-secret-syncer-j5q9r" May 27 21:10:48.437806 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:48.437651 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d2e3f4d-6c7c-4922-a7c1-961f9d756d79-original-pull-secret\") pod \"global-pull-secret-syncer-j5q9r\" (UID: \"1d2e3f4d-6c7c-4922-a7c1-961f9d756d79\") " pod="kube-system/global-pull-secret-syncer-j5q9r" May 27 21:10:48.437806 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:48.437711 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1d2e3f4d-6c7c-4922-a7c1-961f9d756d79-dbus\") pod \"global-pull-secret-syncer-j5q9r\" (UID: \"1d2e3f4d-6c7c-4922-a7c1-961f9d756d79\") " pod="kube-system/global-pull-secret-syncer-j5q9r" May 27 21:10:48.437806 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:48.437726 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1d2e3f4d-6c7c-4922-a7c1-961f9d756d79-kubelet-config\") pod \"global-pull-secret-syncer-j5q9r\" (UID: \"1d2e3f4d-6c7c-4922-a7c1-961f9d756d79\") " pod="kube-system/global-pull-secret-syncer-j5q9r" May 27 21:10:48.437917 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:48.437850 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1d2e3f4d-6c7c-4922-a7c1-961f9d756d79-dbus\") pod \"global-pull-secret-syncer-j5q9r\" (UID: \"1d2e3f4d-6c7c-4922-a7c1-961f9d756d79\") " pod="kube-system/global-pull-secret-syncer-j5q9r" May 27 21:10:48.439990 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:48.439960 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d2e3f4d-6c7c-4922-a7c1-961f9d756d79-original-pull-secret\") pod \"global-pull-secret-syncer-j5q9r\" (UID: \"1d2e3f4d-6c7c-4922-a7c1-961f9d756d79\") " pod="kube-system/global-pull-secret-syncer-j5q9r" May 27 21:10:48.589881 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:48.589855 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5q9r" May 27 21:10:48.711776 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:48.711743 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j5q9r"] May 27 21:10:48.714979 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:10:48.714946 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d2e3f4d_6c7c_4922_a7c1_961f9d756d79.slice/crio-6591034c9fd1e528f1784690dd1fa22b0dd70158e42985a46531f0599a6bbf97 WatchSource:0}: Error finding container 6591034c9fd1e528f1784690dd1fa22b0dd70158e42985a46531f0599a6bbf97: Status 404 returned error can't find the container with id 6591034c9fd1e528f1784690dd1fa22b0dd70158e42985a46531f0599a6bbf97 May 27 21:10:49.027137 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:49.027057 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j5q9r" event={"ID":"1d2e3f4d-6c7c-4922-a7c1-961f9d756d79","Type":"ContainerStarted","Data":"6591034c9fd1e528f1784690dd1fa22b0dd70158e42985a46531f0599a6bbf97"} May 27 21:10:53.041269 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:53.041189 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j5q9r" event={"ID":"1d2e3f4d-6c7c-4922-a7c1-961f9d756d79","Type":"ContainerStarted","Data":"529a378b4390889657addc8d50a3fc0dd35ff041c7c057b3fdbbcd2efd5b3420"} May 27 21:10:53.061000 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:53.060959 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-j5q9r" podStartSLOduration=1.161876352 podStartE2EDuration="5.060945392s" podCreationTimestamp="2026-05-27 21:10:48 +0000 UTC" firstStartedPulling="2026-05-27 21:10:48.716668931 +0000 UTC m=+273.336054709" lastFinishedPulling="2026-05-27 21:10:52.615737983 +0000 UTC m=+277.235123749" observedRunningTime="2026-05-27 21:10:53.060728385 +0000 UTC m=+277.680114163" watchObservedRunningTime="2026-05-27 21:10:53.060945392 +0000 UTC m=+277.680331215" May 27 21:10:57.058620 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:57.058581 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-65578dfbd6-7hzwx" podUID="fc42ee3f-e972-443b-a4eb-97d75d41e8ca" containerName="console" containerID="cri-o://9968adcd54225206281581fcb734bb3dc5e8bf61cb3a726a303c4a77e43b6ea2" gracePeriod=15 May 27 21:10:57.303869 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:57.303845 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-65578dfbd6-7hzwx_fc42ee3f-e972-443b-a4eb-97d75d41e8ca/console/0.log" May 27 21:10:57.303993 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:57.303909 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65578dfbd6-7hzwx" May 27 21:10:57.418985 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:57.418882 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-console-serving-cert\") pod \"fc42ee3f-e972-443b-a4eb-97d75d41e8ca\" (UID: \"fc42ee3f-e972-443b-a4eb-97d75d41e8ca\") " May 27 21:10:57.418985 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:57.418936 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-trusted-ca-bundle\") pod \"fc42ee3f-e972-443b-a4eb-97d75d41e8ca\" (UID: \"fc42ee3f-e972-443b-a4eb-97d75d41e8ca\") " May 27 21:10:57.418985 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:57.418979 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2mp8\" (UniqueName: \"kubernetes.io/projected/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-kube-api-access-v2mp8\") pod \"fc42ee3f-e972-443b-a4eb-97d75d41e8ca\" (UID: \"fc42ee3f-e972-443b-a4eb-97d75d41e8ca\") " May 27 21:10:57.419271 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:57.419074 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-console-config\") pod \"fc42ee3f-e972-443b-a4eb-97d75d41e8ca\" (UID: \"fc42ee3f-e972-443b-a4eb-97d75d41e8ca\") " May 27 21:10:57.419271 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:57.419092 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-service-ca\") pod \"fc42ee3f-e972-443b-a4eb-97d75d41e8ca\" (UID: \"fc42ee3f-e972-443b-a4eb-97d75d41e8ca\") " May 27 21:10:57.419271 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:57.419109 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-oauth-serving-cert\") pod \"fc42ee3f-e972-443b-a4eb-97d75d41e8ca\" (UID: \"fc42ee3f-e972-443b-a4eb-97d75d41e8ca\") " May 27 21:10:57.419271 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:57.419143 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-console-oauth-config\") pod \"fc42ee3f-e972-443b-a4eb-97d75d41e8ca\" (UID: \"fc42ee3f-e972-443b-a4eb-97d75d41e8ca\") " May 27 21:10:57.419477 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:57.419454 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fc42ee3f-e972-443b-a4eb-97d75d41e8ca" (UID: "fc42ee3f-e972-443b-a4eb-97d75d41e8ca"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:10:57.419527 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:57.419480 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-console-config" (OuterVolumeSpecName: "console-config") pod "fc42ee3f-e972-443b-a4eb-97d75d41e8ca" (UID: "fc42ee3f-e972-443b-a4eb-97d75d41e8ca"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:10:57.419673 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:57.419636 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-service-ca" (OuterVolumeSpecName: "service-ca") pod "fc42ee3f-e972-443b-a4eb-97d75d41e8ca" (UID: "fc42ee3f-e972-443b-a4eb-97d75d41e8ca"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:10:57.419787 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:57.419677 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fc42ee3f-e972-443b-a4eb-97d75d41e8ca" (UID: "fc42ee3f-e972-443b-a4eb-97d75d41e8ca"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:10:57.421479 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:57.421443 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fc42ee3f-e972-443b-a4eb-97d75d41e8ca" (UID: "fc42ee3f-e972-443b-a4eb-97d75d41e8ca"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:10:57.421558 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:57.421487 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fc42ee3f-e972-443b-a4eb-97d75d41e8ca" (UID: "fc42ee3f-e972-443b-a4eb-97d75d41e8ca"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:10:57.421558 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:57.421503 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-kube-api-access-v2mp8" (OuterVolumeSpecName: "kube-api-access-v2mp8") pod "fc42ee3f-e972-443b-a4eb-97d75d41e8ca" (UID: "fc42ee3f-e972-443b-a4eb-97d75d41e8ca"). InnerVolumeSpecName "kube-api-access-v2mp8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:10:57.519991 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:57.519940 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-trusted-ca-bundle\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:10:57.519991 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:57.519987 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2mp8\" (UniqueName: \"kubernetes.io/projected/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-kube-api-access-v2mp8\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:10:57.519991 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:57.520000 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-console-config\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:10:57.519991 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:57.520009 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-service-ca\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:10:57.520275 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:57.520018 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-oauth-serving-cert\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:10:57.520275 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:57.520050 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-console-oauth-config\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:10:57.520275 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:57.520061 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc42ee3f-e972-443b-a4eb-97d75d41e8ca-console-serving-cert\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:10:58.057865 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:58.057839 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-65578dfbd6-7hzwx_fc42ee3f-e972-443b-a4eb-97d75d41e8ca/console/0.log" May 27 21:10:58.058066 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:58.057877 2566 generic.go:358] "Generic (PLEG): container finished" podID="fc42ee3f-e972-443b-a4eb-97d75d41e8ca" containerID="9968adcd54225206281581fcb734bb3dc5e8bf61cb3a726a303c4a77e43b6ea2" exitCode=2 May 27 21:10:58.058066 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:58.057904 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65578dfbd6-7hzwx" event={"ID":"fc42ee3f-e972-443b-a4eb-97d75d41e8ca","Type":"ContainerDied","Data":"9968adcd54225206281581fcb734bb3dc5e8bf61cb3a726a303c4a77e43b6ea2"} May 27 21:10:58.058066 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:58.057924 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65578dfbd6-7hzwx" event={"ID":"fc42ee3f-e972-443b-a4eb-97d75d41e8ca","Type":"ContainerDied","Data":"42297e220f81855718c37e02b1dca7299fed88d7e2e6eb7eea58548019239422"} May 27 21:10:58.058066 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:58.057939 2566 scope.go:117] "RemoveContainer" containerID="9968adcd54225206281581fcb734bb3dc5e8bf61cb3a726a303c4a77e43b6ea2" May 27 21:10:58.058066 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:58.057944 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65578dfbd6-7hzwx" May 27 21:10:58.066107 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:58.065926 2566 scope.go:117] "RemoveContainer" containerID="9968adcd54225206281581fcb734bb3dc5e8bf61cb3a726a303c4a77e43b6ea2" May 27 21:10:58.066323 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:10:58.066197 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9968adcd54225206281581fcb734bb3dc5e8bf61cb3a726a303c4a77e43b6ea2\": container with ID starting with 9968adcd54225206281581fcb734bb3dc5e8bf61cb3a726a303c4a77e43b6ea2 not found: ID does not exist" containerID="9968adcd54225206281581fcb734bb3dc5e8bf61cb3a726a303c4a77e43b6ea2" May 27 21:10:58.066323 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:58.066223 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9968adcd54225206281581fcb734bb3dc5e8bf61cb3a726a303c4a77e43b6ea2"} err="failed to get container status \"9968adcd54225206281581fcb734bb3dc5e8bf61cb3a726a303c4a77e43b6ea2\": rpc error: code = NotFound desc = could not find container \"9968adcd54225206281581fcb734bb3dc5e8bf61cb3a726a303c4a77e43b6ea2\": container with ID starting with 9968adcd54225206281581fcb734bb3dc5e8bf61cb3a726a303c4a77e43b6ea2 not found: ID does not exist" May 27 21:10:58.078317 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:58.078293 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65578dfbd6-7hzwx"] May 27 21:10:58.079801 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:10:58.079782 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65578dfbd6-7hzwx"] May 27 21:11:00.030476 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:00.030441 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc42ee3f-e972-443b-a4eb-97d75d41e8ca" path="/var/lib/kubelet/pods/fc42ee3f-e972-443b-a4eb-97d75d41e8ca/volumes" May 27 21:11:15.903612 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:15.903574 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fvw7h_0a60edfe-34bf-4d4f-8244-f08a7a0f3f06/console-operator/1.log" May 27 21:11:15.904184 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:15.903692 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fvw7h_0a60edfe-34bf-4d4f-8244-f08a7a0f3f06/console-operator/1.log" May 27 21:11:15.918582 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:15.918560 2566 kubelet.go:1628] "Image garbage collection succeeded" May 27 21:11:37.072328 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:37.072281 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsxrcp"] May 27 21:11:37.075016 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:37.072634 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc42ee3f-e972-443b-a4eb-97d75d41e8ca" containerName="console" May 27 21:11:37.075016 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:37.072645 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc42ee3f-e972-443b-a4eb-97d75d41e8ca" containerName="console" May 27 21:11:37.075016 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:37.072699 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="fc42ee3f-e972-443b-a4eb-97d75d41e8ca" containerName="console" May 27 21:11:37.075969 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:37.075952 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsxrcp" May 27 21:11:37.078538 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:37.078513 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 27 21:11:37.079386 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:37.079367 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tjd5p\"" May 27 21:11:37.079489 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:37.079367 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 27 21:11:37.083990 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:37.083967 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsxrcp"] May 27 21:11:37.166767 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:37.166725 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j2sp\" (UniqueName: \"kubernetes.io/projected/1a06011f-8fc2-4f7a-bbe3-c4e137022732-kube-api-access-9j2sp\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsxrcp\" (UID: \"1a06011f-8fc2-4f7a-bbe3-c4e137022732\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsxrcp" May 27 21:11:37.166970 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:37.166804 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a06011f-8fc2-4f7a-bbe3-c4e137022732-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsxrcp\" (UID: \"1a06011f-8fc2-4f7a-bbe3-c4e137022732\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsxrcp" May 27 21:11:37.166970 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:37.166852 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a06011f-8fc2-4f7a-bbe3-c4e137022732-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsxrcp\" (UID: \"1a06011f-8fc2-4f7a-bbe3-c4e137022732\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsxrcp" May 27 21:11:37.267584 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:37.267544 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a06011f-8fc2-4f7a-bbe3-c4e137022732-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsxrcp\" (UID: \"1a06011f-8fc2-4f7a-bbe3-c4e137022732\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsxrcp" May 27 21:11:37.267756 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:37.267643 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9j2sp\" (UniqueName: \"kubernetes.io/projected/1a06011f-8fc2-4f7a-bbe3-c4e137022732-kube-api-access-9j2sp\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsxrcp\" (UID: \"1a06011f-8fc2-4f7a-bbe3-c4e137022732\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsxrcp" May 27 21:11:37.267756 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:37.267698 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a06011f-8fc2-4f7a-bbe3-c4e137022732-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsxrcp\" (UID: \"1a06011f-8fc2-4f7a-bbe3-c4e137022732\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsxrcp" May 27 21:11:37.268062 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:37.268001 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a06011f-8fc2-4f7a-bbe3-c4e137022732-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsxrcp\" (UID: \"1a06011f-8fc2-4f7a-bbe3-c4e137022732\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsxrcp" May 27 21:11:37.268062 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:37.268013 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a06011f-8fc2-4f7a-bbe3-c4e137022732-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsxrcp\" (UID: \"1a06011f-8fc2-4f7a-bbe3-c4e137022732\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsxrcp" May 27 21:11:37.276827 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:37.276793 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j2sp\" (UniqueName: \"kubernetes.io/projected/1a06011f-8fc2-4f7a-bbe3-c4e137022732-kube-api-access-9j2sp\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsxrcp\" (UID: \"1a06011f-8fc2-4f7a-bbe3-c4e137022732\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsxrcp" May 27 21:11:37.386442 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:37.386356 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsxrcp" May 27 21:11:37.518603 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:37.518570 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsxrcp"] May 27 21:11:37.524650 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:37.524626 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 21:11:38.180931 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:38.180891 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsxrcp" event={"ID":"1a06011f-8fc2-4f7a-bbe3-c4e137022732","Type":"ContainerStarted","Data":"15696be1d0bbce12934d3074b116e410b662a94a6274b861fc138a17b3f72be0"} May 27 21:11:43.198545 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:43.198506 2566 generic.go:358] "Generic (PLEG): container finished" podID="1a06011f-8fc2-4f7a-bbe3-c4e137022732" containerID="9f04b15553fd799cfa26b173cb8c1d63491210110a7cd6c5133af0e9979c2d55" exitCode=0 May 27 21:11:43.198969 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:43.198601 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsxrcp" event={"ID":"1a06011f-8fc2-4f7a-bbe3-c4e137022732","Type":"ContainerDied","Data":"9f04b15553fd799cfa26b173cb8c1d63491210110a7cd6c5133af0e9979c2d55"} May 27 21:11:46.212335 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:46.212299 2566 generic.go:358] "Generic (PLEG): container finished" podID="1a06011f-8fc2-4f7a-bbe3-c4e137022732" containerID="8bab5c3ac6bcd69fddb62627290bc65e852f1d590b5f9e48c9b47ad4f00d9342" exitCode=0 May 27 21:11:46.212711 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:46.212387 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsxrcp" event={"ID":"1a06011f-8fc2-4f7a-bbe3-c4e137022732","Type":"ContainerDied","Data":"8bab5c3ac6bcd69fddb62627290bc65e852f1d590b5f9e48c9b47ad4f00d9342"} May 27 21:11:52.235737 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:52.235699 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsxrcp" event={"ID":"1a06011f-8fc2-4f7a-bbe3-c4e137022732","Type":"ContainerStarted","Data":"40c3da4cc5d41f4fca2ee57203bf6728b23f11be35700593123c3b9b187d4e31"} May 27 21:11:53.240683 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:53.240651 2566 generic.go:358] "Generic (PLEG): container finished" podID="1a06011f-8fc2-4f7a-bbe3-c4e137022732" containerID="40c3da4cc5d41f4fca2ee57203bf6728b23f11be35700593123c3b9b187d4e31" exitCode=0 May 27 21:11:53.241071 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:53.240739 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsxrcp" event={"ID":"1a06011f-8fc2-4f7a-bbe3-c4e137022732","Type":"ContainerDied","Data":"40c3da4cc5d41f4fca2ee57203bf6728b23f11be35700593123c3b9b187d4e31"} May 27 21:11:53.366188 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:53.366137 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsxrcp" May 27 21:11:53.522492 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:53.522457 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a06011f-8fc2-4f7a-bbe3-c4e137022732-bundle\") pod \"1a06011f-8fc2-4f7a-bbe3-c4e137022732\" (UID: \"1a06011f-8fc2-4f7a-bbe3-c4e137022732\") " May 27 21:11:53.522492 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:53.522500 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9j2sp\" (UniqueName: \"kubernetes.io/projected/1a06011f-8fc2-4f7a-bbe3-c4e137022732-kube-api-access-9j2sp\") pod \"1a06011f-8fc2-4f7a-bbe3-c4e137022732\" (UID: \"1a06011f-8fc2-4f7a-bbe3-c4e137022732\") " May 27 21:11:53.522733 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:53.522573 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a06011f-8fc2-4f7a-bbe3-c4e137022732-util\") pod \"1a06011f-8fc2-4f7a-bbe3-c4e137022732\" (UID: \"1a06011f-8fc2-4f7a-bbe3-c4e137022732\") " May 27 21:11:53.523210 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:53.523182 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a06011f-8fc2-4f7a-bbe3-c4e137022732-bundle" (OuterVolumeSpecName: "bundle") pod "1a06011f-8fc2-4f7a-bbe3-c4e137022732" (UID: "1a06011f-8fc2-4f7a-bbe3-c4e137022732"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:11:53.524717 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:53.524687 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a06011f-8fc2-4f7a-bbe3-c4e137022732-kube-api-access-9j2sp" (OuterVolumeSpecName: "kube-api-access-9j2sp") pod "1a06011f-8fc2-4f7a-bbe3-c4e137022732" (UID: "1a06011f-8fc2-4f7a-bbe3-c4e137022732"). InnerVolumeSpecName "kube-api-access-9j2sp". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:11:53.526667 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:53.526638 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a06011f-8fc2-4f7a-bbe3-c4e137022732-util" (OuterVolumeSpecName: "util") pod "1a06011f-8fc2-4f7a-bbe3-c4e137022732" (UID: "1a06011f-8fc2-4f7a-bbe3-c4e137022732"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:11:53.623860 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:53.623788 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a06011f-8fc2-4f7a-bbe3-c4e137022732-util\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:11:53.623860 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:53.623815 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a06011f-8fc2-4f7a-bbe3-c4e137022732-bundle\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:11:53.623860 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:53.623826 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9j2sp\" (UniqueName: \"kubernetes.io/projected/1a06011f-8fc2-4f7a-bbe3-c4e137022732-kube-api-access-9j2sp\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:11:54.250871 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:54.250829 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsxrcp" event={"ID":"1a06011f-8fc2-4f7a-bbe3-c4e137022732","Type":"ContainerDied","Data":"15696be1d0bbce12934d3074b116e410b662a94a6274b861fc138a17b3f72be0"} May 27 21:11:54.250871 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:54.250868 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="15696be1d0bbce12934d3074b116e410b662a94a6274b861fc138a17b3f72be0" May 27 21:11:54.251265 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:11:54.250867 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsxrcp" May 27 21:12:00.082274 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:00.082190 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-w8nxx"] May 27 21:12:00.082707 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:00.082553 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a06011f-8fc2-4f7a-bbe3-c4e137022732" containerName="util" May 27 21:12:00.082707 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:00.082567 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a06011f-8fc2-4f7a-bbe3-c4e137022732" containerName="util" May 27 21:12:00.082707 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:00.082579 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a06011f-8fc2-4f7a-bbe3-c4e137022732" containerName="pull" May 27 21:12:00.082707 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:00.082584 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a06011f-8fc2-4f7a-bbe3-c4e137022732" containerName="pull" May 27 21:12:00.082707 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:00.082605 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a06011f-8fc2-4f7a-bbe3-c4e137022732" containerName="extract" May 27 21:12:00.082707 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:00.082612 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a06011f-8fc2-4f7a-bbe3-c4e137022732" containerName="extract" May 27 21:12:00.082707 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:00.082665 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="1a06011f-8fc2-4f7a-bbe3-c4e137022732" containerName="extract" May 27 21:12:00.102140 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:00.102114 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-w8nxx" May 27 21:12:00.104286 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:00.104258 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-w8nxx"] May 27 21:12:00.105715 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:00.105696 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" May 27 21:12:00.105797 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:00.105696 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" May 27 21:12:00.105904 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:00.105885 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-nzvfz\"" May 27 21:12:00.274569 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:00.274544 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f13fb531-d34c-4bee-a110-e1e602a7a7c2-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-w8nxx\" (UID: \"f13fb531-d34c-4bee-a110-e1e602a7a7c2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-w8nxx" May 27 21:12:00.274717 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:00.274595 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9srjr\" (UniqueName: \"kubernetes.io/projected/f13fb531-d34c-4bee-a110-e1e602a7a7c2-kube-api-access-9srjr\") pod \"cert-manager-operator-controller-manager-54b9655956-w8nxx\" (UID: \"f13fb531-d34c-4bee-a110-e1e602a7a7c2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-w8nxx" May 27 21:12:00.375474 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:00.375397 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9srjr\" (UniqueName: \"kubernetes.io/projected/f13fb531-d34c-4bee-a110-e1e602a7a7c2-kube-api-access-9srjr\") pod \"cert-manager-operator-controller-manager-54b9655956-w8nxx\" (UID: \"f13fb531-d34c-4bee-a110-e1e602a7a7c2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-w8nxx" May 27 21:12:00.375474 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:00.375458 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f13fb531-d34c-4bee-a110-e1e602a7a7c2-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-w8nxx\" (UID: \"f13fb531-d34c-4bee-a110-e1e602a7a7c2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-w8nxx" May 27 21:12:00.375775 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:00.375759 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f13fb531-d34c-4bee-a110-e1e602a7a7c2-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-w8nxx\" (UID: \"f13fb531-d34c-4bee-a110-e1e602a7a7c2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-w8nxx" May 27 21:12:00.384422 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:00.384392 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9srjr\" (UniqueName: \"kubernetes.io/projected/f13fb531-d34c-4bee-a110-e1e602a7a7c2-kube-api-access-9srjr\") pod \"cert-manager-operator-controller-manager-54b9655956-w8nxx\" (UID: \"f13fb531-d34c-4bee-a110-e1e602a7a7c2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-w8nxx" May 27 21:12:00.412260 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:00.412235 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-w8nxx" May 27 21:12:00.541245 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:00.541216 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-w8nxx"] May 27 21:12:00.544949 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:12:00.544918 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf13fb531_d34c_4bee_a110_e1e602a7a7c2.slice/crio-dce2374e98a0945e471134ccf0bf72de8fd54f91250c0b1c3438e401e89ce448 WatchSource:0}: Error finding container dce2374e98a0945e471134ccf0bf72de8fd54f91250c0b1c3438e401e89ce448: Status 404 returned error can't find the container with id dce2374e98a0945e471134ccf0bf72de8fd54f91250c0b1c3438e401e89ce448 May 27 21:12:01.274433 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:01.274399 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-w8nxx" event={"ID":"f13fb531-d34c-4bee-a110-e1e602a7a7c2","Type":"ContainerStarted","Data":"dce2374e98a0945e471134ccf0bf72de8fd54f91250c0b1c3438e401e89ce448"} May 27 21:12:03.283159 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:03.283085 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-w8nxx" event={"ID":"f13fb531-d34c-4bee-a110-e1e602a7a7c2","Type":"ContainerStarted","Data":"b2994199078577909e347467286d45357a25c9293e8afb4f974f65862d8cbe2c"} May 27 21:12:03.309694 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:03.309647 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-w8nxx" podStartSLOduration=0.826401695 podStartE2EDuration="3.309633709s" podCreationTimestamp="2026-05-27 21:12:00 +0000 UTC" firstStartedPulling="2026-05-27 21:12:00.547405262 +0000 UTC m=+345.166791040" lastFinishedPulling="2026-05-27 21:12:03.030637276 +0000 UTC m=+347.650023054" observedRunningTime="2026-05-27 21:12:03.307111557 +0000 UTC m=+347.926497342" watchObservedRunningTime="2026-05-27 21:12:03.309633709 +0000 UTC m=+347.929019494" May 27 21:12:04.269441 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:04.269405 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcxpcl"] May 27 21:12:04.277288 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:04.277262 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcxpcl" May 27 21:12:04.280062 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:04.280038 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 27 21:12:04.280831 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:04.280813 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tjd5p\"" May 27 21:12:04.280893 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:04.280831 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 27 21:12:04.284782 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:04.284492 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcxpcl"] May 27 21:12:04.409988 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:04.409957 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d2255a3-9e15-4139-9970-4063eafaa042-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcxpcl\" (UID: \"4d2255a3-9e15-4139-9970-4063eafaa042\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcxpcl" May 27 21:12:04.410153 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:04.410003 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d2255a3-9e15-4139-9970-4063eafaa042-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcxpcl\" (UID: \"4d2255a3-9e15-4139-9970-4063eafaa042\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcxpcl" May 27 21:12:04.410153 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:04.410095 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9xhr\" (UniqueName: \"kubernetes.io/projected/4d2255a3-9e15-4139-9970-4063eafaa042-kube-api-access-k9xhr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcxpcl\" (UID: \"4d2255a3-9e15-4139-9970-4063eafaa042\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcxpcl" May 27 21:12:04.511330 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:04.511298 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k9xhr\" (UniqueName: \"kubernetes.io/projected/4d2255a3-9e15-4139-9970-4063eafaa042-kube-api-access-k9xhr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcxpcl\" (UID: \"4d2255a3-9e15-4139-9970-4063eafaa042\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcxpcl" May 27 21:12:04.511491 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:04.511354 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d2255a3-9e15-4139-9970-4063eafaa042-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcxpcl\" (UID: \"4d2255a3-9e15-4139-9970-4063eafaa042\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcxpcl" May 27 21:12:04.511491 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:04.511385 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d2255a3-9e15-4139-9970-4063eafaa042-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcxpcl\" (UID: \"4d2255a3-9e15-4139-9970-4063eafaa042\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcxpcl" May 27 21:12:04.511701 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:04.511684 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d2255a3-9e15-4139-9970-4063eafaa042-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcxpcl\" (UID: \"4d2255a3-9e15-4139-9970-4063eafaa042\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcxpcl" May 27 21:12:04.511756 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:04.511725 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d2255a3-9e15-4139-9970-4063eafaa042-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcxpcl\" (UID: \"4d2255a3-9e15-4139-9970-4063eafaa042\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcxpcl" May 27 21:12:04.520810 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:04.520744 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9xhr\" (UniqueName: \"kubernetes.io/projected/4d2255a3-9e15-4139-9970-4063eafaa042-kube-api-access-k9xhr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcxpcl\" (UID: \"4d2255a3-9e15-4139-9970-4063eafaa042\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcxpcl" May 27 21:12:04.587165 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:04.587138 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcxpcl" May 27 21:12:04.731301 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:04.731274 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcxpcl"] May 27 21:12:04.733001 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:12:04.732975 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d2255a3_9e15_4139_9970_4063eafaa042.slice/crio-ad8006d9ce6a05faee2ce38a1bade6aaf3a579344f9231e931ba91ebdacca606 WatchSource:0}: Error finding container ad8006d9ce6a05faee2ce38a1bade6aaf3a579344f9231e931ba91ebdacca606: Status 404 returned error can't find the container with id ad8006d9ce6a05faee2ce38a1bade6aaf3a579344f9231e931ba91ebdacca606 May 27 21:12:05.290583 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:05.290544 2566 generic.go:358] "Generic (PLEG): container finished" podID="4d2255a3-9e15-4139-9970-4063eafaa042" containerID="c674fd24c90b1eec8c1eda82c5243c99b1f91f4793e47d18a4d6a0346622a76b" exitCode=0 May 27 21:12:05.290965 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:05.290624 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcxpcl" event={"ID":"4d2255a3-9e15-4139-9970-4063eafaa042","Type":"ContainerDied","Data":"c674fd24c90b1eec8c1eda82c5243c99b1f91f4793e47d18a4d6a0346622a76b"} May 27 21:12:05.290965 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:05.290658 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcxpcl" event={"ID":"4d2255a3-9e15-4139-9970-4063eafaa042","Type":"ContainerStarted","Data":"ad8006d9ce6a05faee2ce38a1bade6aaf3a579344f9231e931ba91ebdacca606"} May 27 21:12:07.298511 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:07.298476 2566 generic.go:358] "Generic (PLEG): container finished" podID="4d2255a3-9e15-4139-9970-4063eafaa042" containerID="93d6246d45e376b0d87f0ee7a8ec058f4fefcc8308ba18a6c7028e450d38f734" exitCode=0 May 27 21:12:07.298902 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:07.298535 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcxpcl" event={"ID":"4d2255a3-9e15-4139-9970-4063eafaa042","Type":"ContainerDied","Data":"93d6246d45e376b0d87f0ee7a8ec058f4fefcc8308ba18a6c7028e450d38f734"} May 27 21:12:07.758762 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:07.758727 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-6qppf"] May 27 21:12:07.760860 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:07.760843 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-6qppf" May 27 21:12:07.763293 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:07.763269 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 27 21:12:07.763293 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:07.763272 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-zqhx6\"" May 27 21:12:07.763463 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:07.763292 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 27 21:12:07.770222 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:07.770202 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-6qppf"] May 27 21:12:07.840486 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:07.840460 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc72t\" (UniqueName: \"kubernetes.io/projected/4ef92aaa-b4b7-4fcd-adc1-09b96d923e72-kube-api-access-jc72t\") pod \"cert-manager-cainjector-68b757865b-6qppf\" (UID: \"4ef92aaa-b4b7-4fcd-adc1-09b96d923e72\") " pod="cert-manager/cert-manager-cainjector-68b757865b-6qppf" May 27 21:12:07.840618 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:07.840522 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ef92aaa-b4b7-4fcd-adc1-09b96d923e72-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-6qppf\" (UID: \"4ef92aaa-b4b7-4fcd-adc1-09b96d923e72\") " pod="cert-manager/cert-manager-cainjector-68b757865b-6qppf" May 27 21:12:07.940920 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:07.940888 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ef92aaa-b4b7-4fcd-adc1-09b96d923e72-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-6qppf\" (UID: \"4ef92aaa-b4b7-4fcd-adc1-09b96d923e72\") " pod="cert-manager/cert-manager-cainjector-68b757865b-6qppf" May 27 21:12:07.941103 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:07.940952 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jc72t\" (UniqueName: \"kubernetes.io/projected/4ef92aaa-b4b7-4fcd-adc1-09b96d923e72-kube-api-access-jc72t\") pod \"cert-manager-cainjector-68b757865b-6qppf\" (UID: \"4ef92aaa-b4b7-4fcd-adc1-09b96d923e72\") " pod="cert-manager/cert-manager-cainjector-68b757865b-6qppf" May 27 21:12:07.949564 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:07.949540 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ef92aaa-b4b7-4fcd-adc1-09b96d923e72-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-6qppf\" (UID: \"4ef92aaa-b4b7-4fcd-adc1-09b96d923e72\") " pod="cert-manager/cert-manager-cainjector-68b757865b-6qppf" May 27 21:12:07.949678 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:07.949660 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc72t\" (UniqueName: \"kubernetes.io/projected/4ef92aaa-b4b7-4fcd-adc1-09b96d923e72-kube-api-access-jc72t\") pod \"cert-manager-cainjector-68b757865b-6qppf\" (UID: \"4ef92aaa-b4b7-4fcd-adc1-09b96d923e72\") " pod="cert-manager/cert-manager-cainjector-68b757865b-6qppf" May 27 21:12:08.076856 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:08.076824 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-6qppf" May 27 21:12:08.210745 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:08.210717 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-6qppf"] May 27 21:12:08.213104 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:12:08.213074 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ef92aaa_b4b7_4fcd_adc1_09b96d923e72.slice/crio-d20bed879ddc5a1b860f11d1c9979eb874d39eea3f57cb3024ff053fb6b6b545 WatchSource:0}: Error finding container d20bed879ddc5a1b860f11d1c9979eb874d39eea3f57cb3024ff053fb6b6b545: Status 404 returned error can't find the container with id d20bed879ddc5a1b860f11d1c9979eb874d39eea3f57cb3024ff053fb6b6b545 May 27 21:12:08.305966 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:08.305929 2566 generic.go:358] "Generic (PLEG): container finished" podID="4d2255a3-9e15-4139-9970-4063eafaa042" containerID="fa018ed21a9ebca2f73df32fbad575b9b9ea8fa43887f1f5e2f37f97235d0ad7" exitCode=0 May 27 21:12:08.306377 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:08.306050 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcxpcl" event={"ID":"4d2255a3-9e15-4139-9970-4063eafaa042","Type":"ContainerDied","Data":"fa018ed21a9ebca2f73df32fbad575b9b9ea8fa43887f1f5e2f37f97235d0ad7"} May 27 21:12:08.307823 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:08.307793 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-6qppf" event={"ID":"4ef92aaa-b4b7-4fcd-adc1-09b96d923e72","Type":"ContainerStarted","Data":"d20bed879ddc5a1b860f11d1c9979eb874d39eea3f57cb3024ff053fb6b6b545"} May 27 21:12:09.173431 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:09.173396 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-r8blr"] May 27 21:12:09.176397 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:09.176376 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-r8blr" May 27 21:12:09.179348 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:09.179330 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-hhc7b\"" May 27 21:12:09.199446 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:09.199417 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-r8blr"] May 27 21:12:09.251417 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:09.251391 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d0ba9a1-3af9-4fdd-b9df-1a61349d493a-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-r8blr\" (UID: \"9d0ba9a1-3af9-4fdd-b9df-1a61349d493a\") " pod="cert-manager/cert-manager-webhook-587ccfb98-r8blr" May 27 21:12:09.251552 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:09.251480 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q92lx\" (UniqueName: \"kubernetes.io/projected/9d0ba9a1-3af9-4fdd-b9df-1a61349d493a-kube-api-access-q92lx\") pod \"cert-manager-webhook-587ccfb98-r8blr\" (UID: \"9d0ba9a1-3af9-4fdd-b9df-1a61349d493a\") " pod="cert-manager/cert-manager-webhook-587ccfb98-r8blr" May 27 21:12:09.352951 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:09.352912 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q92lx\" (UniqueName: \"kubernetes.io/projected/9d0ba9a1-3af9-4fdd-b9df-1a61349d493a-kube-api-access-q92lx\") pod \"cert-manager-webhook-587ccfb98-r8blr\" (UID: \"9d0ba9a1-3af9-4fdd-b9df-1a61349d493a\") " pod="cert-manager/cert-manager-webhook-587ccfb98-r8blr" May 27 21:12:09.353337 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:09.352964 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d0ba9a1-3af9-4fdd-b9df-1a61349d493a-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-r8blr\" (UID: \"9d0ba9a1-3af9-4fdd-b9df-1a61349d493a\") " pod="cert-manager/cert-manager-webhook-587ccfb98-r8blr" May 27 21:12:09.361609 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:09.361580 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d0ba9a1-3af9-4fdd-b9df-1a61349d493a-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-r8blr\" (UID: \"9d0ba9a1-3af9-4fdd-b9df-1a61349d493a\") " pod="cert-manager/cert-manager-webhook-587ccfb98-r8blr" May 27 21:12:09.361731 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:09.361592 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q92lx\" (UniqueName: \"kubernetes.io/projected/9d0ba9a1-3af9-4fdd-b9df-1a61349d493a-kube-api-access-q92lx\") pod \"cert-manager-webhook-587ccfb98-r8blr\" (UID: \"9d0ba9a1-3af9-4fdd-b9df-1a61349d493a\") " pod="cert-manager/cert-manager-webhook-587ccfb98-r8blr" May 27 21:12:09.442015 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:09.441992 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcxpcl" May 27 21:12:09.453961 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:09.453936 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d2255a3-9e15-4139-9970-4063eafaa042-util\") pod \"4d2255a3-9e15-4139-9970-4063eafaa042\" (UID: \"4d2255a3-9e15-4139-9970-4063eafaa042\") " May 27 21:12:09.454101 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:09.453990 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d2255a3-9e15-4139-9970-4063eafaa042-bundle\") pod \"4d2255a3-9e15-4139-9970-4063eafaa042\" (UID: \"4d2255a3-9e15-4139-9970-4063eafaa042\") " May 27 21:12:09.454101 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:09.454013 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9xhr\" (UniqueName: \"kubernetes.io/projected/4d2255a3-9e15-4139-9970-4063eafaa042-kube-api-access-k9xhr\") pod \"4d2255a3-9e15-4139-9970-4063eafaa042\" (UID: \"4d2255a3-9e15-4139-9970-4063eafaa042\") " May 27 21:12:09.454333 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:09.454311 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d2255a3-9e15-4139-9970-4063eafaa042-bundle" (OuterVolumeSpecName: "bundle") pod "4d2255a3-9e15-4139-9970-4063eafaa042" (UID: "4d2255a3-9e15-4139-9970-4063eafaa042"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:12:09.456097 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:09.456070 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d2255a3-9e15-4139-9970-4063eafaa042-kube-api-access-k9xhr" (OuterVolumeSpecName: "kube-api-access-k9xhr") pod "4d2255a3-9e15-4139-9970-4063eafaa042" (UID: "4d2255a3-9e15-4139-9970-4063eafaa042"). InnerVolumeSpecName "kube-api-access-k9xhr". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:12:09.459431 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:09.459403 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d2255a3-9e15-4139-9970-4063eafaa042-util" (OuterVolumeSpecName: "util") pod "4d2255a3-9e15-4139-9970-4063eafaa042" (UID: "4d2255a3-9e15-4139-9970-4063eafaa042"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:12:09.486787 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:09.486758 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-r8blr" May 27 21:12:09.555443 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:09.555414 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d2255a3-9e15-4139-9970-4063eafaa042-util\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:12:09.555443 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:09.555444 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d2255a3-9e15-4139-9970-4063eafaa042-bundle\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:12:09.555593 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:09.555454 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9xhr\" (UniqueName: \"kubernetes.io/projected/4d2255a3-9e15-4139-9970-4063eafaa042-kube-api-access-k9xhr\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:12:09.633243 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:09.633217 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-r8blr"] May 27 21:12:09.635249 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:12:09.635224 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d0ba9a1_3af9_4fdd_b9df_1a61349d493a.slice/crio-270cc31837d29649ba72aa38bf91a6acd18c7bd8ca03cb36dba37b311bc0fd88 WatchSource:0}: Error finding container 270cc31837d29649ba72aa38bf91a6acd18c7bd8ca03cb36dba37b311bc0fd88: Status 404 returned error can't find the container with id 270cc31837d29649ba72aa38bf91a6acd18c7bd8ca03cb36dba37b311bc0fd88 May 27 21:12:10.318222 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:10.318183 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcxpcl" event={"ID":"4d2255a3-9e15-4139-9970-4063eafaa042","Type":"ContainerDied","Data":"ad8006d9ce6a05faee2ce38a1bade6aaf3a579344f9231e931ba91ebdacca606"} May 27 21:12:10.318222 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:10.318214 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcxpcl" May 27 21:12:10.318222 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:10.318227 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ad8006d9ce6a05faee2ce38a1bade6aaf3a579344f9231e931ba91ebdacca606" May 27 21:12:10.320356 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:10.319891 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-r8blr" event={"ID":"9d0ba9a1-3af9-4fdd-b9df-1a61349d493a","Type":"ContainerStarted","Data":"270cc31837d29649ba72aa38bf91a6acd18c7bd8ca03cb36dba37b311bc0fd88"} May 27 21:12:12.328463 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:12.328426 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-6qppf" event={"ID":"4ef92aaa-b4b7-4fcd-adc1-09b96d923e72","Type":"ContainerStarted","Data":"eeaf97bdfed74e6ef2701e1b03a676e21a7679960b8f1e8f7d13edfe69a7ba29"} May 27 21:12:12.329693 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:12.329666 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-r8blr" event={"ID":"9d0ba9a1-3af9-4fdd-b9df-1a61349d493a","Type":"ContainerStarted","Data":"ab02125f3e1f64d1442bdbe7e39bde1a7f201a700f75fc0d43cd16c2746ef86a"} May 27 21:12:12.329813 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:12.329795 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-r8blr" May 27 21:12:12.344731 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:12.344684 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-6qppf" podStartSLOduration=2.135164611 podStartE2EDuration="5.344671706s" podCreationTimestamp="2026-05-27 21:12:07 +0000 UTC" firstStartedPulling="2026-05-27 21:12:08.215012229 +0000 UTC m=+352.834397992" lastFinishedPulling="2026-05-27 21:12:11.424519325 +0000 UTC m=+356.043905087" observedRunningTime="2026-05-27 21:12:12.343915993 +0000 UTC m=+356.963301789" watchObservedRunningTime="2026-05-27 21:12:12.344671706 +0000 UTC m=+356.964057492" May 27 21:12:12.361311 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:12.361259 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-r8blr" podStartSLOduration=1.568110085 podStartE2EDuration="3.361243133s" podCreationTimestamp="2026-05-27 21:12:09 +0000 UTC" firstStartedPulling="2026-05-27 21:12:09.63732816 +0000 UTC m=+354.256713924" lastFinishedPulling="2026-05-27 21:12:11.430461196 +0000 UTC m=+356.049846972" observedRunningTime="2026-05-27 21:12:12.359202127 +0000 UTC m=+356.978587912" watchObservedRunningTime="2026-05-27 21:12:12.361243133 +0000 UTC m=+356.980628920" May 27 21:12:18.334520 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:18.334491 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-r8blr" May 27 21:12:23.354658 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:23.354622 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5n76mq"] May 27 21:12:23.355043 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:23.354962 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d2255a3-9e15-4139-9970-4063eafaa042" containerName="pull" May 27 21:12:23.355043 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:23.354972 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d2255a3-9e15-4139-9970-4063eafaa042" containerName="pull" May 27 21:12:23.355043 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:23.354985 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d2255a3-9e15-4139-9970-4063eafaa042" containerName="util" May 27 21:12:23.355043 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:23.354992 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d2255a3-9e15-4139-9970-4063eafaa042" containerName="util" May 27 21:12:23.355043 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:23.355006 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d2255a3-9e15-4139-9970-4063eafaa042" containerName="extract" May 27 21:12:23.355043 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:23.355011 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d2255a3-9e15-4139-9970-4063eafaa042" containerName="extract" May 27 21:12:23.355253 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:23.355109 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="4d2255a3-9e15-4139-9970-4063eafaa042" containerName="extract" May 27 21:12:23.358808 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:23.358787 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5n76mq" May 27 21:12:23.361213 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:23.361187 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 27 21:12:23.361754 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:23.361730 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 27 21:12:23.361857 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:23.361754 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tjd5p\"" May 27 21:12:23.366430 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:23.366398 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5n76mq"] May 27 21:12:23.470803 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:23.470766 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a3b77a0-8087-4241-8f70-cb7d0430dd48-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5n76mq\" (UID: \"7a3b77a0-8087-4241-8f70-cb7d0430dd48\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5n76mq" May 27 21:12:23.470962 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:23.470886 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfvjx\" (UniqueName: \"kubernetes.io/projected/7a3b77a0-8087-4241-8f70-cb7d0430dd48-kube-api-access-hfvjx\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5n76mq\" (UID: \"7a3b77a0-8087-4241-8f70-cb7d0430dd48\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5n76mq" May 27 21:12:23.470962 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:23.470938 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a3b77a0-8087-4241-8f70-cb7d0430dd48-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5n76mq\" (UID: \"7a3b77a0-8087-4241-8f70-cb7d0430dd48\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5n76mq" May 27 21:12:23.571913 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:23.571877 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hfvjx\" (UniqueName: \"kubernetes.io/projected/7a3b77a0-8087-4241-8f70-cb7d0430dd48-kube-api-access-hfvjx\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5n76mq\" (UID: \"7a3b77a0-8087-4241-8f70-cb7d0430dd48\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5n76mq" May 27 21:12:23.571913 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:23.571920 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a3b77a0-8087-4241-8f70-cb7d0430dd48-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5n76mq\" (UID: \"7a3b77a0-8087-4241-8f70-cb7d0430dd48\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5n76mq" May 27 21:12:23.572186 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:23.571961 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a3b77a0-8087-4241-8f70-cb7d0430dd48-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5n76mq\" (UID: \"7a3b77a0-8087-4241-8f70-cb7d0430dd48\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5n76mq" May 27 21:12:23.572338 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:23.572319 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a3b77a0-8087-4241-8f70-cb7d0430dd48-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5n76mq\" (UID: \"7a3b77a0-8087-4241-8f70-cb7d0430dd48\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5n76mq" May 27 21:12:23.572404 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:23.572350 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a3b77a0-8087-4241-8f70-cb7d0430dd48-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5n76mq\" (UID: \"7a3b77a0-8087-4241-8f70-cb7d0430dd48\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5n76mq" May 27 21:12:23.583276 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:23.583243 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfvjx\" (UniqueName: \"kubernetes.io/projected/7a3b77a0-8087-4241-8f70-cb7d0430dd48-kube-api-access-hfvjx\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5n76mq\" (UID: \"7a3b77a0-8087-4241-8f70-cb7d0430dd48\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5n76mq" May 27 21:12:23.669432 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:23.669364 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5n76mq" May 27 21:12:23.796733 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:23.796703 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5n76mq"] May 27 21:12:23.799579 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:12:23.799541 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a3b77a0_8087_4241_8f70_cb7d0430dd48.slice/crio-6e956b07998d0f99cf50d8ac020dd0b7c3452e9e5c4c053c0d3bd2fc0d32805e WatchSource:0}: Error finding container 6e956b07998d0f99cf50d8ac020dd0b7c3452e9e5c4c053c0d3bd2fc0d32805e: Status 404 returned error can't find the container with id 6e956b07998d0f99cf50d8ac020dd0b7c3452e9e5c4c053c0d3bd2fc0d32805e May 27 21:12:24.368407 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:24.368374 2566 generic.go:358] "Generic (PLEG): container finished" podID="7a3b77a0-8087-4241-8f70-cb7d0430dd48" containerID="e2959e798669c5a3c5b73907ccaa466de239b45a16c8012d05e548df79d6f7b6" exitCode=0 May 27 21:12:24.368762 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:24.368445 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5n76mq" event={"ID":"7a3b77a0-8087-4241-8f70-cb7d0430dd48","Type":"ContainerDied","Data":"e2959e798669c5a3c5b73907ccaa466de239b45a16c8012d05e548df79d6f7b6"} May 27 21:12:24.368762 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:24.368466 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5n76mq" event={"ID":"7a3b77a0-8087-4241-8f70-cb7d0430dd48","Type":"ContainerStarted","Data":"6e956b07998d0f99cf50d8ac020dd0b7c3452e9e5c4c053c0d3bd2fc0d32805e"} May 27 21:12:25.373708 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:25.373671 2566 generic.go:358] "Generic (PLEG): container finished" podID="7a3b77a0-8087-4241-8f70-cb7d0430dd48" containerID="7d9015bd7d08c4e8540fe6ce5c38004e1daaedc0837f1fcd67a57eee1a464442" exitCode=0 May 27 21:12:25.374068 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:25.373753 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5n76mq" event={"ID":"7a3b77a0-8087-4241-8f70-cb7d0430dd48","Type":"ContainerDied","Data":"7d9015bd7d08c4e8540fe6ce5c38004e1daaedc0837f1fcd67a57eee1a464442"} May 27 21:12:26.379009 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:26.378971 2566 generic.go:358] "Generic (PLEG): container finished" podID="7a3b77a0-8087-4241-8f70-cb7d0430dd48" containerID="e57a177571f0caa3a0e8b4a88732f7bf0807ed7d719dbd032b1727c7d67adc65" exitCode=0 May 27 21:12:26.379384 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:26.379055 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5n76mq" event={"ID":"7a3b77a0-8087-4241-8f70-cb7d0430dd48","Type":"ContainerDied","Data":"e57a177571f0caa3a0e8b4a88732f7bf0807ed7d719dbd032b1727c7d67adc65"} May 27 21:12:27.512726 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:27.512704 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5n76mq" May 27 21:12:27.604881 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:27.604851 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a3b77a0-8087-4241-8f70-cb7d0430dd48-bundle\") pod \"7a3b77a0-8087-4241-8f70-cb7d0430dd48\" (UID: \"7a3b77a0-8087-4241-8f70-cb7d0430dd48\") " May 27 21:12:27.605048 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:27.604927 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a3b77a0-8087-4241-8f70-cb7d0430dd48-util\") pod \"7a3b77a0-8087-4241-8f70-cb7d0430dd48\" (UID: \"7a3b77a0-8087-4241-8f70-cb7d0430dd48\") " May 27 21:12:27.605048 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:27.604971 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfvjx\" (UniqueName: \"kubernetes.io/projected/7a3b77a0-8087-4241-8f70-cb7d0430dd48-kube-api-access-hfvjx\") pod \"7a3b77a0-8087-4241-8f70-cb7d0430dd48\" (UID: \"7a3b77a0-8087-4241-8f70-cb7d0430dd48\") " May 27 21:12:27.605737 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:27.605710 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a3b77a0-8087-4241-8f70-cb7d0430dd48-bundle" (OuterVolumeSpecName: "bundle") pod "7a3b77a0-8087-4241-8f70-cb7d0430dd48" (UID: "7a3b77a0-8087-4241-8f70-cb7d0430dd48"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:12:27.607012 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:27.606975 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a3b77a0-8087-4241-8f70-cb7d0430dd48-kube-api-access-hfvjx" (OuterVolumeSpecName: "kube-api-access-hfvjx") pod "7a3b77a0-8087-4241-8f70-cb7d0430dd48" (UID: "7a3b77a0-8087-4241-8f70-cb7d0430dd48"). InnerVolumeSpecName "kube-api-access-hfvjx". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:12:27.611065 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:27.611045 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a3b77a0-8087-4241-8f70-cb7d0430dd48-util" (OuterVolumeSpecName: "util") pod "7a3b77a0-8087-4241-8f70-cb7d0430dd48" (UID: "7a3b77a0-8087-4241-8f70-cb7d0430dd48"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:12:27.706394 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:27.706324 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a3b77a0-8087-4241-8f70-cb7d0430dd48-bundle\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:12:27.706394 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:27.706348 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a3b77a0-8087-4241-8f70-cb7d0430dd48-util\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:12:27.706394 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:27.706358 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfvjx\" (UniqueName: \"kubernetes.io/projected/7a3b77a0-8087-4241-8f70-cb7d0430dd48-kube-api-access-hfvjx\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:12:28.387434 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:28.387402 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5n76mq" event={"ID":"7a3b77a0-8087-4241-8f70-cb7d0430dd48","Type":"ContainerDied","Data":"6e956b07998d0f99cf50d8ac020dd0b7c3452e9e5c4c053c0d3bd2fc0d32805e"} May 27 21:12:28.387434 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:28.387437 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e956b07998d0f99cf50d8ac020dd0b7c3452e9e5c4c053c0d3bd2fc0d32805e" May 27 21:12:28.387623 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:28.387413 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5n76mq" May 27 21:12:40.406620 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.406561 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6678cd66dc-s89mh"] May 27 21:12:40.407161 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.406914 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a3b77a0-8087-4241-8f70-cb7d0430dd48" containerName="util" May 27 21:12:40.407161 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.406925 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a3b77a0-8087-4241-8f70-cb7d0430dd48" containerName="util" May 27 21:12:40.407161 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.406936 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a3b77a0-8087-4241-8f70-cb7d0430dd48" containerName="extract" May 27 21:12:40.407161 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.406942 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a3b77a0-8087-4241-8f70-cb7d0430dd48" containerName="extract" May 27 21:12:40.407161 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.406952 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a3b77a0-8087-4241-8f70-cb7d0430dd48" containerName="pull" May 27 21:12:40.407161 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.406958 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a3b77a0-8087-4241-8f70-cb7d0430dd48" containerName="pull" May 27 21:12:40.407161 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.407018 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="7a3b77a0-8087-4241-8f70-cb7d0430dd48" containerName="extract" May 27 21:12:40.410937 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.410917 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6678cd66dc-s89mh" May 27 21:12:40.413229 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.413200 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 27 21:12:40.413229 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.413220 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 27 21:12:40.413396 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.413306 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 27 21:12:40.413396 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.413305 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xq28h\"" May 27 21:12:40.413865 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.413850 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 27 21:12:40.422226 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.422206 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6678cd66dc-s89mh"] May 27 21:12:40.516908 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.516864 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/932e2f7f-e490-43ef-9062-5c0fce6edd85-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6678cd66dc-s89mh\" (UID: \"932e2f7f-e490-43ef-9062-5c0fce6edd85\") " pod="opendatahub/opendatahub-operator-controller-manager-6678cd66dc-s89mh" May 27 21:12:40.517196 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.517176 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/932e2f7f-e490-43ef-9062-5c0fce6edd85-webhook-cert\") pod \"opendatahub-operator-controller-manager-6678cd66dc-s89mh\" (UID: \"932e2f7f-e490-43ef-9062-5c0fce6edd85\") " pod="opendatahub/opendatahub-operator-controller-manager-6678cd66dc-s89mh" May 27 21:12:40.517408 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.517390 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l5tn\" (UniqueName: \"kubernetes.io/projected/932e2f7f-e490-43ef-9062-5c0fce6edd85-kube-api-access-8l5tn\") pod \"opendatahub-operator-controller-manager-6678cd66dc-s89mh\" (UID: \"932e2f7f-e490-43ef-9062-5c0fce6edd85\") " pod="opendatahub/opendatahub-operator-controller-manager-6678cd66dc-s89mh" May 27 21:12:40.581110 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.581076 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hfvzm"] May 27 21:12:40.583541 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.583524 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hfvzm" May 27 21:12:40.586141 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.586110 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 27 21:12:40.586279 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.586191 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tjd5p\"" May 27 21:12:40.586279 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.586125 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 27 21:12:40.592600 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.592565 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hfvzm"] May 27 21:12:40.618195 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.618170 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/932e2f7f-e490-43ef-9062-5c0fce6edd85-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6678cd66dc-s89mh\" (UID: \"932e2f7f-e490-43ef-9062-5c0fce6edd85\") " pod="opendatahub/opendatahub-operator-controller-manager-6678cd66dc-s89mh" May 27 21:12:40.618339 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.618207 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/932e2f7f-e490-43ef-9062-5c0fce6edd85-webhook-cert\") pod \"opendatahub-operator-controller-manager-6678cd66dc-s89mh\" (UID: \"932e2f7f-e490-43ef-9062-5c0fce6edd85\") " pod="opendatahub/opendatahub-operator-controller-manager-6678cd66dc-s89mh" May 27 21:12:40.618339 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.618269 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8l5tn\" (UniqueName: \"kubernetes.io/projected/932e2f7f-e490-43ef-9062-5c0fce6edd85-kube-api-access-8l5tn\") pod \"opendatahub-operator-controller-manager-6678cd66dc-s89mh\" (UID: \"932e2f7f-e490-43ef-9062-5c0fce6edd85\") " pod="opendatahub/opendatahub-operator-controller-manager-6678cd66dc-s89mh" May 27 21:12:40.620616 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.620593 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/932e2f7f-e490-43ef-9062-5c0fce6edd85-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6678cd66dc-s89mh\" (UID: \"932e2f7f-e490-43ef-9062-5c0fce6edd85\") " pod="opendatahub/opendatahub-operator-controller-manager-6678cd66dc-s89mh" May 27 21:12:40.620756 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.620623 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/932e2f7f-e490-43ef-9062-5c0fce6edd85-webhook-cert\") pod \"opendatahub-operator-controller-manager-6678cd66dc-s89mh\" (UID: \"932e2f7f-e490-43ef-9062-5c0fce6edd85\") " pod="opendatahub/opendatahub-operator-controller-manager-6678cd66dc-s89mh" May 27 21:12:40.626865 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.626842 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l5tn\" (UniqueName: \"kubernetes.io/projected/932e2f7f-e490-43ef-9062-5c0fce6edd85-kube-api-access-8l5tn\") pod \"opendatahub-operator-controller-manager-6678cd66dc-s89mh\" (UID: \"932e2f7f-e490-43ef-9062-5c0fce6edd85\") " pod="opendatahub/opendatahub-operator-controller-manager-6678cd66dc-s89mh" May 27 21:12:40.719217 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.719126 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21f4023e-2bc0-4cdf-854a-08876c17f142-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hfvzm\" (UID: \"21f4023e-2bc0-4cdf-854a-08876c17f142\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hfvzm" May 27 21:12:40.719217 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.719184 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwkwp\" (UniqueName: \"kubernetes.io/projected/21f4023e-2bc0-4cdf-854a-08876c17f142-kube-api-access-cwkwp\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hfvzm\" (UID: \"21f4023e-2bc0-4cdf-854a-08876c17f142\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hfvzm" May 27 21:12:40.719404 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.719246 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21f4023e-2bc0-4cdf-854a-08876c17f142-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hfvzm\" (UID: \"21f4023e-2bc0-4cdf-854a-08876c17f142\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hfvzm" May 27 21:12:40.720996 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.720976 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6678cd66dc-s89mh" May 27 21:12:40.819713 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.819679 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21f4023e-2bc0-4cdf-854a-08876c17f142-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hfvzm\" (UID: \"21f4023e-2bc0-4cdf-854a-08876c17f142\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hfvzm" May 27 21:12:40.819872 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.819744 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cwkwp\" (UniqueName: \"kubernetes.io/projected/21f4023e-2bc0-4cdf-854a-08876c17f142-kube-api-access-cwkwp\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hfvzm\" (UID: \"21f4023e-2bc0-4cdf-854a-08876c17f142\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hfvzm" May 27 21:12:40.819872 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.819784 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21f4023e-2bc0-4cdf-854a-08876c17f142-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hfvzm\" (UID: \"21f4023e-2bc0-4cdf-854a-08876c17f142\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hfvzm" May 27 21:12:40.820195 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.820162 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21f4023e-2bc0-4cdf-854a-08876c17f142-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hfvzm\" (UID: \"21f4023e-2bc0-4cdf-854a-08876c17f142\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hfvzm" May 27 21:12:40.820275 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.820196 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21f4023e-2bc0-4cdf-854a-08876c17f142-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hfvzm\" (UID: \"21f4023e-2bc0-4cdf-854a-08876c17f142\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hfvzm" May 27 21:12:40.830381 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.830352 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwkwp\" (UniqueName: \"kubernetes.io/projected/21f4023e-2bc0-4cdf-854a-08876c17f142-kube-api-access-cwkwp\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hfvzm\" (UID: \"21f4023e-2bc0-4cdf-854a-08876c17f142\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hfvzm" May 27 21:12:40.854995 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.854966 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6678cd66dc-s89mh"] May 27 21:12:40.858208 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:12:40.858184 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod932e2f7f_e490_43ef_9062_5c0fce6edd85.slice/crio-db7e21520eaf671cd7968522b56642b5fb970f680a84b1c67cb1410bf9619ed1 WatchSource:0}: Error finding container db7e21520eaf671cd7968522b56642b5fb970f680a84b1c67cb1410bf9619ed1: Status 404 returned error can't find the container with id db7e21520eaf671cd7968522b56642b5fb970f680a84b1c67cb1410bf9619ed1 May 27 21:12:40.893552 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:40.893524 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hfvzm" May 27 21:12:41.028162 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:41.028136 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hfvzm"] May 27 21:12:41.029984 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:12:41.029956 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21f4023e_2bc0_4cdf_854a_08876c17f142.slice/crio-7726d6260a050318ae651faf3f5fdaa622d181f5773da1f07715f4d8e0aabf5f WatchSource:0}: Error finding container 7726d6260a050318ae651faf3f5fdaa622d181f5773da1f07715f4d8e0aabf5f: Status 404 returned error can't find the container with id 7726d6260a050318ae651faf3f5fdaa622d181f5773da1f07715f4d8e0aabf5f May 27 21:12:41.441577 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:41.441541 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6678cd66dc-s89mh" event={"ID":"932e2f7f-e490-43ef-9062-5c0fce6edd85","Type":"ContainerStarted","Data":"db7e21520eaf671cd7968522b56642b5fb970f680a84b1c67cb1410bf9619ed1"} May 27 21:12:41.443335 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:41.443306 2566 generic.go:358] "Generic (PLEG): container finished" podID="21f4023e-2bc0-4cdf-854a-08876c17f142" containerID="0e414883cbc5877306539070b63054e5206a59a406c476de668415d7bfc9d9c2" exitCode=0 May 27 21:12:41.443478 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:41.443357 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hfvzm" event={"ID":"21f4023e-2bc0-4cdf-854a-08876c17f142","Type":"ContainerDied","Data":"0e414883cbc5877306539070b63054e5206a59a406c476de668415d7bfc9d9c2"} May 27 21:12:41.443478 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:41.443383 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hfvzm" event={"ID":"21f4023e-2bc0-4cdf-854a-08876c17f142","Type":"ContainerStarted","Data":"7726d6260a050318ae651faf3f5fdaa622d181f5773da1f07715f4d8e0aabf5f"} May 27 21:12:41.967280 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:41.967242 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-dddbcdc66-7qzcg"] May 27 21:12:41.970464 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:41.970441 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-7qzcg" May 27 21:12:41.973985 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:41.973959 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 27 21:12:41.974610 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:41.974579 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 27 21:12:41.974861 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:41.974709 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 27 21:12:41.974861 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:41.974583 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 27 21:12:41.974861 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:41.974585 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-fx9rw\"" May 27 21:12:41.974861 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:41.974809 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 27 21:12:41.986938 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:41.986899 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-dddbcdc66-7qzcg"] May 27 21:12:42.131433 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:42.131349 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/201d3b42-a8b0-475b-acff-f1861e87de08-manager-config\") pod \"lws-controller-manager-dddbcdc66-7qzcg\" (UID: \"201d3b42-a8b0-475b-acff-f1861e87de08\") " pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-7qzcg" May 27 21:12:42.131433 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:42.131395 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/201d3b42-a8b0-475b-acff-f1861e87de08-metrics-cert\") pod \"lws-controller-manager-dddbcdc66-7qzcg\" (UID: \"201d3b42-a8b0-475b-acff-f1861e87de08\") " pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-7qzcg" May 27 21:12:42.131667 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:42.131535 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nclbw\" (UniqueName: \"kubernetes.io/projected/201d3b42-a8b0-475b-acff-f1861e87de08-kube-api-access-nclbw\") pod \"lws-controller-manager-dddbcdc66-7qzcg\" (UID: \"201d3b42-a8b0-475b-acff-f1861e87de08\") " pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-7qzcg" May 27 21:12:42.131667 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:42.131598 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/201d3b42-a8b0-475b-acff-f1861e87de08-cert\") pod \"lws-controller-manager-dddbcdc66-7qzcg\" (UID: \"201d3b42-a8b0-475b-acff-f1861e87de08\") " pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-7qzcg" May 27 21:12:42.232869 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:42.232784 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nclbw\" (UniqueName: \"kubernetes.io/projected/201d3b42-a8b0-475b-acff-f1861e87de08-kube-api-access-nclbw\") pod \"lws-controller-manager-dddbcdc66-7qzcg\" (UID: \"201d3b42-a8b0-475b-acff-f1861e87de08\") " pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-7qzcg" May 27 21:12:42.232869 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:42.232851 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/201d3b42-a8b0-475b-acff-f1861e87de08-cert\") pod \"lws-controller-manager-dddbcdc66-7qzcg\" (UID: \"201d3b42-a8b0-475b-acff-f1861e87de08\") " pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-7qzcg" May 27 21:12:42.233125 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:42.232908 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/201d3b42-a8b0-475b-acff-f1861e87de08-manager-config\") pod \"lws-controller-manager-dddbcdc66-7qzcg\" (UID: \"201d3b42-a8b0-475b-acff-f1861e87de08\") " pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-7qzcg" May 27 21:12:42.233125 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:42.232930 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/201d3b42-a8b0-475b-acff-f1861e87de08-metrics-cert\") pod \"lws-controller-manager-dddbcdc66-7qzcg\" (UID: \"201d3b42-a8b0-475b-acff-f1861e87de08\") " pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-7qzcg" May 27 21:12:42.233846 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:42.233815 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/201d3b42-a8b0-475b-acff-f1861e87de08-manager-config\") pod \"lws-controller-manager-dddbcdc66-7qzcg\" (UID: \"201d3b42-a8b0-475b-acff-f1861e87de08\") " pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-7qzcg" May 27 21:12:42.236331 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:42.236306 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/201d3b42-a8b0-475b-acff-f1861e87de08-cert\") pod \"lws-controller-manager-dddbcdc66-7qzcg\" (UID: \"201d3b42-a8b0-475b-acff-f1861e87de08\") " pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-7qzcg" May 27 21:12:42.236459 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:42.236345 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/201d3b42-a8b0-475b-acff-f1861e87de08-metrics-cert\") pod \"lws-controller-manager-dddbcdc66-7qzcg\" (UID: \"201d3b42-a8b0-475b-acff-f1861e87de08\") " pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-7qzcg" May 27 21:12:42.257015 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:42.256982 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nclbw\" (UniqueName: \"kubernetes.io/projected/201d3b42-a8b0-475b-acff-f1861e87de08-kube-api-access-nclbw\") pod \"lws-controller-manager-dddbcdc66-7qzcg\" (UID: \"201d3b42-a8b0-475b-acff-f1861e87de08\") " pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-7qzcg" May 27 21:12:42.284770 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:42.284735 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-7qzcg" May 27 21:12:43.553922 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:43.553897 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-dddbcdc66-7qzcg"] May 27 21:12:43.601167 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:12:43.601124 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod201d3b42_a8b0_475b_acff_f1861e87de08.slice/crio-428002f9668d8608ff850144f6604114cc89bf714e282443984909c2a3ffc295 WatchSource:0}: Error finding container 428002f9668d8608ff850144f6604114cc89bf714e282443984909c2a3ffc295: Status 404 returned error can't find the container with id 428002f9668d8608ff850144f6604114cc89bf714e282443984909c2a3ffc295 May 27 21:12:44.456321 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:44.456287 2566 generic.go:358] "Generic (PLEG): container finished" podID="21f4023e-2bc0-4cdf-854a-08876c17f142" containerID="280735549b7d41a0d0fa2f0491cedf0fe9eeaebf03d2c234fee64a4074d9d87e" exitCode=0 May 27 21:12:44.456497 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:44.456371 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hfvzm" event={"ID":"21f4023e-2bc0-4cdf-854a-08876c17f142","Type":"ContainerDied","Data":"280735549b7d41a0d0fa2f0491cedf0fe9eeaebf03d2c234fee64a4074d9d87e"} May 27 21:12:44.457552 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:44.457529 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-7qzcg" event={"ID":"201d3b42-a8b0-475b-acff-f1861e87de08","Type":"ContainerStarted","Data":"428002f9668d8608ff850144f6604114cc89bf714e282443984909c2a3ffc295"} May 27 21:12:44.459056 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:44.459023 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6678cd66dc-s89mh" event={"ID":"932e2f7f-e490-43ef-9062-5c0fce6edd85","Type":"ContainerStarted","Data":"486d34f522c00fe8a63ab826c23afbf8c8d470e6a2b5d21a3740181aeacd1ca3"} May 27 21:12:44.462097 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:44.462078 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6678cd66dc-s89mh" May 27 21:12:44.509209 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:44.509131 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6678cd66dc-s89mh" podStartSLOduration=1.9315749979999999 podStartE2EDuration="4.509112141s" podCreationTimestamp="2026-05-27 21:12:40 +0000 UTC" firstStartedPulling="2026-05-27 21:12:40.859758509 +0000 UTC m=+385.479144272" lastFinishedPulling="2026-05-27 21:12:43.437295634 +0000 UTC m=+388.056681415" observedRunningTime="2026-05-27 21:12:44.506608323 +0000 UTC m=+389.125994108" watchObservedRunningTime="2026-05-27 21:12:44.509112141 +0000 UTC m=+389.128497929" May 27 21:12:45.464507 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:45.464479 2566 generic.go:358] "Generic (PLEG): container finished" podID="21f4023e-2bc0-4cdf-854a-08876c17f142" containerID="25a8ca6ab32ea9f4d3efb6bad509577a99ca14a56f692de25105e3b4868a12e1" exitCode=0 May 27 21:12:45.464859 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:45.464560 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hfvzm" event={"ID":"21f4023e-2bc0-4cdf-854a-08876c17f142","Type":"ContainerDied","Data":"25a8ca6ab32ea9f4d3efb6bad509577a99ca14a56f692de25105e3b4868a12e1"} May 27 21:12:46.473871 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:46.473831 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-7qzcg" event={"ID":"201d3b42-a8b0-475b-acff-f1861e87de08","Type":"ContainerStarted","Data":"b5e69eaa34146943a97a00756dd4c0ee8a989324b3b7eb97f9f1e261cdd04c3e"} May 27 21:12:46.492053 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:46.491954 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-7qzcg" podStartSLOduration=3.6761714039999998 podStartE2EDuration="5.49193798s" podCreationTimestamp="2026-05-27 21:12:41 +0000 UTC" firstStartedPulling="2026-05-27 21:12:43.60297958 +0000 UTC m=+388.222365343" lastFinishedPulling="2026-05-27 21:12:45.418746156 +0000 UTC m=+390.038131919" observedRunningTime="2026-05-27 21:12:46.490781463 +0000 UTC m=+391.110167260" watchObservedRunningTime="2026-05-27 21:12:46.49193798 +0000 UTC m=+391.111323762" May 27 21:12:46.601338 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:46.601315 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hfvzm" May 27 21:12:46.776336 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:46.776248 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21f4023e-2bc0-4cdf-854a-08876c17f142-util\") pod \"21f4023e-2bc0-4cdf-854a-08876c17f142\" (UID: \"21f4023e-2bc0-4cdf-854a-08876c17f142\") " May 27 21:12:46.776336 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:46.776315 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwkwp\" (UniqueName: \"kubernetes.io/projected/21f4023e-2bc0-4cdf-854a-08876c17f142-kube-api-access-cwkwp\") pod \"21f4023e-2bc0-4cdf-854a-08876c17f142\" (UID: \"21f4023e-2bc0-4cdf-854a-08876c17f142\") " May 27 21:12:46.776564 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:46.776373 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21f4023e-2bc0-4cdf-854a-08876c17f142-bundle\") pod \"21f4023e-2bc0-4cdf-854a-08876c17f142\" (UID: \"21f4023e-2bc0-4cdf-854a-08876c17f142\") " May 27 21:12:46.777152 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:46.777119 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21f4023e-2bc0-4cdf-854a-08876c17f142-bundle" (OuterVolumeSpecName: "bundle") pod "21f4023e-2bc0-4cdf-854a-08876c17f142" (UID: "21f4023e-2bc0-4cdf-854a-08876c17f142"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:12:46.778422 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:46.778385 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21f4023e-2bc0-4cdf-854a-08876c17f142-kube-api-access-cwkwp" (OuterVolumeSpecName: "kube-api-access-cwkwp") pod "21f4023e-2bc0-4cdf-854a-08876c17f142" (UID: "21f4023e-2bc0-4cdf-854a-08876c17f142"). InnerVolumeSpecName "kube-api-access-cwkwp". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:12:46.781249 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:46.781227 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21f4023e-2bc0-4cdf-854a-08876c17f142-util" (OuterVolumeSpecName: "util") pod "21f4023e-2bc0-4cdf-854a-08876c17f142" (UID: "21f4023e-2bc0-4cdf-854a-08876c17f142"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:12:46.877214 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:46.877185 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21f4023e-2bc0-4cdf-854a-08876c17f142-util\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:12:46.877214 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:46.877215 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwkwp\" (UniqueName: \"kubernetes.io/projected/21f4023e-2bc0-4cdf-854a-08876c17f142-kube-api-access-cwkwp\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:12:46.877427 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:46.877228 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21f4023e-2bc0-4cdf-854a-08876c17f142-bundle\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:12:47.478878 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:47.478848 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hfvzm" May 27 21:12:47.479286 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:47.478845 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hfvzm" event={"ID":"21f4023e-2bc0-4cdf-854a-08876c17f142","Type":"ContainerDied","Data":"7726d6260a050318ae651faf3f5fdaa622d181f5773da1f07715f4d8e0aabf5f"} May 27 21:12:47.479286 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:47.479011 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7726d6260a050318ae651faf3f5fdaa622d181f5773da1f07715f4d8e0aabf5f" May 27 21:12:47.479286 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:47.479195 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-7qzcg" May 27 21:12:55.467159 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:55.467124 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6678cd66dc-s89mh" May 27 21:12:58.484723 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.484690 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-dddbcdc66-7qzcg" May 27 21:12:58.543083 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.543050 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6f6f4b4c58-r4l95"] May 27 21:12:58.543453 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.543439 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21f4023e-2bc0-4cdf-854a-08876c17f142" containerName="pull" May 27 21:12:58.543500 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.543455 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="21f4023e-2bc0-4cdf-854a-08876c17f142" containerName="pull" May 27 21:12:58.543500 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.543465 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21f4023e-2bc0-4cdf-854a-08876c17f142" containerName="util" May 27 21:12:58.543500 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.543470 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="21f4023e-2bc0-4cdf-854a-08876c17f142" containerName="util" May 27 21:12:58.543500 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.543482 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21f4023e-2bc0-4cdf-854a-08876c17f142" containerName="extract" May 27 21:12:58.543500 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.543487 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="21f4023e-2bc0-4cdf-854a-08876c17f142" containerName="extract" May 27 21:12:58.543656 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.543554 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="21f4023e-2bc0-4cdf-854a-08876c17f142" containerName="extract" May 27 21:12:58.546529 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.546505 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6f6f4b4c58-r4l95" May 27 21:12:58.549877 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.549850 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 27 21:12:58.550159 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.550132 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 27 21:12:58.550341 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.550177 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-74vs5\"" May 27 21:12:58.550341 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.550182 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 27 21:12:58.550534 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.550518 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 27 21:12:58.568175 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.561811 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6f6f4b4c58-r4l95"] May 27 21:12:58.626509 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.626477 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483589drd"] May 27 21:12:58.629945 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.629928 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483589drd" May 27 21:12:58.632542 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.632513 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 27 21:12:58.632661 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.632563 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 27 21:12:58.632661 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.632592 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tjd5p\"" May 27 21:12:58.640595 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.640571 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483589drd"] May 27 21:12:58.681259 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.681223 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfc0d2b1-a730-418b-a864-44717d9d89d9-tls-certs\") pod \"kube-auth-proxy-6f6f4b4c58-r4l95\" (UID: \"bfc0d2b1-a730-418b-a864-44717d9d89d9\") " pod="openshift-ingress/kube-auth-proxy-6f6f4b4c58-r4l95" May 27 21:12:58.681413 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.681292 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62tkc\" (UniqueName: \"kubernetes.io/projected/bfc0d2b1-a730-418b-a864-44717d9d89d9-kube-api-access-62tkc\") pod \"kube-auth-proxy-6f6f4b4c58-r4l95\" (UID: \"bfc0d2b1-a730-418b-a864-44717d9d89d9\") " pod="openshift-ingress/kube-auth-proxy-6f6f4b4c58-r4l95" May 27 21:12:58.681413 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.681325 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bfc0d2b1-a730-418b-a864-44717d9d89d9-tmp\") pod \"kube-auth-proxy-6f6f4b4c58-r4l95\" (UID: \"bfc0d2b1-a730-418b-a864-44717d9d89d9\") " pod="openshift-ingress/kube-auth-proxy-6f6f4b4c58-r4l95" May 27 21:12:58.782589 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.782492 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfc0d2b1-a730-418b-a864-44717d9d89d9-tls-certs\") pod \"kube-auth-proxy-6f6f4b4c58-r4l95\" (UID: \"bfc0d2b1-a730-418b-a864-44717d9d89d9\") " pod="openshift-ingress/kube-auth-proxy-6f6f4b4c58-r4l95" May 27 21:12:58.782589 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.782562 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62tkc\" (UniqueName: \"kubernetes.io/projected/bfc0d2b1-a730-418b-a864-44717d9d89d9-kube-api-access-62tkc\") pod \"kube-auth-proxy-6f6f4b4c58-r4l95\" (UID: \"bfc0d2b1-a730-418b-a864-44717d9d89d9\") " pod="openshift-ingress/kube-auth-proxy-6f6f4b4c58-r4l95" May 27 21:12:58.782792 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.782594 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bfc0d2b1-a730-418b-a864-44717d9d89d9-tmp\") pod \"kube-auth-proxy-6f6f4b4c58-r4l95\" (UID: \"bfc0d2b1-a730-418b-a864-44717d9d89d9\") " pod="openshift-ingress/kube-auth-proxy-6f6f4b4c58-r4l95" May 27 21:12:58.782792 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.782631 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/957bdad5-11f9-4114-9c45-67cd21e412f7-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483589drd\" (UID: \"957bdad5-11f9-4114-9c45-67cd21e412f7\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483589drd" May 27 21:12:58.782792 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.782654 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87sq9\" (UniqueName: \"kubernetes.io/projected/957bdad5-11f9-4114-9c45-67cd21e412f7-kube-api-access-87sq9\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483589drd\" (UID: \"957bdad5-11f9-4114-9c45-67cd21e412f7\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483589drd" May 27 21:12:58.782792 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.782735 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/957bdad5-11f9-4114-9c45-67cd21e412f7-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483589drd\" (UID: \"957bdad5-11f9-4114-9c45-67cd21e412f7\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483589drd" May 27 21:12:58.784933 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.784911 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bfc0d2b1-a730-418b-a864-44717d9d89d9-tmp\") pod \"kube-auth-proxy-6f6f4b4c58-r4l95\" (UID: \"bfc0d2b1-a730-418b-a864-44717d9d89d9\") " pod="openshift-ingress/kube-auth-proxy-6f6f4b4c58-r4l95" May 27 21:12:58.785072 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.785055 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfc0d2b1-a730-418b-a864-44717d9d89d9-tls-certs\") pod \"kube-auth-proxy-6f6f4b4c58-r4l95\" (UID: \"bfc0d2b1-a730-418b-a864-44717d9d89d9\") " pod="openshift-ingress/kube-auth-proxy-6f6f4b4c58-r4l95" May 27 21:12:58.798574 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.798548 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62tkc\" (UniqueName: \"kubernetes.io/projected/bfc0d2b1-a730-418b-a864-44717d9d89d9-kube-api-access-62tkc\") pod \"kube-auth-proxy-6f6f4b4c58-r4l95\" (UID: \"bfc0d2b1-a730-418b-a864-44717d9d89d9\") " pod="openshift-ingress/kube-auth-proxy-6f6f4b4c58-r4l95" May 27 21:12:58.859713 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.859682 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6f6f4b4c58-r4l95" May 27 21:12:58.883861 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.883828 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/957bdad5-11f9-4114-9c45-67cd21e412f7-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483589drd\" (UID: \"957bdad5-11f9-4114-9c45-67cd21e412f7\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483589drd" May 27 21:12:58.884071 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.883866 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-87sq9\" (UniqueName: \"kubernetes.io/projected/957bdad5-11f9-4114-9c45-67cd21e412f7-kube-api-access-87sq9\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483589drd\" (UID: \"957bdad5-11f9-4114-9c45-67cd21e412f7\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483589drd" May 27 21:12:58.884071 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.883900 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/957bdad5-11f9-4114-9c45-67cd21e412f7-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483589drd\" (UID: \"957bdad5-11f9-4114-9c45-67cd21e412f7\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483589drd" May 27 21:12:58.884231 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.884210 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/957bdad5-11f9-4114-9c45-67cd21e412f7-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483589drd\" (UID: \"957bdad5-11f9-4114-9c45-67cd21e412f7\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483589drd" May 27 21:12:58.884289 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.884229 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/957bdad5-11f9-4114-9c45-67cd21e412f7-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483589drd\" (UID: \"957bdad5-11f9-4114-9c45-67cd21e412f7\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483589drd" May 27 21:12:58.914880 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.914843 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87sq9\" (UniqueName: \"kubernetes.io/projected/957bdad5-11f9-4114-9c45-67cd21e412f7-kube-api-access-87sq9\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483589drd\" (UID: \"957bdad5-11f9-4114-9c45-67cd21e412f7\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483589drd" May 27 21:12:58.940833 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.940546 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483589drd" May 27 21:12:58.996098 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:58.995729 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6f6f4b4c58-r4l95"] May 27 21:12:58.998889 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:12:58.998358 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfc0d2b1_a730_418b_a864_44717d9d89d9.slice/crio-1ead7ef16097b8cd1b063a2b5b6f252e9e47102d83ad30e420c5f79c52ea02f8 WatchSource:0}: Error finding container 1ead7ef16097b8cd1b063a2b5b6f252e9e47102d83ad30e420c5f79c52ea02f8: Status 404 returned error can't find the container with id 1ead7ef16097b8cd1b063a2b5b6f252e9e47102d83ad30e420c5f79c52ea02f8 May 27 21:12:59.081329 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:59.081289 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483589drd"] May 27 21:12:59.086095 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:12:59.086065 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod957bdad5_11f9_4114_9c45_67cd21e412f7.slice/crio-d7fb23f463e1aa7480b5552603d2d486d408ffbbd62f193ef92fd0b64bd74562 WatchSource:0}: Error finding container d7fb23f463e1aa7480b5552603d2d486d408ffbbd62f193ef92fd0b64bd74562: Status 404 returned error can't find the container with id d7fb23f463e1aa7480b5552603d2d486d408ffbbd62f193ef92fd0b64bd74562 May 27 21:12:59.522307 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:59.522219 2566 generic.go:358] "Generic (PLEG): container finished" podID="957bdad5-11f9-4114-9c45-67cd21e412f7" containerID="18798143fd300bfbfac788f6fb886ec2c4a2f7f878e1bb7b04d558f2cb7469b4" exitCode=0 May 27 21:12:59.522697 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:59.522311 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483589drd" event={"ID":"957bdad5-11f9-4114-9c45-67cd21e412f7","Type":"ContainerDied","Data":"18798143fd300bfbfac788f6fb886ec2c4a2f7f878e1bb7b04d558f2cb7469b4"} May 27 21:12:59.522697 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:59.522352 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483589drd" event={"ID":"957bdad5-11f9-4114-9c45-67cd21e412f7","Type":"ContainerStarted","Data":"d7fb23f463e1aa7480b5552603d2d486d408ffbbd62f193ef92fd0b64bd74562"} May 27 21:12:59.523462 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:12:59.523439 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6f6f4b4c58-r4l95" event={"ID":"bfc0d2b1-a730-418b-a864-44717d9d89d9","Type":"ContainerStarted","Data":"1ead7ef16097b8cd1b063a2b5b6f252e9e47102d83ad30e420c5f79c52ea02f8"} May 27 21:13:01.533650 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:01.533616 2566 generic.go:358] "Generic (PLEG): container finished" podID="957bdad5-11f9-4114-9c45-67cd21e412f7" containerID="c98fcd2a490cbafc815ce1b6e53b7004b003490a76d1c3dd51215ff2605e3231" exitCode=0 May 27 21:13:01.534163 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:01.533704 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483589drd" event={"ID":"957bdad5-11f9-4114-9c45-67cd21e412f7","Type":"ContainerDied","Data":"c98fcd2a490cbafc815ce1b6e53b7004b003490a76d1c3dd51215ff2605e3231"} May 27 21:13:02.539657 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:02.539623 2566 generic.go:358] "Generic (PLEG): container finished" podID="957bdad5-11f9-4114-9c45-67cd21e412f7" containerID="b324eb0aa3acc50f22fcdcad86fd3bdc324efaba8b02f96932f013943f5cfe62" exitCode=0 May 27 21:13:02.540126 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:02.539696 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483589drd" event={"ID":"957bdad5-11f9-4114-9c45-67cd21e412f7","Type":"ContainerDied","Data":"b324eb0aa3acc50f22fcdcad86fd3bdc324efaba8b02f96932f013943f5cfe62"} May 27 21:13:03.545121 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:03.545084 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6f6f4b4c58-r4l95" event={"ID":"bfc0d2b1-a730-418b-a864-44717d9d89d9","Type":"ContainerStarted","Data":"70012776642cd6d466dc02bcf3b3e255c5f56e688371af3f817467b029492fe9"} May 27 21:13:03.566930 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:03.566874 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6f6f4b4c58-r4l95" podStartSLOduration=1.996802149 podStartE2EDuration="5.566857799s" podCreationTimestamp="2026-05-27 21:12:58 +0000 UTC" firstStartedPulling="2026-05-27 21:12:59.001541721 +0000 UTC m=+403.620927487" lastFinishedPulling="2026-05-27 21:13:02.571597371 +0000 UTC m=+407.190983137" observedRunningTime="2026-05-27 21:13:03.564260376 +0000 UTC m=+408.183646161" watchObservedRunningTime="2026-05-27 21:13:03.566857799 +0000 UTC m=+408.186243585" May 27 21:13:03.681671 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:03.681648 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483589drd" May 27 21:13:03.727081 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:03.727053 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/957bdad5-11f9-4114-9c45-67cd21e412f7-util\") pod \"957bdad5-11f9-4114-9c45-67cd21e412f7\" (UID: \"957bdad5-11f9-4114-9c45-67cd21e412f7\") " May 27 21:13:03.727226 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:03.727102 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/957bdad5-11f9-4114-9c45-67cd21e412f7-bundle\") pod \"957bdad5-11f9-4114-9c45-67cd21e412f7\" (UID: \"957bdad5-11f9-4114-9c45-67cd21e412f7\") " May 27 21:13:03.727226 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:03.727194 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87sq9\" (UniqueName: \"kubernetes.io/projected/957bdad5-11f9-4114-9c45-67cd21e412f7-kube-api-access-87sq9\") pod \"957bdad5-11f9-4114-9c45-67cd21e412f7\" (UID: \"957bdad5-11f9-4114-9c45-67cd21e412f7\") " May 27 21:13:03.727877 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:03.727852 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/957bdad5-11f9-4114-9c45-67cd21e412f7-bundle" (OuterVolumeSpecName: "bundle") pod "957bdad5-11f9-4114-9c45-67cd21e412f7" (UID: "957bdad5-11f9-4114-9c45-67cd21e412f7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:13:03.729246 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:03.729214 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/957bdad5-11f9-4114-9c45-67cd21e412f7-kube-api-access-87sq9" (OuterVolumeSpecName: "kube-api-access-87sq9") pod "957bdad5-11f9-4114-9c45-67cd21e412f7" (UID: "957bdad5-11f9-4114-9c45-67cd21e412f7"). InnerVolumeSpecName "kube-api-access-87sq9". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:13:03.732244 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:03.732225 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/957bdad5-11f9-4114-9c45-67cd21e412f7-util" (OuterVolumeSpecName: "util") pod "957bdad5-11f9-4114-9c45-67cd21e412f7" (UID: "957bdad5-11f9-4114-9c45-67cd21e412f7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:13:03.828282 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:03.828246 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/957bdad5-11f9-4114-9c45-67cd21e412f7-util\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:13:03.828282 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:03.828274 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/957bdad5-11f9-4114-9c45-67cd21e412f7-bundle\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:13:03.828282 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:03.828287 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87sq9\" (UniqueName: \"kubernetes.io/projected/957bdad5-11f9-4114-9c45-67cd21e412f7-kube-api-access-87sq9\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:13:04.550524 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:04.550492 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483589drd" May 27 21:13:04.550524 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:04.550503 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483589drd" event={"ID":"957bdad5-11f9-4114-9c45-67cd21e412f7","Type":"ContainerDied","Data":"d7fb23f463e1aa7480b5552603d2d486d408ffbbd62f193ef92fd0b64bd74562"} May 27 21:13:04.551039 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:04.550537 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d7fb23f463e1aa7480b5552603d2d486d408ffbbd62f193ef92fd0b64bd74562" May 27 21:13:12.870524 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:12.870487 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw22b7"] May 27 21:13:12.871597 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:12.871570 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="957bdad5-11f9-4114-9c45-67cd21e412f7" containerName="util" May 27 21:13:12.871748 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:12.871737 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="957bdad5-11f9-4114-9c45-67cd21e412f7" containerName="util" May 27 21:13:12.871833 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:12.871823 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="957bdad5-11f9-4114-9c45-67cd21e412f7" containerName="pull" May 27 21:13:12.871900 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:12.871892 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="957bdad5-11f9-4114-9c45-67cd21e412f7" containerName="pull" May 27 21:13:12.871980 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:12.871971 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="957bdad5-11f9-4114-9c45-67cd21e412f7" containerName="extract" May 27 21:13:12.872070 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:12.872061 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="957bdad5-11f9-4114-9c45-67cd21e412f7" containerName="extract" May 27 21:13:12.872267 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:12.872246 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="957bdad5-11f9-4114-9c45-67cd21e412f7" containerName="extract" May 27 21:13:12.877504 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:12.877483 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw22b7" May 27 21:13:12.880083 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:12.880063 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 27 21:13:12.880529 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:12.880513 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 27 21:13:12.880595 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:12.880541 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tjd5p\"" May 27 21:13:12.891668 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:12.891643 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw22b7"] May 27 21:13:12.904048 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:12.904006 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glkcc\" (UniqueName: \"kubernetes.io/projected/e9557152-1c20-4ffd-953e-0d4cd0baae91-kube-api-access-glkcc\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw22b7\" (UID: \"e9557152-1c20-4ffd-953e-0d4cd0baae91\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw22b7" May 27 21:13:12.904152 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:12.904063 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9557152-1c20-4ffd-953e-0d4cd0baae91-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw22b7\" (UID: \"e9557152-1c20-4ffd-953e-0d4cd0baae91\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw22b7" May 27 21:13:12.904152 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:12.904104 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9557152-1c20-4ffd-953e-0d4cd0baae91-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw22b7\" (UID: \"e9557152-1c20-4ffd-953e-0d4cd0baae91\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw22b7" May 27 21:13:13.005392 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:13.005362 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-glkcc\" (UniqueName: \"kubernetes.io/projected/e9557152-1c20-4ffd-953e-0d4cd0baae91-kube-api-access-glkcc\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw22b7\" (UID: \"e9557152-1c20-4ffd-953e-0d4cd0baae91\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw22b7" May 27 21:13:13.005392 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:13.005396 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9557152-1c20-4ffd-953e-0d4cd0baae91-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw22b7\" (UID: \"e9557152-1c20-4ffd-953e-0d4cd0baae91\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw22b7" May 27 21:13:13.005594 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:13.005427 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9557152-1c20-4ffd-953e-0d4cd0baae91-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw22b7\" (UID: \"e9557152-1c20-4ffd-953e-0d4cd0baae91\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw22b7" May 27 21:13:13.005814 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:13.005792 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9557152-1c20-4ffd-953e-0d4cd0baae91-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw22b7\" (UID: \"e9557152-1c20-4ffd-953e-0d4cd0baae91\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw22b7" May 27 21:13:13.005852 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:13.005806 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9557152-1c20-4ffd-953e-0d4cd0baae91-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw22b7\" (UID: \"e9557152-1c20-4ffd-953e-0d4cd0baae91\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw22b7" May 27 21:13:13.013954 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:13.013931 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glkcc\" (UniqueName: \"kubernetes.io/projected/e9557152-1c20-4ffd-953e-0d4cd0baae91-kube-api-access-glkcc\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw22b7\" (UID: \"e9557152-1c20-4ffd-953e-0d4cd0baae91\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw22b7" May 27 21:13:13.187624 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:13.187539 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw22b7" May 27 21:13:13.341618 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:13.341586 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw22b7"] May 27 21:13:13.342483 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:13:13.342458 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9557152_1c20_4ffd_953e_0d4cd0baae91.slice/crio-396493687e3452547feeac1a6f839234c6bf2a7e2627f9fde24bb90f486390f3 WatchSource:0}: Error finding container 396493687e3452547feeac1a6f839234c6bf2a7e2627f9fde24bb90f486390f3: Status 404 returned error can't find the container with id 396493687e3452547feeac1a6f839234c6bf2a7e2627f9fde24bb90f486390f3 May 27 21:13:13.597491 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:13.597451 2566 generic.go:358] "Generic (PLEG): container finished" podID="e9557152-1c20-4ffd-953e-0d4cd0baae91" containerID="8a9f5c9a040a6a06e848425f90010d678c6abe5729e96f806605ce1bfc4ea260" exitCode=0 May 27 21:13:13.597646 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:13.597496 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw22b7" event={"ID":"e9557152-1c20-4ffd-953e-0d4cd0baae91","Type":"ContainerDied","Data":"8a9f5c9a040a6a06e848425f90010d678c6abe5729e96f806605ce1bfc4ea260"} May 27 21:13:13.597646 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:13.597529 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw22b7" event={"ID":"e9557152-1c20-4ffd-953e-0d4cd0baae91","Type":"ContainerStarted","Data":"396493687e3452547feeac1a6f839234c6bf2a7e2627f9fde24bb90f486390f3"} May 27 21:13:15.607331 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:15.607299 2566 generic.go:358] "Generic (PLEG): container finished" podID="e9557152-1c20-4ffd-953e-0d4cd0baae91" containerID="db31ca9051502b705785525895d5a354fd2cac8725f75d9688b22b3dfd37b0c5" exitCode=0 May 27 21:13:15.607765 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:15.607337 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw22b7" event={"ID":"e9557152-1c20-4ffd-953e-0d4cd0baae91","Type":"ContainerDied","Data":"db31ca9051502b705785525895d5a354fd2cac8725f75d9688b22b3dfd37b0c5"} May 27 21:13:16.612280 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:16.612246 2566 generic.go:358] "Generic (PLEG): container finished" podID="e9557152-1c20-4ffd-953e-0d4cd0baae91" containerID="bc4ae2dfb104bee932630babb57c2e2fc2838f4c2190539a615c2e5bbb3bf810" exitCode=0 May 27 21:13:16.612661 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:16.612332 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw22b7" event={"ID":"e9557152-1c20-4ffd-953e-0d4cd0baae91","Type":"ContainerDied","Data":"bc4ae2dfb104bee932630babb57c2e2fc2838f4c2190539a615c2e5bbb3bf810"} May 27 21:13:17.744696 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:17.744669 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw22b7" May 27 21:13:17.849207 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:17.849172 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9557152-1c20-4ffd-953e-0d4cd0baae91-util\") pod \"e9557152-1c20-4ffd-953e-0d4cd0baae91\" (UID: \"e9557152-1c20-4ffd-953e-0d4cd0baae91\") " May 27 21:13:17.849403 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:17.849228 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9557152-1c20-4ffd-953e-0d4cd0baae91-bundle\") pod \"e9557152-1c20-4ffd-953e-0d4cd0baae91\" (UID: \"e9557152-1c20-4ffd-953e-0d4cd0baae91\") " May 27 21:13:17.849403 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:17.849251 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-glkcc\" (UniqueName: \"kubernetes.io/projected/e9557152-1c20-4ffd-953e-0d4cd0baae91-kube-api-access-glkcc\") pod \"e9557152-1c20-4ffd-953e-0d4cd0baae91\" (UID: \"e9557152-1c20-4ffd-953e-0d4cd0baae91\") " May 27 21:13:17.850173 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:17.850136 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9557152-1c20-4ffd-953e-0d4cd0baae91-bundle" (OuterVolumeSpecName: "bundle") pod "e9557152-1c20-4ffd-953e-0d4cd0baae91" (UID: "e9557152-1c20-4ffd-953e-0d4cd0baae91"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:13:17.851526 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:17.851499 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9557152-1c20-4ffd-953e-0d4cd0baae91-kube-api-access-glkcc" (OuterVolumeSpecName: "kube-api-access-glkcc") pod "e9557152-1c20-4ffd-953e-0d4cd0baae91" (UID: "e9557152-1c20-4ffd-953e-0d4cd0baae91"). InnerVolumeSpecName "kube-api-access-glkcc". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:13:17.855106 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:17.855085 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9557152-1c20-4ffd-953e-0d4cd0baae91-util" (OuterVolumeSpecName: "util") pod "e9557152-1c20-4ffd-953e-0d4cd0baae91" (UID: "e9557152-1c20-4ffd-953e-0d4cd0baae91"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:13:17.950491 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:17.950415 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9557152-1c20-4ffd-953e-0d4cd0baae91-bundle\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:13:17.950491 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:17.950444 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glkcc\" (UniqueName: \"kubernetes.io/projected/e9557152-1c20-4ffd-953e-0d4cd0baae91-kube-api-access-glkcc\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:13:17.950491 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:17.950455 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9557152-1c20-4ffd-953e-0d4cd0baae91-util\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:13:18.621153 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:18.621115 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw22b7" event={"ID":"e9557152-1c20-4ffd-953e-0d4cd0baae91","Type":"ContainerDied","Data":"396493687e3452547feeac1a6f839234c6bf2a7e2627f9fde24bb90f486390f3"} May 27 21:13:18.621153 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:18.621149 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw22b7" May 27 21:13:18.621153 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:13:18.621155 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="396493687e3452547feeac1a6f839234c6bf2a7e2627f9fde24bb90f486390f3" May 27 21:14:13.272230 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.272196 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg"] May 27 21:14:13.272636 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.272579 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9557152-1c20-4ffd-953e-0d4cd0baae91" containerName="util" May 27 21:14:13.272636 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.272593 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9557152-1c20-4ffd-953e-0d4cd0baae91" containerName="util" May 27 21:14:13.272636 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.272613 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9557152-1c20-4ffd-953e-0d4cd0baae91" containerName="extract" May 27 21:14:13.272636 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.272618 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9557152-1c20-4ffd-953e-0d4cd0baae91" containerName="extract" May 27 21:14:13.272636 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.272626 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9557152-1c20-4ffd-953e-0d4cd0baae91" containerName="pull" May 27 21:14:13.272636 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.272632 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9557152-1c20-4ffd-953e-0d4cd0baae91" containerName="pull" May 27 21:14:13.272819 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.272696 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="e9557152-1c20-4ffd-953e-0d4cd0baae91" containerName="extract" May 27 21:14:13.275056 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.275016 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg" May 27 21:14:13.277770 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.277743 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 27 21:14:13.277770 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.277759 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 27 21:14:13.278598 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.278580 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-64wjq\"" May 27 21:14:13.284202 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.284180 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg"] May 27 21:14:13.350300 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.350264 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4804cd26-eae8-4796-aaef-d209c99ab8a4-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg\" (UID: \"4804cd26-eae8-4796-aaef-d209c99ab8a4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg" May 27 21:14:13.350480 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.350318 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4804cd26-eae8-4796-aaef-d209c99ab8a4-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg\" (UID: \"4804cd26-eae8-4796-aaef-d209c99ab8a4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg" May 27 21:14:13.350480 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.350387 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv769\" (UniqueName: \"kubernetes.io/projected/4804cd26-eae8-4796-aaef-d209c99ab8a4-kube-api-access-qv769\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg\" (UID: \"4804cd26-eae8-4796-aaef-d209c99ab8a4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg" May 27 21:14:13.451447 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.451410 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4804cd26-eae8-4796-aaef-d209c99ab8a4-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg\" (UID: \"4804cd26-eae8-4796-aaef-d209c99ab8a4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg" May 27 21:14:13.451615 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.451468 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4804cd26-eae8-4796-aaef-d209c99ab8a4-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg\" (UID: \"4804cd26-eae8-4796-aaef-d209c99ab8a4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg" May 27 21:14:13.451615 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.451489 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qv769\" (UniqueName: \"kubernetes.io/projected/4804cd26-eae8-4796-aaef-d209c99ab8a4-kube-api-access-qv769\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg\" (UID: \"4804cd26-eae8-4796-aaef-d209c99ab8a4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg" May 27 21:14:13.451845 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.451823 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4804cd26-eae8-4796-aaef-d209c99ab8a4-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg\" (UID: \"4804cd26-eae8-4796-aaef-d209c99ab8a4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg" May 27 21:14:13.451920 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.451868 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4804cd26-eae8-4796-aaef-d209c99ab8a4-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg\" (UID: \"4804cd26-eae8-4796-aaef-d209c99ab8a4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg" May 27 21:14:13.460730 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.460705 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv769\" (UniqueName: \"kubernetes.io/projected/4804cd26-eae8-4796-aaef-d209c99ab8a4-kube-api-access-qv769\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg\" (UID: \"4804cd26-eae8-4796-aaef-d209c99ab8a4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg" May 27 21:14:13.584901 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.584872 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg" May 27 21:14:13.679783 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.679752 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kh4xq"] May 27 21:14:13.686037 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.685992 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kh4xq" May 27 21:14:13.689835 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.689809 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kh4xq"] May 27 21:14:13.719458 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.719435 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg"] May 27 21:14:13.722019 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:14:13.721992 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4804cd26_eae8_4796_aaef_d209c99ab8a4.slice/crio-040ae40ca23f89010eb10d2ec516ce2a1f56f16114a03dad66f3a676ce3bca72 WatchSource:0}: Error finding container 040ae40ca23f89010eb10d2ec516ce2a1f56f16114a03dad66f3a676ce3bca72: Status 404 returned error can't find the container with id 040ae40ca23f89010eb10d2ec516ce2a1f56f16114a03dad66f3a676ce3bca72 May 27 21:14:13.829627 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.829597 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg" event={"ID":"4804cd26-eae8-4796-aaef-d209c99ab8a4","Type":"ContainerStarted","Data":"e6c4d564d85670b16e2bb5a4ed8051ddbd47d4eef6a4bef4fa69d165cbc70479"} May 27 21:14:13.829758 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.829635 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg" event={"ID":"4804cd26-eae8-4796-aaef-d209c99ab8a4","Type":"ContainerStarted","Data":"040ae40ca23f89010eb10d2ec516ce2a1f56f16114a03dad66f3a676ce3bca72"} May 27 21:14:13.855056 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.854978 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8556844-bb43-47fa-8d8b-888eab1d9385-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kh4xq\" (UID: \"d8556844-bb43-47fa-8d8b-888eab1d9385\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kh4xq" May 27 21:14:13.855150 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.855063 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8556844-bb43-47fa-8d8b-888eab1d9385-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kh4xq\" (UID: \"d8556844-bb43-47fa-8d8b-888eab1d9385\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kh4xq" May 27 21:14:13.855150 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.855089 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf2hv\" (UniqueName: \"kubernetes.io/projected/d8556844-bb43-47fa-8d8b-888eab1d9385-kube-api-access-mf2hv\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kh4xq\" (UID: \"d8556844-bb43-47fa-8d8b-888eab1d9385\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kh4xq" May 27 21:14:13.956193 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.956152 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8556844-bb43-47fa-8d8b-888eab1d9385-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kh4xq\" (UID: \"d8556844-bb43-47fa-8d8b-888eab1d9385\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kh4xq" May 27 21:14:13.956371 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.956243 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8556844-bb43-47fa-8d8b-888eab1d9385-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kh4xq\" (UID: \"d8556844-bb43-47fa-8d8b-888eab1d9385\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kh4xq" May 27 21:14:13.956371 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.956270 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mf2hv\" (UniqueName: \"kubernetes.io/projected/d8556844-bb43-47fa-8d8b-888eab1d9385-kube-api-access-mf2hv\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kh4xq\" (UID: \"d8556844-bb43-47fa-8d8b-888eab1d9385\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kh4xq" May 27 21:14:13.956573 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.956553 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8556844-bb43-47fa-8d8b-888eab1d9385-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kh4xq\" (UID: \"d8556844-bb43-47fa-8d8b-888eab1d9385\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kh4xq" May 27 21:14:13.956610 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.956579 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8556844-bb43-47fa-8d8b-888eab1d9385-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kh4xq\" (UID: \"d8556844-bb43-47fa-8d8b-888eab1d9385\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kh4xq" May 27 21:14:13.966195 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.966170 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf2hv\" (UniqueName: \"kubernetes.io/projected/d8556844-bb43-47fa-8d8b-888eab1d9385-kube-api-access-mf2hv\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kh4xq\" (UID: \"d8556844-bb43-47fa-8d8b-888eab1d9385\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kh4xq" May 27 21:14:13.999675 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:13.999645 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kh4xq" May 27 21:14:14.065438 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.065407 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zgzvm"] May 27 21:14:14.068547 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.068530 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zgzvm" May 27 21:14:14.079682 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.079651 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zgzvm"] May 27 21:14:14.137791 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.137768 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kh4xq"] May 27 21:14:14.139478 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:14:14.139452 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8556844_bb43_47fa_8d8b_888eab1d9385.slice/crio-6a1a5f0849ad9911ceecd8b9d642f2e5bcb5ef3221b809a4b12ff921fffb1257 WatchSource:0}: Error finding container 6a1a5f0849ad9911ceecd8b9d642f2e5bcb5ef3221b809a4b12ff921fffb1257: Status 404 returned error can't find the container with id 6a1a5f0849ad9911ceecd8b9d642f2e5bcb5ef3221b809a4b12ff921fffb1257 May 27 21:14:14.157537 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.157503 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c8a84f8-d0d8-4628-8b37-eb7aaaba9202-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zgzvm\" (UID: \"6c8a84f8-d0d8-4628-8b37-eb7aaaba9202\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zgzvm" May 27 21:14:14.157642 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.157624 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c8a84f8-d0d8-4628-8b37-eb7aaaba9202-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zgzvm\" (UID: \"6c8a84f8-d0d8-4628-8b37-eb7aaaba9202\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zgzvm" May 27 21:14:14.157764 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.157738 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t8mw\" (UniqueName: \"kubernetes.io/projected/6c8a84f8-d0d8-4628-8b37-eb7aaaba9202-kube-api-access-7t8mw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zgzvm\" (UID: \"6c8a84f8-d0d8-4628-8b37-eb7aaaba9202\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zgzvm" May 27 21:14:14.258788 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.258754 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7t8mw\" (UniqueName: \"kubernetes.io/projected/6c8a84f8-d0d8-4628-8b37-eb7aaaba9202-kube-api-access-7t8mw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zgzvm\" (UID: \"6c8a84f8-d0d8-4628-8b37-eb7aaaba9202\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zgzvm" May 27 21:14:14.258952 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.258846 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c8a84f8-d0d8-4628-8b37-eb7aaaba9202-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zgzvm\" (UID: \"6c8a84f8-d0d8-4628-8b37-eb7aaaba9202\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zgzvm" May 27 21:14:14.258952 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.258892 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c8a84f8-d0d8-4628-8b37-eb7aaaba9202-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zgzvm\" (UID: \"6c8a84f8-d0d8-4628-8b37-eb7aaaba9202\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zgzvm" May 27 21:14:14.259236 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.259213 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c8a84f8-d0d8-4628-8b37-eb7aaaba9202-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zgzvm\" (UID: \"6c8a84f8-d0d8-4628-8b37-eb7aaaba9202\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zgzvm" May 27 21:14:14.259297 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.259240 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c8a84f8-d0d8-4628-8b37-eb7aaaba9202-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zgzvm\" (UID: \"6c8a84f8-d0d8-4628-8b37-eb7aaaba9202\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zgzvm" May 27 21:14:14.268002 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.267982 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t8mw\" (UniqueName: \"kubernetes.io/projected/6c8a84f8-d0d8-4628-8b37-eb7aaaba9202-kube-api-access-7t8mw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zgzvm\" (UID: \"6c8a84f8-d0d8-4628-8b37-eb7aaaba9202\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zgzvm" May 27 21:14:14.379094 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.379049 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zgzvm" May 27 21:14:14.468348 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.468313 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xb7x"] May 27 21:14:14.471078 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.471051 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xb7x" May 27 21:14:14.490181 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.489448 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xb7x"] May 27 21:14:14.523366 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.523333 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zgzvm"] May 27 21:14:14.524638 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:14:14.524614 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c8a84f8_d0d8_4628_8b37_eb7aaaba9202.slice/crio-2d07e0ac15b2ea398bd651de30bad7c2fbce25ae79cbaece426f6131138ba26b WatchSource:0}: Error finding container 2d07e0ac15b2ea398bd651de30bad7c2fbce25ae79cbaece426f6131138ba26b: Status 404 returned error can't find the container with id 2d07e0ac15b2ea398bd651de30bad7c2fbce25ae79cbaece426f6131138ba26b May 27 21:14:14.562140 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.562101 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vb8l\" (UniqueName: \"kubernetes.io/projected/ff2a3748-c094-4a00-ad3a-0edd2e52afce-kube-api-access-8vb8l\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xb7x\" (UID: \"ff2a3748-c094-4a00-ad3a-0edd2e52afce\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xb7x" May 27 21:14:14.562291 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.562170 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff2a3748-c094-4a00-ad3a-0edd2e52afce-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xb7x\" (UID: \"ff2a3748-c094-4a00-ad3a-0edd2e52afce\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xb7x" May 27 21:14:14.562356 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.562299 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff2a3748-c094-4a00-ad3a-0edd2e52afce-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xb7x\" (UID: \"ff2a3748-c094-4a00-ad3a-0edd2e52afce\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xb7x" May 27 21:14:14.663203 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.663171 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff2a3748-c094-4a00-ad3a-0edd2e52afce-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xb7x\" (UID: \"ff2a3748-c094-4a00-ad3a-0edd2e52afce\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xb7x" May 27 21:14:14.663333 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.663225 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8vb8l\" (UniqueName: \"kubernetes.io/projected/ff2a3748-c094-4a00-ad3a-0edd2e52afce-kube-api-access-8vb8l\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xb7x\" (UID: \"ff2a3748-c094-4a00-ad3a-0edd2e52afce\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xb7x" May 27 21:14:14.663333 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.663274 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff2a3748-c094-4a00-ad3a-0edd2e52afce-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xb7x\" (UID: \"ff2a3748-c094-4a00-ad3a-0edd2e52afce\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xb7x" May 27 21:14:14.663586 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.663563 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff2a3748-c094-4a00-ad3a-0edd2e52afce-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xb7x\" (UID: \"ff2a3748-c094-4a00-ad3a-0edd2e52afce\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xb7x" May 27 21:14:14.663683 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.663661 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff2a3748-c094-4a00-ad3a-0edd2e52afce-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xb7x\" (UID: \"ff2a3748-c094-4a00-ad3a-0edd2e52afce\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xb7x" May 27 21:14:14.673144 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.673116 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vb8l\" (UniqueName: \"kubernetes.io/projected/ff2a3748-c094-4a00-ad3a-0edd2e52afce-kube-api-access-8vb8l\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xb7x\" (UID: \"ff2a3748-c094-4a00-ad3a-0edd2e52afce\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xb7x" May 27 21:14:14.786958 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.786928 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xb7x" May 27 21:14:14.836437 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.836396 2566 generic.go:358] "Generic (PLEG): container finished" podID="4804cd26-eae8-4796-aaef-d209c99ab8a4" containerID="e6c4d564d85670b16e2bb5a4ed8051ddbd47d4eef6a4bef4fa69d165cbc70479" exitCode=0 May 27 21:14:14.836437 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.836429 2566 generic.go:358] "Generic (PLEG): container finished" podID="4804cd26-eae8-4796-aaef-d209c99ab8a4" containerID="fa65ccf9885e4bd6aa3f65899c94c9c8e576ad664678c4232a408b9cb49f3439" exitCode=0 May 27 21:14:14.836610 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.836501 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg" event={"ID":"4804cd26-eae8-4796-aaef-d209c99ab8a4","Type":"ContainerDied","Data":"e6c4d564d85670b16e2bb5a4ed8051ddbd47d4eef6a4bef4fa69d165cbc70479"} May 27 21:14:14.836610 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.836532 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg" event={"ID":"4804cd26-eae8-4796-aaef-d209c99ab8a4","Type":"ContainerDied","Data":"fa65ccf9885e4bd6aa3f65899c94c9c8e576ad664678c4232a408b9cb49f3439"} May 27 21:14:14.838596 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.838514 2566 generic.go:358] "Generic (PLEG): container finished" podID="d8556844-bb43-47fa-8d8b-888eab1d9385" containerID="e28d72e3d8e654f22a143db46b03ccd0601ade5ab5686461936ce35970d58a17" exitCode=0 May 27 21:14:14.838672 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.838638 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kh4xq" event={"ID":"d8556844-bb43-47fa-8d8b-888eab1d9385","Type":"ContainerDied","Data":"e28d72e3d8e654f22a143db46b03ccd0601ade5ab5686461936ce35970d58a17"} May 27 21:14:14.838672 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.838666 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kh4xq" event={"ID":"d8556844-bb43-47fa-8d8b-888eab1d9385","Type":"ContainerStarted","Data":"6a1a5f0849ad9911ceecd8b9d642f2e5bcb5ef3221b809a4b12ff921fffb1257"} May 27 21:14:14.841569 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.841439 2566 generic.go:358] "Generic (PLEG): container finished" podID="6c8a84f8-d0d8-4628-8b37-eb7aaaba9202" containerID="d29e5df93f0077db804acf727d931f373f0961af79563791969a19e0b1705368" exitCode=0 May 27 21:14:14.841693 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.841566 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zgzvm" event={"ID":"6c8a84f8-d0d8-4628-8b37-eb7aaaba9202","Type":"ContainerDied","Data":"d29e5df93f0077db804acf727d931f373f0961af79563791969a19e0b1705368"} May 27 21:14:14.841693 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.841591 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zgzvm" event={"ID":"6c8a84f8-d0d8-4628-8b37-eb7aaaba9202","Type":"ContainerStarted","Data":"2d07e0ac15b2ea398bd651de30bad7c2fbce25ae79cbaece426f6131138ba26b"} May 27 21:14:14.929631 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:14.929604 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xb7x"] May 27 21:14:14.931486 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:14:14.931438 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff2a3748_c094_4a00_ad3a_0edd2e52afce.slice/crio-363f6fe57f91ce3b48afd883f28552af3f17d1f4cff4cbb7a27e29e4c21687c6 WatchSource:0}: Error finding container 363f6fe57f91ce3b48afd883f28552af3f17d1f4cff4cbb7a27e29e4c21687c6: Status 404 returned error can't find the container with id 363f6fe57f91ce3b48afd883f28552af3f17d1f4cff4cbb7a27e29e4c21687c6 May 27 21:14:15.847736 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:15.847701 2566 generic.go:358] "Generic (PLEG): container finished" podID="4804cd26-eae8-4796-aaef-d209c99ab8a4" containerID="7aac73af06cdc7bd38e3c4543ff066e32dc551ac8f935fb5a4ba7c1c5a2b0e94" exitCode=0 May 27 21:14:15.848192 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:15.847772 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg" event={"ID":"4804cd26-eae8-4796-aaef-d209c99ab8a4","Type":"ContainerDied","Data":"7aac73af06cdc7bd38e3c4543ff066e32dc551ac8f935fb5a4ba7c1c5a2b0e94"} May 27 21:14:15.849460 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:15.849432 2566 generic.go:358] "Generic (PLEG): container finished" podID="d8556844-bb43-47fa-8d8b-888eab1d9385" containerID="9b2c7bf437bd25f60113967fa17f6b2b1c2e93e74a6de5c1a0106fcdd34a7f18" exitCode=0 May 27 21:14:15.849566 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:15.849511 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kh4xq" event={"ID":"d8556844-bb43-47fa-8d8b-888eab1d9385","Type":"ContainerDied","Data":"9b2c7bf437bd25f60113967fa17f6b2b1c2e93e74a6de5c1a0106fcdd34a7f18"} May 27 21:14:15.850856 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:15.850832 2566 generic.go:358] "Generic (PLEG): container finished" podID="ff2a3748-c094-4a00-ad3a-0edd2e52afce" containerID="a9da50390fddcba811e7dd6c56662cc071de1f9485d375817d5f162c2350c576" exitCode=0 May 27 21:14:15.850975 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:15.850926 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xb7x" event={"ID":"ff2a3748-c094-4a00-ad3a-0edd2e52afce","Type":"ContainerDied","Data":"a9da50390fddcba811e7dd6c56662cc071de1f9485d375817d5f162c2350c576"} May 27 21:14:15.850975 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:15.850954 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xb7x" event={"ID":"ff2a3748-c094-4a00-ad3a-0edd2e52afce","Type":"ContainerStarted","Data":"363f6fe57f91ce3b48afd883f28552af3f17d1f4cff4cbb7a27e29e4c21687c6"} May 27 21:14:15.852809 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:15.852777 2566 generic.go:358] "Generic (PLEG): container finished" podID="6c8a84f8-d0d8-4628-8b37-eb7aaaba9202" containerID="20bf284aad83ac62af119d40c4d85a6fedffe7b131e341aea5fd932c508b687d" exitCode=0 May 27 21:14:15.852890 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:15.852836 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zgzvm" event={"ID":"6c8a84f8-d0d8-4628-8b37-eb7aaaba9202","Type":"ContainerDied","Data":"20bf284aad83ac62af119d40c4d85a6fedffe7b131e341aea5fd932c508b687d"} May 27 21:14:16.859235 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:16.859198 2566 generic.go:358] "Generic (PLEG): container finished" podID="d8556844-bb43-47fa-8d8b-888eab1d9385" containerID="bfe727077ea37616d5731bebd39ddac85d987ac99d906da3af3f01188d53f6cd" exitCode=0 May 27 21:14:16.859650 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:16.859282 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kh4xq" event={"ID":"d8556844-bb43-47fa-8d8b-888eab1d9385","Type":"ContainerDied","Data":"bfe727077ea37616d5731bebd39ddac85d987ac99d906da3af3f01188d53f6cd"} May 27 21:14:16.860974 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:16.860951 2566 generic.go:358] "Generic (PLEG): container finished" podID="ff2a3748-c094-4a00-ad3a-0edd2e52afce" containerID="8a02501a311a9be45fb539297097d8592adb902ed8f3ae8f357f0feace310e67" exitCode=0 May 27 21:14:16.861094 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:16.861048 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xb7x" event={"ID":"ff2a3748-c094-4a00-ad3a-0edd2e52afce","Type":"ContainerDied","Data":"8a02501a311a9be45fb539297097d8592adb902ed8f3ae8f357f0feace310e67"} May 27 21:14:16.863074 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:16.863007 2566 generic.go:358] "Generic (PLEG): container finished" podID="6c8a84f8-d0d8-4628-8b37-eb7aaaba9202" containerID="11ad1c50a78a1fc17609f7024cd250bd013d581716cc719f98770665be309cdb" exitCode=0 May 27 21:14:16.863074 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:16.863056 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zgzvm" event={"ID":"6c8a84f8-d0d8-4628-8b37-eb7aaaba9202","Type":"ContainerDied","Data":"11ad1c50a78a1fc17609f7024cd250bd013d581716cc719f98770665be309cdb"} May 27 21:14:16.998286 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:16.998261 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg" May 27 21:14:17.088735 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:17.088702 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qv769\" (UniqueName: \"kubernetes.io/projected/4804cd26-eae8-4796-aaef-d209c99ab8a4-kube-api-access-qv769\") pod \"4804cd26-eae8-4796-aaef-d209c99ab8a4\" (UID: \"4804cd26-eae8-4796-aaef-d209c99ab8a4\") " May 27 21:14:17.088893 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:17.088801 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4804cd26-eae8-4796-aaef-d209c99ab8a4-util\") pod \"4804cd26-eae8-4796-aaef-d209c99ab8a4\" (UID: \"4804cd26-eae8-4796-aaef-d209c99ab8a4\") " May 27 21:14:17.088893 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:17.088825 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4804cd26-eae8-4796-aaef-d209c99ab8a4-bundle\") pod \"4804cd26-eae8-4796-aaef-d209c99ab8a4\" (UID: \"4804cd26-eae8-4796-aaef-d209c99ab8a4\") " May 27 21:14:17.089381 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:17.089347 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4804cd26-eae8-4796-aaef-d209c99ab8a4-bundle" (OuterVolumeSpecName: "bundle") pod "4804cd26-eae8-4796-aaef-d209c99ab8a4" (UID: "4804cd26-eae8-4796-aaef-d209c99ab8a4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:14:17.090978 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:17.090958 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4804cd26-eae8-4796-aaef-d209c99ab8a4-kube-api-access-qv769" (OuterVolumeSpecName: "kube-api-access-qv769") pod "4804cd26-eae8-4796-aaef-d209c99ab8a4" (UID: "4804cd26-eae8-4796-aaef-d209c99ab8a4"). InnerVolumeSpecName "kube-api-access-qv769". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:14:17.094774 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:17.094753 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4804cd26-eae8-4796-aaef-d209c99ab8a4-util" (OuterVolumeSpecName: "util") pod "4804cd26-eae8-4796-aaef-d209c99ab8a4" (UID: "4804cd26-eae8-4796-aaef-d209c99ab8a4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:14:17.190386 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:17.190271 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4804cd26-eae8-4796-aaef-d209c99ab8a4-util\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:14:17.190386 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:17.190324 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4804cd26-eae8-4796-aaef-d209c99ab8a4-bundle\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:14:17.190386 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:17.190336 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qv769\" (UniqueName: \"kubernetes.io/projected/4804cd26-eae8-4796-aaef-d209c99ab8a4-kube-api-access-qv769\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:14:17.868503 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:17.868463 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg" event={"ID":"4804cd26-eae8-4796-aaef-d209c99ab8a4","Type":"ContainerDied","Data":"040ae40ca23f89010eb10d2ec516ce2a1f56f16114a03dad66f3a676ce3bca72"} May 27 21:14:17.868503 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:17.868507 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="040ae40ca23f89010eb10d2ec516ce2a1f56f16114a03dad66f3a676ce3bca72" May 27 21:14:17.868962 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:17.868525 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg" May 27 21:14:17.870436 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:17.870403 2566 generic.go:358] "Generic (PLEG): container finished" podID="ff2a3748-c094-4a00-ad3a-0edd2e52afce" containerID="8535612ae2b7959efaa8d241c1d07daa9767692d153848b2458e83cd097a171c" exitCode=0 May 27 21:14:17.870591 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:17.870438 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xb7x" event={"ID":"ff2a3748-c094-4a00-ad3a-0edd2e52afce","Type":"ContainerDied","Data":"8535612ae2b7959efaa8d241c1d07daa9767692d153848b2458e83cd097a171c"} May 27 21:14:18.029854 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:18.029830 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kh4xq" May 27 21:14:18.033271 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:18.033251 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zgzvm" May 27 21:14:18.200890 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:18.200804 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8556844-bb43-47fa-8d8b-888eab1d9385-bundle\") pod \"d8556844-bb43-47fa-8d8b-888eab1d9385\" (UID: \"d8556844-bb43-47fa-8d8b-888eab1d9385\") " May 27 21:14:18.200890 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:18.200850 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c8a84f8-d0d8-4628-8b37-eb7aaaba9202-bundle\") pod \"6c8a84f8-d0d8-4628-8b37-eb7aaaba9202\" (UID: \"6c8a84f8-d0d8-4628-8b37-eb7aaaba9202\") " May 27 21:14:18.201154 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:18.200906 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c8a84f8-d0d8-4628-8b37-eb7aaaba9202-util\") pod \"6c8a84f8-d0d8-4628-8b37-eb7aaaba9202\" (UID: \"6c8a84f8-d0d8-4628-8b37-eb7aaaba9202\") " May 27 21:14:18.201154 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:18.200958 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7t8mw\" (UniqueName: \"kubernetes.io/projected/6c8a84f8-d0d8-4628-8b37-eb7aaaba9202-kube-api-access-7t8mw\") pod \"6c8a84f8-d0d8-4628-8b37-eb7aaaba9202\" (UID: \"6c8a84f8-d0d8-4628-8b37-eb7aaaba9202\") " May 27 21:14:18.201154 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:18.200995 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8556844-bb43-47fa-8d8b-888eab1d9385-util\") pod \"d8556844-bb43-47fa-8d8b-888eab1d9385\" (UID: \"d8556844-bb43-47fa-8d8b-888eab1d9385\") " May 27 21:14:18.201154 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:18.201010 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mf2hv\" (UniqueName: \"kubernetes.io/projected/d8556844-bb43-47fa-8d8b-888eab1d9385-kube-api-access-mf2hv\") pod \"d8556844-bb43-47fa-8d8b-888eab1d9385\" (UID: \"d8556844-bb43-47fa-8d8b-888eab1d9385\") " May 27 21:14:18.201552 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:18.201521 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8556844-bb43-47fa-8d8b-888eab1d9385-bundle" (OuterVolumeSpecName: "bundle") pod "d8556844-bb43-47fa-8d8b-888eab1d9385" (UID: "d8556844-bb43-47fa-8d8b-888eab1d9385"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:14:18.201702 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:18.201621 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c8a84f8-d0d8-4628-8b37-eb7aaaba9202-bundle" (OuterVolumeSpecName: "bundle") pod "6c8a84f8-d0d8-4628-8b37-eb7aaaba9202" (UID: "6c8a84f8-d0d8-4628-8b37-eb7aaaba9202"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:14:18.203292 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:18.203260 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c8a84f8-d0d8-4628-8b37-eb7aaaba9202-kube-api-access-7t8mw" (OuterVolumeSpecName: "kube-api-access-7t8mw") pod "6c8a84f8-d0d8-4628-8b37-eb7aaaba9202" (UID: "6c8a84f8-d0d8-4628-8b37-eb7aaaba9202"). InnerVolumeSpecName "kube-api-access-7t8mw". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:14:18.203435 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:18.203414 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8556844-bb43-47fa-8d8b-888eab1d9385-kube-api-access-mf2hv" (OuterVolumeSpecName: "kube-api-access-mf2hv") pod "d8556844-bb43-47fa-8d8b-888eab1d9385" (UID: "d8556844-bb43-47fa-8d8b-888eab1d9385"). InnerVolumeSpecName "kube-api-access-mf2hv". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:14:18.206251 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:18.206225 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c8a84f8-d0d8-4628-8b37-eb7aaaba9202-util" (OuterVolumeSpecName: "util") pod "6c8a84f8-d0d8-4628-8b37-eb7aaaba9202" (UID: "6c8a84f8-d0d8-4628-8b37-eb7aaaba9202"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:14:18.207251 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:18.207229 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8556844-bb43-47fa-8d8b-888eab1d9385-util" (OuterVolumeSpecName: "util") pod "d8556844-bb43-47fa-8d8b-888eab1d9385" (UID: "d8556844-bb43-47fa-8d8b-888eab1d9385"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:14:18.302238 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:18.302201 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7t8mw\" (UniqueName: \"kubernetes.io/projected/6c8a84f8-d0d8-4628-8b37-eb7aaaba9202-kube-api-access-7t8mw\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:14:18.302238 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:18.302234 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8556844-bb43-47fa-8d8b-888eab1d9385-util\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:14:18.302409 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:18.302250 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mf2hv\" (UniqueName: \"kubernetes.io/projected/d8556844-bb43-47fa-8d8b-888eab1d9385-kube-api-access-mf2hv\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:14:18.302409 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:18.302259 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8556844-bb43-47fa-8d8b-888eab1d9385-bundle\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:14:18.302409 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:18.302268 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c8a84f8-d0d8-4628-8b37-eb7aaaba9202-bundle\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:14:18.302409 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:18.302276 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c8a84f8-d0d8-4628-8b37-eb7aaaba9202-util\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:14:18.875690 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:18.875642 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kh4xq" event={"ID":"d8556844-bb43-47fa-8d8b-888eab1d9385","Type":"ContainerDied","Data":"6a1a5f0849ad9911ceecd8b9d642f2e5bcb5ef3221b809a4b12ff921fffb1257"} May 27 21:14:18.875690 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:18.875679 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kh4xq" May 27 21:14:18.875690 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:18.875696 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6a1a5f0849ad9911ceecd8b9d642f2e5bcb5ef3221b809a4b12ff921fffb1257" May 27 21:14:18.877485 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:18.877466 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zgzvm" May 27 21:14:18.877595 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:18.877494 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zgzvm" event={"ID":"6c8a84f8-d0d8-4628-8b37-eb7aaaba9202","Type":"ContainerDied","Data":"2d07e0ac15b2ea398bd651de30bad7c2fbce25ae79cbaece426f6131138ba26b"} May 27 21:14:18.877595 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:18.877518 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2d07e0ac15b2ea398bd651de30bad7c2fbce25ae79cbaece426f6131138ba26b" May 27 21:14:19.018057 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:19.018018 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xb7x" May 27 21:14:19.111266 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:19.111233 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vb8l\" (UniqueName: \"kubernetes.io/projected/ff2a3748-c094-4a00-ad3a-0edd2e52afce-kube-api-access-8vb8l\") pod \"ff2a3748-c094-4a00-ad3a-0edd2e52afce\" (UID: \"ff2a3748-c094-4a00-ad3a-0edd2e52afce\") " May 27 21:14:19.111433 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:19.111288 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff2a3748-c094-4a00-ad3a-0edd2e52afce-util\") pod \"ff2a3748-c094-4a00-ad3a-0edd2e52afce\" (UID: \"ff2a3748-c094-4a00-ad3a-0edd2e52afce\") " May 27 21:14:19.111433 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:19.111349 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff2a3748-c094-4a00-ad3a-0edd2e52afce-bundle\") pod \"ff2a3748-c094-4a00-ad3a-0edd2e52afce\" (UID: \"ff2a3748-c094-4a00-ad3a-0edd2e52afce\") " May 27 21:14:19.111887 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:19.111854 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff2a3748-c094-4a00-ad3a-0edd2e52afce-bundle" (OuterVolumeSpecName: "bundle") pod "ff2a3748-c094-4a00-ad3a-0edd2e52afce" (UID: "ff2a3748-c094-4a00-ad3a-0edd2e52afce"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:14:19.113397 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:19.113371 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff2a3748-c094-4a00-ad3a-0edd2e52afce-kube-api-access-8vb8l" (OuterVolumeSpecName: "kube-api-access-8vb8l") pod "ff2a3748-c094-4a00-ad3a-0edd2e52afce" (UID: "ff2a3748-c094-4a00-ad3a-0edd2e52afce"). InnerVolumeSpecName "kube-api-access-8vb8l". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:14:19.116645 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:19.116613 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff2a3748-c094-4a00-ad3a-0edd2e52afce-util" (OuterVolumeSpecName: "util") pod "ff2a3748-c094-4a00-ad3a-0edd2e52afce" (UID: "ff2a3748-c094-4a00-ad3a-0edd2e52afce"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:14:19.212631 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:19.212537 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vb8l\" (UniqueName: \"kubernetes.io/projected/ff2a3748-c094-4a00-ad3a-0edd2e52afce-kube-api-access-8vb8l\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:14:19.212631 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:19.212570 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff2a3748-c094-4a00-ad3a-0edd2e52afce-util\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:14:19.212631 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:19.212583 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff2a3748-c094-4a00-ad3a-0edd2e52afce-bundle\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:14:19.883407 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:19.883373 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xb7x" event={"ID":"ff2a3748-c094-4a00-ad3a-0edd2e52afce","Type":"ContainerDied","Data":"363f6fe57f91ce3b48afd883f28552af3f17d1f4cff4cbb7a27e29e4c21687c6"} May 27 21:14:19.883407 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:19.883406 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="363f6fe57f91ce3b48afd883f28552af3f17d1f4cff4cbb7a27e29e4c21687c6" May 27 21:14:19.883407 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:19.883392 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xb7x" May 27 21:14:37.409073 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:37.409038 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6ff7c89b65-5zdxs"] May 27 21:14:43.683051 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.682998 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-9ljzr"] May 27 21:14:43.683438 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.683411 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c8a84f8-d0d8-4628-8b37-eb7aaaba9202" containerName="util" May 27 21:14:43.683438 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.683422 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c8a84f8-d0d8-4628-8b37-eb7aaaba9202" containerName="util" May 27 21:14:43.683438 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.683436 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff2a3748-c094-4a00-ad3a-0edd2e52afce" containerName="util" May 27 21:14:43.683438 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.683441 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff2a3748-c094-4a00-ad3a-0edd2e52afce" containerName="util" May 27 21:14:43.683586 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.683450 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8556844-bb43-47fa-8d8b-888eab1d9385" containerName="pull" May 27 21:14:43.683586 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.683456 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8556844-bb43-47fa-8d8b-888eab1d9385" containerName="pull" May 27 21:14:43.683586 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.683463 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c8a84f8-d0d8-4628-8b37-eb7aaaba9202" containerName="extract" May 27 21:14:43.683586 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.683468 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c8a84f8-d0d8-4628-8b37-eb7aaaba9202" containerName="extract" May 27 21:14:43.683586 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.683476 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c8a84f8-d0d8-4628-8b37-eb7aaaba9202" containerName="pull" May 27 21:14:43.683586 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.683480 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c8a84f8-d0d8-4628-8b37-eb7aaaba9202" containerName="pull" May 27 21:14:43.683586 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.683486 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4804cd26-eae8-4796-aaef-d209c99ab8a4" containerName="pull" May 27 21:14:43.683586 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.683491 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4804cd26-eae8-4796-aaef-d209c99ab8a4" containerName="pull" May 27 21:14:43.683586 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.683497 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff2a3748-c094-4a00-ad3a-0edd2e52afce" containerName="extract" May 27 21:14:43.683586 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.683501 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff2a3748-c094-4a00-ad3a-0edd2e52afce" containerName="extract" May 27 21:14:43.683586 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.683511 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4804cd26-eae8-4796-aaef-d209c99ab8a4" containerName="util" May 27 21:14:43.683586 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.683515 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4804cd26-eae8-4796-aaef-d209c99ab8a4" containerName="util" May 27 21:14:43.683586 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.683522 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8556844-bb43-47fa-8d8b-888eab1d9385" containerName="extract" May 27 21:14:43.683586 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.683527 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8556844-bb43-47fa-8d8b-888eab1d9385" containerName="extract" May 27 21:14:43.683586 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.683534 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8556844-bb43-47fa-8d8b-888eab1d9385" containerName="util" May 27 21:14:43.683586 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.683538 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8556844-bb43-47fa-8d8b-888eab1d9385" containerName="util" May 27 21:14:43.683586 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.683545 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff2a3748-c094-4a00-ad3a-0edd2e52afce" containerName="pull" May 27 21:14:43.683586 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.683550 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff2a3748-c094-4a00-ad3a-0edd2e52afce" containerName="pull" May 27 21:14:43.683586 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.683558 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4804cd26-eae8-4796-aaef-d209c99ab8a4" containerName="extract" May 27 21:14:43.683586 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.683563 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4804cd26-eae8-4796-aaef-d209c99ab8a4" containerName="extract" May 27 21:14:43.684245 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.683613 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="6c8a84f8-d0d8-4628-8b37-eb7aaaba9202" containerName="extract" May 27 21:14:43.684245 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.683623 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="ff2a3748-c094-4a00-ad3a-0edd2e52afce" containerName="extract" May 27 21:14:43.684245 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.683629 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="4804cd26-eae8-4796-aaef-d209c99ab8a4" containerName="extract" May 27 21:14:43.684245 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.683635 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="d8556844-bb43-47fa-8d8b-888eab1d9385" containerName="extract" May 27 21:14:43.686782 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.686763 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-9ljzr" May 27 21:14:43.689137 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.689113 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" May 27 21:14:43.689244 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.689201 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-64wjq\"" May 27 21:14:43.689308 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.689271 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 27 21:14:43.690003 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.689984 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 27 21:14:43.691067 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.691016 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" May 27 21:14:43.697929 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.697908 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-9ljzr"] May 27 21:14:43.725727 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.725701 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2xlj\" (UniqueName: \"kubernetes.io/projected/4de1015f-4253-46dc-8597-a9d69ecd6c94-kube-api-access-r2xlj\") pod \"kuadrant-console-plugin-6cb54b5c86-9ljzr\" (UID: \"4de1015f-4253-46dc-8597-a9d69ecd6c94\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-9ljzr" May 27 21:14:43.725827 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.725744 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4de1015f-4253-46dc-8597-a9d69ecd6c94-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-9ljzr\" (UID: \"4de1015f-4253-46dc-8597-a9d69ecd6c94\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-9ljzr" May 27 21:14:43.725879 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.725860 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4de1015f-4253-46dc-8597-a9d69ecd6c94-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-9ljzr\" (UID: \"4de1015f-4253-46dc-8597-a9d69ecd6c94\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-9ljzr" May 27 21:14:43.826774 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.826740 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4de1015f-4253-46dc-8597-a9d69ecd6c94-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-9ljzr\" (UID: \"4de1015f-4253-46dc-8597-a9d69ecd6c94\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-9ljzr" May 27 21:14:43.826937 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.826802 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4de1015f-4253-46dc-8597-a9d69ecd6c94-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-9ljzr\" (UID: \"4de1015f-4253-46dc-8597-a9d69ecd6c94\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-9ljzr" May 27 21:14:43.826937 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.826855 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r2xlj\" (UniqueName: \"kubernetes.io/projected/4de1015f-4253-46dc-8597-a9d69ecd6c94-kube-api-access-r2xlj\") pod \"kuadrant-console-plugin-6cb54b5c86-9ljzr\" (UID: \"4de1015f-4253-46dc-8597-a9d69ecd6c94\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-9ljzr" May 27 21:14:43.827016 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:14:43.826953 2566 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found May 27 21:14:43.827079 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:14:43.827054 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4de1015f-4253-46dc-8597-a9d69ecd6c94-plugin-serving-cert podName:4de1015f-4253-46dc-8597-a9d69ecd6c94 nodeName:}" failed. No retries permitted until 2026-05-27 21:14:44.327009585 +0000 UTC m=+508.946395360 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/4de1015f-4253-46dc-8597-a9d69ecd6c94-plugin-serving-cert") pod "kuadrant-console-plugin-6cb54b5c86-9ljzr" (UID: "4de1015f-4253-46dc-8597-a9d69ecd6c94") : secret "plugin-serving-cert" not found May 27 21:14:43.827486 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.827468 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4de1015f-4253-46dc-8597-a9d69ecd6c94-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-9ljzr\" (UID: \"4de1015f-4253-46dc-8597-a9d69ecd6c94\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-9ljzr" May 27 21:14:43.835827 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:43.835804 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2xlj\" (UniqueName: \"kubernetes.io/projected/4de1015f-4253-46dc-8597-a9d69ecd6c94-kube-api-access-r2xlj\") pod \"kuadrant-console-plugin-6cb54b5c86-9ljzr\" (UID: \"4de1015f-4253-46dc-8597-a9d69ecd6c94\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-9ljzr" May 27 21:14:44.331073 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:44.331012 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4de1015f-4253-46dc-8597-a9d69ecd6c94-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-9ljzr\" (UID: \"4de1015f-4253-46dc-8597-a9d69ecd6c94\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-9ljzr" May 27 21:14:44.333492 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:44.333466 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4de1015f-4253-46dc-8597-a9d69ecd6c94-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-9ljzr\" (UID: \"4de1015f-4253-46dc-8597-a9d69ecd6c94\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-9ljzr" May 27 21:14:44.597058 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:44.596970 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-9ljzr" May 27 21:14:44.733055 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:44.733013 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-9ljzr"] May 27 21:14:44.735234 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:14:44.735208 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4de1015f_4253_46dc_8597_a9d69ecd6c94.slice/crio-5bd6fe0ce333377e88205f5e3e70049b4ae51c6cb5d280f4710184a958783e65 WatchSource:0}: Error finding container 5bd6fe0ce333377e88205f5e3e70049b4ae51c6cb5d280f4710184a958783e65: Status 404 returned error can't find the container with id 5bd6fe0ce333377e88205f5e3e70049b4ae51c6cb5d280f4710184a958783e65 May 27 21:14:44.982962 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:14:44.982872 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-9ljzr" event={"ID":"4de1015f-4253-46dc-8597-a9d69ecd6c94","Type":"ContainerStarted","Data":"5bd6fe0ce333377e88205f5e3e70049b4ae51c6cb5d280f4710184a958783e65"} May 27 21:15:02.431457 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:02.431348 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6ff7c89b65-5zdxs" podUID="52a29fef-828a-41f6-abaa-9a89635489ed" containerName="console" containerID="cri-o://10bd70493e7329e95780a5279349c10b5f0abbc7b769488064895d98f8558b89" gracePeriod=15 May 27 21:15:09.100992 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:09.100966 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6ff7c89b65-5zdxs_52a29fef-828a-41f6-abaa-9a89635489ed/console/0.log" May 27 21:15:09.101353 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:09.101010 2566 generic.go:358] "Generic (PLEG): container finished" podID="52a29fef-828a-41f6-abaa-9a89635489ed" containerID="10bd70493e7329e95780a5279349c10b5f0abbc7b769488064895d98f8558b89" exitCode=2 May 27 21:15:09.101353 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:09.101061 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ff7c89b65-5zdxs" event={"ID":"52a29fef-828a-41f6-abaa-9a89635489ed","Type":"ContainerDied","Data":"10bd70493e7329e95780a5279349c10b5f0abbc7b769488064895d98f8558b89"} May 27 21:15:09.158397 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:09.158379 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6ff7c89b65-5zdxs_52a29fef-828a-41f6-abaa-9a89635489ed/console/0.log" May 27 21:15:09.158512 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:09.158441 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ff7c89b65-5zdxs" May 27 21:15:09.164214 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:09.164190 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/52a29fef-828a-41f6-abaa-9a89635489ed-oauth-serving-cert\") pod \"52a29fef-828a-41f6-abaa-9a89635489ed\" (UID: \"52a29fef-828a-41f6-abaa-9a89635489ed\") " May 27 21:15:09.164325 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:09.164233 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/52a29fef-828a-41f6-abaa-9a89635489ed-service-ca\") pod \"52a29fef-828a-41f6-abaa-9a89635489ed\" (UID: \"52a29fef-828a-41f6-abaa-9a89635489ed\") " May 27 21:15:09.164325 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:09.164258 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/52a29fef-828a-41f6-abaa-9a89635489ed-console-oauth-config\") pod \"52a29fef-828a-41f6-abaa-9a89635489ed\" (UID: \"52a29fef-828a-41f6-abaa-9a89635489ed\") " May 27 21:15:09.164325 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:09.164283 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5pzx\" (UniqueName: \"kubernetes.io/projected/52a29fef-828a-41f6-abaa-9a89635489ed-kube-api-access-j5pzx\") pod \"52a29fef-828a-41f6-abaa-9a89635489ed\" (UID: \"52a29fef-828a-41f6-abaa-9a89635489ed\") " May 27 21:15:09.164325 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:09.164313 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/52a29fef-828a-41f6-abaa-9a89635489ed-console-serving-cert\") pod \"52a29fef-828a-41f6-abaa-9a89635489ed\" (UID: \"52a29fef-828a-41f6-abaa-9a89635489ed\") " May 27 21:15:09.164533 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:09.164349 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/52a29fef-828a-41f6-abaa-9a89635489ed-console-config\") pod \"52a29fef-828a-41f6-abaa-9a89635489ed\" (UID: \"52a29fef-828a-41f6-abaa-9a89635489ed\") " May 27 21:15:09.164533 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:09.164400 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52a29fef-828a-41f6-abaa-9a89635489ed-trusted-ca-bundle\") pod \"52a29fef-828a-41f6-abaa-9a89635489ed\" (UID: \"52a29fef-828a-41f6-abaa-9a89635489ed\") " May 27 21:15:09.164679 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:09.164628 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52a29fef-828a-41f6-abaa-9a89635489ed-service-ca" (OuterVolumeSpecName: "service-ca") pod "52a29fef-828a-41f6-abaa-9a89635489ed" (UID: "52a29fef-828a-41f6-abaa-9a89635489ed"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:15:09.164804 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:09.164607 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52a29fef-828a-41f6-abaa-9a89635489ed-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "52a29fef-828a-41f6-abaa-9a89635489ed" (UID: "52a29fef-828a-41f6-abaa-9a89635489ed"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:15:09.164804 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:09.164704 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/52a29fef-828a-41f6-abaa-9a89635489ed-service-ca\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:15:09.164916 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:09.164896 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52a29fef-828a-41f6-abaa-9a89635489ed-console-config" (OuterVolumeSpecName: "console-config") pod "52a29fef-828a-41f6-abaa-9a89635489ed" (UID: "52a29fef-828a-41f6-abaa-9a89635489ed"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:15:09.165042 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:09.165008 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52a29fef-828a-41f6-abaa-9a89635489ed-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "52a29fef-828a-41f6-abaa-9a89635489ed" (UID: "52a29fef-828a-41f6-abaa-9a89635489ed"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:15:09.166453 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:09.166431 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52a29fef-828a-41f6-abaa-9a89635489ed-kube-api-access-j5pzx" (OuterVolumeSpecName: "kube-api-access-j5pzx") pod "52a29fef-828a-41f6-abaa-9a89635489ed" (UID: "52a29fef-828a-41f6-abaa-9a89635489ed"). InnerVolumeSpecName "kube-api-access-j5pzx". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:15:09.166829 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:09.166804 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52a29fef-828a-41f6-abaa-9a89635489ed-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "52a29fef-828a-41f6-abaa-9a89635489ed" (UID: "52a29fef-828a-41f6-abaa-9a89635489ed"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:15:09.166882 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:09.166853 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52a29fef-828a-41f6-abaa-9a89635489ed-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "52a29fef-828a-41f6-abaa-9a89635489ed" (UID: "52a29fef-828a-41f6-abaa-9a89635489ed"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:15:09.265066 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:09.265010 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/52a29fef-828a-41f6-abaa-9a89635489ed-oauth-serving-cert\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:15:09.265066 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:09.265062 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/52a29fef-828a-41f6-abaa-9a89635489ed-console-oauth-config\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:15:09.265066 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:09.265072 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5pzx\" (UniqueName: \"kubernetes.io/projected/52a29fef-828a-41f6-abaa-9a89635489ed-kube-api-access-j5pzx\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:15:09.265284 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:09.265082 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/52a29fef-828a-41f6-abaa-9a89635489ed-console-serving-cert\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:15:09.265284 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:09.265092 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/52a29fef-828a-41f6-abaa-9a89635489ed-console-config\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:15:09.265284 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:09.265101 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52a29fef-828a-41f6-abaa-9a89635489ed-trusted-ca-bundle\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:15:10.105663 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:10.105628 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-9ljzr" event={"ID":"4de1015f-4253-46dc-8597-a9d69ecd6c94","Type":"ContainerStarted","Data":"0344c038247eaab85ca066d6a7a3e75a09f96a1a6255a37aa96f521c5ae1d047"} May 27 21:15:10.106872 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:10.106851 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6ff7c89b65-5zdxs_52a29fef-828a-41f6-abaa-9a89635489ed/console/0.log" May 27 21:15:10.107006 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:10.106920 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ff7c89b65-5zdxs" event={"ID":"52a29fef-828a-41f6-abaa-9a89635489ed","Type":"ContainerDied","Data":"2f0e890bc6cd02ea1a75728c3089ca36e1f6d2a3f902d358e638bdb1f190dd19"} May 27 21:15:10.107006 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:10.106952 2566 scope.go:117] "RemoveContainer" containerID="10bd70493e7329e95780a5279349c10b5f0abbc7b769488064895d98f8558b89" May 27 21:15:10.107006 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:10.106963 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ff7c89b65-5zdxs" May 27 21:15:10.136712 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:10.136672 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-9ljzr" podStartSLOduration=2.501281807 podStartE2EDuration="27.136660788s" podCreationTimestamp="2026-05-27 21:14:43 +0000 UTC" firstStartedPulling="2026-05-27 21:14:44.736460865 +0000 UTC m=+509.355846627" lastFinishedPulling="2026-05-27 21:15:09.371839842 +0000 UTC m=+533.991225608" observedRunningTime="2026-05-27 21:15:10.134779632 +0000 UTC m=+534.754165416" watchObservedRunningTime="2026-05-27 21:15:10.136660788 +0000 UTC m=+534.756046574" May 27 21:15:10.165136 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:10.165105 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6ff7c89b65-5zdxs"] May 27 21:15:10.172346 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:10.172326 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6ff7c89b65-5zdxs"] May 27 21:15:12.030559 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:12.030527 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52a29fef-828a-41f6-abaa-9a89635489ed" path="/var/lib/kubelet/pods/52a29fef-828a-41f6-abaa-9a89635489ed/volumes" May 27 21:15:30.602017 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:30.601981 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:15:30.602453 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:30.602379 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52a29fef-828a-41f6-abaa-9a89635489ed" containerName="console" May 27 21:15:30.602453 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:30.602392 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="52a29fef-828a-41f6-abaa-9a89635489ed" containerName="console" May 27 21:15:30.602453 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:30.602453 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="52a29fef-828a-41f6-abaa-9a89635489ed" containerName="console" May 27 21:15:30.605517 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:30.605500 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-nvdlb" May 27 21:15:30.608110 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:30.608090 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 27 21:15:30.619845 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:30.619819 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:15:30.643978 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:30.643948 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:15:30.732018 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:30.731981 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d16d2759-81db-4523-b16a-1abd77dec182-config-file\") pod \"limitador-limitador-78c99df468-nvdlb\" (UID: \"d16d2759-81db-4523-b16a-1abd77dec182\") " pod="kuadrant-system/limitador-limitador-78c99df468-nvdlb" May 27 21:15:30.732198 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:30.732045 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsw8g\" (UniqueName: \"kubernetes.io/projected/d16d2759-81db-4523-b16a-1abd77dec182-kube-api-access-xsw8g\") pod \"limitador-limitador-78c99df468-nvdlb\" (UID: \"d16d2759-81db-4523-b16a-1abd77dec182\") " pod="kuadrant-system/limitador-limitador-78c99df468-nvdlb" May 27 21:15:30.832944 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:30.832898 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d16d2759-81db-4523-b16a-1abd77dec182-config-file\") pod \"limitador-limitador-78c99df468-nvdlb\" (UID: \"d16d2759-81db-4523-b16a-1abd77dec182\") " pod="kuadrant-system/limitador-limitador-78c99df468-nvdlb" May 27 21:15:30.832944 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:30.832955 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xsw8g\" (UniqueName: \"kubernetes.io/projected/d16d2759-81db-4523-b16a-1abd77dec182-kube-api-access-xsw8g\") pod \"limitador-limitador-78c99df468-nvdlb\" (UID: \"d16d2759-81db-4523-b16a-1abd77dec182\") " pod="kuadrant-system/limitador-limitador-78c99df468-nvdlb" May 27 21:15:30.833526 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:30.833506 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d16d2759-81db-4523-b16a-1abd77dec182-config-file\") pod \"limitador-limitador-78c99df468-nvdlb\" (UID: \"d16d2759-81db-4523-b16a-1abd77dec182\") " pod="kuadrant-system/limitador-limitador-78c99df468-nvdlb" May 27 21:15:30.842304 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:30.842284 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsw8g\" (UniqueName: \"kubernetes.io/projected/d16d2759-81db-4523-b16a-1abd77dec182-kube-api-access-xsw8g\") pod \"limitador-limitador-78c99df468-nvdlb\" (UID: \"d16d2759-81db-4523-b16a-1abd77dec182\") " pod="kuadrant-system/limitador-limitador-78c99df468-nvdlb" May 27 21:15:30.916108 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:30.916023 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-nvdlb" May 27 21:15:31.054172 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:31.054142 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:15:31.054300 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:15:31.054199 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd16d2759_81db_4523_b16a_1abd77dec182.slice/crio-3352574711c9e7c5fbe85a473401f9fa18b71ccd2e3b33b12261572d7b25e98f WatchSource:0}: Error finding container 3352574711c9e7c5fbe85a473401f9fa18b71ccd2e3b33b12261572d7b25e98f: Status 404 returned error can't find the container with id 3352574711c9e7c5fbe85a473401f9fa18b71ccd2e3b33b12261572d7b25e98f May 27 21:15:31.057598 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:31.057580 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-88h4w"] May 27 21:15:31.062496 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:31.062479 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-88h4w" May 27 21:15:31.064991 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:31.064972 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ncq76\"" May 27 21:15:31.067450 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:31.067428 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-88h4w"] May 27 21:15:31.135418 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:31.135386 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br9wd\" (UniqueName: \"kubernetes.io/projected/96b1209e-7f57-408d-bb1a-3fada3c503f5-kube-api-access-br9wd\") pod \"authorino-f99f4b5cd-88h4w\" (UID: \"96b1209e-7f57-408d-bb1a-3fada3c503f5\") " pod="kuadrant-system/authorino-f99f4b5cd-88h4w" May 27 21:15:31.189611 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:31.189526 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-nvdlb" event={"ID":"d16d2759-81db-4523-b16a-1abd77dec182","Type":"ContainerStarted","Data":"3352574711c9e7c5fbe85a473401f9fa18b71ccd2e3b33b12261572d7b25e98f"} May 27 21:15:31.236112 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:31.236077 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-br9wd\" (UniqueName: \"kubernetes.io/projected/96b1209e-7f57-408d-bb1a-3fada3c503f5-kube-api-access-br9wd\") pod \"authorino-f99f4b5cd-88h4w\" (UID: \"96b1209e-7f57-408d-bb1a-3fada3c503f5\") " pod="kuadrant-system/authorino-f99f4b5cd-88h4w" May 27 21:15:31.251525 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:31.251494 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-br9wd\" (UniqueName: \"kubernetes.io/projected/96b1209e-7f57-408d-bb1a-3fada3c503f5-kube-api-access-br9wd\") pod \"authorino-f99f4b5cd-88h4w\" (UID: \"96b1209e-7f57-408d-bb1a-3fada3c503f5\") " pod="kuadrant-system/authorino-f99f4b5cd-88h4w" May 27 21:15:31.373088 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:31.373021 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-88h4w" May 27 21:15:31.526500 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:31.526410 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-88h4w"] May 27 21:15:31.530151 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:15:31.530105 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96b1209e_7f57_408d_bb1a_3fada3c503f5.slice/crio-862fb7c8979db1565e115b38f1f8e5c7982d56f7a3bcb1207f53f278d441e032 WatchSource:0}: Error finding container 862fb7c8979db1565e115b38f1f8e5c7982d56f7a3bcb1207f53f278d441e032: Status 404 returned error can't find the container with id 862fb7c8979db1565e115b38f1f8e5c7982d56f7a3bcb1207f53f278d441e032 May 27 21:15:32.199022 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:32.198978 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-88h4w" event={"ID":"96b1209e-7f57-408d-bb1a-3fada3c503f5","Type":"ContainerStarted","Data":"862fb7c8979db1565e115b38f1f8e5c7982d56f7a3bcb1207f53f278d441e032"} May 27 21:15:35.609263 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:35.609227 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-88h4w"] May 27 21:15:36.218553 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:36.218513 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-88h4w" event={"ID":"96b1209e-7f57-408d-bb1a-3fada3c503f5","Type":"ContainerStarted","Data":"5eddcd46f8222647735e722b6bc4738e02b4bea983e16589261394fe22286a47"} May 27 21:15:36.219910 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:36.219882 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-nvdlb" event={"ID":"d16d2759-81db-4523-b16a-1abd77dec182","Type":"ContainerStarted","Data":"b3db8b2a856f0204796d3ad2d8e37f3d1fe39fc24a993d1dd8a4dc23bf45ce20"} May 27 21:15:36.220060 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:36.220004 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-nvdlb" May 27 21:15:36.246867 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:36.246822 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-88h4w" podStartSLOduration=1.38341179 podStartE2EDuration="5.246809676s" podCreationTimestamp="2026-05-27 21:15:31 +0000 UTC" firstStartedPulling="2026-05-27 21:15:31.531302896 +0000 UTC m=+556.150688673" lastFinishedPulling="2026-05-27 21:15:35.394700792 +0000 UTC m=+560.014086559" observedRunningTime="2026-05-27 21:15:36.244567298 +0000 UTC m=+560.863953097" watchObservedRunningTime="2026-05-27 21:15:36.246809676 +0000 UTC m=+560.866195460" May 27 21:15:36.282528 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:36.282478 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-nvdlb" podStartSLOduration=1.946006284 podStartE2EDuration="6.282464612s" podCreationTimestamp="2026-05-27 21:15:30 +0000 UTC" firstStartedPulling="2026-05-27 21:15:31.056347175 +0000 UTC m=+555.675732952" lastFinishedPulling="2026-05-27 21:15:35.392805517 +0000 UTC m=+560.012191280" observedRunningTime="2026-05-27 21:15:36.281252646 +0000 UTC m=+560.900638442" watchObservedRunningTime="2026-05-27 21:15:36.282464612 +0000 UTC m=+560.901850396" May 27 21:15:37.223507 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:37.223467 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-88h4w" podUID="96b1209e-7f57-408d-bb1a-3fada3c503f5" containerName="authorino" containerID="cri-o://5eddcd46f8222647735e722b6bc4738e02b4bea983e16589261394fe22286a47" gracePeriod=30 May 27 21:15:37.996492 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:37.996465 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-88h4w" May 27 21:15:38.101199 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:38.101161 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-br9wd\" (UniqueName: \"kubernetes.io/projected/96b1209e-7f57-408d-bb1a-3fada3c503f5-kube-api-access-br9wd\") pod \"96b1209e-7f57-408d-bb1a-3fada3c503f5\" (UID: \"96b1209e-7f57-408d-bb1a-3fada3c503f5\") " May 27 21:15:38.103306 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:38.103271 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96b1209e-7f57-408d-bb1a-3fada3c503f5-kube-api-access-br9wd" (OuterVolumeSpecName: "kube-api-access-br9wd") pod "96b1209e-7f57-408d-bb1a-3fada3c503f5" (UID: "96b1209e-7f57-408d-bb1a-3fada3c503f5"). InnerVolumeSpecName "kube-api-access-br9wd". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:15:38.202099 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:38.202006 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-br9wd\" (UniqueName: \"kubernetes.io/projected/96b1209e-7f57-408d-bb1a-3fada3c503f5-kube-api-access-br9wd\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:15:38.228121 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:38.228081 2566 generic.go:358] "Generic (PLEG): container finished" podID="96b1209e-7f57-408d-bb1a-3fada3c503f5" containerID="5eddcd46f8222647735e722b6bc4738e02b4bea983e16589261394fe22286a47" exitCode=0 May 27 21:15:38.228631 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:38.228142 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-88h4w" May 27 21:15:38.228631 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:38.228172 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-88h4w" event={"ID":"96b1209e-7f57-408d-bb1a-3fada3c503f5","Type":"ContainerDied","Data":"5eddcd46f8222647735e722b6bc4738e02b4bea983e16589261394fe22286a47"} May 27 21:15:38.228631 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:38.228208 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-88h4w" event={"ID":"96b1209e-7f57-408d-bb1a-3fada3c503f5","Type":"ContainerDied","Data":"862fb7c8979db1565e115b38f1f8e5c7982d56f7a3bcb1207f53f278d441e032"} May 27 21:15:38.228631 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:38.228224 2566 scope.go:117] "RemoveContainer" containerID="5eddcd46f8222647735e722b6bc4738e02b4bea983e16589261394fe22286a47" May 27 21:15:38.238255 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:38.238238 2566 scope.go:117] "RemoveContainer" containerID="5eddcd46f8222647735e722b6bc4738e02b4bea983e16589261394fe22286a47" May 27 21:15:38.238498 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:15:38.238477 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5eddcd46f8222647735e722b6bc4738e02b4bea983e16589261394fe22286a47\": container with ID starting with 5eddcd46f8222647735e722b6bc4738e02b4bea983e16589261394fe22286a47 not found: ID does not exist" containerID="5eddcd46f8222647735e722b6bc4738e02b4bea983e16589261394fe22286a47" May 27 21:15:38.238573 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:38.238507 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5eddcd46f8222647735e722b6bc4738e02b4bea983e16589261394fe22286a47"} err="failed to get container status \"5eddcd46f8222647735e722b6bc4738e02b4bea983e16589261394fe22286a47\": rpc error: code = NotFound desc = could not find container \"5eddcd46f8222647735e722b6bc4738e02b4bea983e16589261394fe22286a47\": container with ID starting with 5eddcd46f8222647735e722b6bc4738e02b4bea983e16589261394fe22286a47 not found: ID does not exist" May 27 21:15:38.251876 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:38.251849 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-88h4w"] May 27 21:15:38.256231 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:38.256207 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-88h4w"] May 27 21:15:40.030847 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:40.030812 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96b1209e-7f57-408d-bb1a-3fada3c503f5" path="/var/lib/kubelet/pods/96b1209e-7f57-408d-bb1a-3fada3c503f5/volumes" May 27 21:15:47.224698 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:15:47.224670 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-nvdlb" May 27 21:16:03.206608 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:03.206570 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-q229d"] May 27 21:16:03.206981 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:03.206950 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96b1209e-7f57-408d-bb1a-3fada3c503f5" containerName="authorino" May 27 21:16:03.206981 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:03.206963 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="96b1209e-7f57-408d-bb1a-3fada3c503f5" containerName="authorino" May 27 21:16:03.207079 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:03.207040 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="96b1209e-7f57-408d-bb1a-3fada3c503f5" containerName="authorino" May 27 21:16:03.208816 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:03.208799 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-q229d" May 27 21:16:03.211276 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:03.211258 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ncq76\"" May 27 21:16:03.216150 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:03.215937 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpk8r\" (UniqueName: \"kubernetes.io/projected/dc2bddb0-3046-4611-9d49-260cb9387239-kube-api-access-cpk8r\") pod \"authorino-8b475cf9f-q229d\" (UID: \"dc2bddb0-3046-4611-9d49-260cb9387239\") " pod="kuadrant-system/authorino-8b475cf9f-q229d" May 27 21:16:03.216980 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:03.216957 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-q229d"] May 27 21:16:03.316672 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:03.316639 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cpk8r\" (UniqueName: \"kubernetes.io/projected/dc2bddb0-3046-4611-9d49-260cb9387239-kube-api-access-cpk8r\") pod \"authorino-8b475cf9f-q229d\" (UID: \"dc2bddb0-3046-4611-9d49-260cb9387239\") " pod="kuadrant-system/authorino-8b475cf9f-q229d" May 27 21:16:03.325253 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:03.325225 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpk8r\" (UniqueName: \"kubernetes.io/projected/dc2bddb0-3046-4611-9d49-260cb9387239-kube-api-access-cpk8r\") pod \"authorino-8b475cf9f-q229d\" (UID: \"dc2bddb0-3046-4611-9d49-260cb9387239\") " pod="kuadrant-system/authorino-8b475cf9f-q229d" May 27 21:16:03.444557 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:03.444526 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-q229d"] May 27 21:16:03.444830 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:03.444818 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-q229d" May 27 21:16:03.602809 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:03.602776 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-q229d"] May 27 21:16:03.603657 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:16:03.603628 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc2bddb0_3046_4611_9d49_260cb9387239.slice/crio-b6c1d4cfc82f2c3771ca8a706194c98eb2f10d78147f961a1eae888d316e1b2d WatchSource:0}: Error finding container b6c1d4cfc82f2c3771ca8a706194c98eb2f10d78147f961a1eae888d316e1b2d: Status 404 returned error can't find the container with id b6c1d4cfc82f2c3771ca8a706194c98eb2f10d78147f961a1eae888d316e1b2d May 27 21:16:03.774387 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:03.774302 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6fd599cf9-zvblp"] May 27 21:16:03.777210 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:03.777192 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6fd599cf9-zvblp" May 27 21:16:03.779707 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:03.779689 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 27 21:16:03.787605 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:03.787579 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6fd599cf9-zvblp"] May 27 21:16:03.820221 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:03.820188 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0422f5e4-2618-4c22-aada-6dff698e1f55-tls-cert\") pod \"authorino-6fd599cf9-zvblp\" (UID: \"0422f5e4-2618-4c22-aada-6dff698e1f55\") " pod="kuadrant-system/authorino-6fd599cf9-zvblp" May 27 21:16:03.820221 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:03.820224 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88nxv\" (UniqueName: \"kubernetes.io/projected/0422f5e4-2618-4c22-aada-6dff698e1f55-kube-api-access-88nxv\") pod \"authorino-6fd599cf9-zvblp\" (UID: \"0422f5e4-2618-4c22-aada-6dff698e1f55\") " pod="kuadrant-system/authorino-6fd599cf9-zvblp" May 27 21:16:03.921553 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:03.921519 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0422f5e4-2618-4c22-aada-6dff698e1f55-tls-cert\") pod \"authorino-6fd599cf9-zvblp\" (UID: \"0422f5e4-2618-4c22-aada-6dff698e1f55\") " pod="kuadrant-system/authorino-6fd599cf9-zvblp" May 27 21:16:03.921722 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:03.921558 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-88nxv\" (UniqueName: \"kubernetes.io/projected/0422f5e4-2618-4c22-aada-6dff698e1f55-kube-api-access-88nxv\") pod \"authorino-6fd599cf9-zvblp\" (UID: \"0422f5e4-2618-4c22-aada-6dff698e1f55\") " pod="kuadrant-system/authorino-6fd599cf9-zvblp" May 27 21:16:03.924149 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:03.924119 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0422f5e4-2618-4c22-aada-6dff698e1f55-tls-cert\") pod \"authorino-6fd599cf9-zvblp\" (UID: \"0422f5e4-2618-4c22-aada-6dff698e1f55\") " pod="kuadrant-system/authorino-6fd599cf9-zvblp" May 27 21:16:03.931181 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:03.931149 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88nxv\" (UniqueName: \"kubernetes.io/projected/0422f5e4-2618-4c22-aada-6dff698e1f55-kube-api-access-88nxv\") pod \"authorino-6fd599cf9-zvblp\" (UID: \"0422f5e4-2618-4c22-aada-6dff698e1f55\") " pod="kuadrant-system/authorino-6fd599cf9-zvblp" May 27 21:16:04.087722 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:04.087686 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6fd599cf9-zvblp" May 27 21:16:04.222620 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:04.222573 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6fd599cf9-zvblp"] May 27 21:16:04.224665 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:16:04.224632 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0422f5e4_2618_4c22_aada_6dff698e1f55.slice/crio-e7b19f6ace698dea466867212c2f9946aaba2f3452bc831ce4ac2cfdd5583751 WatchSource:0}: Error finding container e7b19f6ace698dea466867212c2f9946aaba2f3452bc831ce4ac2cfdd5583751: Status 404 returned error can't find the container with id e7b19f6ace698dea466867212c2f9946aaba2f3452bc831ce4ac2cfdd5583751 May 27 21:16:04.328173 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:04.328133 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-q229d" event={"ID":"dc2bddb0-3046-4611-9d49-260cb9387239","Type":"ContainerStarted","Data":"94265a735bd3951c11e737714da9086e21110415205238214040919964c2e12e"} May 27 21:16:04.328359 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:04.328180 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-q229d" event={"ID":"dc2bddb0-3046-4611-9d49-260cb9387239","Type":"ContainerStarted","Data":"b6c1d4cfc82f2c3771ca8a706194c98eb2f10d78147f961a1eae888d316e1b2d"} May 27 21:16:04.328359 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:04.328231 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-q229d" podUID="dc2bddb0-3046-4611-9d49-260cb9387239" containerName="authorino" containerID="cri-o://94265a735bd3951c11e737714da9086e21110415205238214040919964c2e12e" gracePeriod=30 May 27 21:16:04.329492 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:04.329465 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6fd599cf9-zvblp" event={"ID":"0422f5e4-2618-4c22-aada-6dff698e1f55","Type":"ContainerStarted","Data":"e7b19f6ace698dea466867212c2f9946aaba2f3452bc831ce4ac2cfdd5583751"} May 27 21:16:04.345526 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:04.345485 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-q229d" podStartSLOduration=0.982916632 podStartE2EDuration="1.345470129s" podCreationTimestamp="2026-05-27 21:16:03 +0000 UTC" firstStartedPulling="2026-05-27 21:16:03.605387909 +0000 UTC m=+588.224773672" lastFinishedPulling="2026-05-27 21:16:03.967941403 +0000 UTC m=+588.587327169" observedRunningTime="2026-05-27 21:16:04.34384122 +0000 UTC m=+588.963227005" watchObservedRunningTime="2026-05-27 21:16:04.345470129 +0000 UTC m=+588.964855913" May 27 21:16:04.590674 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:04.590645 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-q229d" May 27 21:16:04.626874 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:04.626847 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpk8r\" (UniqueName: \"kubernetes.io/projected/dc2bddb0-3046-4611-9d49-260cb9387239-kube-api-access-cpk8r\") pod \"dc2bddb0-3046-4611-9d49-260cb9387239\" (UID: \"dc2bddb0-3046-4611-9d49-260cb9387239\") " May 27 21:16:04.628888 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:04.628864 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc2bddb0-3046-4611-9d49-260cb9387239-kube-api-access-cpk8r" (OuterVolumeSpecName: "kube-api-access-cpk8r") pod "dc2bddb0-3046-4611-9d49-260cb9387239" (UID: "dc2bddb0-3046-4611-9d49-260cb9387239"). InnerVolumeSpecName "kube-api-access-cpk8r". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:16:04.728174 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:04.728126 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpk8r\" (UniqueName: \"kubernetes.io/projected/dc2bddb0-3046-4611-9d49-260cb9387239-kube-api-access-cpk8r\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:16:05.335488 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:05.335455 2566 generic.go:358] "Generic (PLEG): container finished" podID="dc2bddb0-3046-4611-9d49-260cb9387239" containerID="94265a735bd3951c11e737714da9086e21110415205238214040919964c2e12e" exitCode=0 May 27 21:16:05.335884 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:05.335489 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-q229d" event={"ID":"dc2bddb0-3046-4611-9d49-260cb9387239","Type":"ContainerDied","Data":"94265a735bd3951c11e737714da9086e21110415205238214040919964c2e12e"} May 27 21:16:05.335884 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:05.335506 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-q229d" May 27 21:16:05.335884 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:05.335537 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-q229d" event={"ID":"dc2bddb0-3046-4611-9d49-260cb9387239","Type":"ContainerDied","Data":"b6c1d4cfc82f2c3771ca8a706194c98eb2f10d78147f961a1eae888d316e1b2d"} May 27 21:16:05.335884 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:05.335561 2566 scope.go:117] "RemoveContainer" containerID="94265a735bd3951c11e737714da9086e21110415205238214040919964c2e12e" May 27 21:16:05.337228 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:05.337203 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6fd599cf9-zvblp" event={"ID":"0422f5e4-2618-4c22-aada-6dff698e1f55","Type":"ContainerStarted","Data":"d0b13ac055f77245a1d9087bdf13b3ac38653a045fb106c657c3ecf0df186303"} May 27 21:16:05.344733 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:05.344719 2566 scope.go:117] "RemoveContainer" containerID="94265a735bd3951c11e737714da9086e21110415205238214040919964c2e12e" May 27 21:16:05.344958 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:16:05.344941 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94265a735bd3951c11e737714da9086e21110415205238214040919964c2e12e\": container with ID starting with 94265a735bd3951c11e737714da9086e21110415205238214040919964c2e12e not found: ID does not exist" containerID="94265a735bd3951c11e737714da9086e21110415205238214040919964c2e12e" May 27 21:16:05.345000 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:05.344965 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94265a735bd3951c11e737714da9086e21110415205238214040919964c2e12e"} err="failed to get container status \"94265a735bd3951c11e737714da9086e21110415205238214040919964c2e12e\": rpc error: code = NotFound desc = could not find container \"94265a735bd3951c11e737714da9086e21110415205238214040919964c2e12e\": container with ID starting with 94265a735bd3951c11e737714da9086e21110415205238214040919964c2e12e not found: ID does not exist" May 27 21:16:05.359330 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:05.359288 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-6fd599cf9-zvblp" podStartSLOduration=1.992174285 podStartE2EDuration="2.359276919s" podCreationTimestamp="2026-05-27 21:16:03 +0000 UTC" firstStartedPulling="2026-05-27 21:16:04.225905266 +0000 UTC m=+588.845291032" lastFinishedPulling="2026-05-27 21:16:04.5930079 +0000 UTC m=+589.212393666" observedRunningTime="2026-05-27 21:16:05.358088859 +0000 UTC m=+589.977474628" watchObservedRunningTime="2026-05-27 21:16:05.359276919 +0000 UTC m=+589.978662703" May 27 21:16:05.376258 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:05.376232 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-q229d"] May 27 21:16:05.378625 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:05.378602 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-q229d"] May 27 21:16:06.031263 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:06.031230 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc2bddb0-3046-4611-9d49-260cb9387239" path="/var/lib/kubelet/pods/dc2bddb0-3046-4611-9d49-260cb9387239/volumes" May 27 21:16:15.944526 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:15.944490 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fvw7h_0a60edfe-34bf-4d4f-8244-f08a7a0f3f06/console-operator/1.log" May 27 21:16:15.946510 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:15.946488 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fvw7h_0a60edfe-34bf-4d4f-8244-f08a7a0f3f06/console-operator/1.log" May 27 21:16:42.224883 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:16:42.224842 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:17:14.460260 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:17:14.460221 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:17:33.070388 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:17:33.070349 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:17:36.874405 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:17:36.874367 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:17:42.479655 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:17:42.479615 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:17:48.875014 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:17:48.874977 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:18:35.764494 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:35.764446 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:18:56.215260 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:56.215211 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-766d456b54-9pws2"] May 27 21:18:56.215625 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:56.215588 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc2bddb0-3046-4611-9d49-260cb9387239" containerName="authorino" May 27 21:18:56.215625 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:56.215600 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc2bddb0-3046-4611-9d49-260cb9387239" containerName="authorino" May 27 21:18:56.215699 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:56.215675 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="dc2bddb0-3046-4611-9d49-260cb9387239" containerName="authorino" May 27 21:18:56.217482 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:56.217465 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-766d456b54-9pws2" May 27 21:18:56.228485 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:56.228459 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-766d456b54-9pws2"] May 27 21:18:56.355490 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:56.355452 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wltch\" (UniqueName: \"kubernetes.io/projected/6f1c9443-6571-4350-b152-ef1d6994a3d4-kube-api-access-wltch\") pod \"authorino-766d456b54-9pws2\" (UID: \"6f1c9443-6571-4350-b152-ef1d6994a3d4\") " pod="kuadrant-system/authorino-766d456b54-9pws2" May 27 21:18:56.355704 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:56.355534 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6f1c9443-6571-4350-b152-ef1d6994a3d4-tls-cert\") pod \"authorino-766d456b54-9pws2\" (UID: \"6f1c9443-6571-4350-b152-ef1d6994a3d4\") " pod="kuadrant-system/authorino-766d456b54-9pws2" May 27 21:18:56.456809 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:56.456770 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6f1c9443-6571-4350-b152-ef1d6994a3d4-tls-cert\") pod \"authorino-766d456b54-9pws2\" (UID: \"6f1c9443-6571-4350-b152-ef1d6994a3d4\") " pod="kuadrant-system/authorino-766d456b54-9pws2" May 27 21:18:56.456959 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:56.456867 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wltch\" (UniqueName: \"kubernetes.io/projected/6f1c9443-6571-4350-b152-ef1d6994a3d4-kube-api-access-wltch\") pod \"authorino-766d456b54-9pws2\" (UID: \"6f1c9443-6571-4350-b152-ef1d6994a3d4\") " pod="kuadrant-system/authorino-766d456b54-9pws2" May 27 21:18:56.459335 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:56.459307 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6f1c9443-6571-4350-b152-ef1d6994a3d4-tls-cert\") pod \"authorino-766d456b54-9pws2\" (UID: \"6f1c9443-6571-4350-b152-ef1d6994a3d4\") " pod="kuadrant-system/authorino-766d456b54-9pws2" May 27 21:18:56.465589 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:56.465525 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wltch\" (UniqueName: \"kubernetes.io/projected/6f1c9443-6571-4350-b152-ef1d6994a3d4-kube-api-access-wltch\") pod \"authorino-766d456b54-9pws2\" (UID: \"6f1c9443-6571-4350-b152-ef1d6994a3d4\") " pod="kuadrant-system/authorino-766d456b54-9pws2" May 27 21:18:56.527316 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:56.527282 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-766d456b54-9pws2" May 27 21:18:56.655199 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:56.655170 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-766d456b54-9pws2"] May 27 21:18:56.657144 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:18:56.657114 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f1c9443_6571_4350_b152_ef1d6994a3d4.slice/crio-437f3de982d0973cdada0e011a83dfc0d7466897fa72da2f93368c948aac8141 WatchSource:0}: Error finding container 437f3de982d0973cdada0e011a83dfc0d7466897fa72da2f93368c948aac8141: Status 404 returned error can't find the container with id 437f3de982d0973cdada0e011a83dfc0d7466897fa72da2f93368c948aac8141 May 27 21:18:56.658694 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:56.658678 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 21:18:57.025089 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:57.025054 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-766d456b54-9pws2" event={"ID":"6f1c9443-6571-4350-b152-ef1d6994a3d4","Type":"ContainerStarted","Data":"437f3de982d0973cdada0e011a83dfc0d7466897fa72da2f93368c948aac8141"} May 27 21:18:58.035666 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:58.035621 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-766d456b54-9pws2" event={"ID":"6f1c9443-6571-4350-b152-ef1d6994a3d4","Type":"ContainerStarted","Data":"f8594350b96c49752b64512c5172d2ed8e64b5a61483787ba65d1575787ce93f"} May 27 21:18:58.054984 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:58.054929 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-766d456b54-9pws2" podStartSLOduration=1.69004609 podStartE2EDuration="2.054912715s" podCreationTimestamp="2026-05-27 21:18:56 +0000 UTC" firstStartedPulling="2026-05-27 21:18:56.658799102 +0000 UTC m=+761.278184865" lastFinishedPulling="2026-05-27 21:18:57.023665714 +0000 UTC m=+761.643051490" observedRunningTime="2026-05-27 21:18:58.050842142 +0000 UTC m=+762.670227927" watchObservedRunningTime="2026-05-27 21:18:58.054912715 +0000 UTC m=+762.674298501" May 27 21:18:58.087055 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:58.083935 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6fd599cf9-zvblp"] May 27 21:18:58.087055 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:58.084237 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-6fd599cf9-zvblp" podUID="0422f5e4-2618-4c22-aada-6dff698e1f55" containerName="authorino" containerID="cri-o://d0b13ac055f77245a1d9087bdf13b3ac38653a045fb106c657c3ecf0df186303" gracePeriod=30 May 27 21:18:58.352427 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:58.352395 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6fd599cf9-zvblp" May 27 21:18:58.473365 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:58.473330 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88nxv\" (UniqueName: \"kubernetes.io/projected/0422f5e4-2618-4c22-aada-6dff698e1f55-kube-api-access-88nxv\") pod \"0422f5e4-2618-4c22-aada-6dff698e1f55\" (UID: \"0422f5e4-2618-4c22-aada-6dff698e1f55\") " May 27 21:18:58.473535 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:58.473517 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0422f5e4-2618-4c22-aada-6dff698e1f55-tls-cert\") pod \"0422f5e4-2618-4c22-aada-6dff698e1f55\" (UID: \"0422f5e4-2618-4c22-aada-6dff698e1f55\") " May 27 21:18:58.475440 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:58.475412 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0422f5e4-2618-4c22-aada-6dff698e1f55-kube-api-access-88nxv" (OuterVolumeSpecName: "kube-api-access-88nxv") pod "0422f5e4-2618-4c22-aada-6dff698e1f55" (UID: "0422f5e4-2618-4c22-aada-6dff698e1f55"). InnerVolumeSpecName "kube-api-access-88nxv". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:18:58.484213 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:58.484186 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0422f5e4-2618-4c22-aada-6dff698e1f55-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "0422f5e4-2618-4c22-aada-6dff698e1f55" (UID: "0422f5e4-2618-4c22-aada-6dff698e1f55"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:18:58.575130 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:58.575092 2566 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0422f5e4-2618-4c22-aada-6dff698e1f55-tls-cert\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:18:58.575130 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:58.575124 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88nxv\" (UniqueName: \"kubernetes.io/projected/0422f5e4-2618-4c22-aada-6dff698e1f55-kube-api-access-88nxv\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:18:59.037258 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:59.037222 2566 generic.go:358] "Generic (PLEG): container finished" podID="0422f5e4-2618-4c22-aada-6dff698e1f55" containerID="d0b13ac055f77245a1d9087bdf13b3ac38653a045fb106c657c3ecf0df186303" exitCode=0 May 27 21:18:59.037624 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:59.037269 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6fd599cf9-zvblp" May 27 21:18:59.037624 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:59.037307 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6fd599cf9-zvblp" event={"ID":"0422f5e4-2618-4c22-aada-6dff698e1f55","Type":"ContainerDied","Data":"d0b13ac055f77245a1d9087bdf13b3ac38653a045fb106c657c3ecf0df186303"} May 27 21:18:59.037624 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:59.037346 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6fd599cf9-zvblp" event={"ID":"0422f5e4-2618-4c22-aada-6dff698e1f55","Type":"ContainerDied","Data":"e7b19f6ace698dea466867212c2f9946aaba2f3452bc831ce4ac2cfdd5583751"} May 27 21:18:59.037624 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:59.037366 2566 scope.go:117] "RemoveContainer" containerID="d0b13ac055f77245a1d9087bdf13b3ac38653a045fb106c657c3ecf0df186303" May 27 21:18:59.047081 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:59.047064 2566 scope.go:117] "RemoveContainer" containerID="d0b13ac055f77245a1d9087bdf13b3ac38653a045fb106c657c3ecf0df186303" May 27 21:18:59.047298 ip-10-0-130-116 kubenswrapper[2566]: E0527 21:18:59.047282 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0b13ac055f77245a1d9087bdf13b3ac38653a045fb106c657c3ecf0df186303\": container with ID starting with d0b13ac055f77245a1d9087bdf13b3ac38653a045fb106c657c3ecf0df186303 not found: ID does not exist" containerID="d0b13ac055f77245a1d9087bdf13b3ac38653a045fb106c657c3ecf0df186303" May 27 21:18:59.047355 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:59.047304 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0b13ac055f77245a1d9087bdf13b3ac38653a045fb106c657c3ecf0df186303"} err="failed to get container status \"d0b13ac055f77245a1d9087bdf13b3ac38653a045fb106c657c3ecf0df186303\": rpc error: code = NotFound desc = could not find container \"d0b13ac055f77245a1d9087bdf13b3ac38653a045fb106c657c3ecf0df186303\": container with ID starting with d0b13ac055f77245a1d9087bdf13b3ac38653a045fb106c657c3ecf0df186303 not found: ID does not exist" May 27 21:18:59.061179 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:59.061157 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6fd599cf9-zvblp"] May 27 21:18:59.065405 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:18:59.065385 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6fd599cf9-zvblp"] May 27 21:19:00.031350 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:19:00.031318 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0422f5e4-2618-4c22-aada-6dff698e1f55" path="/var/lib/kubelet/pods/0422f5e4-2618-4c22-aada-6dff698e1f55/volumes" May 27 21:19:15.670651 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:19:15.670611 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:19:21.557694 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:19:21.557658 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:19:27.659888 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:19:27.659808 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:19:37.567602 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:19:37.567556 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:19:46.166994 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:19:46.166959 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:19:57.107807 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:19:57.107769 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:20:05.992686 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:20:05.992637 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:20:16.562183 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:20:16.562143 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:20:47.761206 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:20:47.761162 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:20:53.058046 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:20:53.057992 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:21:15.987332 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:21:15.987297 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fvw7h_0a60edfe-34bf-4d4f-8244-f08a7a0f3f06/console-operator/1.log" May 27 21:21:15.991498 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:21:15.991477 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fvw7h_0a60edfe-34bf-4d4f-8244-f08a7a0f3f06/console-operator/1.log" May 27 21:21:20.963436 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:21:20.963401 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:21:36.758042 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:21:36.757992 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:22:00.662615 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:22:00.662574 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:22:17.352183 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:22:17.352139 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:22:31.062092 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:22:31.061999 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:22:47.860471 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:22:47.860438 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:23:42.257177 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:23:42.257139 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:23:50.452202 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:23:50.452165 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:24:07.363770 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:24:07.363729 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:24:15.663054 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:24:15.662997 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:24:32.273692 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:24:32.273650 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:24:40.752928 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:24:40.752885 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:25:13.761453 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:25:13.761412 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:25:22.153699 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:25:22.153655 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:25:30.859047 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:25:30.858944 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:25:39.354669 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:25:39.354624 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:25:47.354249 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:25:47.354216 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:26:04.459300 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:26:04.459256 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:26:15.456548 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:26:15.456503 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:26:16.021866 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:26:16.021836 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fvw7h_0a60edfe-34bf-4d4f-8244-f08a7a0f3f06/console-operator/1.log" May 27 21:26:16.027580 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:26:16.027549 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fvw7h_0a60edfe-34bf-4d4f-8244-f08a7a0f3f06/console-operator/1.log" May 27 21:27:02.353971 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:27:02.353937 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:27:06.852689 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:27:06.852651 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:27:16.068121 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:27:16.068088 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:27:24.557391 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:27:24.557357 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:27:33.454943 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:27:33.454912 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:27:42.463820 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:27:42.463782 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:27:51.272042 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:27:51.271984 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:27:59.153805 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:27:59.153770 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:28:07.957355 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:28:07.957317 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:28:16.555274 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:28:16.555240 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:28:26.257357 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:28:26.257314 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:28:34.556425 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:28:34.556340 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:28:43.055921 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:28:43.055879 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:28:51.259498 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:28:51.259452 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:29:00.959532 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:29:00.959485 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:29:08.854731 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:29:08.854688 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:29:18.257248 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:29:18.257211 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:29:25.959075 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:29:25.959041 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:30:00.141733 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:30:00.141657 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29665290-mf4mz"] May 27 21:30:00.142188 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:30:00.142074 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0422f5e4-2618-4c22-aada-6dff698e1f55" containerName="authorino" May 27 21:30:00.142188 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:30:00.142099 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0422f5e4-2618-4c22-aada-6dff698e1f55" containerName="authorino" May 27 21:30:00.142188 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:30:00.142180 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="0422f5e4-2618-4c22-aada-6dff698e1f55" containerName="authorino" May 27 21:30:00.145305 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:30:00.145287 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29665290-mf4mz" May 27 21:30:00.147624 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:30:00.147602 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-2wmg6\"" May 27 21:30:00.161996 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:30:00.161972 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29665290-mf4mz"] May 27 21:30:00.246489 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:30:00.246464 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gntr\" (UniqueName: \"kubernetes.io/projected/de1793e7-46d9-4f46-b5b7-570e4b8d4612-kube-api-access-6gntr\") pod \"maas-api-key-cleanup-29665290-mf4mz\" (UID: \"de1793e7-46d9-4f46-b5b7-570e4b8d4612\") " pod="opendatahub/maas-api-key-cleanup-29665290-mf4mz" May 27 21:30:00.347365 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:30:00.347335 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6gntr\" (UniqueName: \"kubernetes.io/projected/de1793e7-46d9-4f46-b5b7-570e4b8d4612-kube-api-access-6gntr\") pod \"maas-api-key-cleanup-29665290-mf4mz\" (UID: \"de1793e7-46d9-4f46-b5b7-570e4b8d4612\") " pod="opendatahub/maas-api-key-cleanup-29665290-mf4mz" May 27 21:30:00.356178 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:30:00.356159 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gntr\" (UniqueName: \"kubernetes.io/projected/de1793e7-46d9-4f46-b5b7-570e4b8d4612-kube-api-access-6gntr\") pod \"maas-api-key-cleanup-29665290-mf4mz\" (UID: \"de1793e7-46d9-4f46-b5b7-570e4b8d4612\") " pod="opendatahub/maas-api-key-cleanup-29665290-mf4mz" May 27 21:30:00.456367 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:30:00.456308 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29665290-mf4mz" May 27 21:30:00.584405 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:30:00.584379 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29665290-mf4mz"] May 27 21:30:00.586296 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:30:00.586261 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde1793e7_46d9_4f46_b5b7_570e4b8d4612.slice/crio-698107b23091fcba72f08d963579382dfe436272f92fa7cfc171f501d9f6c3dc WatchSource:0}: Error finding container 698107b23091fcba72f08d963579382dfe436272f92fa7cfc171f501d9f6c3dc: Status 404 returned error can't find the container with id 698107b23091fcba72f08d963579382dfe436272f92fa7cfc171f501d9f6c3dc May 27 21:30:00.588053 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:30:00.588018 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 21:30:00.604705 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:30:00.604683 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29665290-mf4mz" event={"ID":"de1793e7-46d9-4f46-b5b7-570e4b8d4612","Type":"ContainerStarted","Data":"698107b23091fcba72f08d963579382dfe436272f92fa7cfc171f501d9f6c3dc"} May 27 21:30:13.658277 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:30:13.658238 2566 generic.go:358] "Generic (PLEG): container finished" podID="de1793e7-46d9-4f46-b5b7-570e4b8d4612" containerID="5d7ba546534c886fa59a89770b211c0f5ef45b55faac88a7665157d1a33236ee" exitCode=0 May 27 21:30:13.658657 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:30:13.658299 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29665290-mf4mz" event={"ID":"de1793e7-46d9-4f46-b5b7-570e4b8d4612","Type":"ContainerDied","Data":"5d7ba546534c886fa59a89770b211c0f5ef45b55faac88a7665157d1a33236ee"} May 27 21:30:14.790921 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:30:14.790898 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29665290-mf4mz" May 27 21:30:14.874812 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:30:14.874782 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gntr\" (UniqueName: \"kubernetes.io/projected/de1793e7-46d9-4f46-b5b7-570e4b8d4612-kube-api-access-6gntr\") pod \"de1793e7-46d9-4f46-b5b7-570e4b8d4612\" (UID: \"de1793e7-46d9-4f46-b5b7-570e4b8d4612\") " May 27 21:30:14.876797 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:30:14.876774 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de1793e7-46d9-4f46-b5b7-570e4b8d4612-kube-api-access-6gntr" (OuterVolumeSpecName: "kube-api-access-6gntr") pod "de1793e7-46d9-4f46-b5b7-570e4b8d4612" (UID: "de1793e7-46d9-4f46-b5b7-570e4b8d4612"). InnerVolumeSpecName "kube-api-access-6gntr". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:30:14.975936 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:30:14.975873 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gntr\" (UniqueName: \"kubernetes.io/projected/de1793e7-46d9-4f46-b5b7-570e4b8d4612-kube-api-access-6gntr\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" May 27 21:30:15.667942 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:30:15.667912 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29665290-mf4mz" May 27 21:30:15.668144 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:30:15.667908 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29665290-mf4mz" event={"ID":"de1793e7-46d9-4f46-b5b7-570e4b8d4612","Type":"ContainerDied","Data":"698107b23091fcba72f08d963579382dfe436272f92fa7cfc171f501d9f6c3dc"} May 27 21:30:15.668144 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:30:15.668017 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="698107b23091fcba72f08d963579382dfe436272f92fa7cfc171f501d9f6c3dc" May 27 21:31:16.063104 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:31:16.063049 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fvw7h_0a60edfe-34bf-4d4f-8244-f08a7a0f3f06/console-operator/1.log" May 27 21:31:16.070014 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:31:16.069993 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fvw7h_0a60edfe-34bf-4d4f-8244-f08a7a0f3f06/console-operator/1.log" May 27 21:31:43.829526 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:31:43.829438 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:31:48.964931 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:31:48.964895 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:32:16.305790 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:32:16.305751 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:32:21.982582 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:32:21.982545 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:32:31.595870 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:32:31.595835 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:32:42.264698 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:32:42.264660 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:32:50.978537 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:32:50.978496 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:33:02.169300 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:33:02.169228 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:33:10.889921 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:33:10.889885 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:33:21.256611 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:33:21.256572 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:33:29.954271 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:33:29.954232 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:33:40.662139 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:33:40.662088 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:33:49.463539 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:33:49.463498 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:34:22.455583 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:34:22.455543 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:35:05.360366 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:35:05.360280 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:35:13.271858 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:35:13.271820 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:35:21.961691 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:35:21.961661 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:35:30.665989 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:35:30.665944 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:35:39.571640 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:35:39.571602 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:35:52.663325 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:35:52.663274 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:36:01.589080 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:36:01.588987 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:36:09.362847 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:36:09.362814 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:36:16.098576 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:36:16.098545 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fvw7h_0a60edfe-34bf-4d4f-8244-f08a7a0f3f06/console-operator/1.log" May 27 21:36:16.106981 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:36:16.106957 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fvw7h_0a60edfe-34bf-4d4f-8244-f08a7a0f3f06/console-operator/1.log" May 27 21:36:19.270746 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:36:19.270708 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:36:26.878985 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:36:26.878948 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:36:34.764041 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:36:34.763986 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:36:45.764173 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:36:45.764140 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:37:02.967866 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:37:02.967824 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:37:11.360046 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:37:11.359983 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:37:20.563195 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:37:20.563161 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:37:29.064170 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:37:29.064086 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:37:45.774370 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:37:45.774332 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:37:53.663920 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:37:53.663867 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:38:03.688510 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:38:03.688474 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:38:11.463430 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:38:11.463395 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:38:20.483360 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:38:20.483326 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:38:29.164740 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:38:29.164693 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:38:37.974790 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:38:37.974748 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:38:49.582455 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:38:49.582404 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:38:59.562810 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:38:59.562721 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:39:10.382735 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:39:10.382700 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:39:19.962856 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:39:19.962815 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:39:27.066447 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:39:27.066409 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:39:34.664978 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:39:34.664941 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:39:43.068583 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:39:43.068544 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:39:59.257037 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:39:59.256996 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:40:08.862650 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:40:08.862601 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:40:17.075977 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:40:17.075939 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:40:24.562389 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:40:24.562344 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:40:48.457458 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:40:48.457375 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:41:02.266243 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:02.266208 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-766d456b54-9pws2_6f1c9443-6571-4350-b152-ef1d6994a3d4/authorino/0.log" May 27 21:41:02.552557 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:02.552468 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-nvdlb"] May 27 21:41:06.808784 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:06.808755 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29665290-mf4mz_de1793e7-46d9-4f46-b5b7-570e4b8d4612/cleanup/0.log" May 27 21:41:07.385789 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:07.385760 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6678cd66dc-s89mh_932e2f7f-e490-43ef-9062-5c0fce6edd85/manager/0.log" May 27 21:41:08.227566 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:08.227533 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg_4804cd26-eae8-4796-aaef-d209c99ab8a4/extract/0.log" May 27 21:41:08.233250 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:08.233228 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg_4804cd26-eae8-4796-aaef-d209c99ab8a4/util/0.log" May 27 21:41:08.238744 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:08.238713 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg_4804cd26-eae8-4796-aaef-d209c99ab8a4/pull/0.log" May 27 21:41:08.357205 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:08.357179 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kh4xq_d8556844-bb43-47fa-8d8b-888eab1d9385/pull/0.log" May 27 21:41:08.362701 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:08.362675 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kh4xq_d8556844-bb43-47fa-8d8b-888eab1d9385/extract/0.log" May 27 21:41:08.367818 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:08.367802 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kh4xq_d8556844-bb43-47fa-8d8b-888eab1d9385/util/0.log" May 27 21:41:08.468576 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:08.468545 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zgzvm_6c8a84f8-d0d8-4628-8b37-eb7aaaba9202/util/0.log" May 27 21:41:08.474397 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:08.474373 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zgzvm_6c8a84f8-d0d8-4628-8b37-eb7aaaba9202/pull/0.log" May 27 21:41:08.479999 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:08.479956 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zgzvm_6c8a84f8-d0d8-4628-8b37-eb7aaaba9202/extract/0.log" May 27 21:41:08.587086 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:08.587024 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xb7x_ff2a3748-c094-4a00-ad3a-0edd2e52afce/util/0.log" May 27 21:41:08.593221 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:08.593198 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xb7x_ff2a3748-c094-4a00-ad3a-0edd2e52afce/pull/0.log" May 27 21:41:08.598828 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:08.598810 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xb7x_ff2a3748-c094-4a00-ad3a-0edd2e52afce/extract/0.log" May 27 21:41:08.707262 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:08.707236 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-766d456b54-9pws2_6f1c9443-6571-4350-b152-ef1d6994a3d4/authorino/0.log" May 27 21:41:09.035311 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:09.035284 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-9ljzr_4de1015f-4253-46dc-8597-a9d69ecd6c94/kuadrant-console-plugin/0.log" May 27 21:41:09.384082 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:09.384023 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-nvdlb_d16d2759-81db-4523-b16a-1abd77dec182/limitador/0.log" May 27 21:41:10.161257 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:10.161228 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f6f4b4c58-r4l95_bfc0d2b1-a730-418b-a864-44717d9d89d9/kube-auth-proxy/0.log" May 27 21:41:15.546043 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:15.545998 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t5vz8/must-gather-kl4vp"] May 27 21:41:15.546582 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:15.546560 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de1793e7-46d9-4f46-b5b7-570e4b8d4612" containerName="cleanup" May 27 21:41:15.546665 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:15.546584 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="de1793e7-46d9-4f46-b5b7-570e4b8d4612" containerName="cleanup" May 27 21:41:15.546726 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:15.546717 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="de1793e7-46d9-4f46-b5b7-570e4b8d4612" containerName="cleanup" May 27 21:41:15.549922 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:15.549897 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t5vz8/must-gather-kl4vp" May 27 21:41:15.552531 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:15.552501 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t5vz8\"/\"openshift-service-ca.crt\"" May 27 21:41:15.552628 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:15.552547 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t5vz8\"/\"kube-root-ca.crt\"" May 27 21:41:15.552680 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:15.552666 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-t5vz8\"/\"default-dockercfg-qz47r\"" May 27 21:41:15.570395 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:15.570376 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t5vz8/must-gather-kl4vp"] May 27 21:41:15.669477 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:15.669445 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/809f2bf8-db2f-48c2-b87b-753d64093027-must-gather-output\") pod \"must-gather-kl4vp\" (UID: \"809f2bf8-db2f-48c2-b87b-753d64093027\") " pod="openshift-must-gather-t5vz8/must-gather-kl4vp" May 27 21:41:15.669618 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:15.669545 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp98k\" (UniqueName: \"kubernetes.io/projected/809f2bf8-db2f-48c2-b87b-753d64093027-kube-api-access-mp98k\") pod \"must-gather-kl4vp\" (UID: \"809f2bf8-db2f-48c2-b87b-753d64093027\") " pod="openshift-must-gather-t5vz8/must-gather-kl4vp" May 27 21:41:15.770489 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:15.770459 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/809f2bf8-db2f-48c2-b87b-753d64093027-must-gather-output\") pod \"must-gather-kl4vp\" (UID: \"809f2bf8-db2f-48c2-b87b-753d64093027\") " pod="openshift-must-gather-t5vz8/must-gather-kl4vp" May 27 21:41:15.770641 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:15.770522 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mp98k\" (UniqueName: \"kubernetes.io/projected/809f2bf8-db2f-48c2-b87b-753d64093027-kube-api-access-mp98k\") pod \"must-gather-kl4vp\" (UID: \"809f2bf8-db2f-48c2-b87b-753d64093027\") " pod="openshift-must-gather-t5vz8/must-gather-kl4vp" May 27 21:41:15.770819 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:15.770799 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/809f2bf8-db2f-48c2-b87b-753d64093027-must-gather-output\") pod \"must-gather-kl4vp\" (UID: \"809f2bf8-db2f-48c2-b87b-753d64093027\") " pod="openshift-must-gather-t5vz8/must-gather-kl4vp" May 27 21:41:15.778831 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:15.778801 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp98k\" (UniqueName: \"kubernetes.io/projected/809f2bf8-db2f-48c2-b87b-753d64093027-kube-api-access-mp98k\") pod \"must-gather-kl4vp\" (UID: \"809f2bf8-db2f-48c2-b87b-753d64093027\") " pod="openshift-must-gather-t5vz8/must-gather-kl4vp" May 27 21:41:15.860098 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:15.860066 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t5vz8/must-gather-kl4vp" May 27 21:41:15.997936 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:15.997907 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t5vz8/must-gather-kl4vp"] May 27 21:41:16.000278 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:41:16.000232 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod809f2bf8_db2f_48c2_b87b_753d64093027.slice/crio-9c3356ab6abfdd8741bb6d49943af90ee63d99dc5c6cfe42ca5e076c5c0b3d8b WatchSource:0}: Error finding container 9c3356ab6abfdd8741bb6d49943af90ee63d99dc5c6cfe42ca5e076c5c0b3d8b: Status 404 returned error can't find the container with id 9c3356ab6abfdd8741bb6d49943af90ee63d99dc5c6cfe42ca5e076c5c0b3d8b May 27 21:41:16.002021 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:16.002001 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 21:41:16.146202 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:16.146119 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fvw7h_0a60edfe-34bf-4d4f-8244-f08a7a0f3f06/console-operator/1.log" May 27 21:41:16.148369 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:16.148345 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fvw7h_0a60edfe-34bf-4d4f-8244-f08a7a0f3f06/console-operator/1.log" May 27 21:41:16.261585 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:16.261548 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t5vz8/must-gather-kl4vp" event={"ID":"809f2bf8-db2f-48c2-b87b-753d64093027","Type":"ContainerStarted","Data":"9c3356ab6abfdd8741bb6d49943af90ee63d99dc5c6cfe42ca5e076c5c0b3d8b"} May 27 21:41:17.267722 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:17.267684 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t5vz8/must-gather-kl4vp" event={"ID":"809f2bf8-db2f-48c2-b87b-753d64093027","Type":"ContainerStarted","Data":"d3edcb7c978a6fdc8e6d76feb129f7919ce65dcae73d54dfc36e046cb371d42b"} May 27 21:41:17.267722 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:17.267725 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t5vz8/must-gather-kl4vp" event={"ID":"809f2bf8-db2f-48c2-b87b-753d64093027","Type":"ContainerStarted","Data":"d9cbe9d03ab393c619f96a15bd46b7cb182187555f5e4b16892b0949789088d6"} May 27 21:41:17.305816 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:17.305751 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-t5vz8/must-gather-kl4vp" podStartSLOduration=1.513969127 podStartE2EDuration="2.305730801s" podCreationTimestamp="2026-05-27 21:41:15 +0000 UTC" firstStartedPulling="2026-05-27 21:41:16.002197805 +0000 UTC m=+2100.621583567" lastFinishedPulling="2026-05-27 21:41:16.793959474 +0000 UTC m=+2101.413345241" observedRunningTime="2026-05-27 21:41:17.304500675 +0000 UTC m=+2101.923886460" watchObservedRunningTime="2026-05-27 21:41:17.305730801 +0000 UTC m=+2101.925116589" May 27 21:41:18.722493 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:18.722464 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-j5q9r_1d2e3f4d-6c7c-4922-a7c1-961f9d756d79/global-pull-secret-syncer/0.log" May 27 21:41:18.839395 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:18.839359 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6mrqq_0fed42af-d37a-40b7-a34e-d4a611de1479/konnectivity-agent/0.log" May 27 21:41:18.929922 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:18.929887 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-116.ec2.internal_cbb190866593adbdc91ba8af1639e9f3/haproxy/0.log" May 27 21:41:22.213323 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:22.213275 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg_4804cd26-eae8-4796-aaef-d209c99ab8a4/extract/0.log" May 27 21:41:22.236922 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:22.236764 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg_4804cd26-eae8-4796-aaef-d209c99ab8a4/util/0.log" May 27 21:41:22.261776 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:22.261751 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xg5bg_4804cd26-eae8-4796-aaef-d209c99ab8a4/pull/0.log" May 27 21:41:22.302657 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:22.302627 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kh4xq_d8556844-bb43-47fa-8d8b-888eab1d9385/extract/0.log" May 27 21:41:22.346552 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:22.346522 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kh4xq_d8556844-bb43-47fa-8d8b-888eab1d9385/util/0.log" May 27 21:41:22.377066 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:22.377013 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kh4xq_d8556844-bb43-47fa-8d8b-888eab1d9385/pull/0.log" May 27 21:41:22.405396 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:22.405358 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zgzvm_6c8a84f8-d0d8-4628-8b37-eb7aaaba9202/extract/0.log" May 27 21:41:22.427677 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:22.427642 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zgzvm_6c8a84f8-d0d8-4628-8b37-eb7aaaba9202/util/0.log" May 27 21:41:22.448910 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:22.448873 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zgzvm_6c8a84f8-d0d8-4628-8b37-eb7aaaba9202/pull/0.log" May 27 21:41:22.475712 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:22.475623 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xb7x_ff2a3748-c094-4a00-ad3a-0edd2e52afce/extract/0.log" May 27 21:41:22.497762 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:22.497736 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xb7x_ff2a3748-c094-4a00-ad3a-0edd2e52afce/util/0.log" May 27 21:41:22.520039 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:22.519991 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14xb7x_ff2a3748-c094-4a00-ad3a-0edd2e52afce/pull/0.log" May 27 21:41:22.778102 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:22.777056 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-766d456b54-9pws2_6f1c9443-6571-4350-b152-ef1d6994a3d4/authorino/0.log" May 27 21:41:22.856051 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:22.856008 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-9ljzr_4de1015f-4253-46dc-8597-a9d69ecd6c94/kuadrant-console-plugin/0.log" May 27 21:41:22.990183 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:22.990150 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-nvdlb_d16d2759-81db-4523-b16a-1abd77dec182/limitador/0.log" May 27 21:41:24.547112 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:24.547082 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7215fe9f-2bcb-4abd-86f3-449e31b0fe57/alertmanager/0.log" May 27 21:41:24.580907 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:24.580880 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7215fe9f-2bcb-4abd-86f3-449e31b0fe57/config-reloader/0.log" May 27 21:41:24.609089 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:24.609022 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7215fe9f-2bcb-4abd-86f3-449e31b0fe57/kube-rbac-proxy-web/0.log" May 27 21:41:24.634591 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:24.634550 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7215fe9f-2bcb-4abd-86f3-449e31b0fe57/kube-rbac-proxy/0.log" May 27 21:41:24.662964 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:24.662929 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7215fe9f-2bcb-4abd-86f3-449e31b0fe57/kube-rbac-proxy-metric/0.log" May 27 21:41:24.685827 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:24.685746 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7215fe9f-2bcb-4abd-86f3-449e31b0fe57/prom-label-proxy/0.log" May 27 21:41:24.708525 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:24.708498 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7215fe9f-2bcb-4abd-86f3-449e31b0fe57/init-config-reloader/0.log" May 27 21:41:24.905954 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:24.905923 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-98wmk_bbcc17ba-9d30-4795-bd01-e75cad541472/monitoring-plugin/0.log" May 27 21:41:24.940553 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:24.940444 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-48l8d_546b0029-85a2-4623-b927-f815a3725c53/node-exporter/0.log" May 27 21:41:24.970160 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:24.970132 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-48l8d_546b0029-85a2-4623-b927-f815a3725c53/kube-rbac-proxy/0.log" May 27 21:41:24.992515 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:24.992488 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-48l8d_546b0029-85a2-4623-b927-f815a3725c53/init-textfile/0.log" May 27 21:41:25.177923 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:25.177889 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-lvnxd_b878561d-7da1-4f5e-8f2e-1a30d47b68ae/kube-rbac-proxy-main/0.log" May 27 21:41:25.201907 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:25.201788 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-lvnxd_b878561d-7da1-4f5e-8f2e-1a30d47b68ae/kube-rbac-proxy-self/0.log" May 27 21:41:25.223464 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:25.223435 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-lvnxd_b878561d-7da1-4f5e-8f2e-1a30d47b68ae/openshift-state-metrics/0.log" May 27 21:41:25.441692 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:25.441661 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-q7szz_42805e5a-68b3-424d-80cd-3a0e9597c73e/prometheus-operator/0.log" May 27 21:41:25.462756 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:25.462679 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-q7szz_42805e5a-68b3-424d-80cd-3a0e9597c73e/kube-rbac-proxy/0.log" May 27 21:41:25.516381 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:25.516326 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c6f8fcdb9-dpq64_53a75dfd-597c-444f-ae01-30a0b49dfd78/telemeter-client/0.log" May 27 21:41:25.539810 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:25.539780 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c6f8fcdb9-dpq64_53a75dfd-597c-444f-ae01-30a0b49dfd78/reload/0.log" May 27 21:41:25.565471 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:25.565440 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c6f8fcdb9-dpq64_53a75dfd-597c-444f-ae01-30a0b49dfd78/kube-rbac-proxy/0.log" May 27 21:41:25.595090 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:25.594976 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54f7bff98c-qdrhx_a7088d87-a64b-4f0e-9135-6b7b55fc706e/thanos-query/0.log" May 27 21:41:25.651299 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:25.651259 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54f7bff98c-qdrhx_a7088d87-a64b-4f0e-9135-6b7b55fc706e/kube-rbac-proxy-web/0.log" May 27 21:41:25.696115 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:25.696082 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54f7bff98c-qdrhx_a7088d87-a64b-4f0e-9135-6b7b55fc706e/kube-rbac-proxy/0.log" May 27 21:41:25.720758 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:25.720679 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54f7bff98c-qdrhx_a7088d87-a64b-4f0e-9135-6b7b55fc706e/prom-label-proxy/0.log" May 27 21:41:25.743213 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:25.743187 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54f7bff98c-qdrhx_a7088d87-a64b-4f0e-9135-6b7b55fc706e/kube-rbac-proxy-rules/0.log" May 27 21:41:25.773947 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:25.773902 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54f7bff98c-qdrhx_a7088d87-a64b-4f0e-9135-6b7b55fc706e/kube-rbac-proxy-metrics/0.log" May 27 21:41:27.352233 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:27.352203 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fvw7h_0a60edfe-34bf-4d4f-8244-f08a7a0f3f06/console-operator/1.log" May 27 21:41:27.356561 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:27.356536 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fvw7h_0a60edfe-34bf-4d4f-8244-f08a7a0f3f06/console-operator/2.log" May 27 21:41:27.388232 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:27.388192 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t5vz8/perf-node-gather-daemonset-j9cpt"] May 27 21:41:27.395787 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:27.395752 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-j9cpt" May 27 21:41:27.400205 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:27.400173 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t5vz8/perf-node-gather-daemonset-j9cpt"] May 27 21:41:27.490778 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:27.490741 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e7eda400-59b6-4733-9c21-d869ecb1bd13-proc\") pod \"perf-node-gather-daemonset-j9cpt\" (UID: \"e7eda400-59b6-4733-9c21-d869ecb1bd13\") " pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-j9cpt" May 27 21:41:27.490980 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:27.490823 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhprq\" (UniqueName: \"kubernetes.io/projected/e7eda400-59b6-4733-9c21-d869ecb1bd13-kube-api-access-nhprq\") pod \"perf-node-gather-daemonset-j9cpt\" (UID: \"e7eda400-59b6-4733-9c21-d869ecb1bd13\") " pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-j9cpt" May 27 21:41:27.490980 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:27.490866 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7eda400-59b6-4733-9c21-d869ecb1bd13-lib-modules\") pod \"perf-node-gather-daemonset-j9cpt\" (UID: \"e7eda400-59b6-4733-9c21-d869ecb1bd13\") " pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-j9cpt" May 27 21:41:27.490980 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:27.490905 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7eda400-59b6-4733-9c21-d869ecb1bd13-sys\") pod \"perf-node-gather-daemonset-j9cpt\" (UID: \"e7eda400-59b6-4733-9c21-d869ecb1bd13\") " pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-j9cpt" May 27 21:41:27.490980 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:27.490944 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e7eda400-59b6-4733-9c21-d869ecb1bd13-podres\") pod \"perf-node-gather-daemonset-j9cpt\" (UID: \"e7eda400-59b6-4733-9c21-d869ecb1bd13\") " pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-j9cpt" May 27 21:41:27.591951 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:27.591918 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e7eda400-59b6-4733-9c21-d869ecb1bd13-proc\") pod \"perf-node-gather-daemonset-j9cpt\" (UID: \"e7eda400-59b6-4733-9c21-d869ecb1bd13\") " pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-j9cpt" May 27 21:41:27.592156 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:27.591992 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nhprq\" (UniqueName: \"kubernetes.io/projected/e7eda400-59b6-4733-9c21-d869ecb1bd13-kube-api-access-nhprq\") pod \"perf-node-gather-daemonset-j9cpt\" (UID: \"e7eda400-59b6-4733-9c21-d869ecb1bd13\") " pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-j9cpt" May 27 21:41:27.592156 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:27.592045 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7eda400-59b6-4733-9c21-d869ecb1bd13-lib-modules\") pod \"perf-node-gather-daemonset-j9cpt\" (UID: \"e7eda400-59b6-4733-9c21-d869ecb1bd13\") " pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-j9cpt" May 27 21:41:27.592156 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:27.592086 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7eda400-59b6-4733-9c21-d869ecb1bd13-sys\") pod \"perf-node-gather-daemonset-j9cpt\" (UID: \"e7eda400-59b6-4733-9c21-d869ecb1bd13\") " pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-j9cpt" May 27 21:41:27.592156 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:27.592046 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e7eda400-59b6-4733-9c21-d869ecb1bd13-proc\") pod \"perf-node-gather-daemonset-j9cpt\" (UID: \"e7eda400-59b6-4733-9c21-d869ecb1bd13\") " pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-j9cpt" May 27 21:41:27.592156 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:27.592126 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e7eda400-59b6-4733-9c21-d869ecb1bd13-podres\") pod \"perf-node-gather-daemonset-j9cpt\" (UID: \"e7eda400-59b6-4733-9c21-d869ecb1bd13\") " pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-j9cpt" May 27 21:41:27.592373 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:27.592196 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7eda400-59b6-4733-9c21-d869ecb1bd13-sys\") pod \"perf-node-gather-daemonset-j9cpt\" (UID: \"e7eda400-59b6-4733-9c21-d869ecb1bd13\") " pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-j9cpt" May 27 21:41:27.592373 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:27.592207 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7eda400-59b6-4733-9c21-d869ecb1bd13-lib-modules\") pod \"perf-node-gather-daemonset-j9cpt\" (UID: \"e7eda400-59b6-4733-9c21-d869ecb1bd13\") " pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-j9cpt" May 27 21:41:27.592373 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:27.592224 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e7eda400-59b6-4733-9c21-d869ecb1bd13-podres\") pod \"perf-node-gather-daemonset-j9cpt\" (UID: \"e7eda400-59b6-4733-9c21-d869ecb1bd13\") " pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-j9cpt" May 27 21:41:27.600960 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:27.600932 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhprq\" (UniqueName: \"kubernetes.io/projected/e7eda400-59b6-4733-9c21-d869ecb1bd13-kube-api-access-nhprq\") pod \"perf-node-gather-daemonset-j9cpt\" (UID: \"e7eda400-59b6-4733-9c21-d869ecb1bd13\") " pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-j9cpt" May 27 21:41:27.711287 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:27.711196 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-j9cpt" May 27 21:41:27.898989 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:27.898958 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t5vz8/perf-node-gather-daemonset-j9cpt"] May 27 21:41:27.901798 ip-10-0-130-116 kubenswrapper[2566]: W0527 21:41:27.901765 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode7eda400_59b6_4733_9c21_d869ecb1bd13.slice/crio-1dd7a8961275e903603837baa34c97339c6fcbf15a55b78ae3376d664f4b781e WatchSource:0}: Error finding container 1dd7a8961275e903603837baa34c97339c6fcbf15a55b78ae3376d664f4b781e: Status 404 returned error can't find the container with id 1dd7a8961275e903603837baa34c97339c6fcbf15a55b78ae3376d664f4b781e May 27 21:41:27.983738 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:27.983653 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-xw8r7_8c01813f-aad3-4011-a23f-2e4e98cb4c26/download-server/0.log" May 27 21:41:28.338192 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:28.338143 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-j9cpt" event={"ID":"e7eda400-59b6-4733-9c21-d869ecb1bd13","Type":"ContainerStarted","Data":"f2f6e1860d2ed1483d39298570715d74bdce744d242b147abb47af369cc8db3d"} May 27 21:41:28.338192 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:28.338193 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-j9cpt" event={"ID":"e7eda400-59b6-4733-9c21-d869ecb1bd13","Type":"ContainerStarted","Data":"1dd7a8961275e903603837baa34c97339c6fcbf15a55b78ae3376d664f4b781e"} May 27 21:41:28.338452 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:28.338213 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-j9cpt" May 27 21:41:28.359045 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:28.358970 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-j9cpt" podStartSLOduration=1.358950143 podStartE2EDuration="1.358950143s" podCreationTimestamp="2026-05-27 21:41:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:41:28.354437262 +0000 UTC m=+2112.973823050" watchObservedRunningTime="2026-05-27 21:41:28.358950143 +0000 UTC m=+2112.978335930" May 27 21:41:28.486326 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:28.486292 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-cjclm_e6ac89f5-855d-4800-ab27-5f75d8d2d32f/volume-data-source-validator/0.log" May 27 21:41:29.350697 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:29.350665 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n4mw8_ac701952-aba5-4b19-8037-2e1b598413ce/dns/0.log" May 27 21:41:29.371447 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:29.371423 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n4mw8_ac701952-aba5-4b19-8037-2e1b598413ce/kube-rbac-proxy/0.log" May 27 21:41:29.464743 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:29.464717 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-d722x_bb5828e9-6222-41c1-9586-5105d4c9d1f3/dns-node-resolver/0.log" May 27 21:41:29.983018 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:29.982989 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-22zqb_cab49327-f463-431f-b649-e6065ef8df95/node-ca/0.log" May 27 21:41:31.082950 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:31.082924 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f6f4b4c58-r4l95_bfc0d2b1-a730-418b-a864-44717d9d89d9/kube-auth-proxy/0.log" May 27 21:41:31.739942 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:31.739911 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j2sdl_5908789d-9a0e-402a-af5b-9cece18e09cb/serve-healthcheck-canary/0.log" May 27 21:41:32.232091 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:32.232063 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-vq5t6_ec6a5a07-1a2d-4f45-8146-ba0d534d28ea/insights-operator/0.log" May 27 21:41:32.232648 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:32.232623 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-vq5t6_ec6a5a07-1a2d-4f45-8146-ba0d534d28ea/insights-operator/1.log" May 27 21:41:32.447602 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:32.447561 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t6s72_fc474e67-135e-4c91-856e-afec7398384e/kube-rbac-proxy/0.log" May 27 21:41:32.469068 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:32.469040 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t6s72_fc474e67-135e-4c91-856e-afec7398384e/exporter/0.log" May 27 21:41:32.491193 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:32.491119 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t6s72_fc474e67-135e-4c91-856e-afec7398384e/extractor/0.log" May 27 21:41:34.352650 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:34.352614 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-t5vz8/perf-node-gather-daemonset-j9cpt" May 27 21:41:34.459657 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:34.459632 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29665290-mf4mz_de1793e7-46d9-4f46-b5b7-570e4b8d4612/cleanup/0.log" May 27 21:41:34.693117 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:34.693016 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6678cd66dc-s89mh_932e2f7f-e490-43ef-9062-5c0fce6edd85/manager/0.log" May 27 21:41:35.948747 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:35.948717 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-dddbcdc66-7qzcg_201d3b42-a8b0-475b-acff-f1861e87de08/manager/0.log" May 27 21:41:40.701212 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:40.701156 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-rrcjv_e52f464a-d258-43ed-8f4f-9605f15b3c4f/migrator/0.log" May 27 21:41:40.723200 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:40.723174 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-rrcjv_e52f464a-d258-43ed-8f4f-9605f15b3c4f/graceful-termination/0.log" May 27 21:41:41.144397 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:41.144365 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-wwsch_d33788ba-035e-4978-ac0a-88f2777a3401/kube-storage-version-migrator-operator/1.log" May 27 21:41:41.145358 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:41.145338 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-wwsch_d33788ba-035e-4978-ac0a-88f2777a3401/kube-storage-version-migrator-operator/0.log" May 27 21:41:42.313438 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:42.313412 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ct8th_924d6e9e-49fd-44b8-9c8c-bc859c8e05cd/kube-multus-additional-cni-plugins/0.log" May 27 21:41:42.338423 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:42.338390 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ct8th_924d6e9e-49fd-44b8-9c8c-bc859c8e05cd/egress-router-binary-copy/0.log" May 27 21:41:42.359470 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:42.359440 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ct8th_924d6e9e-49fd-44b8-9c8c-bc859c8e05cd/cni-plugins/0.log" May 27 21:41:42.382151 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:42.382119 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ct8th_924d6e9e-49fd-44b8-9c8c-bc859c8e05cd/bond-cni-plugin/0.log" May 27 21:41:42.403003 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:42.402969 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ct8th_924d6e9e-49fd-44b8-9c8c-bc859c8e05cd/routeoverride-cni/0.log" May 27 21:41:42.423733 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:42.423704 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ct8th_924d6e9e-49fd-44b8-9c8c-bc859c8e05cd/whereabouts-cni-bincopy/0.log" May 27 21:41:42.446576 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:42.446546 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ct8th_924d6e9e-49fd-44b8-9c8c-bc859c8e05cd/whereabouts-cni/0.log" May 27 21:41:42.641174 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:42.641096 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-f577f_6c5de23b-1792-4e5c-86a5-b2964c551b92/kube-multus/0.log" May 27 21:41:42.741246 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:42.741218 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-b7dq5_5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1/network-metrics-daemon/0.log" May 27 21:41:42.762470 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:42.762445 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-b7dq5_5961a7fc-d8b0-43e5-9b3f-f007a3b0baf1/kube-rbac-proxy/0.log" May 27 21:41:43.668063 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:43.668012 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7tlfn_650f3617-9cba-4404-b65b-8d6a46ab3604/ovn-controller/0.log" May 27 21:41:43.695663 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:43.695631 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7tlfn_650f3617-9cba-4404-b65b-8d6a46ab3604/ovn-acl-logging/0.log" May 27 21:41:43.714651 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:43.714617 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7tlfn_650f3617-9cba-4404-b65b-8d6a46ab3604/kube-rbac-proxy-node/0.log" May 27 21:41:43.737978 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:43.737950 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7tlfn_650f3617-9cba-4404-b65b-8d6a46ab3604/kube-rbac-proxy-ovn-metrics/0.log" May 27 21:41:43.756230 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:43.756199 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7tlfn_650f3617-9cba-4404-b65b-8d6a46ab3604/northd/0.log" May 27 21:41:43.777789 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:43.777761 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7tlfn_650f3617-9cba-4404-b65b-8d6a46ab3604/nbdb/0.log" May 27 21:41:43.800604 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:43.800573 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7tlfn_650f3617-9cba-4404-b65b-8d6a46ab3604/sbdb/0.log" May 27 21:41:43.933885 ip-10-0-130-116 kubenswrapper[2566]: I0527 21:41:43.933809 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7tlfn_650f3617-9cba-4404-b65b-8d6a46ab3604/ovnkube-controller/0.log"