May 29 17:29:27.277775 ip-10-0-128-221 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 29 17:29:27.277786 ip-10-0-128-221 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 29 17:29:27.277793 ip-10-0-128-221 systemd[1]: kubelet.service: Failed with result 'resources'. May 29 17:29:27.278026 ip-10-0-128-221 systemd[1]: Failed to start Kubernetes Kubelet. May 29 17:29:37.412878 ip-10-0-128-221 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 29 17:29:37.412897 ip-10-0-128-221 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot b308a98664d3411c8584982726f98e62 -- May 29 17:31:45.589022 ip-10-0-128-221 systemd[1]: Starting Kubernetes Kubelet... May 29 17:31:46.113832 ip-10-0-128-221 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 29 17:31:46.113832 ip-10-0-128-221 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 29 17:31:46.113832 ip-10-0-128-221 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 29 17:31:46.113832 ip-10-0-128-221 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 29 17:31:46.113832 ip-10-0-128-221 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 29 17:31:46.115608 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.115518 2567 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 29 17:31:46.118306 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118290 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 17:31:46.118343 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118308 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 17:31:46.118343 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118312 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 17:31:46.118343 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118315 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 17:31:46.118343 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118318 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 17:31:46.118343 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118321 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 17:31:46.118343 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118337 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 17:31:46.118343 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118340 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 17:31:46.118343 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118343 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 17:31:46.118343 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118346 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 17:31:46.118343 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118349 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 17:31:46.118580 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118351 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 17:31:46.118580 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118354 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 17:31:46.118580 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118357 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 17:31:46.118580 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118359 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 17:31:46.118580 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118361 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 17:31:46.118580 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118364 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 17:31:46.118580 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118366 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 17:31:46.118580 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118369 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 17:31:46.118580 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118372 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 17:31:46.118580 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118374 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 17:31:46.118580 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118377 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 17:31:46.118580 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118379 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 17:31:46.118580 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118382 2567 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 17:31:46.118580 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118384 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 17:31:46.118580 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118387 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 17:31:46.118580 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118390 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 17:31:46.118580 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118392 2567 feature_gate.go:328] unrecognized feature gate: Example May 29 17:31:46.118580 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118395 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 17:31:46.118580 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118397 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 17:31:46.118580 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118400 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 17:31:46.119111 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118402 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 17:31:46.119111 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118407 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 17:31:46.119111 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118410 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 17:31:46.119111 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118413 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 17:31:46.119111 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118416 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 17:31:46.119111 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118418 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 17:31:46.119111 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118422 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 17:31:46.119111 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118424 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 17:31:46.119111 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118427 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 17:31:46.119111 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118429 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 17:31:46.119111 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118432 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 17:31:46.119111 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118435 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 17:31:46.119111 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118438 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 17:31:46.119111 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118442 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 17:31:46.119111 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118444 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 17:31:46.119111 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118447 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 17:31:46.119111 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118449 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 17:31:46.119111 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118452 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 17:31:46.119111 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118455 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 17:31:46.119577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118457 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 17:31:46.119577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118460 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 17:31:46.119577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118462 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 17:31:46.119577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118465 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 17:31:46.119577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118467 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 17:31:46.119577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118470 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 17:31:46.119577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118472 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 17:31:46.119577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118475 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 17:31:46.119577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118477 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 17:31:46.119577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118480 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 17:31:46.119577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118482 2567 feature_gate.go:328] unrecognized feature gate: Example2 May 29 17:31:46.119577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118486 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 17:31:46.119577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118489 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 17:31:46.119577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118491 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 17:31:46.119577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118494 2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 17:31:46.119577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118496 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 17:31:46.119577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118498 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 17:31:46.119577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118501 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 17:31:46.119577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118503 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 17:31:46.119577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118506 2567 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 17:31:46.120077 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118509 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 17:31:46.120077 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118511 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 17:31:46.120077 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118514 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 17:31:46.120077 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118517 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 17:31:46.120077 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118520 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 17:31:46.120077 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118523 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 17:31:46.120077 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118527 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 17:31:46.120077 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118530 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 17:31:46.120077 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118533 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 17:31:46.120077 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118535 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 17:31:46.120077 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118538 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 17:31:46.120077 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118541 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 17:31:46.120077 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118543 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 17:31:46.120077 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118546 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 17:31:46.120077 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118549 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 17:31:46.120077 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118551 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 17:31:46.120077 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118958 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 17:31:46.120077 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118964 2567 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 17:31:46.120077 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118967 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 17:31:46.120077 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118970 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 17:31:46.120562 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118974 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 17:31:46.120562 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118977 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 17:31:46.120562 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118980 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 17:31:46.120562 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118983 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 17:31:46.120562 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118985 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 17:31:46.120562 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118988 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 17:31:46.120562 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118991 2567 feature_gate.go:328] unrecognized feature gate: Example2 May 29 17:31:46.120562 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118993 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 17:31:46.120562 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118996 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 17:31:46.120562 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.118999 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 17:31:46.120562 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119002 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 17:31:46.120562 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119004 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 17:31:46.120562 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119007 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 17:31:46.120562 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119010 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 17:31:46.120562 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119013 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 17:31:46.120562 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119016 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 17:31:46.120562 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119018 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 17:31:46.120562 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119021 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 17:31:46.120562 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119025 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 17:31:46.121035 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119027 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 17:31:46.121035 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119030 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 17:31:46.121035 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119032 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 17:31:46.121035 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119035 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 17:31:46.121035 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119037 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 17:31:46.121035 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119040 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 17:31:46.121035 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119042 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 17:31:46.121035 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119045 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 17:31:46.121035 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119047 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 17:31:46.121035 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119050 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 17:31:46.121035 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119052 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 17:31:46.121035 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119055 2567 feature_gate.go:328] unrecognized feature gate: Example May 29 17:31:46.121035 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119058 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 17:31:46.121035 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119060 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 17:31:46.121035 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119063 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 17:31:46.121035 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119066 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 17:31:46.121035 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119069 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 17:31:46.121035 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119071 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 17:31:46.121035 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119074 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 17:31:46.121035 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119076 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 17:31:46.121876 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119079 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 17:31:46.121876 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119081 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 17:31:46.121876 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119084 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 17:31:46.121876 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119087 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 17:31:46.121876 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119090 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 17:31:46.121876 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119092 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 17:31:46.121876 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119094 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 17:31:46.121876 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119097 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 17:31:46.121876 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119102 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 17:31:46.121876 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119105 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 17:31:46.121876 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119108 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 17:31:46.121876 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119111 2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 17:31:46.121876 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119114 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 17:31:46.121876 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119118 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 17:31:46.121876 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119121 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 17:31:46.121876 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119123 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 17:31:46.121876 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119126 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 17:31:46.121876 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119128 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 17:31:46.121876 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119131 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 17:31:46.122350 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119133 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 17:31:46.122350 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119136 2567 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 17:31:46.122350 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119139 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 17:31:46.122350 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119141 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 17:31:46.122350 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119144 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 17:31:46.122350 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119146 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 17:31:46.122350 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119149 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 17:31:46.122350 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119151 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 17:31:46.122350 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119154 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 17:31:46.122350 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119156 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 17:31:46.122350 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119159 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 17:31:46.122350 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119162 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 17:31:46.122350 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119165 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 17:31:46.122350 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119167 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 17:31:46.122350 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119170 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 17:31:46.122350 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119172 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 17:31:46.122350 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119175 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 17:31:46.122350 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119177 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 17:31:46.122350 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119179 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 17:31:46.122833 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119182 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 17:31:46.122833 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119184 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 17:31:46.122833 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119187 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 17:31:46.122833 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119190 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 17:31:46.122833 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.119192 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 17:31:46.122833 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120739 2567 flags.go:64] FLAG: --address="0.0.0.0" May 29 17:31:46.122833 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120750 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 29 17:31:46.122833 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120757 2567 flags.go:64] FLAG: --anonymous-auth="true" May 29 17:31:46.122833 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120762 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" May 29 17:31:46.122833 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120766 2567 flags.go:64] FLAG: --authentication-token-webhook="false" May 29 17:31:46.122833 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120769 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 29 17:31:46.122833 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120774 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 29 17:31:46.122833 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120778 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 29 17:31:46.122833 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120782 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 29 17:31:46.122833 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120786 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 29 17:31:46.122833 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120789 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 29 17:31:46.122833 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120793 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 29 17:31:46.122833 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120796 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 29 17:31:46.122833 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120799 2567 flags.go:64] FLAG: --cgroup-root="" May 29 17:31:46.122833 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120802 2567 flags.go:64] FLAG: --cgroups-per-qos="true" May 29 17:31:46.122833 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120805 2567 flags.go:64] FLAG: --client-ca-file="" May 29 17:31:46.122833 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120808 2567 flags.go:64] FLAG: --cloud-config="" May 29 17:31:46.122833 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120811 2567 flags.go:64] FLAG: --cloud-provider="external" May 29 17:31:46.123397 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120814 2567 flags.go:64] FLAG: --cluster-dns="[]" May 29 17:31:46.123397 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120820 2567 flags.go:64] FLAG: --cluster-domain="" May 29 17:31:46.123397 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120823 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 29 17:31:46.123397 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120826 2567 flags.go:64] FLAG: --config-dir="" May 29 17:31:46.123397 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120829 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 29 17:31:46.123397 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120833 2567 flags.go:64] FLAG: --container-log-max-files="5" May 29 17:31:46.123397 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120837 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" May 29 17:31:46.123397 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120841 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 29 17:31:46.123397 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120844 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 29 17:31:46.123397 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120847 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 29 17:31:46.123397 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120850 2567 flags.go:64] FLAG: --contention-profiling="false" May 29 17:31:46.123397 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120853 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" May 29 17:31:46.123397 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120856 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 29 17:31:46.123397 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120907 2567 flags.go:64] FLAG: --cpu-manager-policy="none" May 29 17:31:46.123397 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120955 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" May 29 17:31:46.123397 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120961 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 29 17:31:46.123397 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120965 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 29 17:31:46.123397 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120969 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" May 29 17:31:46.123397 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120972 2567 flags.go:64] FLAG: --enable-load-reader="false" May 29 17:31:46.123397 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120976 2567 flags.go:64] FLAG: --enable-server="true" May 29 17:31:46.123397 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120979 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 29 17:31:46.123397 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120984 2567 flags.go:64] FLAG: --event-burst="100" May 29 17:31:46.123397 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120988 2567 flags.go:64] FLAG: --event-qps="50" May 29 17:31:46.123397 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.120996 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 29 17:31:46.123397 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.121001 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 29 17:31:46.124097 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.121006 2567 flags.go:64] FLAG: --eviction-hard="" May 29 17:31:46.124097 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.121013 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 29 17:31:46.124097 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.121018 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 29 17:31:46.124097 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.121023 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 29 17:31:46.124097 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.121029 2567 flags.go:64] FLAG: --eviction-soft="" May 29 17:31:46.124316 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124301 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" May 29 17:31:46.124316 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124314 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" May 29 17:31:46.124396 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124319 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 29 17:31:46.124396 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124323 2567 flags.go:64] FLAG: --experimental-mounter-path="" May 29 17:31:46.124396 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124327 2567 flags.go:64] FLAG: --fail-cgroupv1="false" May 29 17:31:46.124396 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124331 2567 flags.go:64] FLAG: --fail-swap-on="true" May 29 17:31:46.124396 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124335 2567 flags.go:64] FLAG: --feature-gates="" May 29 17:31:46.124396 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124343 2567 flags.go:64] FLAG: --file-check-frequency="20s" May 29 17:31:46.124396 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124349 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 29 17:31:46.124396 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124360 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 29 17:31:46.124396 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124365 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 29 17:31:46.124396 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124371 2567 flags.go:64] FLAG: --healthz-port="10248" May 29 17:31:46.124396 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124376 2567 flags.go:64] FLAG: --help="false" May 29 17:31:46.124396 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124381 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-128-221.ec2.internal" May 29 17:31:46.124396 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124387 2567 flags.go:64] FLAG: --housekeeping-interval="10s" May 29 17:31:46.124396 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124392 2567 flags.go:64] FLAG: --http-check-frequency="20s" May 29 17:31:46.124781 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124409 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 29 17:31:46.124781 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124419 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 29 17:31:46.124781 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124425 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" May 29 17:31:46.124781 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124430 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" May 29 17:31:46.124781 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124435 2567 flags.go:64] FLAG: --image-service-endpoint="" May 29 17:31:46.124781 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124439 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" May 29 17:31:46.124781 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124445 2567 flags.go:64] FLAG: --kube-api-burst="100" May 29 17:31:46.124781 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124450 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 29 17:31:46.124781 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124454 2567 flags.go:64] FLAG: --kube-api-qps="50" May 29 17:31:46.124781 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124457 2567 flags.go:64] FLAG: --kube-reserved="" May 29 17:31:46.124781 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124463 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" May 29 17:31:46.124781 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124466 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 29 17:31:46.124781 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124470 2567 flags.go:64] FLAG: --kubelet-cgroups="" May 29 17:31:46.124781 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124506 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 29 17:31:46.124781 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124649 2567 flags.go:64] FLAG: --lock-file="" May 29 17:31:46.124781 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124657 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" May 29 17:31:46.124781 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124662 2567 flags.go:64] FLAG: --log-flush-frequency="5s" May 29 17:31:46.124781 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124666 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 29 17:31:46.124781 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124674 2567 flags.go:64] FLAG: --log-json-split-stream="false" May 29 17:31:46.124781 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124677 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 29 17:31:46.124781 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124681 2567 flags.go:64] FLAG: --log-text-split-stream="false" May 29 17:31:46.124781 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124684 2567 flags.go:64] FLAG: --logging-format="text" May 29 17:31:46.124781 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124687 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 29 17:31:46.125346 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124692 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" May 29 17:31:46.125346 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124695 2567 flags.go:64] FLAG: --manifest-url="" May 29 17:31:46.125346 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124698 2567 flags.go:64] FLAG: --manifest-url-header="" May 29 17:31:46.125346 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124704 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 29 17:31:46.125346 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124708 2567 flags.go:64] FLAG: --max-open-files="1000000" May 29 17:31:46.125346 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124712 2567 flags.go:64] FLAG: --max-pods="110" May 29 17:31:46.125346 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124716 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" May 29 17:31:46.125346 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124719 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 29 17:31:46.125346 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124733 2567 flags.go:64] FLAG: --memory-manager-policy="None" May 29 17:31:46.125346 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124736 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 29 17:31:46.125346 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124741 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 29 17:31:46.125346 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124744 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" May 29 17:31:46.125346 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124747 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 29 17:31:46.125346 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124756 2567 flags.go:64] FLAG: --node-status-max-images="50" May 29 17:31:46.125346 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124760 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" May 29 17:31:46.125346 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124763 2567 flags.go:64] FLAG: --oom-score-adj="-999" May 29 17:31:46.125346 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124766 2567 flags.go:64] FLAG: --pod-cidr="" May 29 17:31:46.125346 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124769 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" May 29 17:31:46.125346 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124776 2567 flags.go:64] FLAG: --pod-manifest-path="" May 29 17:31:46.125346 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124779 2567 flags.go:64] FLAG: --pod-max-pids="-1" May 29 17:31:46.125346 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124782 2567 flags.go:64] FLAG: --pods-per-core="0" May 29 17:31:46.125346 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124786 2567 flags.go:64] FLAG: --port="10250" May 29 17:31:46.125346 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124789 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" May 29 17:31:46.125346 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124793 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0087332addf2efcc8" May 29 17:31:46.125941 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124797 2567 flags.go:64] FLAG: --qos-reserved="" May 29 17:31:46.125941 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124800 2567 flags.go:64] FLAG: --read-only-port="10255" May 29 17:31:46.125941 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124803 2567 flags.go:64] FLAG: --register-node="true" May 29 17:31:46.125941 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124807 2567 flags.go:64] FLAG: --register-schedulable="true" May 29 17:31:46.125941 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124810 2567 flags.go:64] FLAG: --register-with-taints="" May 29 17:31:46.125941 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124814 2567 flags.go:64] FLAG: --registry-burst="10" May 29 17:31:46.125941 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124817 2567 flags.go:64] FLAG: --registry-qps="5" May 29 17:31:46.125941 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124820 2567 flags.go:64] FLAG: --reserved-cpus="" May 29 17:31:46.125941 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124823 2567 flags.go:64] FLAG: --reserved-memory="" May 29 17:31:46.125941 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124828 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 29 17:31:46.125941 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124831 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 29 17:31:46.125941 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124834 2567 flags.go:64] FLAG: --rotate-certificates="false" May 29 17:31:46.125941 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124838 2567 flags.go:64] FLAG: --rotate-server-certificates="false" May 29 17:31:46.125941 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124841 2567 flags.go:64] FLAG: --runonce="false" May 29 17:31:46.125941 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124844 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 29 17:31:46.125941 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124847 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 29 17:31:46.125941 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124850 2567 flags.go:64] FLAG: --seccomp-default="false" May 29 17:31:46.125941 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124853 2567 flags.go:64] FLAG: --serialize-image-pulls="true" May 29 17:31:46.125941 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124856 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 29 17:31:46.125941 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124859 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 29 17:31:46.125941 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124862 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 29 17:31:46.125941 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124865 2567 flags.go:64] FLAG: --storage-driver-password="root" May 29 17:31:46.125941 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124868 2567 flags.go:64] FLAG: --storage-driver-secure="false" May 29 17:31:46.125941 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124871 2567 flags.go:64] FLAG: --storage-driver-table="stats" May 29 17:31:46.125941 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124874 2567 flags.go:64] FLAG: --storage-driver-user="root" May 29 17:31:46.125941 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124877 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 29 17:31:46.126570 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124880 2567 flags.go:64] FLAG: --sync-frequency="1m0s" May 29 17:31:46.126570 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124884 2567 flags.go:64] FLAG: --system-cgroups="" May 29 17:31:46.126570 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124886 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 29 17:31:46.126570 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124892 2567 flags.go:64] FLAG: --system-reserved-cgroup="" May 29 17:31:46.126570 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124896 2567 flags.go:64] FLAG: --tls-cert-file="" May 29 17:31:46.126570 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124908 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" May 29 17:31:46.126570 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124914 2567 flags.go:64] FLAG: --tls-min-version="" May 29 17:31:46.126570 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124917 2567 flags.go:64] FLAG: --tls-private-key-file="" May 29 17:31:46.126570 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124921 2567 flags.go:64] FLAG: --topology-manager-policy="none" May 29 17:31:46.126570 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124924 2567 flags.go:64] FLAG: --topology-manager-policy-options="" May 29 17:31:46.126570 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124927 2567 flags.go:64] FLAG: --topology-manager-scope="container" May 29 17:31:46.126570 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124930 2567 flags.go:64] FLAG: --v="2" May 29 17:31:46.126570 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124934 2567 flags.go:64] FLAG: --version="false" May 29 17:31:46.126570 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124939 2567 flags.go:64] FLAG: --vmodule="" May 29 17:31:46.126570 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124943 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 29 17:31:46.126570 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.124947 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 29 17:31:46.126570 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.125940 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 17:31:46.126570 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.125947 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 17:31:46.126570 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.125951 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 17:31:46.126570 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.125956 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 17:31:46.126570 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.125959 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 17:31:46.126570 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.125962 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 17:31:46.126570 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.125965 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 17:31:46.127138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.125968 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 17:31:46.127138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.125971 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 17:31:46.127138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.125974 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 17:31:46.127138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.125976 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 17:31:46.127138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.125981 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 17:31:46.127138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.125985 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 17:31:46.127138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.125988 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 17:31:46.127138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.125991 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 17:31:46.127138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.125994 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 17:31:46.127138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.125997 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 17:31:46.127138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126000 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 17:31:46.127138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126004 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 17:31:46.127138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126007 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 17:31:46.127138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126010 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 17:31:46.127138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126013 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 17:31:46.127138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126017 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 17:31:46.127138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126020 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 17:31:46.127138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126023 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 17:31:46.127138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126026 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 17:31:46.127619 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126029 2567 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 17:31:46.127619 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126031 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 17:31:46.127619 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126034 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 17:31:46.127619 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126037 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 17:31:46.127619 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126040 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 17:31:46.127619 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126043 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 17:31:46.127619 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126046 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 17:31:46.127619 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126049 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 17:31:46.127619 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126052 2567 feature_gate.go:328] unrecognized feature gate: Example2 May 29 17:31:46.127619 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126055 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 17:31:46.127619 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126057 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 17:31:46.127619 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126060 2567 feature_gate.go:328] unrecognized feature gate: Example May 29 17:31:46.127619 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126063 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 17:31:46.127619 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126065 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 17:31:46.127619 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126068 2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 17:31:46.127619 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126071 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 17:31:46.127619 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126073 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 17:31:46.127619 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126076 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 17:31:46.127619 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126078 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 17:31:46.127619 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126081 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 17:31:46.128138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126083 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 17:31:46.128138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126086 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 17:31:46.128138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126089 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 17:31:46.128138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126091 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 17:31:46.128138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126094 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 17:31:46.128138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126096 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 17:31:46.128138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126100 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 17:31:46.128138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126102 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 17:31:46.128138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126105 2567 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 17:31:46.128138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126111 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 17:31:46.128138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126114 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 17:31:46.128138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126117 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 17:31:46.128138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126119 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 17:31:46.128138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126122 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 17:31:46.128138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126124 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 17:31:46.128138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126127 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 17:31:46.128138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126129 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 17:31:46.128138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126132 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 17:31:46.128138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126134 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 17:31:46.128138 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126137 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 17:31:46.128626 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126140 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 17:31:46.128626 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126143 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 17:31:46.128626 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126145 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 17:31:46.128626 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126148 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 17:31:46.128626 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126150 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 17:31:46.128626 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126153 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 17:31:46.128626 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126156 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 17:31:46.128626 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126159 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 17:31:46.128626 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126161 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 17:31:46.128626 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126164 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 17:31:46.128626 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126166 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 17:31:46.128626 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126169 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 17:31:46.128626 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126172 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 17:31:46.128626 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126174 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 17:31:46.128626 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126177 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 17:31:46.128626 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126179 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 17:31:46.128626 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126182 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 17:31:46.128626 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126186 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 17:31:46.128626 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126190 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 17:31:46.128626 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.126193 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 17:31:46.129152 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.126967 2567 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 29 17:31:46.133617 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.133591 2567 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" May 29 17:31:46.133617 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.133616 2567 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 29 17:31:46.133705 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133668 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 17:31:46.133705 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133674 2567 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 17:31:46.133705 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133677 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 17:31:46.133705 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133680 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 17:31:46.133705 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133683 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 17:31:46.133705 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133686 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 17:31:46.133705 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133689 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 17:31:46.133705 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133692 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 17:31:46.133705 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133695 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 17:31:46.133705 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133697 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 17:31:46.133705 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133700 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 17:31:46.133705 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133702 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 17:31:46.133705 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133706 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 17:31:46.133705 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133708 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 17:31:46.133705 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133712 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 17:31:46.134095 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133714 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 17:31:46.134095 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133717 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 17:31:46.134095 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133735 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 17:31:46.134095 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133739 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 17:31:46.134095 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133742 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 17:31:46.134095 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133745 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 17:31:46.134095 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133748 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 17:31:46.134095 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133751 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 17:31:46.134095 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133753 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 17:31:46.134095 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133756 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 17:31:46.134095 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133759 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 17:31:46.134095 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133761 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 17:31:46.134095 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133764 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 17:31:46.134095 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133767 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 17:31:46.134095 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133769 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 17:31:46.134095 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133773 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 17:31:46.134095 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133778 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 17:31:46.134095 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133781 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 17:31:46.134095 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133784 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 17:31:46.134577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133787 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 17:31:46.134577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133789 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 17:31:46.134577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133792 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 17:31:46.134577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133794 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 17:31:46.134577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133797 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 17:31:46.134577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133800 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 17:31:46.134577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133802 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 17:31:46.134577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133805 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 17:31:46.134577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133807 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 17:31:46.134577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133810 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 17:31:46.134577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133812 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 17:31:46.134577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133815 2567 feature_gate.go:328] unrecognized feature gate: Example2 May 29 17:31:46.134577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133818 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 17:31:46.134577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133820 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 17:31:46.134577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133824 2567 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 17:31:46.134577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133827 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 17:31:46.134577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133829 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 17:31:46.134577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133832 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 17:31:46.134577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133834 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 17:31:46.134577 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133837 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 17:31:46.135114 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133840 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 17:31:46.135114 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133842 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 17:31:46.135114 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133844 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 17:31:46.135114 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133847 2567 feature_gate.go:328] unrecognized feature gate: Example May 29 17:31:46.135114 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133850 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 17:31:46.135114 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133852 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 17:31:46.135114 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133855 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 17:31:46.135114 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133858 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 17:31:46.135114 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133861 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 17:31:46.135114 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133864 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 17:31:46.135114 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133867 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 17:31:46.135114 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133870 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 17:31:46.135114 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133872 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 17:31:46.135114 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133875 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 17:31:46.135114 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133879 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 17:31:46.135114 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133883 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 17:31:46.135114 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133886 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 17:31:46.135114 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133889 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 17:31:46.135114 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133892 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 17:31:46.135114 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133895 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 17:31:46.135616 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133898 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 17:31:46.135616 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133901 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 17:31:46.135616 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133903 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 17:31:46.135616 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133906 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 17:31:46.135616 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133909 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 17:31:46.135616 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133911 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 17:31:46.135616 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133914 2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 17:31:46.135616 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133917 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 17:31:46.135616 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133920 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 17:31:46.135616 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133923 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 17:31:46.135616 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133925 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 17:31:46.135616 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.133928 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 17:31:46.135616 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.133933 2567 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 29 17:31:46.135616 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134061 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 17:31:46.135616 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134066 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 17:31:46.136017 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134069 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 17:31:46.136017 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134072 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 17:31:46.136017 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134075 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 17:31:46.136017 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134078 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 17:31:46.136017 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134081 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 17:31:46.136017 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134084 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 17:31:46.136017 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134087 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 17:31:46.136017 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134089 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 17:31:46.136017 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134092 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 17:31:46.136017 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134095 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 17:31:46.136017 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134098 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 17:31:46.136017 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134100 2567 feature_gate.go:328] unrecognized feature gate: Example2 May 29 17:31:46.136017 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134104 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 17:31:46.136017 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134108 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 17:31:46.136017 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134111 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 17:31:46.136017 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134114 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 17:31:46.136017 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134117 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 17:31:46.136017 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134119 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 17:31:46.136017 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134122 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 17:31:46.136477 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134124 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 17:31:46.136477 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134126 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 17:31:46.136477 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134129 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 17:31:46.136477 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134131 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 17:31:46.136477 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134134 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 17:31:46.136477 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134137 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 17:31:46.136477 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134139 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 17:31:46.136477 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134142 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 17:31:46.136477 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134145 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 17:31:46.136477 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134147 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 17:31:46.136477 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134150 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 17:31:46.136477 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134152 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 17:31:46.136477 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134154 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 17:31:46.136477 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134157 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 17:31:46.136477 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134160 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 17:31:46.136477 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134162 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 17:31:46.136477 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134165 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 17:31:46.136477 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134168 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 17:31:46.136477 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134170 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 17:31:46.136953 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134173 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 17:31:46.136953 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134175 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 17:31:46.136953 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134178 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 17:31:46.136953 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134182 2567 feature_gate.go:328] unrecognized feature gate: Example May 29 17:31:46.136953 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134185 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 17:31:46.136953 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134189 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 17:31:46.136953 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134192 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 17:31:46.136953 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134195 2567 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 17:31:46.136953 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134197 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 17:31:46.136953 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134200 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 17:31:46.136953 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134202 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 17:31:46.136953 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134205 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 17:31:46.136953 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134208 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 17:31:46.136953 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134210 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 17:31:46.136953 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134213 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 17:31:46.136953 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134215 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 17:31:46.136953 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134218 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 17:31:46.136953 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134220 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 17:31:46.136953 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134222 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 17:31:46.136953 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134225 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 17:31:46.137435 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134227 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 17:31:46.137435 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134230 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 17:31:46.137435 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134233 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 17:31:46.137435 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134235 2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 17:31:46.137435 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134238 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 17:31:46.137435 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134240 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 17:31:46.137435 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134243 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 17:31:46.137435 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134246 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 17:31:46.137435 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134248 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 17:31:46.137435 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134250 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 17:31:46.137435 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134253 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 17:31:46.137435 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134256 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 17:31:46.137435 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134258 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 17:31:46.137435 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134261 2567 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 17:31:46.137435 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134263 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 17:31:46.137435 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134266 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 17:31:46.137435 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134269 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 17:31:46.137435 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134272 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 17:31:46.137435 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134275 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 17:31:46.137435 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134278 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 17:31:46.137935 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134281 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 17:31:46.137935 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134283 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 17:31:46.137935 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134286 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 17:31:46.137935 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134288 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 17:31:46.137935 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134290 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 17:31:46.137935 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:46.134293 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 17:31:46.137935 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.134297 2567 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 29 17:31:46.137935 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.135278 2567 server.go:962] "Client rotation is on, will bootstrap in background" May 29 17:31:46.138750 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.138714 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 29 17:31:46.139940 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.139928 2567 server.go:1019] "Starting client certificate rotation" May 29 17:31:46.140039 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.140022 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 29 17:31:46.140074 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.140054 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 29 17:31:46.171629 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.171606 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 29 17:31:46.173468 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.173445 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 29 17:31:46.187010 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.186987 2567 log.go:25] "Validated CRI v1 runtime API" May 29 17:31:46.193230 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.193210 2567 log.go:25] "Validated CRI v1 image API" May 29 17:31:46.194590 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.194571 2567 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 29 17:31:46.199389 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.199367 2567 fs.go:135] Filesystem UUIDs: map[0fc3dc62-a1ae-4ef1-a32b-5d543c28064f:/dev/nvme0n1p3 52656b3d-e64a-4fde-a133-4265f668b35e:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] May 29 17:31:46.199455 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.199388 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 29 17:31:46.204144 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.204030 2567 manager.go:217] Machine: {Timestamp:2026-05-29 17:31:46.203498792 +0000 UTC m=+0.476726163 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101427 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a0c040e638cecf8c6f09dcb306d68 SystemUUID:ec2a0c04-0e63-8cec-f8c6-f09dcb306d68 BootID:b308a986-64d3-411c-8584-982726f98e62 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:7f:c9:81:9e:77 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:7f:c9:81:9e:77 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:82:fa:a1:d3:63:ff Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 29 17:31:46.204896 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.204885 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 29 17:31:46.205013 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.205000 2567 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 29 17:31:46.205376 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.205357 2567 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 29 17:31:46.207139 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.207108 2567 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 29 17:31:46.207276 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.207141 2567 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-221.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 29 17:31:46.207319 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.207286 2567 topology_manager.go:138] "Creating topology manager with none policy" May 29 17:31:46.207319 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.207294 2567 container_manager_linux.go:306] "Creating device plugin manager" May 29 17:31:46.207319 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.207301 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 29 17:31:46.208319 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.208308 2567 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 29 17:31:46.209891 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.209880 2567 state_mem.go:36] "Initialized new in-memory state store" May 29 17:31:46.210162 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.210153 2567 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 29 17:31:46.212908 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.212898 2567 kubelet.go:491] "Attempting to sync node with API server" May 29 17:31:46.212941 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.212911 2567 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 29 17:31:46.212941 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.212923 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 29 17:31:46.212941 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.212932 2567 kubelet.go:397] "Adding apiserver pod source" May 29 17:31:46.212941 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.212940 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 29 17:31:46.214357 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.214345 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 29 17:31:46.214405 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.214365 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 29 17:31:46.221052 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.221036 2567 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" May 29 17:31:46.222977 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.222964 2567 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 29 17:31:46.224352 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:46.224310 2567 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-221.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 29 17:31:46.224524 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:46.224496 2567 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 29 17:31:46.225445 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.225432 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 29 17:31:46.225506 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.225451 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 29 17:31:46.225506 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.225460 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 29 17:31:46.225506 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.225469 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 29 17:31:46.225506 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.225480 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 29 17:31:46.225506 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.225498 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 29 17:31:46.225506 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.225504 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 29 17:31:46.225654 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.225509 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 29 17:31:46.225654 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.225516 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 29 17:31:46.225654 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.225523 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 29 17:31:46.225654 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.225535 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 29 17:31:46.225654 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.225541 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 29 17:31:46.226709 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.226699 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 29 17:31:46.226709 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.226709 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 29 17:31:46.229910 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.229897 2567 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 29 17:31:46.229953 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.229932 2567 server.go:1295] "Started kubelet" May 29 17:31:46.230077 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.230021 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 29 17:31:46.230179 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.230063 2567 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 29 17:31:46.230179 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.230141 2567 server_v1.go:47] "podresources" method="list" useActivePods=true May 29 17:31:46.230769 ip-10-0-128-221 systemd[1]: Started Kubernetes Kubelet. May 29 17:31:46.233590 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.233566 2567 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 29 17:31:46.236391 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.236203 2567 server.go:317] "Adding debug handlers to kubelet server" May 29 17:31:46.239494 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.239472 2567 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-221.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 29 17:31:46.240424 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.240405 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 29 17:31:46.240796 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:46.240777 2567 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 29 17:31:46.241037 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.241021 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 29 17:31:46.241221 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.241203 2567 volume_manager.go:295] "The desired_state_of_world populator starts" May 29 17:31:46.241221 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.241222 2567 volume_manager.go:297] "Starting Kubelet Volume Manager" May 29 17:31:46.241360 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.241289 2567 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 29 17:31:46.241360 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.241343 2567 reconstruct.go:97] "Volume reconstruction finished" May 29 17:31:46.241360 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.241352 2567 reconciler.go:26] "Reconciler: start to sync state" May 29 17:31:46.241633 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.241612 2567 factory.go:55] Registering systemd factory May 29 17:31:46.241710 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.241662 2567 factory.go:223] Registration of the systemd container factory successfully May 29 17:31:46.241945 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.241932 2567 factory.go:153] Registering CRI-O factory May 29 17:31:46.241945 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.241947 2567 factory.go:223] Registration of the crio container factory successfully May 29 17:31:46.242057 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:46.241974 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-221.ec2.internal\" not found" May 29 17:31:46.242057 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.242039 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 29 17:31:46.242057 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.242055 2567 factory.go:103] Registering Raw factory May 29 17:31:46.242189 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.242069 2567 manager.go:1196] Started watching for new ooms in manager May 29 17:31:46.242390 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.242379 2567 manager.go:319] Starting recovery of all containers May 29 17:31:46.249661 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:46.249629 2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-221.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 29 17:31:46.249819 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:46.249708 2567 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 29 17:31:46.250264 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.250243 2567 manager.go:324] Recovery completed May 29 17:31:46.250888 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:46.249865 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-221.ec2.internal.18b4199b0010b863 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-221.ec2.internal,UID:ip-10-0-128-221.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-221.ec2.internal,},FirstTimestamp:2026-05-29 17:31:46.229909603 +0000 UTC m=+0.503136975,LastTimestamp:2026-05-29 17:31:46.229909603 +0000 UTC m=+0.503136975,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-221.ec2.internal,}" May 29 17:31:46.253280 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.253259 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zkk9n" May 29 17:31:46.255179 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.255167 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 17:31:46.257370 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.257355 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasSufficientMemory" May 29 17:31:46.257431 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.257388 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasNoDiskPressure" May 29 17:31:46.257431 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.257400 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasSufficientPID" May 29 17:31:46.257944 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.257926 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" May 29 17:31:46.257944 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.257944 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 29 17:31:46.258060 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.257963 2567 state_mem.go:36] "Initialized new in-memory state store" May 29 17:31:46.258419 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.258401 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zkk9n" May 29 17:31:46.259097 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:46.259034 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-221.ec2.internal.18b4199b01b3bf46 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-221.ec2.internal,UID:ip-10-0-128-221.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-221.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-221.ec2.internal,},FirstTimestamp:2026-05-29 17:31:46.25737095 +0000 UTC m=+0.530598324,LastTimestamp:2026-05-29 17:31:46.25737095 +0000 UTC m=+0.530598324,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-221.ec2.internal,}" May 29 17:31:46.261265 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.261242 2567 policy_none.go:49] "None policy: Start" May 29 17:31:46.261265 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.261268 2567 memory_manager.go:186] "Starting memorymanager" policy="None" May 29 17:31:46.261357 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.261279 2567 state_mem.go:35] "Initializing new in-memory state store" May 29 17:31:46.301372 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.301349 2567 manager.go:341] "Starting Device Plugin manager" May 29 17:31:46.321181 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:46.301401 2567 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 29 17:31:46.321181 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.301415 2567 server.go:85] "Starting device plugin registration server" May 29 17:31:46.321181 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.301662 2567 eviction_manager.go:189] "Eviction manager: starting control loop" May 29 17:31:46.321181 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.301672 2567 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 29 17:31:46.321181 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.301768 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 29 17:31:46.321181 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.301839 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 29 17:31:46.321181 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.301846 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 29 17:31:46.321181 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:46.302417 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 29 17:31:46.321181 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:46.302459 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-221.ec2.internal\" not found" May 29 17:31:46.321181 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.306491 2567 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 29 17:31:46.321181 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.307665 2567 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 29 17:31:46.321181 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.307688 2567 status_manager.go:230] "Starting to sync pod status with apiserver" May 29 17:31:46.321181 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.307707 2567 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 29 17:31:46.321181 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.307716 2567 kubelet.go:2451] "Starting kubelet main sync loop" May 29 17:31:46.321181 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:46.307776 2567 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 29 17:31:46.321181 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.312235 2567 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 29 17:31:46.402039 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.401942 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 17:31:46.402983 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.402967 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasSufficientMemory" May 29 17:31:46.403072 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.403011 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasNoDiskPressure" May 29 17:31:46.403072 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.403024 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasSufficientPID" May 29 17:31:46.403072 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.403050 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-221.ec2.internal" May 29 17:31:46.408135 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.408116 2567 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-221.ec2.internal"] May 29 17:31:46.408191 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.408182 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 17:31:46.408978 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.408964 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasSufficientMemory" May 29 17:31:46.409034 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.408990 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasNoDiskPressure" May 29 17:31:46.409034 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.409001 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasSufficientPID" May 29 17:31:46.411401 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.411390 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 17:31:46.411597 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.411580 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal" May 29 17:31:46.411659 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.411618 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 17:31:46.412119 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.412102 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasSufficientMemory" May 29 17:31:46.412209 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.412126 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasNoDiskPressure" May 29 17:31:46.412209 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.412105 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasSufficientMemory" May 29 17:31:46.412209 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.412138 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasSufficientPID" May 29 17:31:46.412209 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.412150 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasNoDiskPressure" May 29 17:31:46.412209 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.412160 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasSufficientPID" May 29 17:31:46.412807 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.412792 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-221.ec2.internal" May 29 17:31:46.412860 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:46.412811 2567 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-221.ec2.internal\": node \"ip-10-0-128-221.ec2.internal\" not found" May 29 17:31:46.414757 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.414743 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-221.ec2.internal" May 29 17:31:46.414826 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.414767 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 17:31:46.415373 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.415356 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasSufficientMemory" May 29 17:31:46.415464 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.415383 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasNoDiskPressure" May 29 17:31:46.415464 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.415395 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasSufficientPID" May 29 17:31:46.436397 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:46.436379 2567 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-221.ec2.internal\" not found" node="ip-10-0-128-221.ec2.internal" May 29 17:31:46.436622 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:46.436606 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-221.ec2.internal\" not found" May 29 17:31:46.440846 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:46.440830 2567 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-221.ec2.internal\" not found" node="ip-10-0-128-221.ec2.internal" May 29 17:31:46.536931 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:46.536895 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-221.ec2.internal\" not found" May 29 17:31:46.542152 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.542128 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f163f355a8c28c9c3dd29ffeb15632a3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal\" (UID: \"f163f355a8c28c9c3dd29ffeb15632a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal" May 29 17:31:46.542220 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.542160 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f163f355a8c28c9c3dd29ffeb15632a3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal\" (UID: \"f163f355a8c28c9c3dd29ffeb15632a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal" May 29 17:31:46.542220 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.542181 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4855e81ed8bee2be722afee434bf936b-config\") pod \"kube-apiserver-proxy-ip-10-0-128-221.ec2.internal\" (UID: \"4855e81ed8bee2be722afee434bf936b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-221.ec2.internal" May 29 17:31:46.637478 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:46.637439 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-221.ec2.internal\" not found" May 29 17:31:46.642767 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.642746 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f163f355a8c28c9c3dd29ffeb15632a3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal\" (UID: \"f163f355a8c28c9c3dd29ffeb15632a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal" May 29 17:31:46.642814 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.642777 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f163f355a8c28c9c3dd29ffeb15632a3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal\" (UID: \"f163f355a8c28c9c3dd29ffeb15632a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal" May 29 17:31:46.642814 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.642797 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4855e81ed8bee2be722afee434bf936b-config\") pod \"kube-apiserver-proxy-ip-10-0-128-221.ec2.internal\" (UID: \"4855e81ed8bee2be722afee434bf936b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-221.ec2.internal" May 29 17:31:46.642889 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.642853 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4855e81ed8bee2be722afee434bf936b-config\") pod \"kube-apiserver-proxy-ip-10-0-128-221.ec2.internal\" (UID: \"4855e81ed8bee2be722afee434bf936b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-221.ec2.internal" May 29 17:31:46.642889 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.642865 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f163f355a8c28c9c3dd29ffeb15632a3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal\" (UID: \"f163f355a8c28c9c3dd29ffeb15632a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal" May 29 17:31:46.642889 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.642853 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f163f355a8c28c9c3dd29ffeb15632a3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal\" (UID: \"f163f355a8c28c9c3dd29ffeb15632a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal" May 29 17:31:46.738258 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:46.738184 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-221.ec2.internal\" not found" May 29 17:31:46.740330 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.740312 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal" May 29 17:31:46.746676 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:46.746653 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-221.ec2.internal" May 29 17:31:46.838674 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:46.838628 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-221.ec2.internal\" not found" May 29 17:31:46.939136 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:46.939100 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-221.ec2.internal\" not found" May 29 17:31:47.039641 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:47.039560 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-221.ec2.internal\" not found" May 29 17:31:47.139112 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.139077 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 29 17:31:47.139899 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.139266 2567 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 29 17:31:47.140183 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:47.140154 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-221.ec2.internal\" not found" May 29 17:31:47.202881 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.202855 2567 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 29 17:31:47.213870 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.213844 2567 apiserver.go:52] "Watching apiserver" May 29 17:31:47.225992 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.225962 2567 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 29 17:31:47.226306 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.226282 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-r8mnd","kube-system/konnectivity-agent-ttrl9","openshift-cluster-node-tuning-operator/tuned-zlvq6","openshift-image-registry/node-ca-v8trn","openshift-multus/network-metrics-daemon-bcp7w","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzntn","openshift-dns/node-resolver-8lmqz","openshift-multus/multus-additional-cni-plugins-95w4p","openshift-multus/multus-jp89n","openshift-network-diagnostics/network-check-target-95vg5","openshift-network-operator/iptables-alerter-mfs9d","openshift-ovn-kubernetes/ovnkube-node-w49xp"] May 29 17:31:47.230291 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.230266 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8mnd" May 29 17:31:47.230435 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:47.230354 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8mnd" podUID="7ee27fe1-5b5c-469c-b841-914fb8f1eb48" May 29 17:31:47.231954 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.231933 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ttrl9" May 29 17:31:47.233472 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.233451 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.234450 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.234354 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6tc8s\"" May 29 17:31:47.234450 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.234431 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 29 17:31:47.234606 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.234462 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 29 17:31:47.235496 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.235467 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-r7vg8\"" May 29 17:31:47.235592 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.235509 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 29 17:31:47.235763 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.235747 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 29 17:31:47.236028 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.236010 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v8trn" May 29 17:31:47.237877 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.237851 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 29 17:31:47.238231 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.238208 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 29 17:31:47.238231 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.238227 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcp7w" May 29 17:31:47.238392 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.238290 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 29 17:31:47.238392 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:47.238321 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcp7w" podUID="d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49" May 29 17:31:47.238392 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.238334 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9vf8v\"" May 29 17:31:47.240129 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.240108 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzntn" May 29 17:31:47.240205 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.240165 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8lmqz" May 29 17:31:47.240502 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.240482 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 29 17:31:47.241279 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.241264 2567 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal" May 29 17:31:47.242318 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.242298 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-95w4p" May 29 17:31:47.244421 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.244293 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 29 17:31:47.244421 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.244305 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 29 17:31:47.244421 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.244317 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 29 17:31:47.244421 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.244323 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 29 17:31:47.244421 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.244335 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 29 17:31:47.244664 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.244455 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zpn7x\"" May 29 17:31:47.244707 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.244692 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-786jx\"" May 29 17:31:47.244814 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.244798 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jp89n" May 29 17:31:47.245291 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.245274 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 29 17:31:47.245518 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.245500 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 29 17:31:47.245620 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.245530 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f600c44-f078-461d-b75f-bac51676fd2d-cni-binary-copy\") pod \"multus-additional-cni-plugins-95w4p\" (UID: \"8f600c44-f078-461d-b75f-bac51676fd2d\") " pod="openshift-multus/multus-additional-cni-plugins-95w4p" May 29 17:31:47.245620 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.245543 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m9hv6\"" May 29 17:31:47.245620 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.245553 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 29 17:31:47.245620 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.245565 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 29 17:31:47.245620 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.245562 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsl4t\" (UniqueName: \"kubernetes.io/projected/8f600c44-f078-461d-b75f-bac51676fd2d-kube-api-access-fsl4t\") pod \"multus-additional-cni-plugins-95w4p\" (UID: \"8f600c44-f078-461d-b75f-bac51676fd2d\") " pod="openshift-multus/multus-additional-cni-plugins-95w4p" May 29 17:31:47.245872 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.245635 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsgx9\" (UniqueName: \"kubernetes.io/projected/09f1ad69-c9d7-4fbb-817a-af2956d532e8-kube-api-access-dsgx9\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.245872 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.245655 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6a6a5a92-9a66-4acb-86d8-7bd102357b41-registration-dir\") pod \"aws-ebs-csi-driver-node-mzntn\" (UID: \"6a6a5a92-9a66-4acb-86d8-7bd102357b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzntn" May 29 17:31:47.245872 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.245672 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7ee27fe1-5b5c-469c-b841-914fb8f1eb48-kubelet-config\") pod \"global-pull-secret-syncer-r8mnd\" (UID: \"7ee27fe1-5b5c-469c-b841-914fb8f1eb48\") " pod="kube-system/global-pull-secret-syncer-r8mnd" May 29 17:31:47.245872 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.245703 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8f600c44-f078-461d-b75f-bac51676fd2d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-95w4p\" (UID: \"8f600c44-f078-461d-b75f-bac51676fd2d\") " pod="openshift-multus/multus-additional-cni-plugins-95w4p" May 29 17:31:47.245872 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.245771 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/09f1ad69-c9d7-4fbb-817a-af2956d532e8-run\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.245872 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.245786 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/09f1ad69-c9d7-4fbb-817a-af2956d532e8-host\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.245872 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.245823 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/92b4d776-17cd-4b31-9dea-c4fb783ed515-serviceca\") pod \"node-ca-v8trn\" (UID: \"92b4d776-17cd-4b31-9dea-c4fb783ed515\") " pod="openshift-image-registry/node-ca-v8trn" May 29 17:31:47.245872 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.245866 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6a6a5a92-9a66-4acb-86d8-7bd102357b41-etc-selinux\") pod \"aws-ebs-csi-driver-node-mzntn\" (UID: \"6a6a5a92-9a66-4acb-86d8-7bd102357b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzntn" May 29 17:31:47.246217 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.245908 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkgpb\" (UniqueName: \"kubernetes.io/projected/6a6a5a92-9a66-4acb-86d8-7bd102357b41-kube-api-access-fkgpb\") pod \"aws-ebs-csi-driver-node-mzntn\" (UID: \"6a6a5a92-9a66-4acb-86d8-7bd102357b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzntn" May 29 17:31:47.246217 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.245939 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8743123a-c7a3-4dba-b656-622c9a23c6e6-hosts-file\") pod \"node-resolver-8lmqz\" (UID: \"8743123a-c7a3-4dba-b656-622c9a23c6e6\") " pod="openshift-dns/node-resolver-8lmqz" May 29 17:31:47.246217 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.245965 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kb56\" (UniqueName: \"kubernetes.io/projected/8743123a-c7a3-4dba-b656-622c9a23c6e6-kube-api-access-8kb56\") pod \"node-resolver-8lmqz\" (UID: \"8743123a-c7a3-4dba-b656-622c9a23c6e6\") " pod="openshift-dns/node-resolver-8lmqz" May 29 17:31:47.246217 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.245990 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09f1ad69-c9d7-4fbb-817a-af2956d532e8-var-lib-kubelet\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.246217 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.246014 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6a6a5a92-9a66-4acb-86d8-7bd102357b41-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mzntn\" (UID: \"6a6a5a92-9a66-4acb-86d8-7bd102357b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzntn" May 29 17:31:47.246217 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.246038 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f600c44-f078-461d-b75f-bac51676fd2d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-95w4p\" (UID: \"8f600c44-f078-461d-b75f-bac51676fd2d\") " pod="openshift-multus/multus-additional-cni-plugins-95w4p" May 29 17:31:47.246217 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.246063 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8f600c44-f078-461d-b75f-bac51676fd2d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-95w4p\" (UID: \"8f600c44-f078-461d-b75f-bac51676fd2d\") " pod="openshift-multus/multus-additional-cni-plugins-95w4p" May 29 17:31:47.246217 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.246087 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e75f1628-0b78-4da8-8842-714be82d7308-agent-certs\") pod \"konnectivity-agent-ttrl9\" (UID: \"e75f1628-0b78-4da8-8842-714be82d7308\") " pod="kube-system/konnectivity-agent-ttrl9" May 29 17:31:47.246217 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.246116 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/09f1ad69-c9d7-4fbb-817a-af2956d532e8-etc-modprobe-d\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.246217 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.246140 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09f1ad69-c9d7-4fbb-817a-af2956d532e8-etc-kubernetes\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.246217 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.246167 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/09f1ad69-c9d7-4fbb-817a-af2956d532e8-sys\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.246217 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.246200 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/09f1ad69-c9d7-4fbb-817a-af2956d532e8-etc-tuned\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.246670 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.246226 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6a6a5a92-9a66-4acb-86d8-7bd102357b41-socket-dir\") pod \"aws-ebs-csi-driver-node-mzntn\" (UID: \"6a6a5a92-9a66-4acb-86d8-7bd102357b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzntn" May 29 17:31:47.246670 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.246250 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7ee27fe1-5b5c-469c-b841-914fb8f1eb48-dbus\") pod \"global-pull-secret-syncer-r8mnd\" (UID: \"7ee27fe1-5b5c-469c-b841-914fb8f1eb48\") " pod="kube-system/global-pull-secret-syncer-r8mnd" May 29 17:31:47.246670 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.246273 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8f600c44-f078-461d-b75f-bac51676fd2d-os-release\") pod \"multus-additional-cni-plugins-95w4p\" (UID: \"8f600c44-f078-461d-b75f-bac51676fd2d\") " pod="openshift-multus/multus-additional-cni-plugins-95w4p" May 29 17:31:47.246670 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.246317 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/09f1ad69-c9d7-4fbb-817a-af2956d532e8-etc-sysctl-d\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.246670 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.246354 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/09f1ad69-c9d7-4fbb-817a-af2956d532e8-etc-systemd\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.246670 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.246373 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 29 17:31:47.246670 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.246387 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09f1ad69-c9d7-4fbb-817a-af2956d532e8-tmp\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.246670 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.246415 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8743123a-c7a3-4dba-b656-622c9a23c6e6-tmp-dir\") pod \"node-resolver-8lmqz\" (UID: \"8743123a-c7a3-4dba-b656-622c9a23c6e6\") " pod="openshift-dns/node-resolver-8lmqz" May 29 17:31:47.246670 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.246441 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc7sx\" (UniqueName: \"kubernetes.io/projected/d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49-kube-api-access-hc7sx\") pod \"network-metrics-daemon-bcp7w\" (UID: \"d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49\") " pod="openshift-multus/network-metrics-daemon-bcp7w" May 29 17:31:47.246670 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.246464 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6a6a5a92-9a66-4acb-86d8-7bd102357b41-device-dir\") pod \"aws-ebs-csi-driver-node-mzntn\" (UID: \"6a6a5a92-9a66-4acb-86d8-7bd102357b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzntn" May 29 17:31:47.246670 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.246488 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ee27fe1-5b5c-469c-b841-914fb8f1eb48-original-pull-secret\") pod \"global-pull-secret-syncer-r8mnd\" (UID: \"7ee27fe1-5b5c-469c-b841-914fb8f1eb48\") " pod="kube-system/global-pull-secret-syncer-r8mnd" May 29 17:31:47.246670 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.246513 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e75f1628-0b78-4da8-8842-714be82d7308-konnectivity-ca\") pod \"konnectivity-agent-ttrl9\" (UID: \"e75f1628-0b78-4da8-8842-714be82d7308\") " pod="kube-system/konnectivity-agent-ttrl9" May 29 17:31:47.246670 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.246536 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/09f1ad69-c9d7-4fbb-817a-af2956d532e8-etc-sysconfig\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.246670 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.246557 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/09f1ad69-c9d7-4fbb-817a-af2956d532e8-etc-sysctl-conf\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.246670 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.246581 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92b4d776-17cd-4b31-9dea-c4fb783ed515-host\") pod \"node-ca-v8trn\" (UID: \"92b4d776-17cd-4b31-9dea-c4fb783ed515\") " pod="openshift-image-registry/node-ca-v8trn" May 29 17:31:47.246670 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.246621 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49-metrics-certs\") pod \"network-metrics-daemon-bcp7w\" (UID: \"d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49\") " pod="openshift-multus/network-metrics-daemon-bcp7w" May 29 17:31:47.246670 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.246645 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6a6a5a92-9a66-4acb-86d8-7bd102357b41-sys-fs\") pod \"aws-ebs-csi-driver-node-mzntn\" (UID: \"6a6a5a92-9a66-4acb-86d8-7bd102357b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzntn" May 29 17:31:47.247427 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.246666 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95vg5" May 29 17:31:47.247427 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.246667 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/09f1ad69-c9d7-4fbb-817a-af2956d532e8-lib-modules\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.247427 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.246768 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lq69\" (UniqueName: \"kubernetes.io/projected/92b4d776-17cd-4b31-9dea-c4fb783ed515-kube-api-access-2lq69\") pod \"node-ca-v8trn\" (UID: \"92b4d776-17cd-4b31-9dea-c4fb783ed515\") " pod="openshift-image-registry/node-ca-v8trn" May 29 17:31:47.247427 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:47.246775 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95vg5" podUID="c3c798e6-b4da-4967-89c3-cf3d1e94cd4a" May 29 17:31:47.247427 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.246801 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f600c44-f078-461d-b75f-bac51676fd2d-system-cni-dir\") pod \"multus-additional-cni-plugins-95w4p\" (UID: \"8f600c44-f078-461d-b75f-bac51676fd2d\") " pod="openshift-multus/multus-additional-cni-plugins-95w4p" May 29 17:31:47.247427 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.246831 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f600c44-f078-461d-b75f-bac51676fd2d-cnibin\") pod \"multus-additional-cni-plugins-95w4p\" (UID: \"8f600c44-f078-461d-b75f-bac51676fd2d\") " pod="openshift-multus/multus-additional-cni-plugins-95w4p" May 29 17:31:47.247427 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.247011 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5mtls\"" May 29 17:31:47.247427 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.247088 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 29 17:31:47.248531 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.248516 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mfs9d" May 29 17:31:47.250385 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.250369 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 29 17:31:47.250721 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.250700 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8967m\"" May 29 17:31:47.250811 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.250787 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.250925 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.250910 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 29 17:31:47.250969 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.250921 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 29 17:31:47.251613 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.251598 2567 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 29 17:31:47.252790 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.252773 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 29 17:31:47.252888 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.252869 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-78rc7\"" May 29 17:31:47.253087 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.253068 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 29 17:31:47.253242 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.253228 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 29 17:31:47.253292 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.253233 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 29 17:31:47.253608 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.253596 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 29 17:31:47.253676 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.253663 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 29 17:31:47.255930 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.255915 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal"] May 29 17:31:47.256579 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.256566 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 29 17:31:47.256636 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.256627 2567 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-221.ec2.internal" May 29 17:31:47.260776 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.260755 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-28 17:26:46 +0000 UTC" deadline="2028-02-23 16:57:43.995816486 +0000 UTC" May 29 17:31:47.260825 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.260776 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15239h25m56.73504309s" May 29 17:31:47.264650 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.264631 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 29 17:31:47.264833 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.264816 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-221.ec2.internal"] May 29 17:31:47.273711 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.273673 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mtfvb" May 29 17:31:47.280005 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.279982 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mtfvb" May 29 17:31:47.333920 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.333892 2567 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 29 17:31:47.342608 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.342584 2567 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 29 17:31:47.347970 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.347947 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75241da4-b76f-468e-b501-eeab92ff75d7-cni-binary-copy\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.348099 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.347976 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b127b743-ab2d-443c-beda-d0e62ec97544-ovnkube-script-lib\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.348099 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348006 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8743123a-c7a3-4dba-b656-622c9a23c6e6-tmp-dir\") pod \"node-resolver-8lmqz\" (UID: \"8743123a-c7a3-4dba-b656-622c9a23c6e6\") " pod="openshift-dns/node-resolver-8lmqz" May 29 17:31:47.348099 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348055 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f3395817-65a6-4c39-9a0c-a610c2dda031-iptables-alerter-script\") pod \"iptables-alerter-mfs9d\" (UID: \"f3395817-65a6-4c39-9a0c-a610c2dda031\") " pod="openshift-network-operator/iptables-alerter-mfs9d" May 29 17:31:47.348099 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348085 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq5l6\" (UniqueName: \"kubernetes.io/projected/f3395817-65a6-4c39-9a0c-a610c2dda031-kube-api-access-zq5l6\") pod \"iptables-alerter-mfs9d\" (UID: \"f3395817-65a6-4c39-9a0c-a610c2dda031\") " pod="openshift-network-operator/iptables-alerter-mfs9d" May 29 17:31:47.348233 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348109 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-cnibin\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.348233 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348134 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-run-openvswitch\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.348233 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348158 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-run-ovn\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.348233 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348179 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-node-log\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.348233 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348202 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/09f1ad69-c9d7-4fbb-817a-af2956d532e8-etc-sysconfig\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.348233 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348218 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-host-run-netns\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.348233 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348232 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-etc-openvswitch\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.348429 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348255 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8743123a-c7a3-4dba-b656-622c9a23c6e6-tmp-dir\") pod \"node-resolver-8lmqz\" (UID: \"8743123a-c7a3-4dba-b656-622c9a23c6e6\") " pod="openshift-dns/node-resolver-8lmqz" May 29 17:31:47.348429 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348284 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/09f1ad69-c9d7-4fbb-817a-af2956d532e8-etc-sysconfig\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.348429 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348253 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b127b743-ab2d-443c-beda-d0e62ec97544-ovn-node-metrics-cert\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.348429 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348321 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6a6a5a92-9a66-4acb-86d8-7bd102357b41-sys-fs\") pod \"aws-ebs-csi-driver-node-mzntn\" (UID: \"6a6a5a92-9a66-4acb-86d8-7bd102357b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzntn" May 29 17:31:47.348429 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348339 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/09f1ad69-c9d7-4fbb-817a-af2956d532e8-lib-modules\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.348429 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348355 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2lq69\" (UniqueName: \"kubernetes.io/projected/92b4d776-17cd-4b31-9dea-c4fb783ed515-kube-api-access-2lq69\") pod \"node-ca-v8trn\" (UID: \"92b4d776-17cd-4b31-9dea-c4fb783ed515\") " pod="openshift-image-registry/node-ca-v8trn" May 29 17:31:47.348429 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348373 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-host-var-lib-cni-bin\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.348429 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348378 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6a6a5a92-9a66-4acb-86d8-7bd102357b41-sys-fs\") pod \"aws-ebs-csi-driver-node-mzntn\" (UID: \"6a6a5a92-9a66-4acb-86d8-7bd102357b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzntn" May 29 17:31:47.348661 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348434 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/09f1ad69-c9d7-4fbb-817a-af2956d532e8-lib-modules\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.348661 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348475 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-host-var-lib-kubelet\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.348661 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348503 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dsgx9\" (UniqueName: \"kubernetes.io/projected/09f1ad69-c9d7-4fbb-817a-af2956d532e8-kube-api-access-dsgx9\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.348661 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348528 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3395817-65a6-4c39-9a0c-a610c2dda031-host-slash\") pod \"iptables-alerter-mfs9d\" (UID: \"f3395817-65a6-4c39-9a0c-a610c2dda031\") " pod="openshift-network-operator/iptables-alerter-mfs9d" May 29 17:31:47.348661 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348552 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-log-socket\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.348661 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348578 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7ee27fe1-5b5c-469c-b841-914fb8f1eb48-kubelet-config\") pod \"global-pull-secret-syncer-r8mnd\" (UID: \"7ee27fe1-5b5c-469c-b841-914fb8f1eb48\") " pod="kube-system/global-pull-secret-syncer-r8mnd" May 29 17:31:47.348661 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348619 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-var-lib-openvswitch\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.348661 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348656 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6a6a5a92-9a66-4acb-86d8-7bd102357b41-etc-selinux\") pod \"aws-ebs-csi-driver-node-mzntn\" (UID: \"6a6a5a92-9a66-4acb-86d8-7bd102357b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzntn" May 29 17:31:47.348982 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348662 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7ee27fe1-5b5c-469c-b841-914fb8f1eb48-kubelet-config\") pod \"global-pull-secret-syncer-r8mnd\" (UID: \"7ee27fe1-5b5c-469c-b841-914fb8f1eb48\") " pod="kube-system/global-pull-secret-syncer-r8mnd" May 29 17:31:47.348982 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348684 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79pxf\" (UniqueName: \"kubernetes.io/projected/75241da4-b76f-468e-b501-eeab92ff75d7-kube-api-access-79pxf\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.348982 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348738 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-host-cni-bin\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.348982 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348745 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6a6a5a92-9a66-4acb-86d8-7bd102357b41-etc-selinux\") pod \"aws-ebs-csi-driver-node-mzntn\" (UID: \"6a6a5a92-9a66-4acb-86d8-7bd102357b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzntn" May 29 17:31:47.348982 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348766 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f600c44-f078-461d-b75f-bac51676fd2d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-95w4p\" (UID: \"8f600c44-f078-461d-b75f-bac51676fd2d\") " pod="openshift-multus/multus-additional-cni-plugins-95w4p" May 29 17:31:47.348982 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348799 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8f600c44-f078-461d-b75f-bac51676fd2d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-95w4p\" (UID: \"8f600c44-f078-461d-b75f-bac51676fd2d\") " pod="openshift-multus/multus-additional-cni-plugins-95w4p" May 29 17:31:47.348982 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348825 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09f1ad69-c9d7-4fbb-817a-af2956d532e8-etc-kubernetes\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.348982 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348849 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/09f1ad69-c9d7-4fbb-817a-af2956d532e8-sys\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.348982 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348871 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/09f1ad69-c9d7-4fbb-817a-af2956d532e8-etc-tuned\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.348982 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348888 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f600c44-f078-461d-b75f-bac51676fd2d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-95w4p\" (UID: \"8f600c44-f078-461d-b75f-bac51676fd2d\") " pod="openshift-multus/multus-additional-cni-plugins-95w4p" May 29 17:31:47.348982 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348897 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwqbz\" (UniqueName: \"kubernetes.io/projected/c3c798e6-b4da-4967-89c3-cf3d1e94cd4a-kube-api-access-hwqbz\") pod \"network-check-target-95vg5\" (UID: \"c3c798e6-b4da-4967-89c3-cf3d1e94cd4a\") " pod="openshift-network-diagnostics/network-check-target-95vg5" May 29 17:31:47.348982 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348910 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09f1ad69-c9d7-4fbb-817a-af2956d532e8-etc-kubernetes\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.348982 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348919 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/09f1ad69-c9d7-4fbb-817a-af2956d532e8-sys\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.348982 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348952 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-hostroot\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.348982 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348971 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-run-systemd\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.348982 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.348989 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8f600c44-f078-461d-b75f-bac51676fd2d-os-release\") pod \"multus-additional-cni-plugins-95w4p\" (UID: \"8f600c44-f078-461d-b75f-bac51676fd2d\") " pod="openshift-multus/multus-additional-cni-plugins-95w4p" May 29 17:31:47.349572 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.349035 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/09f1ad69-c9d7-4fbb-817a-af2956d532e8-etc-systemd\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.349572 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.349085 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09f1ad69-c9d7-4fbb-817a-af2956d532e8-tmp\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.349572 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.349110 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/09f1ad69-c9d7-4fbb-817a-af2956d532e8-etc-systemd\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.349572 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.349111 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8f600c44-f078-461d-b75f-bac51676fd2d-os-release\") pod \"multus-additional-cni-plugins-95w4p\" (UID: \"8f600c44-f078-461d-b75f-bac51676fd2d\") " pod="openshift-multus/multus-additional-cni-plugins-95w4p" May 29 17:31:47.349572 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.349151 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-multus-cni-dir\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.349572 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.349167 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-host-run-netns\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.349572 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.349173 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 29 17:31:47.349572 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.349203 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-os-release\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.349572 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.349233 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-host-kubelet\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.349572 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.349283 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-host-run-ovn-kubernetes\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.349572 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.349312 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.349572 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.349342 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hc7sx\" (UniqueName: \"kubernetes.io/projected/d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49-kube-api-access-hc7sx\") pod \"network-metrics-daemon-bcp7w\" (UID: \"d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49\") " pod="openshift-multus/network-metrics-daemon-bcp7w" May 29 17:31:47.349572 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.349370 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6a6a5a92-9a66-4acb-86d8-7bd102357b41-device-dir\") pod \"aws-ebs-csi-driver-node-mzntn\" (UID: \"6a6a5a92-9a66-4acb-86d8-7bd102357b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzntn" May 29 17:31:47.349572 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.349388 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8f600c44-f078-461d-b75f-bac51676fd2d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-95w4p\" (UID: \"8f600c44-f078-461d-b75f-bac51676fd2d\") " pod="openshift-multus/multus-additional-cni-plugins-95w4p" May 29 17:31:47.349572 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.349432 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6a6a5a92-9a66-4acb-86d8-7bd102357b41-device-dir\") pod \"aws-ebs-csi-driver-node-mzntn\" (UID: \"6a6a5a92-9a66-4acb-86d8-7bd102357b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzntn" May 29 17:31:47.349572 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.349471 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ee27fe1-5b5c-469c-b841-914fb8f1eb48-original-pull-secret\") pod \"global-pull-secret-syncer-r8mnd\" (UID: \"7ee27fe1-5b5c-469c-b841-914fb8f1eb48\") " pod="kube-system/global-pull-secret-syncer-r8mnd" May 29 17:31:47.349572 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.349501 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e75f1628-0b78-4da8-8842-714be82d7308-konnectivity-ca\") pod \"konnectivity-agent-ttrl9\" (UID: \"e75f1628-0b78-4da8-8842-714be82d7308\") " pod="kube-system/konnectivity-agent-ttrl9" May 29 17:31:47.351207 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.349525 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/09f1ad69-c9d7-4fbb-817a-af2956d532e8-etc-sysctl-conf\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.351207 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:47.349593 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 29 17:31:47.351207 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.349627 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/09f1ad69-c9d7-4fbb-817a-af2956d532e8-etc-sysctl-conf\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.351207 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:47.349689 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ee27fe1-5b5c-469c-b841-914fb8f1eb48-original-pull-secret podName:7ee27fe1-5b5c-469c-b841-914fb8f1eb48 nodeName:}" failed. No retries permitted until 2026-05-29 17:31:47.849645163 +0000 UTC m=+2.122872540 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ee27fe1-5b5c-469c-b841-914fb8f1eb48-original-pull-secret") pod "global-pull-secret-syncer-r8mnd" (UID: "7ee27fe1-5b5c-469c-b841-914fb8f1eb48") : object "kube-system"/"original-pull-secret" not registered May 29 17:31:47.351207 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.349710 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92b4d776-17cd-4b31-9dea-c4fb783ed515-host\") pod \"node-ca-v8trn\" (UID: \"92b4d776-17cd-4b31-9dea-c4fb783ed515\") " pod="openshift-image-registry/node-ca-v8trn" May 29 17:31:47.351207 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.349758 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/75241da4-b76f-468e-b501-eeab92ff75d7-multus-daemon-config\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.351207 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.349785 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49-metrics-certs\") pod \"network-metrics-daemon-bcp7w\" (UID: \"d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49\") " pod="openshift-multus/network-metrics-daemon-bcp7w" May 29 17:31:47.351207 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.349807 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-etc-kubernetes\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.351207 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.349828 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-host-slash\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.351207 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.349850 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f600c44-f078-461d-b75f-bac51676fd2d-system-cni-dir\") pod \"multus-additional-cni-plugins-95w4p\" (UID: \"8f600c44-f078-461d-b75f-bac51676fd2d\") " pod="openshift-multus/multus-additional-cni-plugins-95w4p" May 29 17:31:47.351207 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.349871 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f600c44-f078-461d-b75f-bac51676fd2d-cnibin\") pod \"multus-additional-cni-plugins-95w4p\" (UID: \"8f600c44-f078-461d-b75f-bac51676fd2d\") " pod="openshift-multus/multus-additional-cni-plugins-95w4p" May 29 17:31:47.351207 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.349893 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f600c44-f078-461d-b75f-bac51676fd2d-cni-binary-copy\") pod \"multus-additional-cni-plugins-95w4p\" (UID: \"8f600c44-f078-461d-b75f-bac51676fd2d\") " pod="openshift-multus/multus-additional-cni-plugins-95w4p" May 29 17:31:47.351207 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.349916 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fsl4t\" (UniqueName: \"kubernetes.io/projected/8f600c44-f078-461d-b75f-bac51676fd2d-kube-api-access-fsl4t\") pod \"multus-additional-cni-plugins-95w4p\" (UID: \"8f600c44-f078-461d-b75f-bac51676fd2d\") " pod="openshift-multus/multus-additional-cni-plugins-95w4p" May 29 17:31:47.351207 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:47.349942 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 17:31:47.351207 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:47.349990 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49-metrics-certs podName:d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49 nodeName:}" failed. No retries permitted until 2026-05-29 17:31:47.849973849 +0000 UTC m=+2.123201217 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49-metrics-certs") pod "network-metrics-daemon-bcp7w" (UID: "d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 17:31:47.351207 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350015 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f600c44-f078-461d-b75f-bac51676fd2d-cnibin\") pod \"multus-additional-cni-plugins-95w4p\" (UID: \"8f600c44-f078-461d-b75f-bac51676fd2d\") " pod="openshift-multus/multus-additional-cni-plugins-95w4p" May 29 17:31:47.352194 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350034 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e75f1628-0b78-4da8-8842-714be82d7308-konnectivity-ca\") pod \"konnectivity-agent-ttrl9\" (UID: \"e75f1628-0b78-4da8-8842-714be82d7308\") " pod="kube-system/konnectivity-agent-ttrl9" May 29 17:31:47.352194 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350030 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92b4d776-17cd-4b31-9dea-c4fb783ed515-host\") pod \"node-ca-v8trn\" (UID: \"92b4d776-17cd-4b31-9dea-c4fb783ed515\") " pod="openshift-image-registry/node-ca-v8trn" May 29 17:31:47.352194 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350106 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f600c44-f078-461d-b75f-bac51676fd2d-system-cni-dir\") pod \"multus-additional-cni-plugins-95w4p\" (UID: \"8f600c44-f078-461d-b75f-bac51676fd2d\") " pod="openshift-multus/multus-additional-cni-plugins-95w4p" May 29 17:31:47.352194 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.349942 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-multus-socket-dir-parent\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.352194 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350144 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-systemd-units\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.352194 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350167 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-host-cni-netd\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.352194 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350193 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b127b743-ab2d-443c-beda-d0e62ec97544-env-overrides\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.352194 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350216 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6a6a5a92-9a66-4acb-86d8-7bd102357b41-registration-dir\") pod \"aws-ebs-csi-driver-node-mzntn\" (UID: \"6a6a5a92-9a66-4acb-86d8-7bd102357b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzntn" May 29 17:31:47.352194 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350239 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8f600c44-f078-461d-b75f-bac51676fd2d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-95w4p\" (UID: \"8f600c44-f078-461d-b75f-bac51676fd2d\") " pod="openshift-multus/multus-additional-cni-plugins-95w4p" May 29 17:31:47.352194 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350275 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/09f1ad69-c9d7-4fbb-817a-af2956d532e8-run\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.352194 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350321 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/09f1ad69-c9d7-4fbb-817a-af2956d532e8-host\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.352194 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350347 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/92b4d776-17cd-4b31-9dea-c4fb783ed515-serviceca\") pod \"node-ca-v8trn\" (UID: \"92b4d776-17cd-4b31-9dea-c4fb783ed515\") " pod="openshift-image-registry/node-ca-v8trn" May 29 17:31:47.352194 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350380 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-multus-conf-dir\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.352194 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350408 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-host-run-multus-certs\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.352194 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350432 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rrlg\" (UniqueName: \"kubernetes.io/projected/b127b743-ab2d-443c-beda-d0e62ec97544-kube-api-access-6rrlg\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.352194 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350456 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/09f1ad69-c9d7-4fbb-817a-af2956d532e8-host\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.352194 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350461 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fkgpb\" (UniqueName: \"kubernetes.io/projected/6a6a5a92-9a66-4acb-86d8-7bd102357b41-kube-api-access-fkgpb\") pod \"aws-ebs-csi-driver-node-mzntn\" (UID: \"6a6a5a92-9a66-4acb-86d8-7bd102357b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzntn" May 29 17:31:47.352939 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350500 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8743123a-c7a3-4dba-b656-622c9a23c6e6-hosts-file\") pod \"node-resolver-8lmqz\" (UID: \"8743123a-c7a3-4dba-b656-622c9a23c6e6\") " pod="openshift-dns/node-resolver-8lmqz" May 29 17:31:47.352939 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350515 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/09f1ad69-c9d7-4fbb-817a-af2956d532e8-run\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.352939 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350523 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8kb56\" (UniqueName: \"kubernetes.io/projected/8743123a-c7a3-4dba-b656-622c9a23c6e6-kube-api-access-8kb56\") pod \"node-resolver-8lmqz\" (UID: \"8743123a-c7a3-4dba-b656-622c9a23c6e6\") " pod="openshift-dns/node-resolver-8lmqz" May 29 17:31:47.352939 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350408 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f600c44-f078-461d-b75f-bac51676fd2d-cni-binary-copy\") pod \"multus-additional-cni-plugins-95w4p\" (UID: \"8f600c44-f078-461d-b75f-bac51676fd2d\") " pod="openshift-multus/multus-additional-cni-plugins-95w4p" May 29 17:31:47.352939 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350599 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09f1ad69-c9d7-4fbb-817a-af2956d532e8-var-lib-kubelet\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.352939 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350627 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b127b743-ab2d-443c-beda-d0e62ec97544-ovnkube-config\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.352939 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350654 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-system-cni-dir\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.352939 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350681 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-host-run-k8s-cni-cncf-io\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.352939 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350709 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6a6a5a92-9a66-4acb-86d8-7bd102357b41-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mzntn\" (UID: \"6a6a5a92-9a66-4acb-86d8-7bd102357b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzntn" May 29 17:31:47.352939 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350715 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6a6a5a92-9a66-4acb-86d8-7bd102357b41-registration-dir\") pod \"aws-ebs-csi-driver-node-mzntn\" (UID: \"6a6a5a92-9a66-4acb-86d8-7bd102357b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzntn" May 29 17:31:47.352939 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350756 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e75f1628-0b78-4da8-8842-714be82d7308-agent-certs\") pod \"konnectivity-agent-ttrl9\" (UID: \"e75f1628-0b78-4da8-8842-714be82d7308\") " pod="kube-system/konnectivity-agent-ttrl9" May 29 17:31:47.352939 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350757 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8f600c44-f078-461d-b75f-bac51676fd2d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-95w4p\" (UID: \"8f600c44-f078-461d-b75f-bac51676fd2d\") " pod="openshift-multus/multus-additional-cni-plugins-95w4p" May 29 17:31:47.352939 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350781 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/09f1ad69-c9d7-4fbb-817a-af2956d532e8-etc-modprobe-d\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.352939 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350656 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8743123a-c7a3-4dba-b656-622c9a23c6e6-hosts-file\") pod \"node-resolver-8lmqz\" (UID: \"8743123a-c7a3-4dba-b656-622c9a23c6e6\") " pod="openshift-dns/node-resolver-8lmqz" May 29 17:31:47.352939 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350808 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-host-var-lib-cni-multus\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.352939 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350864 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6a6a5a92-9a66-4acb-86d8-7bd102357b41-socket-dir\") pod \"aws-ebs-csi-driver-node-mzntn\" (UID: \"6a6a5a92-9a66-4acb-86d8-7bd102357b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzntn" May 29 17:31:47.352939 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350892 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7ee27fe1-5b5c-469c-b841-914fb8f1eb48-dbus\") pod \"global-pull-secret-syncer-r8mnd\" (UID: \"7ee27fe1-5b5c-469c-b841-914fb8f1eb48\") " pod="kube-system/global-pull-secret-syncer-r8mnd" May 29 17:31:47.353476 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350924 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/09f1ad69-c9d7-4fbb-817a-af2956d532e8-etc-sysctl-d\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.353476 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350867 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6a6a5a92-9a66-4acb-86d8-7bd102357b41-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mzntn\" (UID: \"6a6a5a92-9a66-4acb-86d8-7bd102357b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzntn" May 29 17:31:47.353476 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350909 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09f1ad69-c9d7-4fbb-817a-af2956d532e8-var-lib-kubelet\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.353476 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.350922 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/92b4d776-17cd-4b31-9dea-c4fb783ed515-serviceca\") pod \"node-ca-v8trn\" (UID: \"92b4d776-17cd-4b31-9dea-c4fb783ed515\") " pod="openshift-image-registry/node-ca-v8trn" May 29 17:31:47.353476 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.351070 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6a6a5a92-9a66-4acb-86d8-7bd102357b41-socket-dir\") pod \"aws-ebs-csi-driver-node-mzntn\" (UID: \"6a6a5a92-9a66-4acb-86d8-7bd102357b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzntn" May 29 17:31:47.353476 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.351124 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7ee27fe1-5b5c-469c-b841-914fb8f1eb48-dbus\") pod \"global-pull-secret-syncer-r8mnd\" (UID: \"7ee27fe1-5b5c-469c-b841-914fb8f1eb48\") " pod="kube-system/global-pull-secret-syncer-r8mnd" May 29 17:31:47.353476 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.351153 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/09f1ad69-c9d7-4fbb-817a-af2956d532e8-etc-sysctl-d\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.353476 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.351204 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/09f1ad69-c9d7-4fbb-817a-af2956d532e8-etc-modprobe-d\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.353476 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.352208 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/09f1ad69-c9d7-4fbb-817a-af2956d532e8-etc-tuned\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.353476 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.352825 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09f1ad69-c9d7-4fbb-817a-af2956d532e8-tmp\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.353476 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.353461 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e75f1628-0b78-4da8-8842-714be82d7308-agent-certs\") pod \"konnectivity-agent-ttrl9\" (UID: \"e75f1628-0b78-4da8-8842-714be82d7308\") " pod="kube-system/konnectivity-agent-ttrl9" May 29 17:31:47.356495 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.356471 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc7sx\" (UniqueName: \"kubernetes.io/projected/d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49-kube-api-access-hc7sx\") pod \"network-metrics-daemon-bcp7w\" (UID: \"d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49\") " pod="openshift-multus/network-metrics-daemon-bcp7w" May 29 17:31:47.357294 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.357265 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lq69\" (UniqueName: \"kubernetes.io/projected/92b4d776-17cd-4b31-9dea-c4fb783ed515-kube-api-access-2lq69\") pod \"node-ca-v8trn\" (UID: \"92b4d776-17cd-4b31-9dea-c4fb783ed515\") " pod="openshift-image-registry/node-ca-v8trn" May 29 17:31:47.357520 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.357498 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsgx9\" (UniqueName: \"kubernetes.io/projected/09f1ad69-c9d7-4fbb-817a-af2956d532e8-kube-api-access-dsgx9\") pod \"tuned-zlvq6\" (UID: \"09f1ad69-c9d7-4fbb-817a-af2956d532e8\") " pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.358072 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.358047 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsl4t\" (UniqueName: \"kubernetes.io/projected/8f600c44-f078-461d-b75f-bac51676fd2d-kube-api-access-fsl4t\") pod \"multus-additional-cni-plugins-95w4p\" (UID: \"8f600c44-f078-461d-b75f-bac51676fd2d\") " pod="openshift-multus/multus-additional-cni-plugins-95w4p" May 29 17:31:47.358400 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.358378 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kb56\" (UniqueName: \"kubernetes.io/projected/8743123a-c7a3-4dba-b656-622c9a23c6e6-kube-api-access-8kb56\") pod \"node-resolver-8lmqz\" (UID: \"8743123a-c7a3-4dba-b656-622c9a23c6e6\") " pod="openshift-dns/node-resolver-8lmqz" May 29 17:31:47.358738 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.358704 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkgpb\" (UniqueName: \"kubernetes.io/projected/6a6a5a92-9a66-4acb-86d8-7bd102357b41-kube-api-access-fkgpb\") pod \"aws-ebs-csi-driver-node-mzntn\" (UID: \"6a6a5a92-9a66-4acb-86d8-7bd102357b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzntn" May 29 17:31:47.360079 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.360065 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-95w4p" May 29 17:31:47.366987 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:47.366946 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4855e81ed8bee2be722afee434bf936b.slice/crio-7ee0505e5eab656623bff6517af5eb234f5f74f42415db22c397d118da9d9e62 WatchSource:0}: Error finding container 7ee0505e5eab656623bff6517af5eb234f5f74f42415db22c397d118da9d9e62: Status 404 returned error can't find the container with id 7ee0505e5eab656623bff6517af5eb234f5f74f42415db22c397d118da9d9e62 May 29 17:31:47.367261 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:47.367240 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf163f355a8c28c9c3dd29ffeb15632a3.slice/crio-95e5910445785e81e58f526cd3d8af8b1f348646f14585dc6c5bb37f6cc759aa WatchSource:0}: Error finding container 95e5910445785e81e58f526cd3d8af8b1f348646f14585dc6c5bb37f6cc759aa: Status 404 returned error can't find the container with id 95e5910445785e81e58f526cd3d8af8b1f348646f14585dc6c5bb37f6cc759aa May 29 17:31:47.370260 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:47.370238 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f600c44_f078_461d_b75f_bac51676fd2d.slice/crio-e02ad592c7b017d58b4ab5ff96a815a4ca6f1ddeae863ee953cbc0a64a91e0b5 WatchSource:0}: Error finding container e02ad592c7b017d58b4ab5ff96a815a4ca6f1ddeae863ee953cbc0a64a91e0b5: Status 404 returned error can't find the container with id e02ad592c7b017d58b4ab5ff96a815a4ca6f1ddeae863ee953cbc0a64a91e0b5 May 29 17:31:47.370348 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.370335 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 17:31:47.452177 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.452145 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-etc-kubernetes\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.452177 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.452176 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-host-slash\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.452375 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.452213 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-multus-socket-dir-parent\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.452375 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.452252 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-host-slash\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.452375 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.452273 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-etc-kubernetes\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.452482 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.452366 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-multus-socket-dir-parent\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.452482 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.452384 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-systemd-units\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.452482 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.452413 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-host-cni-netd\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.452482 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.452439 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b127b743-ab2d-443c-beda-d0e62ec97544-env-overrides\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.452482 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.452468 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-systemd-units\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.452687 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.452486 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-multus-conf-dir\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.452687 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.452492 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-host-cni-netd\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.452687 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.452522 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-host-run-multus-certs\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.452687 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.452529 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-multus-conf-dir\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.452687 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.452548 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6rrlg\" (UniqueName: \"kubernetes.io/projected/b127b743-ab2d-443c-beda-d0e62ec97544-kube-api-access-6rrlg\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.452687 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.452569 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-host-run-multus-certs\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.452687 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.452573 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b127b743-ab2d-443c-beda-d0e62ec97544-ovnkube-config\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.452687 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.452596 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-system-cni-dir\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.452687 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.452611 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-host-run-k8s-cni-cncf-io\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.452687 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.452634 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-host-var-lib-cni-multus\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.452687 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.452677 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-host-run-k8s-cni-cncf-io\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.452687 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.452679 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75241da4-b76f-468e-b501-eeab92ff75d7-cni-binary-copy\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.453083 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.452707 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-host-var-lib-cni-multus\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.453083 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.452712 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b127b743-ab2d-443c-beda-d0e62ec97544-ovnkube-script-lib\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.453083 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.452680 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-system-cni-dir\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.453083 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.452773 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f3395817-65a6-4c39-9a0c-a610c2dda031-iptables-alerter-script\") pod \"iptables-alerter-mfs9d\" (UID: \"f3395817-65a6-4c39-9a0c-a610c2dda031\") " pod="openshift-network-operator/iptables-alerter-mfs9d" May 29 17:31:47.453083 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.452833 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zq5l6\" (UniqueName: \"kubernetes.io/projected/f3395817-65a6-4c39-9a0c-a610c2dda031-kube-api-access-zq5l6\") pod \"iptables-alerter-mfs9d\" (UID: \"f3395817-65a6-4c39-9a0c-a610c2dda031\") " pod="openshift-network-operator/iptables-alerter-mfs9d" May 29 17:31:47.453083 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.452882 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-cnibin\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.453083 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.452911 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-run-openvswitch\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.453083 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.452940 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-run-ovn\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.453083 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.452965 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-node-log\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.453083 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.452987 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-host-run-netns\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.453083 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.452987 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-cnibin\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.453083 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453008 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-etc-openvswitch\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.453083 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453024 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b127b743-ab2d-443c-beda-d0e62ec97544-ovn-node-metrics-cert\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.453083 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453035 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-run-ovn\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.453083 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453042 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-host-var-lib-cni-bin\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.453083 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453073 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-etc-openvswitch\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.453083 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453035 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-run-openvswitch\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.453745 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453110 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-host-run-netns\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.453745 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453075 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-host-var-lib-kubelet\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.453745 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453143 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-host-var-lib-cni-bin\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.453745 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453152 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3395817-65a6-4c39-9a0c-a610c2dda031-host-slash\") pod \"iptables-alerter-mfs9d\" (UID: \"f3395817-65a6-4c39-9a0c-a610c2dda031\") " pod="openshift-network-operator/iptables-alerter-mfs9d" May 29 17:31:47.453745 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453134 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75241da4-b76f-468e-b501-eeab92ff75d7-cni-binary-copy\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.453745 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453110 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-host-var-lib-kubelet\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.453745 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453179 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-node-log\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.453745 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453181 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-log-socket\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.453745 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453219 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-log-socket\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.453745 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453223 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3395817-65a6-4c39-9a0c-a610c2dda031-host-slash\") pod \"iptables-alerter-mfs9d\" (UID: \"f3395817-65a6-4c39-9a0c-a610c2dda031\") " pod="openshift-network-operator/iptables-alerter-mfs9d" May 29 17:31:47.453745 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453229 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-var-lib-openvswitch\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.453745 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453262 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-79pxf\" (UniqueName: \"kubernetes.io/projected/75241da4-b76f-468e-b501-eeab92ff75d7-kube-api-access-79pxf\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.453745 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453278 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-host-cni-bin\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.453745 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453282 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-var-lib-openvswitch\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.453745 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453317 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hwqbz\" (UniqueName: \"kubernetes.io/projected/c3c798e6-b4da-4967-89c3-cf3d1e94cd4a-kube-api-access-hwqbz\") pod \"network-check-target-95vg5\" (UID: \"c3c798e6-b4da-4967-89c3-cf3d1e94cd4a\") " pod="openshift-network-diagnostics/network-check-target-95vg5" May 29 17:31:47.453745 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453322 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-host-cni-bin\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.453745 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453334 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-hostroot\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.453745 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453360 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-hostroot\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.454281 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453363 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-run-systemd\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.454281 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453391 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-multus-cni-dir\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.454281 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453416 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-host-run-netns\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.454281 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453439 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-os-release\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.454281 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453465 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-host-kubelet\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.454281 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453490 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-host-run-ovn-kubernetes\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.454281 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453509 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-host-run-netns\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.454281 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453513 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.454281 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453550 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-run-systemd\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.454281 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453565 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.454281 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453570 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/75241da4-b76f-468e-b501-eeab92ff75d7-multus-daemon-config\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.454281 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453605 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-multus-cni-dir\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.454281 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453621 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-host-run-ovn-kubernetes\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.454281 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453641 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b127b743-ab2d-443c-beda-d0e62ec97544-host-kubelet\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.454281 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453667 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/75241da4-b76f-468e-b501-eeab92ff75d7-os-release\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.454281 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.453797 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b127b743-ab2d-443c-beda-d0e62ec97544-env-overrides\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.454281 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.454035 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b127b743-ab2d-443c-beda-d0e62ec97544-ovnkube-config\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.454281 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.454086 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/75241da4-b76f-468e-b501-eeab92ff75d7-multus-daemon-config\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.454801 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.454094 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f3395817-65a6-4c39-9a0c-a610c2dda031-iptables-alerter-script\") pod \"iptables-alerter-mfs9d\" (UID: \"f3395817-65a6-4c39-9a0c-a610c2dda031\") " pod="openshift-network-operator/iptables-alerter-mfs9d" May 29 17:31:47.454801 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.454152 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b127b743-ab2d-443c-beda-d0e62ec97544-ovnkube-script-lib\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.455704 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.455687 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b127b743-ab2d-443c-beda-d0e62ec97544-ovn-node-metrics-cert\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.458344 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:47.458326 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 17:31:47.458344 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:47.458344 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 17:31:47.458477 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:47.458353 2567 projected.go:194] Error preparing data for projected volume kube-api-access-hwqbz for pod openshift-network-diagnostics/network-check-target-95vg5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 17:31:47.458477 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:47.458402 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3c798e6-b4da-4967-89c3-cf3d1e94cd4a-kube-api-access-hwqbz podName:c3c798e6-b4da-4967-89c3-cf3d1e94cd4a nodeName:}" failed. No retries permitted until 2026-05-29 17:31:47.958388716 +0000 UTC m=+2.231616102 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hwqbz" (UniqueName: "kubernetes.io/projected/c3c798e6-b4da-4967-89c3-cf3d1e94cd4a-kube-api-access-hwqbz") pod "network-check-target-95vg5" (UID: "c3c798e6-b4da-4967-89c3-cf3d1e94cd4a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 17:31:47.460528 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.460499 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rrlg\" (UniqueName: \"kubernetes.io/projected/b127b743-ab2d-443c-beda-d0e62ec97544-kube-api-access-6rrlg\") pod \"ovnkube-node-w49xp\" (UID: \"b127b743-ab2d-443c-beda-d0e62ec97544\") " pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.460613 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.460574 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79pxf\" (UniqueName: \"kubernetes.io/projected/75241da4-b76f-468e-b501-eeab92ff75d7-kube-api-access-79pxf\") pod \"multus-jp89n\" (UID: \"75241da4-b76f-468e-b501-eeab92ff75d7\") " pod="openshift-multus/multus-jp89n" May 29 17:31:47.460915 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.460899 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq5l6\" (UniqueName: \"kubernetes.io/projected/f3395817-65a6-4c39-9a0c-a610c2dda031-kube-api-access-zq5l6\") pod \"iptables-alerter-mfs9d\" (UID: \"f3395817-65a6-4c39-9a0c-a610c2dda031\") " pod="openshift-network-operator/iptables-alerter-mfs9d" May 29 17:31:47.533933 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.533901 2567 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 29 17:31:47.566438 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.566351 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ttrl9" May 29 17:31:47.572202 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:47.572180 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode75f1628_0b78_4da8_8842_714be82d7308.slice/crio-5b5ec00d2d36b0e58acdb81d1996c6dc76cca282b4c2604a1f1b053aab21fc8a WatchSource:0}: Error finding container 5b5ec00d2d36b0e58acdb81d1996c6dc76cca282b4c2604a1f1b053aab21fc8a: Status 404 returned error can't find the container with id 5b5ec00d2d36b0e58acdb81d1996c6dc76cca282b4c2604a1f1b053aab21fc8a May 29 17:31:47.582077 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.582056 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" May 29 17:31:47.587781 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:47.587755 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09f1ad69_c9d7_4fbb_817a_af2956d532e8.slice/crio-0de2f85a178e5ea178d8dcfa01726631996c2ca7b038ed84c8991a9f76f24c39 WatchSource:0}: Error finding container 0de2f85a178e5ea178d8dcfa01726631996c2ca7b038ed84c8991a9f76f24c39: Status 404 returned error can't find the container with id 0de2f85a178e5ea178d8dcfa01726631996c2ca7b038ed84c8991a9f76f24c39 May 29 17:31:47.604088 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.604065 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v8trn" May 29 17:31:47.609962 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:47.609937 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92b4d776_17cd_4b31_9dea_c4fb783ed515.slice/crio-f09a5cdf5a7ce0c024f15d566905e766bb1d7fc2d5ee961f8806dd18152dd466 WatchSource:0}: Error finding container f09a5cdf5a7ce0c024f15d566905e766bb1d7fc2d5ee961f8806dd18152dd466: Status 404 returned error can't find the container with id f09a5cdf5a7ce0c024f15d566905e766bb1d7fc2d5ee961f8806dd18152dd466 May 29 17:31:47.614806 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.614790 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzntn" May 29 17:31:47.620314 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:47.620294 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a6a5a92_9a66_4acb_86d8_7bd102357b41.slice/crio-c18ee8d1e8c6b07a6e78ad330c80cdd13010ab6997fdb31fe174b4c2bf96fd74 WatchSource:0}: Error finding container c18ee8d1e8c6b07a6e78ad330c80cdd13010ab6997fdb31fe174b4c2bf96fd74: Status 404 returned error can't find the container with id c18ee8d1e8c6b07a6e78ad330c80cdd13010ab6997fdb31fe174b4c2bf96fd74 May 29 17:31:47.635148 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.635125 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8lmqz" May 29 17:31:47.641772 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:47.641749 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8743123a_c7a3_4dba_b656_622c9a23c6e6.slice/crio-4725448bee182d3fd19f4a228383b08533707a6048c0e3260f3f7449193d56af WatchSource:0}: Error finding container 4725448bee182d3fd19f4a228383b08533707a6048c0e3260f3f7449193d56af: Status 404 returned error can't find the container with id 4725448bee182d3fd19f4a228383b08533707a6048c0e3260f3f7449193d56af May 29 17:31:47.670418 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.670394 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jp89n" May 29 17:31:47.677207 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.676990 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mfs9d" May 29 17:31:47.677295 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:47.677262 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75241da4_b76f_468e_b501_eeab92ff75d7.slice/crio-369d71e125f1d7150198d1484d02ca149e87b04aeea4cd7083dd41ffcf6f7b6a WatchSource:0}: Error finding container 369d71e125f1d7150198d1484d02ca149e87b04aeea4cd7083dd41ffcf6f7b6a: Status 404 returned error can't find the container with id 369d71e125f1d7150198d1484d02ca149e87b04aeea4cd7083dd41ffcf6f7b6a May 29 17:31:47.682015 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.681998 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:31:47.683778 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:47.683756 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3395817_65a6_4c39_9a0c_a610c2dda031.slice/crio-5696cdacd17dd74c9dff306e11a4d5491d23e2545657894f4715a6d2dd77a681 WatchSource:0}: Error finding container 5696cdacd17dd74c9dff306e11a4d5491d23e2545657894f4715a6d2dd77a681: Status 404 returned error can't find the container with id 5696cdacd17dd74c9dff306e11a4d5491d23e2545657894f4715a6d2dd77a681 May 29 17:31:47.689424 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:31:47.689395 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb127b743_ab2d_443c_beda_d0e62ec97544.slice/crio-24a3800b82b775fbb668e0404528977978ae56585e1c4fe4b9edd53bdd7d43ae WatchSource:0}: Error finding container 24a3800b82b775fbb668e0404528977978ae56585e1c4fe4b9edd53bdd7d43ae: Status 404 returned error can't find the container with id 24a3800b82b775fbb668e0404528977978ae56585e1c4fe4b9edd53bdd7d43ae May 29 17:31:47.856659 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.856576 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ee27fe1-5b5c-469c-b841-914fb8f1eb48-original-pull-secret\") pod \"global-pull-secret-syncer-r8mnd\" (UID: \"7ee27fe1-5b5c-469c-b841-914fb8f1eb48\") " pod="kube-system/global-pull-secret-syncer-r8mnd" May 29 17:31:47.856659 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:47.856610 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49-metrics-certs\") pod \"network-metrics-daemon-bcp7w\" (UID: \"d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49\") " pod="openshift-multus/network-metrics-daemon-bcp7w" May 29 17:31:47.856902 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:47.856756 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 29 17:31:47.856902 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:47.856828 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ee27fe1-5b5c-469c-b841-914fb8f1eb48-original-pull-secret podName:7ee27fe1-5b5c-469c-b841-914fb8f1eb48 nodeName:}" failed. No retries permitted until 2026-05-29 17:31:48.856810128 +0000 UTC m=+3.130037488 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ee27fe1-5b5c-469c-b841-914fb8f1eb48-original-pull-secret") pod "global-pull-secret-syncer-r8mnd" (UID: "7ee27fe1-5b5c-469c-b841-914fb8f1eb48") : object "kube-system"/"original-pull-secret" not registered May 29 17:31:47.856902 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:47.856833 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 17:31:47.856902 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:47.856880 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49-metrics-certs podName:d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49 nodeName:}" failed. No retries permitted until 2026-05-29 17:31:48.856866872 +0000 UTC m=+3.130094229 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49-metrics-certs") pod "network-metrics-daemon-bcp7w" (UID: "d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 17:31:48.025835 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:48.025546 2567 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 29 17:31:48.059597 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:48.059563 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hwqbz\" (UniqueName: \"kubernetes.io/projected/c3c798e6-b4da-4967-89c3-cf3d1e94cd4a-kube-api-access-hwqbz\") pod \"network-check-target-95vg5\" (UID: \"c3c798e6-b4da-4967-89c3-cf3d1e94cd4a\") " pod="openshift-network-diagnostics/network-check-target-95vg5" May 29 17:31:48.067644 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:48.065713 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 17:31:48.067644 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:48.065761 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 17:31:48.067644 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:48.065778 2567 projected.go:194] Error preparing data for projected volume kube-api-access-hwqbz for pod openshift-network-diagnostics/network-check-target-95vg5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 17:31:48.067644 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:48.065851 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3c798e6-b4da-4967-89c3-cf3d1e94cd4a-kube-api-access-hwqbz podName:c3c798e6-b4da-4967-89c3-cf3d1e94cd4a nodeName:}" failed. No retries permitted until 2026-05-29 17:31:49.065829852 +0000 UTC m=+3.339057212 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hwqbz" (UniqueName: "kubernetes.io/projected/c3c798e6-b4da-4967-89c3-cf3d1e94cd4a-kube-api-access-hwqbz") pod "network-check-target-95vg5" (UID: "c3c798e6-b4da-4967-89c3-cf3d1e94cd4a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 17:31:48.280982 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:48.280768 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-28 17:26:47 +0000 UTC" deadline="2027-11-10 07:39:03.553496888 +0000 UTC" May 29 17:31:48.280982 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:48.280804 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12710h7m15.272696295s" May 29 17:31:48.334590 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:48.334498 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" event={"ID":"b127b743-ab2d-443c-beda-d0e62ec97544","Type":"ContainerStarted","Data":"24a3800b82b775fbb668e0404528977978ae56585e1c4fe4b9edd53bdd7d43ae"} May 29 17:31:48.346194 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:48.346111 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jp89n" event={"ID":"75241da4-b76f-468e-b501-eeab92ff75d7","Type":"ContainerStarted","Data":"369d71e125f1d7150198d1484d02ca149e87b04aeea4cd7083dd41ffcf6f7b6a"} May 29 17:31:48.350771 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:48.350710 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8lmqz" event={"ID":"8743123a-c7a3-4dba-b656-622c9a23c6e6","Type":"ContainerStarted","Data":"4725448bee182d3fd19f4a228383b08533707a6048c0e3260f3f7449193d56af"} May 29 17:31:48.358360 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:48.358327 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzntn" event={"ID":"6a6a5a92-9a66-4acb-86d8-7bd102357b41","Type":"ContainerStarted","Data":"c18ee8d1e8c6b07a6e78ad330c80cdd13010ab6997fdb31fe174b4c2bf96fd74"} May 29 17:31:48.376796 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:48.376757 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ttrl9" event={"ID":"e75f1628-0b78-4da8-8842-714be82d7308","Type":"ContainerStarted","Data":"5b5ec00d2d36b0e58acdb81d1996c6dc76cca282b4c2604a1f1b053aab21fc8a"} May 29 17:31:48.405598 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:48.405559 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95w4p" event={"ID":"8f600c44-f078-461d-b75f-bac51676fd2d","Type":"ContainerStarted","Data":"e02ad592c7b017d58b4ab5ff96a815a4ca6f1ddeae863ee953cbc0a64a91e0b5"} May 29 17:31:48.415958 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:48.415922 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal" event={"ID":"f163f355a8c28c9c3dd29ffeb15632a3","Type":"ContainerStarted","Data":"95e5910445785e81e58f526cd3d8af8b1f348646f14585dc6c5bb37f6cc759aa"} May 29 17:31:48.432567 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:48.432475 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mfs9d" event={"ID":"f3395817-65a6-4c39-9a0c-a610c2dda031","Type":"ContainerStarted","Data":"5696cdacd17dd74c9dff306e11a4d5491d23e2545657894f4715a6d2dd77a681"} May 29 17:31:48.436488 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:48.436439 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v8trn" event={"ID":"92b4d776-17cd-4b31-9dea-c4fb783ed515","Type":"ContainerStarted","Data":"f09a5cdf5a7ce0c024f15d566905e766bb1d7fc2d5ee961f8806dd18152dd466"} May 29 17:31:48.450515 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:48.450476 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" event={"ID":"09f1ad69-c9d7-4fbb-817a-af2956d532e8","Type":"ContainerStarted","Data":"0de2f85a178e5ea178d8dcfa01726631996c2ca7b038ed84c8991a9f76f24c39"} May 29 17:31:48.457572 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:48.457540 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-221.ec2.internal" event={"ID":"4855e81ed8bee2be722afee434bf936b","Type":"ContainerStarted","Data":"7ee0505e5eab656623bff6517af5eb234f5f74f42415db22c397d118da9d9e62"} May 29 17:31:48.866807 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:48.865966 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ee27fe1-5b5c-469c-b841-914fb8f1eb48-original-pull-secret\") pod \"global-pull-secret-syncer-r8mnd\" (UID: \"7ee27fe1-5b5c-469c-b841-914fb8f1eb48\") " pod="kube-system/global-pull-secret-syncer-r8mnd" May 29 17:31:48.866807 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:48.866023 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49-metrics-certs\") pod \"network-metrics-daemon-bcp7w\" (UID: \"d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49\") " pod="openshift-multus/network-metrics-daemon-bcp7w" May 29 17:31:48.866807 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:48.866216 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 17:31:48.866807 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:48.866287 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49-metrics-certs podName:d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49 nodeName:}" failed. No retries permitted until 2026-05-29 17:31:50.866267805 +0000 UTC m=+5.139495186 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49-metrics-certs") pod "network-metrics-daemon-bcp7w" (UID: "d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 17:31:48.866807 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:48.866685 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 29 17:31:48.866807 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:48.866778 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ee27fe1-5b5c-469c-b841-914fb8f1eb48-original-pull-secret podName:7ee27fe1-5b5c-469c-b841-914fb8f1eb48 nodeName:}" failed. No retries permitted until 2026-05-29 17:31:50.86676029 +0000 UTC m=+5.139987671 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ee27fe1-5b5c-469c-b841-914fb8f1eb48-original-pull-secret") pod "global-pull-secret-syncer-r8mnd" (UID: "7ee27fe1-5b5c-469c-b841-914fb8f1eb48") : object "kube-system"/"original-pull-secret" not registered May 29 17:31:49.068796 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:49.068109 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hwqbz\" (UniqueName: \"kubernetes.io/projected/c3c798e6-b4da-4967-89c3-cf3d1e94cd4a-kube-api-access-hwqbz\") pod \"network-check-target-95vg5\" (UID: \"c3c798e6-b4da-4967-89c3-cf3d1e94cd4a\") " pod="openshift-network-diagnostics/network-check-target-95vg5" May 29 17:31:49.068796 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:49.068313 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 17:31:49.068796 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:49.068333 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 17:31:49.068796 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:49.068347 2567 projected.go:194] Error preparing data for projected volume kube-api-access-hwqbz for pod openshift-network-diagnostics/network-check-target-95vg5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 17:31:49.068796 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:49.068409 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3c798e6-b4da-4967-89c3-cf3d1e94cd4a-kube-api-access-hwqbz podName:c3c798e6-b4da-4967-89c3-cf3d1e94cd4a nodeName:}" failed. No retries permitted until 2026-05-29 17:31:51.068391055 +0000 UTC m=+5.341618427 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hwqbz" (UniqueName: "kubernetes.io/projected/c3c798e6-b4da-4967-89c3-cf3d1e94cd4a-kube-api-access-hwqbz") pod "network-check-target-95vg5" (UID: "c3c798e6-b4da-4967-89c3-cf3d1e94cd4a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 17:31:49.281749 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:49.281608 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-28 17:26:47 +0000 UTC" deadline="2028-01-19 17:24:08.079554486 +0000 UTC" May 29 17:31:49.281749 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:49.281648 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14399h52m18.797910687s" May 29 17:31:49.309377 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:49.308450 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcp7w" May 29 17:31:49.309377 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:49.308594 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcp7w" podUID="d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49" May 29 17:31:49.309377 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:49.309055 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95vg5" May 29 17:31:49.309377 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:49.309143 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95vg5" podUID="c3c798e6-b4da-4967-89c3-cf3d1e94cd4a" May 29 17:31:49.309377 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:49.309213 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8mnd" May 29 17:31:49.309377 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:49.309288 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8mnd" podUID="7ee27fe1-5b5c-469c-b841-914fb8f1eb48" May 29 17:31:50.884445 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:50.883845 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ee27fe1-5b5c-469c-b841-914fb8f1eb48-original-pull-secret\") pod \"global-pull-secret-syncer-r8mnd\" (UID: \"7ee27fe1-5b5c-469c-b841-914fb8f1eb48\") " pod="kube-system/global-pull-secret-syncer-r8mnd" May 29 17:31:50.884445 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:50.883895 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49-metrics-certs\") pod \"network-metrics-daemon-bcp7w\" (UID: \"d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49\") " pod="openshift-multus/network-metrics-daemon-bcp7w" May 29 17:31:50.884445 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:50.884042 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 17:31:50.884445 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:50.884111 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 29 17:31:50.884445 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:50.884113 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49-metrics-certs podName:d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49 nodeName:}" failed. No retries permitted until 2026-05-29 17:31:54.884093838 +0000 UTC m=+9.157321217 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49-metrics-certs") pod "network-metrics-daemon-bcp7w" (UID: "d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 17:31:50.884445 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:50.884158 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ee27fe1-5b5c-469c-b841-914fb8f1eb48-original-pull-secret podName:7ee27fe1-5b5c-469c-b841-914fb8f1eb48 nodeName:}" failed. No retries permitted until 2026-05-29 17:31:54.88414687 +0000 UTC m=+9.157374231 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ee27fe1-5b5c-469c-b841-914fb8f1eb48-original-pull-secret") pod "global-pull-secret-syncer-r8mnd" (UID: "7ee27fe1-5b5c-469c-b841-914fb8f1eb48") : object "kube-system"/"original-pull-secret" not registered May 29 17:31:51.084893 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:51.084862 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hwqbz\" (UniqueName: \"kubernetes.io/projected/c3c798e6-b4da-4967-89c3-cf3d1e94cd4a-kube-api-access-hwqbz\") pod \"network-check-target-95vg5\" (UID: \"c3c798e6-b4da-4967-89c3-cf3d1e94cd4a\") " pod="openshift-network-diagnostics/network-check-target-95vg5" May 29 17:31:51.085061 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:51.085028 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 17:31:51.085061 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:51.085053 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 17:31:51.085184 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:51.085066 2567 projected.go:194] Error preparing data for projected volume kube-api-access-hwqbz for pod openshift-network-diagnostics/network-check-target-95vg5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 17:31:51.085184 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:51.085137 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3c798e6-b4da-4967-89c3-cf3d1e94cd4a-kube-api-access-hwqbz podName:c3c798e6-b4da-4967-89c3-cf3d1e94cd4a nodeName:}" failed. No retries permitted until 2026-05-29 17:31:55.08511474 +0000 UTC m=+9.358342113 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hwqbz" (UniqueName: "kubernetes.io/projected/c3c798e6-b4da-4967-89c3-cf3d1e94cd4a-kube-api-access-hwqbz") pod "network-check-target-95vg5" (UID: "c3c798e6-b4da-4967-89c3-cf3d1e94cd4a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 17:31:51.308119 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:51.308046 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcp7w" May 29 17:31:51.308287 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:51.308190 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcp7w" podUID="d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49" May 29 17:31:51.308805 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:51.308547 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95vg5" May 29 17:31:51.308805 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:51.308635 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95vg5" podUID="c3c798e6-b4da-4967-89c3-cf3d1e94cd4a" May 29 17:31:51.308805 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:51.308683 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8mnd" May 29 17:31:51.308805 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:51.308781 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8mnd" podUID="7ee27fe1-5b5c-469c-b841-914fb8f1eb48" May 29 17:31:53.308353 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:53.308314 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95vg5" May 29 17:31:53.308833 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:53.308438 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95vg5" podUID="c3c798e6-b4da-4967-89c3-cf3d1e94cd4a" May 29 17:31:53.308833 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:53.308314 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcp7w" May 29 17:31:53.308833 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:53.308314 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8mnd" May 29 17:31:53.308833 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:53.308541 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcp7w" podUID="d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49" May 29 17:31:53.308833 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:53.308664 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8mnd" podUID="7ee27fe1-5b5c-469c-b841-914fb8f1eb48" May 29 17:31:54.915558 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:54.915523 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ee27fe1-5b5c-469c-b841-914fb8f1eb48-original-pull-secret\") pod \"global-pull-secret-syncer-r8mnd\" (UID: \"7ee27fe1-5b5c-469c-b841-914fb8f1eb48\") " pod="kube-system/global-pull-secret-syncer-r8mnd" May 29 17:31:54.915558 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:54.915566 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49-metrics-certs\") pod \"network-metrics-daemon-bcp7w\" (UID: \"d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49\") " pod="openshift-multus/network-metrics-daemon-bcp7w" May 29 17:31:54.916098 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:54.915687 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 17:31:54.916098 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:54.915689 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 29 17:31:54.916098 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:54.915775 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49-metrics-certs podName:d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49 nodeName:}" failed. No retries permitted until 2026-05-29 17:32:02.915755486 +0000 UTC m=+17.188982865 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49-metrics-certs") pod "network-metrics-daemon-bcp7w" (UID: "d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 17:31:54.916098 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:54.915794 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ee27fe1-5b5c-469c-b841-914fb8f1eb48-original-pull-secret podName:7ee27fe1-5b5c-469c-b841-914fb8f1eb48 nodeName:}" failed. No retries permitted until 2026-05-29 17:32:02.915784958 +0000 UTC m=+17.189012318 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ee27fe1-5b5c-469c-b841-914fb8f1eb48-original-pull-secret") pod "global-pull-secret-syncer-r8mnd" (UID: "7ee27fe1-5b5c-469c-b841-914fb8f1eb48") : object "kube-system"/"original-pull-secret" not registered May 29 17:31:55.117885 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:55.117817 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hwqbz\" (UniqueName: \"kubernetes.io/projected/c3c798e6-b4da-4967-89c3-cf3d1e94cd4a-kube-api-access-hwqbz\") pod \"network-check-target-95vg5\" (UID: \"c3c798e6-b4da-4967-89c3-cf3d1e94cd4a\") " pod="openshift-network-diagnostics/network-check-target-95vg5" May 29 17:31:55.118234 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:55.118062 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 17:31:55.118234 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:55.118092 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 17:31:55.118234 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:55.118107 2567 projected.go:194] Error preparing data for projected volume kube-api-access-hwqbz for pod openshift-network-diagnostics/network-check-target-95vg5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 17:31:55.118234 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:55.118175 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3c798e6-b4da-4967-89c3-cf3d1e94cd4a-kube-api-access-hwqbz podName:c3c798e6-b4da-4967-89c3-cf3d1e94cd4a nodeName:}" failed. No retries permitted until 2026-05-29 17:32:03.118154741 +0000 UTC m=+17.391382112 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hwqbz" (UniqueName: "kubernetes.io/projected/c3c798e6-b4da-4967-89c3-cf3d1e94cd4a-kube-api-access-hwqbz") pod "network-check-target-95vg5" (UID: "c3c798e6-b4da-4967-89c3-cf3d1e94cd4a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 17:31:55.308863 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:55.308774 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8mnd" May 29 17:31:55.308863 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:55.308823 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcp7w" May 29 17:31:55.309103 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:55.308913 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8mnd" podUID="7ee27fe1-5b5c-469c-b841-914fb8f1eb48" May 29 17:31:55.309103 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:55.308971 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95vg5" May 29 17:31:55.309103 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:55.309057 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95vg5" podUID="c3c798e6-b4da-4967-89c3-cf3d1e94cd4a" May 29 17:31:55.309264 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:55.309150 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcp7w" podUID="d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49" May 29 17:31:57.308777 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:57.308630 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8mnd" May 29 17:31:57.308777 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:57.308655 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcp7w" May 29 17:31:57.309386 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:57.308777 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95vg5" May 29 17:31:57.309386 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:57.308785 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcp7w" podUID="d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49" May 29 17:31:57.309386 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:57.308903 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95vg5" podUID="c3c798e6-b4da-4967-89c3-cf3d1e94cd4a" May 29 17:31:57.309386 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:57.308999 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8mnd" podUID="7ee27fe1-5b5c-469c-b841-914fb8f1eb48" May 29 17:31:59.308489 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:59.308453 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcp7w" May 29 17:31:59.309006 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:59.308453 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95vg5" May 29 17:31:59.309006 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:59.308577 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcp7w" podUID="d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49" May 29 17:31:59.309006 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:31:59.308453 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8mnd" May 29 17:31:59.309006 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:59.308661 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95vg5" podUID="c3c798e6-b4da-4967-89c3-cf3d1e94cd4a" May 29 17:31:59.309006 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:31:59.308777 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8mnd" podUID="7ee27fe1-5b5c-469c-b841-914fb8f1eb48" May 29 17:32:01.308439 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:01.308402 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8mnd" May 29 17:32:01.308902 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:01.308448 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcp7w" May 29 17:32:01.308902 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:01.308518 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8mnd" podUID="7ee27fe1-5b5c-469c-b841-914fb8f1eb48" May 29 17:32:01.308902 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:01.308624 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcp7w" podUID="d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49" May 29 17:32:01.308902 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:01.308687 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95vg5" May 29 17:32:01.308902 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:01.308783 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95vg5" podUID="c3c798e6-b4da-4967-89c3-cf3d1e94cd4a" May 29 17:32:02.983544 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:02.983497 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ee27fe1-5b5c-469c-b841-914fb8f1eb48-original-pull-secret\") pod \"global-pull-secret-syncer-r8mnd\" (UID: \"7ee27fe1-5b5c-469c-b841-914fb8f1eb48\") " pod="kube-system/global-pull-secret-syncer-r8mnd" May 29 17:32:02.983544 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:02.983547 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49-metrics-certs\") pod \"network-metrics-daemon-bcp7w\" (UID: \"d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49\") " pod="openshift-multus/network-metrics-daemon-bcp7w" May 29 17:32:02.984083 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:02.983657 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 29 17:32:02.984083 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:02.983667 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 17:32:02.984083 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:02.983746 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ee27fe1-5b5c-469c-b841-914fb8f1eb48-original-pull-secret podName:7ee27fe1-5b5c-469c-b841-914fb8f1eb48 nodeName:}" failed. No retries permitted until 2026-05-29 17:32:18.983710776 +0000 UTC m=+33.256938144 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ee27fe1-5b5c-469c-b841-914fb8f1eb48-original-pull-secret") pod "global-pull-secret-syncer-r8mnd" (UID: "7ee27fe1-5b5c-469c-b841-914fb8f1eb48") : object "kube-system"/"original-pull-secret" not registered May 29 17:32:02.984083 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:02.983768 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49-metrics-certs podName:d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49 nodeName:}" failed. No retries permitted until 2026-05-29 17:32:18.98375792 +0000 UTC m=+33.256985278 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49-metrics-certs") pod "network-metrics-daemon-bcp7w" (UID: "d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 17:32:03.184915 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:03.184874 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hwqbz\" (UniqueName: \"kubernetes.io/projected/c3c798e6-b4da-4967-89c3-cf3d1e94cd4a-kube-api-access-hwqbz\") pod \"network-check-target-95vg5\" (UID: \"c3c798e6-b4da-4967-89c3-cf3d1e94cd4a\") " pod="openshift-network-diagnostics/network-check-target-95vg5" May 29 17:32:03.185098 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:03.185038 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 17:32:03.185098 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:03.185065 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 17:32:03.185098 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:03.185079 2567 projected.go:194] Error preparing data for projected volume kube-api-access-hwqbz for pod openshift-network-diagnostics/network-check-target-95vg5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 17:32:03.185235 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:03.185137 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3c798e6-b4da-4967-89c3-cf3d1e94cd4a-kube-api-access-hwqbz podName:c3c798e6-b4da-4967-89c3-cf3d1e94cd4a nodeName:}" failed. No retries permitted until 2026-05-29 17:32:19.185124044 +0000 UTC m=+33.458351400 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hwqbz" (UniqueName: "kubernetes.io/projected/c3c798e6-b4da-4967-89c3-cf3d1e94cd4a-kube-api-access-hwqbz") pod "network-check-target-95vg5" (UID: "c3c798e6-b4da-4967-89c3-cf3d1e94cd4a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 17:32:03.308535 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:03.308456 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95vg5" May 29 17:32:03.308535 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:03.308483 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8mnd" May 29 17:32:03.308535 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:03.308456 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcp7w" May 29 17:32:03.308747 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:03.308592 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8mnd" podUID="7ee27fe1-5b5c-469c-b841-914fb8f1eb48" May 29 17:32:03.308747 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:03.308649 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcp7w" podUID="d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49" May 29 17:32:03.308817 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:03.308770 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95vg5" podUID="c3c798e6-b4da-4967-89c3-cf3d1e94cd4a" May 29 17:32:05.308942 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:05.308906 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8mnd" May 29 17:32:05.309402 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:05.308906 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95vg5" May 29 17:32:05.309402 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:05.309026 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8mnd" podUID="7ee27fe1-5b5c-469c-b841-914fb8f1eb48" May 29 17:32:05.309402 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:05.308909 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcp7w" May 29 17:32:05.309402 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:05.309133 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95vg5" podUID="c3c798e6-b4da-4967-89c3-cf3d1e94cd4a" May 29 17:32:05.309402 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:05.309273 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcp7w" podUID="d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49" May 29 17:32:07.308440 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:07.308281 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8mnd" May 29 17:32:07.309063 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:07.308281 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcp7w" May 29 17:32:07.309063 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:07.308523 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8mnd" podUID="7ee27fe1-5b5c-469c-b841-914fb8f1eb48" May 29 17:32:07.309063 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:07.308368 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95vg5" May 29 17:32:07.309063 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:07.308597 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcp7w" podUID="d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49" May 29 17:32:07.309063 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:07.308655 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95vg5" podUID="c3c798e6-b4da-4967-89c3-cf3d1e94cd4a" May 29 17:32:07.534332 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:07.534258 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w49xp_b127b743-ab2d-443c-beda-d0e62ec97544/ovn-acl-logging/0.log" May 29 17:32:07.534567 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:07.534548 2567 generic.go:358] "Generic (PLEG): container finished" podID="b127b743-ab2d-443c-beda-d0e62ec97544" containerID="b47ff1e8d7be198787a3146f5dd6f3431a590a87d4086c15c69bdeaff708e078" exitCode=1 May 29 17:32:07.534625 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:07.534611 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" event={"ID":"b127b743-ab2d-443c-beda-d0e62ec97544","Type":"ContainerStarted","Data":"603227b0ab7f45707795c8e0a41133996469b11df0f7bfb63256c2ae39d4d320"} May 29 17:32:07.534668 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:07.534637 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" event={"ID":"b127b743-ab2d-443c-beda-d0e62ec97544","Type":"ContainerStarted","Data":"b5ca4d1cb4ea16c5a50d7967a602466426a1e4271be186971189b4686ceb55c8"} May 29 17:32:07.534668 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:07.534647 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" event={"ID":"b127b743-ab2d-443c-beda-d0e62ec97544","Type":"ContainerStarted","Data":"cd55431380fd910153c2f60e9c33d1c94e074078958b66593a9b0e6a707b29b2"} May 29 17:32:07.534668 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:07.534655 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" event={"ID":"b127b743-ab2d-443c-beda-d0e62ec97544","Type":"ContainerStarted","Data":"8423993e33a8e009d6a5312aef1fae292d80a18f6193a43e84a3aaef3a5873ba"} May 29 17:32:07.534668 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:07.534662 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" event={"ID":"b127b743-ab2d-443c-beda-d0e62ec97544","Type":"ContainerDied","Data":"b47ff1e8d7be198787a3146f5dd6f3431a590a87d4086c15c69bdeaff708e078"} May 29 17:32:07.534866 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:07.534675 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" event={"ID":"b127b743-ab2d-443c-beda-d0e62ec97544","Type":"ContainerStarted","Data":"b22fc306e41018794926b91aedee1561f3f73ac1776fcc1a4ac23153337e44cc"} May 29 17:32:07.537602 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:07.537574 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jp89n" event={"ID":"75241da4-b76f-468e-b501-eeab92ff75d7","Type":"ContainerStarted","Data":"5554a324b1dd3f764f539825e0100e52e74f45da04a6d0153977aa6b47775a5c"} May 29 17:32:07.538947 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:07.538925 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" event={"ID":"09f1ad69-c9d7-4fbb-817a-af2956d532e8","Type":"ContainerStarted","Data":"fef44c1e9c285b6fcfd1600bfd53724f1d4f2652a356281a5a90c43682858b03"} May 29 17:32:07.540077 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:07.540053 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-221.ec2.internal" event={"ID":"4855e81ed8bee2be722afee434bf936b","Type":"ContainerStarted","Data":"25d536ea4117bb7df73f1d299d5ef570522832880dbc1962c0c8e485fd2388f1"} May 29 17:32:07.554506 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:07.554458 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-jp89n" podStartSLOduration=2.777626671 podStartE2EDuration="21.554446535s" podCreationTimestamp="2026-05-29 17:31:46 +0000 UTC" firstStartedPulling="2026-05-29 17:31:47.67947391 +0000 UTC m=+1.952701271" lastFinishedPulling="2026-05-29 17:32:06.456293763 +0000 UTC m=+20.729521135" observedRunningTime="2026-05-29 17:32:07.554268815 +0000 UTC m=+21.827496195" watchObservedRunningTime="2026-05-29 17:32:07.554446535 +0000 UTC m=+21.827673913" May 29 17:32:07.566578 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:07.566541 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-221.ec2.internal" podStartSLOduration=20.56652907 podStartE2EDuration="20.56652907s" podCreationTimestamp="2026-05-29 17:31:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:32:07.566054839 +0000 UTC m=+21.839282217" watchObservedRunningTime="2026-05-29 17:32:07.56652907 +0000 UTC m=+21.839756448" May 29 17:32:08.543618 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:08.543339 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8lmqz" event={"ID":"8743123a-c7a3-4dba-b656-622c9a23c6e6","Type":"ContainerStarted","Data":"57b1d6b8cc2444552645305e7d01412a2e3063d8567aa36c76c94224baae9a1a"} May 29 17:32:08.544640 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:08.544605 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzntn" event={"ID":"6a6a5a92-9a66-4acb-86d8-7bd102357b41","Type":"ContainerStarted","Data":"60d1add8bd5a36a68649cd3e38d54bd9f7412849b569677d6d33dcd53b0fbfe1"} May 29 17:32:08.545827 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:08.545803 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ttrl9" event={"ID":"e75f1628-0b78-4da8-8842-714be82d7308","Type":"ContainerStarted","Data":"81727d262bf1256979890edfa2bd3d5134dab596dbd1a5d5b1781886f7a0340d"} May 29 17:32:08.547158 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:08.547135 2567 generic.go:358] "Generic (PLEG): container finished" podID="8f600c44-f078-461d-b75f-bac51676fd2d" containerID="39c68aade79e6d1a6ce5f9fa21af716b14f40be99897db20d1b3f77b4c3606a6" exitCode=0 May 29 17:32:08.547263 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:08.547195 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95w4p" event={"ID":"8f600c44-f078-461d-b75f-bac51676fd2d","Type":"ContainerDied","Data":"39c68aade79e6d1a6ce5f9fa21af716b14f40be99897db20d1b3f77b4c3606a6"} May 29 17:32:08.548636 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:08.548609 2567 generic.go:358] "Generic (PLEG): container finished" podID="f163f355a8c28c9c3dd29ffeb15632a3" containerID="cade72d02f422a2e1f321fca84b85822d2c97f8d7aa5b9938414d4edda4a085c" exitCode=0 May 29 17:32:08.549038 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:08.548667 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal" event={"ID":"f163f355a8c28c9c3dd29ffeb15632a3","Type":"ContainerDied","Data":"cade72d02f422a2e1f321fca84b85822d2c97f8d7aa5b9938414d4edda4a085c"} May 29 17:32:08.549929 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:08.549911 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mfs9d" event={"ID":"f3395817-65a6-4c39-9a0c-a610c2dda031","Type":"ContainerStarted","Data":"eb562132411ab2f5adc63e827c0556c5bd617c1b2e6f67459c2a0f2f72027056"} May 29 17:32:08.551236 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:08.551202 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v8trn" event={"ID":"92b4d776-17cd-4b31-9dea-c4fb783ed515","Type":"ContainerStarted","Data":"a5a1c03a718df928001b3dc6da15e84ba46fcf4f65d5faf556ce020ce9d10a5e"} May 29 17:32:08.558214 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:08.558176 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zlvq6" podStartSLOduration=3.727897193 podStartE2EDuration="22.558166673s" podCreationTimestamp="2026-05-29 17:31:46 +0000 UTC" firstStartedPulling="2026-05-29 17:31:47.589254496 +0000 UTC m=+1.862481853" lastFinishedPulling="2026-05-29 17:32:06.419523962 +0000 UTC m=+20.692751333" observedRunningTime="2026-05-29 17:32:07.583980832 +0000 UTC m=+21.857208210" watchObservedRunningTime="2026-05-29 17:32:08.558166673 +0000 UTC m=+22.831394052" May 29 17:32:08.558435 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:08.558413 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-8lmqz" podStartSLOduration=8.504404593 podStartE2EDuration="22.558408274s" podCreationTimestamp="2026-05-29 17:31:46 +0000 UTC" firstStartedPulling="2026-05-29 17:31:47.643273866 +0000 UTC m=+1.916501223" lastFinishedPulling="2026-05-29 17:32:01.697277547 +0000 UTC m=+15.970504904" observedRunningTime="2026-05-29 17:32:08.558119414 +0000 UTC m=+22.831346792" watchObservedRunningTime="2026-05-29 17:32:08.558408274 +0000 UTC m=+22.831635652" May 29 17:32:08.597745 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:08.597674 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mfs9d" podStartSLOduration=3.865677915 podStartE2EDuration="22.597656239s" podCreationTimestamp="2026-05-29 17:31:46 +0000 UTC" firstStartedPulling="2026-05-29 17:31:47.687542521 +0000 UTC m=+1.960769884" lastFinishedPulling="2026-05-29 17:32:06.419520835 +0000 UTC m=+20.692748208" observedRunningTime="2026-05-29 17:32:08.573688031 +0000 UTC m=+22.846915405" watchObservedRunningTime="2026-05-29 17:32:08.597656239 +0000 UTC m=+22.870883619" May 29 17:32:08.629137 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:08.628798 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ttrl9" podStartSLOduration=3.749094568 podStartE2EDuration="22.628782263s" podCreationTimestamp="2026-05-29 17:31:46 +0000 UTC" firstStartedPulling="2026-05-29 17:31:47.573824066 +0000 UTC m=+1.847051423" lastFinishedPulling="2026-05-29 17:32:06.453511752 +0000 UTC m=+20.726739118" observedRunningTime="2026-05-29 17:32:08.6280729 +0000 UTC m=+22.901300279" watchObservedRunningTime="2026-05-29 17:32:08.628782263 +0000 UTC m=+22.902009643" May 29 17:32:09.308587 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:09.308566 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcp7w" May 29 17:32:09.308690 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:09.308664 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcp7w" podUID="d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49" May 29 17:32:09.308690 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:09.308673 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8mnd" May 29 17:32:09.308782 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:09.308685 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95vg5" May 29 17:32:09.308821 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:09.308779 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8mnd" podUID="7ee27fe1-5b5c-469c-b841-914fb8f1eb48" May 29 17:32:09.308868 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:09.308854 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95vg5" podUID="c3c798e6-b4da-4967-89c3-cf3d1e94cd4a" May 29 17:32:09.514165 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:09.513958 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 29 17:32:09.555411 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:09.555336 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzntn" event={"ID":"6a6a5a92-9a66-4acb-86d8-7bd102357b41","Type":"ContainerStarted","Data":"14c847714245d6141293d3e797e2ef12f2c90d8a9aad953590f825a73fbe896d"} May 29 17:32:09.557053 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:09.557022 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal" event={"ID":"f163f355a8c28c9c3dd29ffeb15632a3","Type":"ContainerStarted","Data":"8944aeff60355e46c42a8513609424c09db77563553a562d61465e7604f13e67"} May 29 17:32:09.559604 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:09.559586 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w49xp_b127b743-ab2d-443c-beda-d0e62ec97544/ovn-acl-logging/0.log" May 29 17:32:09.560017 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:09.559987 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" event={"ID":"b127b743-ab2d-443c-beda-d0e62ec97544","Type":"ContainerStarted","Data":"b8323ebd48ade3bfa88b3c628ef28ee64ba9b946f4148aff9921d24ca4ea0c63"} May 29 17:32:09.570672 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:09.570624 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal" podStartSLOduration=22.570611657 podStartE2EDuration="22.570611657s" podCreationTimestamp="2026-05-29 17:31:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:32:09.570372253 +0000 UTC m=+23.843599634" watchObservedRunningTime="2026-05-29 17:32:09.570611657 +0000 UTC m=+23.843839036" May 29 17:32:09.570973 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:09.570938 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-v8trn" podStartSLOduration=4.728825339 podStartE2EDuration="23.570926294s" podCreationTimestamp="2026-05-29 17:31:46 +0000 UTC" firstStartedPulling="2026-05-29 17:31:47.611395011 +0000 UTC m=+1.884622371" lastFinishedPulling="2026-05-29 17:32:06.453495955 +0000 UTC m=+20.726723326" observedRunningTime="2026-05-29 17:32:08.666419874 +0000 UTC m=+22.939647253" watchObservedRunningTime="2026-05-29 17:32:09.570926294 +0000 UTC m=+23.844153675" May 29 17:32:10.310734 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:10.310633 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-29T17:32:09.514159793Z","UUID":"d9b129f7-e53a-4d80-a7ab-f3cb61e799c4","Handler":null,"Name":"","Endpoint":""} May 29 17:32:10.313172 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:10.313149 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 29 17:32:10.313319 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:10.313180 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 29 17:32:11.308806 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:11.308738 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95vg5" May 29 17:32:11.309366 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:11.308741 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8mnd" May 29 17:32:11.309366 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:11.308827 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95vg5" podUID="c3c798e6-b4da-4967-89c3-cf3d1e94cd4a" May 29 17:32:11.309366 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:11.308930 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8mnd" podUID="7ee27fe1-5b5c-469c-b841-914fb8f1eb48" May 29 17:32:11.309366 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:11.308962 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcp7w" May 29 17:32:11.309366 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:11.309056 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcp7w" podUID="d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49" May 29 17:32:11.565992 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:11.565958 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzntn" event={"ID":"6a6a5a92-9a66-4acb-86d8-7bd102357b41","Type":"ContainerStarted","Data":"38f4c2568c406ab4cf806a62a52d8f4c1eb998a1f2d3a4b19524caaa396d81bd"} May 29 17:32:11.585197 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:11.585150 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzntn" podStartSLOduration=2.358281314 podStartE2EDuration="25.585132682s" podCreationTimestamp="2026-05-29 17:31:46 +0000 UTC" firstStartedPulling="2026-05-29 17:31:47.621683653 +0000 UTC m=+1.894911010" lastFinishedPulling="2026-05-29 17:32:10.848535007 +0000 UTC m=+25.121762378" observedRunningTime="2026-05-29 17:32:11.584860856 +0000 UTC m=+25.858088230" watchObservedRunningTime="2026-05-29 17:32:11.585132682 +0000 UTC m=+25.858360063" May 29 17:32:12.570310 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:12.570132 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w49xp_b127b743-ab2d-443c-beda-d0e62ec97544/ovn-acl-logging/0.log" May 29 17:32:12.571069 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:12.570639 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" event={"ID":"b127b743-ab2d-443c-beda-d0e62ec97544","Type":"ContainerStarted","Data":"93874840da12ad7c9bfa9fcb801c4866e21215df9ea2bc4cfb7fa709ae52e961"} May 29 17:32:12.571231 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:12.571214 2567 scope.go:117] "RemoveContainer" containerID="b47ff1e8d7be198787a3146f5dd6f3431a590a87d4086c15c69bdeaff708e078" May 29 17:32:13.308632 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:13.308587 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95vg5" May 29 17:32:13.308632 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:13.308617 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcp7w" May 29 17:32:13.308860 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:13.308602 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8mnd" May 29 17:32:13.308860 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:13.308778 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcp7w" podUID="d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49" May 29 17:32:13.308860 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:13.308823 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8mnd" podUID="7ee27fe1-5b5c-469c-b841-914fb8f1eb48" May 29 17:32:13.309013 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:13.308903 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95vg5" podUID="c3c798e6-b4da-4967-89c3-cf3d1e94cd4a" May 29 17:32:13.396414 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:13.396367 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ttrl9" May 29 17:32:13.397065 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:13.397041 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ttrl9" May 29 17:32:13.492189 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:13.492149 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-95vg5"] May 29 17:32:13.495522 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:13.495490 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r8mnd"] May 29 17:32:13.496221 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:13.496181 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bcp7w"] May 29 17:32:13.576508 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:13.576432 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w49xp_b127b743-ab2d-443c-beda-d0e62ec97544/ovn-acl-logging/0.log" May 29 17:32:13.577030 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:13.576926 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8mnd" May 29 17:32:13.577030 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:13.576983 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" event={"ID":"b127b743-ab2d-443c-beda-d0e62ec97544","Type":"ContainerStarted","Data":"cf0c9cdbb22b9af26f08d0b578074a7214563f0d0883470f8a3848a1efe1713f"} May 29 17:32:13.577128 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:13.577071 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8mnd" podUID="7ee27fe1-5b5c-469c-b841-914fb8f1eb48" May 29 17:32:13.577128 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:13.577115 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:32:13.577242 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:13.577141 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:32:13.577242 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:13.577154 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:32:13.577396 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:13.577368 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcp7w" May 29 17:32:13.577502 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:13.577482 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcp7w" podUID="d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49" May 29 17:32:13.577562 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:13.577520 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ttrl9" May 29 17:32:13.577611 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:13.577600 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95vg5" May 29 17:32:13.577696 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:13.577677 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95vg5" podUID="c3c798e6-b4da-4967-89c3-cf3d1e94cd4a" May 29 17:32:13.577883 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:13.577863 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ttrl9" May 29 17:32:13.594815 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:13.594718 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:32:13.594966 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:13.594945 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:32:13.606537 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:13.605069 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" podStartSLOduration=8.79478307 podStartE2EDuration="27.605052173s" podCreationTimestamp="2026-05-29 17:31:46 +0000 UTC" firstStartedPulling="2026-05-29 17:31:47.690938276 +0000 UTC m=+1.964165632" lastFinishedPulling="2026-05-29 17:32:06.501207378 +0000 UTC m=+20.774434735" observedRunningTime="2026-05-29 17:32:13.604514532 +0000 UTC m=+27.877741926" watchObservedRunningTime="2026-05-29 17:32:13.605052173 +0000 UTC m=+27.878279552" May 29 17:32:15.308938 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:15.308903 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95vg5" May 29 17:32:15.308938 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:15.308922 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcp7w" May 29 17:32:15.309435 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:15.308903 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8mnd" May 29 17:32:15.309435 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:15.309023 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95vg5" podUID="c3c798e6-b4da-4967-89c3-cf3d1e94cd4a" May 29 17:32:15.309435 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:15.309145 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcp7w" podUID="d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49" May 29 17:32:15.309435 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:15.309227 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8mnd" podUID="7ee27fe1-5b5c-469c-b841-914fb8f1eb48" May 29 17:32:15.582247 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:15.581644 2567 generic.go:358] "Generic (PLEG): container finished" podID="8f600c44-f078-461d-b75f-bac51676fd2d" containerID="d254890412ed635981dac960a9cd387330e3bd8a83bb75f3a65608ced724ea6c" exitCode=0 May 29 17:32:15.582247 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:15.581744 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95w4p" event={"ID":"8f600c44-f078-461d-b75f-bac51676fd2d","Type":"ContainerDied","Data":"d254890412ed635981dac960a9cd387330e3bd8a83bb75f3a65608ced724ea6c"} May 29 17:32:16.585362 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:16.585154 2567 generic.go:358] "Generic (PLEG): container finished" podID="8f600c44-f078-461d-b75f-bac51676fd2d" containerID="2f8b9b3030794b2bd60a747c83b0daa7f5fc33325a1221ca65e79b4dc39e9aeb" exitCode=0 May 29 17:32:16.585362 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:16.585248 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95w4p" event={"ID":"8f600c44-f078-461d-b75f-bac51676fd2d","Type":"ContainerDied","Data":"2f8b9b3030794b2bd60a747c83b0daa7f5fc33325a1221ca65e79b4dc39e9aeb"} May 29 17:32:17.308135 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:17.308105 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8mnd" May 29 17:32:17.308283 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:17.308214 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcp7w" May 29 17:32:17.308283 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:17.308230 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8mnd" podUID="7ee27fe1-5b5c-469c-b841-914fb8f1eb48" May 29 17:32:17.308367 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:17.308290 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcp7w" podUID="d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49" May 29 17:32:17.308367 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:17.308336 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95vg5" May 29 17:32:17.308445 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:17.308429 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95vg5" podUID="c3c798e6-b4da-4967-89c3-cf3d1e94cd4a" May 29 17:32:17.589043 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:17.588959 2567 generic.go:358] "Generic (PLEG): container finished" podID="8f600c44-f078-461d-b75f-bac51676fd2d" containerID="9e65fb88f53863c08db859cf541c02f16a0f26d312e2f9c333d4bf860fccbdbd" exitCode=0 May 29 17:32:17.589043 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:17.589013 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95w4p" event={"ID":"8f600c44-f078-461d-b75f-bac51676fd2d","Type":"ContainerDied","Data":"9e65fb88f53863c08db859cf541c02f16a0f26d312e2f9c333d4bf860fccbdbd"} May 29 17:32:19.006539 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.006494 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ee27fe1-5b5c-469c-b841-914fb8f1eb48-original-pull-secret\") pod \"global-pull-secret-syncer-r8mnd\" (UID: \"7ee27fe1-5b5c-469c-b841-914fb8f1eb48\") " pod="kube-system/global-pull-secret-syncer-r8mnd" May 29 17:32:19.007053 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.006550 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49-metrics-certs\") pod \"network-metrics-daemon-bcp7w\" (UID: \"d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49\") " pod="openshift-multus/network-metrics-daemon-bcp7w" May 29 17:32:19.007053 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:19.006657 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 17:32:19.007053 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:19.006658 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 29 17:32:19.007053 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:19.006742 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49-metrics-certs podName:d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49 nodeName:}" failed. No retries permitted until 2026-05-29 17:32:51.006706253 +0000 UTC m=+65.279933615 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49-metrics-certs") pod "network-metrics-daemon-bcp7w" (UID: "d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 17:32:19.007053 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:19.006762 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ee27fe1-5b5c-469c-b841-914fb8f1eb48-original-pull-secret podName:7ee27fe1-5b5c-469c-b841-914fb8f1eb48 nodeName:}" failed. No retries permitted until 2026-05-29 17:32:51.006752375 +0000 UTC m=+65.279979737 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ee27fe1-5b5c-469c-b841-914fb8f1eb48-original-pull-secret") pod "global-pull-secret-syncer-r8mnd" (UID: "7ee27fe1-5b5c-469c-b841-914fb8f1eb48") : object "kube-system"/"original-pull-secret" not registered May 29 17:32:19.208161 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.208078 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hwqbz\" (UniqueName: \"kubernetes.io/projected/c3c798e6-b4da-4967-89c3-cf3d1e94cd4a-kube-api-access-hwqbz\") pod \"network-check-target-95vg5\" (UID: \"c3c798e6-b4da-4967-89c3-cf3d1e94cd4a\") " pod="openshift-network-diagnostics/network-check-target-95vg5" May 29 17:32:19.208294 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:19.208250 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 17:32:19.208294 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:19.208276 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 17:32:19.208294 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:19.208287 2567 projected.go:194] Error preparing data for projected volume kube-api-access-hwqbz for pod openshift-network-diagnostics/network-check-target-95vg5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 17:32:19.208391 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:19.208342 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3c798e6-b4da-4967-89c3-cf3d1e94cd4a-kube-api-access-hwqbz podName:c3c798e6-b4da-4967-89c3-cf3d1e94cd4a nodeName:}" failed. No retries permitted until 2026-05-29 17:32:51.208325471 +0000 UTC m=+65.481552830 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hwqbz" (UniqueName: "kubernetes.io/projected/c3c798e6-b4da-4967-89c3-cf3d1e94cd4a-kube-api-access-hwqbz") pod "network-check-target-95vg5" (UID: "c3c798e6-b4da-4967-89c3-cf3d1e94cd4a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 17:32:19.308772 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.308718 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcp7w" May 29 17:32:19.308953 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.308718 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8mnd" May 29 17:32:19.308953 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:19.308878 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcp7w" podUID="d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49" May 29 17:32:19.308953 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.308919 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95vg5" May 29 17:32:19.309103 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:19.309005 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8mnd" podUID="7ee27fe1-5b5c-469c-b841-914fb8f1eb48" May 29 17:32:19.309103 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:19.309085 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95vg5" podUID="c3c798e6-b4da-4967-89c3-cf3d1e94cd4a" May 29 17:32:19.528893 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.528816 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeReady" May 29 17:32:19.529076 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.528974 2567 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 29 17:32:19.560322 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.560247 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-745dfbbf78-w5ws8"] May 29 17:32:19.563520 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.563495 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-745dfbbf78-w5ws8" May 29 17:32:19.566029 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.566002 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 29 17:32:19.566147 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.566086 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 29 17:32:19.566217 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.566154 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 29 17:32:19.566217 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.566094 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-55j58\"" May 29 17:32:19.570213 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.570183 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4g6sj"] May 29 17:32:19.572339 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.571849 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 29 17:32:19.573302 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.573270 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2kcrl"] May 29 17:32:19.573404 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.573349 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4g6sj" May 29 17:32:19.577444 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.577422 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 29 17:32:19.577694 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.577669 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 29 17:32:19.577892 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.577866 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7x9xz\"" May 29 17:32:19.581960 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.581935 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-745dfbbf78-w5ws8"] May 29 17:32:19.582158 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.582088 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2kcrl" May 29 17:32:19.583362 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.583330 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4g6sj"] May 29 17:32:19.586014 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.585675 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 29 17:32:19.586119 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.586104 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 29 17:32:19.586515 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.586247 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 29 17:32:19.586515 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.586306 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-sf6m9\"" May 29 17:32:19.587170 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.587138 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2kcrl"] May 29 17:32:19.712393 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.712359 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/015a10aa-8188-41f4-8c50-ee5cdf0c3727-ca-trust-extracted\") pod \"image-registry-745dfbbf78-w5ws8\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " pod="openshift-image-registry/image-registry-745dfbbf78-w5ws8" May 29 17:32:19.712393 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.712397 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/015a10aa-8188-41f4-8c50-ee5cdf0c3727-registry-certificates\") pod \"image-registry-745dfbbf78-w5ws8\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " pod="openshift-image-registry/image-registry-745dfbbf78-w5ws8" May 29 17:32:19.712643 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.712423 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/015a10aa-8188-41f4-8c50-ee5cdf0c3727-trusted-ca\") pod \"image-registry-745dfbbf78-w5ws8\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " pod="openshift-image-registry/image-registry-745dfbbf78-w5ws8" May 29 17:32:19.712643 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.712469 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd97r\" (UniqueName: \"kubernetes.io/projected/200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25-kube-api-access-zd97r\") pod \"dns-default-4g6sj\" (UID: \"200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25\") " pod="openshift-dns/dns-default-4g6sj" May 29 17:32:19.712643 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.712495 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59flr\" (UniqueName: \"kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-kube-api-access-59flr\") pod \"image-registry-745dfbbf78-w5ws8\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " pod="openshift-image-registry/image-registry-745dfbbf78-w5ws8" May 29 17:32:19.712643 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.712544 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmn8c\" (UniqueName: \"kubernetes.io/projected/ee552438-fa19-400b-a3f8-f2c6711e7721-kube-api-access-dmn8c\") pod \"ingress-canary-2kcrl\" (UID: \"ee552438-fa19-400b-a3f8-f2c6711e7721\") " pod="openshift-ingress-canary/ingress-canary-2kcrl" May 29 17:32:19.712643 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.712580 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee552438-fa19-400b-a3f8-f2c6711e7721-cert\") pod \"ingress-canary-2kcrl\" (UID: \"ee552438-fa19-400b-a3f8-f2c6711e7721\") " pod="openshift-ingress-canary/ingress-canary-2kcrl" May 29 17:32:19.712643 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.712603 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25-tmp-dir\") pod \"dns-default-4g6sj\" (UID: \"200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25\") " pod="openshift-dns/dns-default-4g6sj" May 29 17:32:19.712929 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.712658 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-bound-sa-token\") pod \"image-registry-745dfbbf78-w5ws8\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " pod="openshift-image-registry/image-registry-745dfbbf78-w5ws8" May 29 17:32:19.712929 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.712681 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25-config-volume\") pod \"dns-default-4g6sj\" (UID: \"200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25\") " pod="openshift-dns/dns-default-4g6sj" May 29 17:32:19.712929 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.712705 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-registry-tls\") pod \"image-registry-745dfbbf78-w5ws8\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " pod="openshift-image-registry/image-registry-745dfbbf78-w5ws8" May 29 17:32:19.712929 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.712736 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/015a10aa-8188-41f4-8c50-ee5cdf0c3727-installation-pull-secrets\") pod \"image-registry-745dfbbf78-w5ws8\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " pod="openshift-image-registry/image-registry-745dfbbf78-w5ws8" May 29 17:32:19.712929 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.712856 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25-metrics-tls\") pod \"dns-default-4g6sj\" (UID: \"200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25\") " pod="openshift-dns/dns-default-4g6sj" May 29 17:32:19.712929 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.712883 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/015a10aa-8188-41f4-8c50-ee5cdf0c3727-image-registry-private-configuration\") pod \"image-registry-745dfbbf78-w5ws8\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " pod="openshift-image-registry/image-registry-745dfbbf78-w5ws8" May 29 17:32:19.813875 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.813842 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-bound-sa-token\") pod \"image-registry-745dfbbf78-w5ws8\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " pod="openshift-image-registry/image-registry-745dfbbf78-w5ws8" May 29 17:32:19.814094 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.813878 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25-config-volume\") pod \"dns-default-4g6sj\" (UID: \"200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25\") " pod="openshift-dns/dns-default-4g6sj" May 29 17:32:19.814094 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.813900 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-registry-tls\") pod \"image-registry-745dfbbf78-w5ws8\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " pod="openshift-image-registry/image-registry-745dfbbf78-w5ws8" May 29 17:32:19.814094 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.813917 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/015a10aa-8188-41f4-8c50-ee5cdf0c3727-installation-pull-secrets\") pod \"image-registry-745dfbbf78-w5ws8\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " pod="openshift-image-registry/image-registry-745dfbbf78-w5ws8" May 29 17:32:19.814094 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.813938 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25-metrics-tls\") pod \"dns-default-4g6sj\" (UID: \"200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25\") " pod="openshift-dns/dns-default-4g6sj" May 29 17:32:19.814094 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.813963 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/015a10aa-8188-41f4-8c50-ee5cdf0c3727-image-registry-private-configuration\") pod \"image-registry-745dfbbf78-w5ws8\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " pod="openshift-image-registry/image-registry-745dfbbf78-w5ws8" May 29 17:32:19.814094 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.813992 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/015a10aa-8188-41f4-8c50-ee5cdf0c3727-ca-trust-extracted\") pod \"image-registry-745dfbbf78-w5ws8\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " pod="openshift-image-registry/image-registry-745dfbbf78-w5ws8" May 29 17:32:19.814094 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.814017 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/015a10aa-8188-41f4-8c50-ee5cdf0c3727-registry-certificates\") pod \"image-registry-745dfbbf78-w5ws8\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " pod="openshift-image-registry/image-registry-745dfbbf78-w5ws8" May 29 17:32:19.814094 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.814041 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/015a10aa-8188-41f4-8c50-ee5cdf0c3727-trusted-ca\") pod \"image-registry-745dfbbf78-w5ws8\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " pod="openshift-image-registry/image-registry-745dfbbf78-w5ws8" May 29 17:32:19.814094 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:19.814042 2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 17:32:19.814094 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:19.814066 2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-745dfbbf78-w5ws8: secret "image-registry-tls" not found May 29 17:32:19.814094 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:19.814072 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 17:32:19.814569 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.814065 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zd97r\" (UniqueName: \"kubernetes.io/projected/200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25-kube-api-access-zd97r\") pod \"dns-default-4g6sj\" (UID: \"200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25\") " pod="openshift-dns/dns-default-4g6sj" May 29 17:32:19.814569 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:19.814131 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25-metrics-tls podName:200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25 nodeName:}" failed. No retries permitted until 2026-05-29 17:32:20.314108384 +0000 UTC m=+34.587335747 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25-metrics-tls") pod "dns-default-4g6sj" (UID: "200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25") : secret "dns-default-metrics-tls" not found May 29 17:32:19.814569 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:19.814312 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-registry-tls podName:015a10aa-8188-41f4-8c50-ee5cdf0c3727 nodeName:}" failed. No retries permitted until 2026-05-29 17:32:20.314284799 +0000 UTC m=+34.587512163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-registry-tls") pod "image-registry-745dfbbf78-w5ws8" (UID: "015a10aa-8188-41f4-8c50-ee5cdf0c3727") : secret "image-registry-tls" not found May 29 17:32:19.814569 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.814357 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-59flr\" (UniqueName: \"kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-kube-api-access-59flr\") pod \"image-registry-745dfbbf78-w5ws8\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " pod="openshift-image-registry/image-registry-745dfbbf78-w5ws8" May 29 17:32:19.814569 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.814424 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dmn8c\" (UniqueName: \"kubernetes.io/projected/ee552438-fa19-400b-a3f8-f2c6711e7721-kube-api-access-dmn8c\") pod \"ingress-canary-2kcrl\" (UID: \"ee552438-fa19-400b-a3f8-f2c6711e7721\") " pod="openshift-ingress-canary/ingress-canary-2kcrl" May 29 17:32:19.814569 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.814486 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee552438-fa19-400b-a3f8-f2c6711e7721-cert\") pod \"ingress-canary-2kcrl\" (UID: \"ee552438-fa19-400b-a3f8-f2c6711e7721\") " pod="openshift-ingress-canary/ingress-canary-2kcrl" May 29 17:32:19.814569 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.814510 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25-tmp-dir\") pod \"dns-default-4g6sj\" (UID: \"200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25\") " pod="openshift-dns/dns-default-4g6sj" May 29 17:32:19.814569 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.814527 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25-config-volume\") pod \"dns-default-4g6sj\" (UID: \"200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25\") " pod="openshift-dns/dns-default-4g6sj" May 29 17:32:19.814969 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.814685 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/015a10aa-8188-41f4-8c50-ee5cdf0c3727-ca-trust-extracted\") pod \"image-registry-745dfbbf78-w5ws8\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " pod="openshift-image-registry/image-registry-745dfbbf78-w5ws8" May 29 17:32:19.814969 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.814705 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/015a10aa-8188-41f4-8c50-ee5cdf0c3727-registry-certificates\") pod \"image-registry-745dfbbf78-w5ws8\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " pod="openshift-image-registry/image-registry-745dfbbf78-w5ws8" May 29 17:32:19.814969 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:19.814811 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 17:32:19.814969 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.814836 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25-tmp-dir\") pod \"dns-default-4g6sj\" (UID: \"200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25\") " pod="openshift-dns/dns-default-4g6sj" May 29 17:32:19.814969 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:19.814861 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee552438-fa19-400b-a3f8-f2c6711e7721-cert podName:ee552438-fa19-400b-a3f8-f2c6711e7721 nodeName:}" failed. No retries permitted until 2026-05-29 17:32:20.314845185 +0000 UTC m=+34.588072541 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ee552438-fa19-400b-a3f8-f2c6711e7721-cert") pod "ingress-canary-2kcrl" (UID: "ee552438-fa19-400b-a3f8-f2c6711e7721") : secret "canary-serving-cert" not found May 29 17:32:19.815215 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.815195 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/015a10aa-8188-41f4-8c50-ee5cdf0c3727-trusted-ca\") pod \"image-registry-745dfbbf78-w5ws8\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " pod="openshift-image-registry/image-registry-745dfbbf78-w5ws8" May 29 17:32:19.818075 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.818035 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/015a10aa-8188-41f4-8c50-ee5cdf0c3727-image-registry-private-configuration\") pod \"image-registry-745dfbbf78-w5ws8\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " pod="openshift-image-registry/image-registry-745dfbbf78-w5ws8" May 29 17:32:19.818075 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.818052 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/015a10aa-8188-41f4-8c50-ee5cdf0c3727-installation-pull-secrets\") pod \"image-registry-745dfbbf78-w5ws8\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " pod="openshift-image-registry/image-registry-745dfbbf78-w5ws8" May 29 17:32:19.823669 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.823626 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59flr\" (UniqueName: \"kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-kube-api-access-59flr\") pod \"image-registry-745dfbbf78-w5ws8\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " pod="openshift-image-registry/image-registry-745dfbbf78-w5ws8" May 29 17:32:19.823848 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.823794 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-bound-sa-token\") pod \"image-registry-745dfbbf78-w5ws8\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " pod="openshift-image-registry/image-registry-745dfbbf78-w5ws8" May 29 17:32:19.823973 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.823953 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmn8c\" (UniqueName: \"kubernetes.io/projected/ee552438-fa19-400b-a3f8-f2c6711e7721-kube-api-access-dmn8c\") pod \"ingress-canary-2kcrl\" (UID: \"ee552438-fa19-400b-a3f8-f2c6711e7721\") " pod="openshift-ingress-canary/ingress-canary-2kcrl" May 29 17:32:19.824631 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:19.824610 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd97r\" (UniqueName: \"kubernetes.io/projected/200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25-kube-api-access-zd97r\") pod \"dns-default-4g6sj\" (UID: \"200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25\") " pod="openshift-dns/dns-default-4g6sj" May 29 17:32:20.318623 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:20.318446 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25-metrics-tls\") pod \"dns-default-4g6sj\" (UID: \"200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25\") " pod="openshift-dns/dns-default-4g6sj" May 29 17:32:20.319162 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:20.318580 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 17:32:20.319162 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:20.318694 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee552438-fa19-400b-a3f8-f2c6711e7721-cert\") pod \"ingress-canary-2kcrl\" (UID: \"ee552438-fa19-400b-a3f8-f2c6711e7721\") " pod="openshift-ingress-canary/ingress-canary-2kcrl" May 29 17:32:20.319162 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:20.318759 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25-metrics-tls podName:200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25 nodeName:}" failed. No retries permitted until 2026-05-29 17:32:21.318744579 +0000 UTC m=+35.591971936 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25-metrics-tls") pod "dns-default-4g6sj" (UID: "200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25") : secret "dns-default-metrics-tls" not found May 29 17:32:20.319162 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:20.318788 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-registry-tls\") pod \"image-registry-745dfbbf78-w5ws8\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " pod="openshift-image-registry/image-registry-745dfbbf78-w5ws8" May 29 17:32:20.319162 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:20.318823 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 17:32:20.319162 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:20.318851 2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 17:32:20.319162 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:20.318860 2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-745dfbbf78-w5ws8: secret "image-registry-tls" not found May 29 17:32:20.319162 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:20.318888 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee552438-fa19-400b-a3f8-f2c6711e7721-cert podName:ee552438-fa19-400b-a3f8-f2c6711e7721 nodeName:}" failed. No retries permitted until 2026-05-29 17:32:21.31887053 +0000 UTC m=+35.592097890 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ee552438-fa19-400b-a3f8-f2c6711e7721-cert") pod "ingress-canary-2kcrl" (UID: "ee552438-fa19-400b-a3f8-f2c6711e7721") : secret "canary-serving-cert" not found May 29 17:32:20.319162 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:20.318907 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-registry-tls podName:015a10aa-8188-41f4-8c50-ee5cdf0c3727 nodeName:}" failed. No retries permitted until 2026-05-29 17:32:21.318896255 +0000 UTC m=+35.592123630 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-registry-tls") pod "image-registry-745dfbbf78-w5ws8" (UID: "015a10aa-8188-41f4-8c50-ee5cdf0c3727") : secret "image-registry-tls" not found May 29 17:32:21.307975 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:21.307933 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcp7w" May 29 17:32:21.307975 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:21.307961 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95vg5" May 29 17:32:21.308198 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:21.308020 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8mnd" May 29 17:32:21.310765 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:21.310743 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 29 17:32:21.310892 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:21.310775 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 29 17:32:21.311671 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:21.311651 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 29 17:32:21.311671 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:21.311669 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-q6stw\"" May 29 17:32:21.311857 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:21.311746 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 29 17:32:21.311997 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:21.311981 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nlz48\"" May 29 17:32:21.327705 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:21.327674 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee552438-fa19-400b-a3f8-f2c6711e7721-cert\") pod \"ingress-canary-2kcrl\" (UID: \"ee552438-fa19-400b-a3f8-f2c6711e7721\") " pod="openshift-ingress-canary/ingress-canary-2kcrl" May 29 17:32:21.328051 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:21.327741 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-registry-tls\") pod \"image-registry-745dfbbf78-w5ws8\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " pod="openshift-image-registry/image-registry-745dfbbf78-w5ws8" May 29 17:32:21.328051 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:21.327783 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25-metrics-tls\") pod \"dns-default-4g6sj\" (UID: \"200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25\") " pod="openshift-dns/dns-default-4g6sj" May 29 17:32:21.328051 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:21.327821 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 17:32:21.328051 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:21.327874 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee552438-fa19-400b-a3f8-f2c6711e7721-cert podName:ee552438-fa19-400b-a3f8-f2c6711e7721 nodeName:}" failed. No retries permitted until 2026-05-29 17:32:23.32786097 +0000 UTC m=+37.601088327 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ee552438-fa19-400b-a3f8-f2c6711e7721-cert") pod "ingress-canary-2kcrl" (UID: "ee552438-fa19-400b-a3f8-f2c6711e7721") : secret "canary-serving-cert" not found May 29 17:32:21.328051 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:21.327892 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 17:32:21.328051 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:21.327942 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25-metrics-tls podName:200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25 nodeName:}" failed. No retries permitted until 2026-05-29 17:32:23.327925678 +0000 UTC m=+37.601153043 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25-metrics-tls") pod "dns-default-4g6sj" (UID: "200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25") : secret "dns-default-metrics-tls" not found May 29 17:32:21.328051 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:21.328000 2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 17:32:21.328051 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:21.328016 2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-745dfbbf78-w5ws8: secret "image-registry-tls" not found May 29 17:32:21.328293 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:21.328068 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-registry-tls podName:015a10aa-8188-41f4-8c50-ee5cdf0c3727 nodeName:}" failed. No retries permitted until 2026-05-29 17:32:23.328052718 +0000 UTC m=+37.601280094 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-registry-tls") pod "image-registry-745dfbbf78-w5ws8" (UID: "015a10aa-8188-41f4-8c50-ee5cdf0c3727") : secret "image-registry-tls" not found May 29 17:32:23.345521 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:23.345488 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee552438-fa19-400b-a3f8-f2c6711e7721-cert\") pod \"ingress-canary-2kcrl\" (UID: \"ee552438-fa19-400b-a3f8-f2c6711e7721\") " pod="openshift-ingress-canary/ingress-canary-2kcrl" May 29 17:32:23.345985 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:23.345546 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-registry-tls\") pod \"image-registry-745dfbbf78-w5ws8\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " pod="openshift-image-registry/image-registry-745dfbbf78-w5ws8" May 29 17:32:23.345985 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:23.345579 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25-metrics-tls\") pod \"dns-default-4g6sj\" (UID: \"200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25\") " pod="openshift-dns/dns-default-4g6sj" May 29 17:32:23.345985 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:23.345631 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 17:32:23.345985 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:23.345706 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 17:32:23.345985 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:23.345709 2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 17:32:23.345985 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:23.345749 2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-745dfbbf78-w5ws8: secret "image-registry-tls" not found May 29 17:32:23.345985 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:23.345714 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee552438-fa19-400b-a3f8-f2c6711e7721-cert podName:ee552438-fa19-400b-a3f8-f2c6711e7721 nodeName:}" failed. No retries permitted until 2026-05-29 17:32:27.345691974 +0000 UTC m=+41.618919354 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ee552438-fa19-400b-a3f8-f2c6711e7721-cert") pod "ingress-canary-2kcrl" (UID: "ee552438-fa19-400b-a3f8-f2c6711e7721") : secret "canary-serving-cert" not found May 29 17:32:23.345985 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:23.345825 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25-metrics-tls podName:200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25 nodeName:}" failed. No retries permitted until 2026-05-29 17:32:27.34580448 +0000 UTC m=+41.619031847 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25-metrics-tls") pod "dns-default-4g6sj" (UID: "200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25") : secret "dns-default-metrics-tls" not found May 29 17:32:23.345985 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:23.345841 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-registry-tls podName:015a10aa-8188-41f4-8c50-ee5cdf0c3727 nodeName:}" failed. No retries permitted until 2026-05-29 17:32:27.34583354 +0000 UTC m=+41.619060898 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-registry-tls") pod "image-registry-745dfbbf78-w5ws8" (UID: "015a10aa-8188-41f4-8c50-ee5cdf0c3727") : secret "image-registry-tls" not found May 29 17:32:26.609851 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:26.609816 2567 generic.go:358] "Generic (PLEG): container finished" podID="8f600c44-f078-461d-b75f-bac51676fd2d" containerID="48665ed7868ae6e45d6d020b0c393a08980d3031b97abe581e8788a8951c48a4" exitCode=0 May 29 17:32:26.610206 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:26.609879 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95w4p" event={"ID":"8f600c44-f078-461d-b75f-bac51676fd2d","Type":"ContainerDied","Data":"48665ed7868ae6e45d6d020b0c393a08980d3031b97abe581e8788a8951c48a4"} May 29 17:32:27.382632 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:27.382585 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25-metrics-tls\") pod \"dns-default-4g6sj\" (UID: \"200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25\") " pod="openshift-dns/dns-default-4g6sj" May 29 17:32:27.382837 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:27.382674 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee552438-fa19-400b-a3f8-f2c6711e7721-cert\") pod \"ingress-canary-2kcrl\" (UID: \"ee552438-fa19-400b-a3f8-f2c6711e7721\") " pod="openshift-ingress-canary/ingress-canary-2kcrl" May 29 17:32:27.382837 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:27.382702 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-registry-tls\") pod \"image-registry-745dfbbf78-w5ws8\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " pod="openshift-image-registry/image-registry-745dfbbf78-w5ws8" May 29 17:32:27.382837 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:27.382747 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 17:32:27.382837 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:27.382811 2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 17:32:27.382837 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:27.382815 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 17:32:27.383005 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:27.382824 2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-745dfbbf78-w5ws8: secret "image-registry-tls" not found May 29 17:32:27.383005 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:27.382814 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25-metrics-tls podName:200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25 nodeName:}" failed. No retries permitted until 2026-05-29 17:32:35.38279844 +0000 UTC m=+49.656025802 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25-metrics-tls") pod "dns-default-4g6sj" (UID: "200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25") : secret "dns-default-metrics-tls" not found May 29 17:32:27.383005 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:27.382896 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee552438-fa19-400b-a3f8-f2c6711e7721-cert podName:ee552438-fa19-400b-a3f8-f2c6711e7721 nodeName:}" failed. No retries permitted until 2026-05-29 17:32:35.382883999 +0000 UTC m=+49.656111359 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ee552438-fa19-400b-a3f8-f2c6711e7721-cert") pod "ingress-canary-2kcrl" (UID: "ee552438-fa19-400b-a3f8-f2c6711e7721") : secret "canary-serving-cert" not found May 29 17:32:27.383005 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:27.382908 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-registry-tls podName:015a10aa-8188-41f4-8c50-ee5cdf0c3727 nodeName:}" failed. No retries permitted until 2026-05-29 17:32:35.382902524 +0000 UTC m=+49.656129887 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-registry-tls") pod "image-registry-745dfbbf78-w5ws8" (UID: "015a10aa-8188-41f4-8c50-ee5cdf0c3727") : secret "image-registry-tls" not found May 29 17:32:27.614443 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:27.614407 2567 generic.go:358] "Generic (PLEG): container finished" podID="8f600c44-f078-461d-b75f-bac51676fd2d" containerID="b2143015d9e6512c7c9d4db7c35969ee4f4e0076bcae4e54f631db5fc8d61547" exitCode=0 May 29 17:32:27.614822 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:27.614468 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95w4p" event={"ID":"8f600c44-f078-461d-b75f-bac51676fd2d","Type":"ContainerDied","Data":"b2143015d9e6512c7c9d4db7c35969ee4f4e0076bcae4e54f631db5fc8d61547"} May 29 17:32:28.618527 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:28.618495 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95w4p" event={"ID":"8f600c44-f078-461d-b75f-bac51676fd2d","Type":"ContainerStarted","Data":"eaf2b5938e12ac8043ae1c4c7dab82956528f1db10782c01f09d1db106ed69be"} May 29 17:32:28.640234 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:28.640183 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-95w4p" podStartSLOduration=4.200827939 podStartE2EDuration="42.640169904s" podCreationTimestamp="2026-05-29 17:31:46 +0000 UTC" firstStartedPulling="2026-05-29 17:31:47.372214508 +0000 UTC m=+1.645441865" lastFinishedPulling="2026-05-29 17:32:25.811556456 +0000 UTC m=+40.084783830" observedRunningTime="2026-05-29 17:32:28.638768103 +0000 UTC m=+42.911995481" watchObservedRunningTime="2026-05-29 17:32:28.640169904 +0000 UTC m=+42.913397282" May 29 17:32:30.166071 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:30.166030 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-846f69d86f-l8knz"] May 29 17:32:30.199595 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:30.199562 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-846f69d86f-l8knz"] May 29 17:32:30.199770 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:30.199682 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846f69d86f-l8knz" May 29 17:32:30.202188 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:30.202163 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 29 17:32:30.202972 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:30.202951 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 29 17:32:30.203067 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:30.203007 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" May 29 17:32:30.203067 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:30.203016 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 29 17:32:30.303901 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:30.303853 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w5d5\" (UniqueName: \"kubernetes.io/projected/9ef50bcb-e48f-44dd-8252-8578132168f4-kube-api-access-7w5d5\") pod \"klusterlet-addon-workmgr-846f69d86f-l8knz\" (UID: \"9ef50bcb-e48f-44dd-8252-8578132168f4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846f69d86f-l8knz" May 29 17:32:30.304081 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:30.303949 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ef50bcb-e48f-44dd-8252-8578132168f4-tmp\") pod \"klusterlet-addon-workmgr-846f69d86f-l8knz\" (UID: \"9ef50bcb-e48f-44dd-8252-8578132168f4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846f69d86f-l8knz" May 29 17:32:30.304081 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:30.303966 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9ef50bcb-e48f-44dd-8252-8578132168f4-klusterlet-config\") pod \"klusterlet-addon-workmgr-846f69d86f-l8knz\" (UID: \"9ef50bcb-e48f-44dd-8252-8578132168f4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846f69d86f-l8knz" May 29 17:32:30.404656 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:30.404611 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ef50bcb-e48f-44dd-8252-8578132168f4-tmp\") pod \"klusterlet-addon-workmgr-846f69d86f-l8knz\" (UID: \"9ef50bcb-e48f-44dd-8252-8578132168f4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846f69d86f-l8knz" May 29 17:32:30.404656 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:30.404652 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9ef50bcb-e48f-44dd-8252-8578132168f4-klusterlet-config\") pod \"klusterlet-addon-workmgr-846f69d86f-l8knz\" (UID: \"9ef50bcb-e48f-44dd-8252-8578132168f4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846f69d86f-l8knz" May 29 17:32:30.404876 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:30.404720 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7w5d5\" (UniqueName: \"kubernetes.io/projected/9ef50bcb-e48f-44dd-8252-8578132168f4-kube-api-access-7w5d5\") pod \"klusterlet-addon-workmgr-846f69d86f-l8knz\" (UID: \"9ef50bcb-e48f-44dd-8252-8578132168f4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846f69d86f-l8knz" May 29 17:32:30.405156 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:30.405134 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ef50bcb-e48f-44dd-8252-8578132168f4-tmp\") pod \"klusterlet-addon-workmgr-846f69d86f-l8knz\" (UID: \"9ef50bcb-e48f-44dd-8252-8578132168f4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846f69d86f-l8knz" May 29 17:32:30.408044 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:30.408023 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9ef50bcb-e48f-44dd-8252-8578132168f4-klusterlet-config\") pod \"klusterlet-addon-workmgr-846f69d86f-l8knz\" (UID: \"9ef50bcb-e48f-44dd-8252-8578132168f4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846f69d86f-l8knz" May 29 17:32:30.413085 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:30.413062 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w5d5\" (UniqueName: \"kubernetes.io/projected/9ef50bcb-e48f-44dd-8252-8578132168f4-kube-api-access-7w5d5\") pod \"klusterlet-addon-workmgr-846f69d86f-l8knz\" (UID: \"9ef50bcb-e48f-44dd-8252-8578132168f4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846f69d86f-l8knz" May 29 17:32:30.509256 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:30.509172 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846f69d86f-l8knz" May 29 17:32:30.667138 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:30.667108 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-846f69d86f-l8knz"] May 29 17:32:30.670359 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:32:30.670332 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ef50bcb_e48f_44dd_8252_8578132168f4.slice/crio-6339f2f55893ee3c1a701d0433840f2841239d9d0d223a533fe333275a788a19 WatchSource:0}: Error finding container 6339f2f55893ee3c1a701d0433840f2841239d9d0d223a533fe333275a788a19: Status 404 returned error can't find the container with id 6339f2f55893ee3c1a701d0433840f2841239d9d0d223a533fe333275a788a19 May 29 17:32:31.626139 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:31.626096 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846f69d86f-l8knz" event={"ID":"9ef50bcb-e48f-44dd-8252-8578132168f4","Type":"ContainerStarted","Data":"6339f2f55893ee3c1a701d0433840f2841239d9d0d223a533fe333275a788a19"} May 29 17:32:35.443679 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:35.443638 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee552438-fa19-400b-a3f8-f2c6711e7721-cert\") pod \"ingress-canary-2kcrl\" (UID: \"ee552438-fa19-400b-a3f8-f2c6711e7721\") " pod="openshift-ingress-canary/ingress-canary-2kcrl" May 29 17:32:35.444188 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:35.443691 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-registry-tls\") pod \"image-registry-745dfbbf78-w5ws8\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " pod="openshift-image-registry/image-registry-745dfbbf78-w5ws8" May 29 17:32:35.444188 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:35.443714 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25-metrics-tls\") pod \"dns-default-4g6sj\" (UID: \"200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25\") " pod="openshift-dns/dns-default-4g6sj" May 29 17:32:35.444188 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:35.443794 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 17:32:35.444188 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:35.443811 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 17:32:35.444188 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:35.443838 2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 17:32:35.444188 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:35.443854 2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-745dfbbf78-w5ws8: secret "image-registry-tls" not found May 29 17:32:35.444188 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:35.443858 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee552438-fa19-400b-a3f8-f2c6711e7721-cert podName:ee552438-fa19-400b-a3f8-f2c6711e7721 nodeName:}" failed. No retries permitted until 2026-05-29 17:32:51.443843369 +0000 UTC m=+65.717070726 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ee552438-fa19-400b-a3f8-f2c6711e7721-cert") pod "ingress-canary-2kcrl" (UID: "ee552438-fa19-400b-a3f8-f2c6711e7721") : secret "canary-serving-cert" not found May 29 17:32:35.444188 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:35.443894 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25-metrics-tls podName:200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25 nodeName:}" failed. No retries permitted until 2026-05-29 17:32:51.443869599 +0000 UTC m=+65.717096971 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25-metrics-tls") pod "dns-default-4g6sj" (UID: "200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25") : secret "dns-default-metrics-tls" not found May 29 17:32:35.444188 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:35.443921 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-registry-tls podName:015a10aa-8188-41f4-8c50-ee5cdf0c3727 nodeName:}" failed. No retries permitted until 2026-05-29 17:32:51.44390967 +0000 UTC m=+65.717137034 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-registry-tls") pod "image-registry-745dfbbf78-w5ws8" (UID: "015a10aa-8188-41f4-8c50-ee5cdf0c3727") : secret "image-registry-tls" not found May 29 17:32:36.637050 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:36.637011 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846f69d86f-l8knz" event={"ID":"9ef50bcb-e48f-44dd-8252-8578132168f4","Type":"ContainerStarted","Data":"8fe6122b6b6b1c833cf83cfa4655a629d086cb8d5d53197401896ee11329ed24"} May 29 17:32:36.637532 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:36.637252 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846f69d86f-l8knz" May 29 17:32:36.638973 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:36.638953 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846f69d86f-l8knz" May 29 17:32:36.654037 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:36.653980 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846f69d86f-l8knz" podStartSLOduration=1.553947049 podStartE2EDuration="6.653964484s" podCreationTimestamp="2026-05-29 17:32:30 +0000 UTC" firstStartedPulling="2026-05-29 17:32:30.672129043 +0000 UTC m=+44.945356400" lastFinishedPulling="2026-05-29 17:32:35.772146478 +0000 UTC m=+50.045373835" observedRunningTime="2026-05-29 17:32:36.653497308 +0000 UTC m=+50.926724697" watchObservedRunningTime="2026-05-29 17:32:36.653964484 +0000 UTC m=+50.927191863" May 29 17:32:45.592769 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:45.592719 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w49xp" May 29 17:32:51.058675 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:51.058628 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ee27fe1-5b5c-469c-b841-914fb8f1eb48-original-pull-secret\") pod \"global-pull-secret-syncer-r8mnd\" (UID: \"7ee27fe1-5b5c-469c-b841-914fb8f1eb48\") " pod="kube-system/global-pull-secret-syncer-r8mnd" May 29 17:32:51.058675 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:51.058677 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49-metrics-certs\") pod \"network-metrics-daemon-bcp7w\" (UID: \"d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49\") " pod="openshift-multus/network-metrics-daemon-bcp7w" May 29 17:32:51.061530 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:51.061511 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 29 17:32:51.061597 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:51.061519 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 29 17:32:51.069699 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:51.069669 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 29 17:32:51.069817 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:51.069784 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49-metrics-certs podName:d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49 nodeName:}" failed. No retries permitted until 2026-05-29 17:33:55.069759612 +0000 UTC m=+129.342986972 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49-metrics-certs") pod "network-metrics-daemon-bcp7w" (UID: "d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49") : secret "metrics-daemon-secret" not found May 29 17:32:51.071772 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:51.071757 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ee27fe1-5b5c-469c-b841-914fb8f1eb48-original-pull-secret\") pod \"global-pull-secret-syncer-r8mnd\" (UID: \"7ee27fe1-5b5c-469c-b841-914fb8f1eb48\") " pod="kube-system/global-pull-secret-syncer-r8mnd" May 29 17:32:51.259749 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:51.259682 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hwqbz\" (UniqueName: \"kubernetes.io/projected/c3c798e6-b4da-4967-89c3-cf3d1e94cd4a-kube-api-access-hwqbz\") pod \"network-check-target-95vg5\" (UID: \"c3c798e6-b4da-4967-89c3-cf3d1e94cd4a\") " pod="openshift-network-diagnostics/network-check-target-95vg5" May 29 17:32:51.262461 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:51.262443 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 29 17:32:51.272578 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:51.272551 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 29 17:32:51.283666 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:51.283636 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwqbz\" (UniqueName: \"kubernetes.io/projected/c3c798e6-b4da-4967-89c3-cf3d1e94cd4a-kube-api-access-hwqbz\") pod \"network-check-target-95vg5\" (UID: \"c3c798e6-b4da-4967-89c3-cf3d1e94cd4a\") " pod="openshift-network-diagnostics/network-check-target-95vg5" May 29 17:32:51.328921 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:51.328840 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-q6stw\"" May 29 17:32:51.330625 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:51.330608 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8mnd" May 29 17:32:51.336898 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:51.336878 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95vg5" May 29 17:32:51.454708 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:51.454676 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r8mnd"] May 29 17:32:51.458185 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:32:51.458157 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ee27fe1_5b5c_469c_b841_914fb8f1eb48.slice/crio-7661a40a68fcb4f59cbc6b1b08f5f266f0b04a3201978912b62abf4bbc47a282 WatchSource:0}: Error finding container 7661a40a68fcb4f59cbc6b1b08f5f266f0b04a3201978912b62abf4bbc47a282: Status 404 returned error can't find the container with id 7661a40a68fcb4f59cbc6b1b08f5f266f0b04a3201978912b62abf4bbc47a282 May 29 17:32:51.461493 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:51.461469 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25-metrics-tls\") pod \"dns-default-4g6sj\" (UID: \"200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25\") " pod="openshift-dns/dns-default-4g6sj" May 29 17:32:51.461570 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:51.461524 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee552438-fa19-400b-a3f8-f2c6711e7721-cert\") pod \"ingress-canary-2kcrl\" (UID: \"ee552438-fa19-400b-a3f8-f2c6711e7721\") " pod="openshift-ingress-canary/ingress-canary-2kcrl" May 29 17:32:51.461570 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:51.461559 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-registry-tls\") pod \"image-registry-745dfbbf78-w5ws8\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " pod="openshift-image-registry/image-registry-745dfbbf78-w5ws8" May 29 17:32:51.461647 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:51.461626 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 17:32:51.461685 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:51.461646 2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 17:32:51.461685 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:51.461658 2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-745dfbbf78-w5ws8: secret "image-registry-tls" not found May 29 17:32:51.461685 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:51.461676 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 17:32:51.461795 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:51.461691 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25-metrics-tls podName:200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25 nodeName:}" failed. No retries permitted until 2026-05-29 17:33:23.461674853 +0000 UTC m=+97.734902210 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25-metrics-tls") pod "dns-default-4g6sj" (UID: "200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25") : secret "dns-default-metrics-tls" not found May 29 17:32:51.461795 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:51.461704 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-registry-tls podName:015a10aa-8188-41f4-8c50-ee5cdf0c3727 nodeName:}" failed. No retries permitted until 2026-05-29 17:33:23.461698081 +0000 UTC m=+97.734925438 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-registry-tls") pod "image-registry-745dfbbf78-w5ws8" (UID: "015a10aa-8188-41f4-8c50-ee5cdf0c3727") : secret "image-registry-tls" not found May 29 17:32:51.461795 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:32:51.461742 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee552438-fa19-400b-a3f8-f2c6711e7721-cert podName:ee552438-fa19-400b-a3f8-f2c6711e7721 nodeName:}" failed. No retries permitted until 2026-05-29 17:33:23.461709431 +0000 UTC m=+97.734936811 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ee552438-fa19-400b-a3f8-f2c6711e7721-cert") pod "ingress-canary-2kcrl" (UID: "ee552438-fa19-400b-a3f8-f2c6711e7721") : secret "canary-serving-cert" not found May 29 17:32:51.470031 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:51.470004 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-95vg5"] May 29 17:32:51.473078 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:32:51.473056 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3c798e6_b4da_4967_89c3_cf3d1e94cd4a.slice/crio-18a6052bc6d8d00391c69d66f34323a960f145a0fe1c770c1efcc2be1115e91e WatchSource:0}: Error finding container 18a6052bc6d8d00391c69d66f34323a960f145a0fe1c770c1efcc2be1115e91e: Status 404 returned error can't find the container with id 18a6052bc6d8d00391c69d66f34323a960f145a0fe1c770c1efcc2be1115e91e May 29 17:32:51.666415 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:51.666323 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-95vg5" event={"ID":"c3c798e6-b4da-4967-89c3-cf3d1e94cd4a","Type":"ContainerStarted","Data":"18a6052bc6d8d00391c69d66f34323a960f145a0fe1c770c1efcc2be1115e91e"} May 29 17:32:51.667271 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:51.667250 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r8mnd" event={"ID":"7ee27fe1-5b5c-469c-b841-914fb8f1eb48","Type":"ContainerStarted","Data":"7661a40a68fcb4f59cbc6b1b08f5f266f0b04a3201978912b62abf4bbc47a282"} May 29 17:32:56.678877 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:56.678828 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r8mnd" event={"ID":"7ee27fe1-5b5c-469c-b841-914fb8f1eb48","Type":"ContainerStarted","Data":"8509a421382f8e003a0c82e3ae79b6cb5c6cfcb5292d2e1b7f342085d32aa3e8"} May 29 17:32:56.680115 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:56.680092 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-95vg5" event={"ID":"c3c798e6-b4da-4967-89c3-cf3d1e94cd4a","Type":"ContainerStarted","Data":"4881c43bcd1d643174b478debce3111845f4db6c52945bbab04017c5acf0034f"} May 29 17:32:56.680232 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:56.680222 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-95vg5" May 29 17:32:56.694889 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:56.694841 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-r8mnd" podStartSLOduration=65.870950117 podStartE2EDuration="1m10.69482789s" podCreationTimestamp="2026-05-29 17:31:46 +0000 UTC" firstStartedPulling="2026-05-29 17:32:51.459974203 +0000 UTC m=+65.733201560" lastFinishedPulling="2026-05-29 17:32:56.283851961 +0000 UTC m=+70.557079333" observedRunningTime="2026-05-29 17:32:56.693481225 +0000 UTC m=+70.966708604" watchObservedRunningTime="2026-05-29 17:32:56.69482789 +0000 UTC m=+70.968055268" May 29 17:32:56.709956 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:32:56.709910 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-95vg5" podStartSLOduration=65.90063396 podStartE2EDuration="1m10.709898424s" podCreationTimestamp="2026-05-29 17:31:46 +0000 UTC" firstStartedPulling="2026-05-29 17:32:51.474953762 +0000 UTC m=+65.748181120" lastFinishedPulling="2026-05-29 17:32:56.28421822 +0000 UTC m=+70.557445584" observedRunningTime="2026-05-29 17:32:56.709304772 +0000 UTC m=+70.982532152" watchObservedRunningTime="2026-05-29 17:32:56.709898424 +0000 UTC m=+70.983125804" May 29 17:33:16.543536 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.543501 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-xlb82"] May 29 17:33:16.547648 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.547629 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-xlb82" May 29 17:33:16.549800 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.549765 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-b67975c55-zmgg7"] May 29 17:33:16.550944 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.550921 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-5tw4l\"" May 29 17:33:16.551057 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.550958 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 29 17:33:16.551057 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.550956 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 29 17:33:16.551057 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.550956 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 29 17:33:16.551057 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.550985 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 29 17:33:16.551992 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.551974 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-b67975c55-zmgg7" May 29 17:33:16.553871 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.553851 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 29 17:33:16.554121 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.554092 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 29 17:33:16.554215 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.554130 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 29 17:33:16.554215 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.554127 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 29 17:33:16.554215 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.554170 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 29 17:33:16.554215 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.554180 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-f8wqq\"" May 29 17:33:16.554426 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.554277 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 29 17:33:16.555626 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.555606 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 29 17:33:16.559009 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.558990 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-xlb82"] May 29 17:33:16.563456 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.563437 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-b67975c55-zmgg7"] May 29 17:33:16.652142 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.652114 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwzpd\" (UniqueName: \"kubernetes.io/projected/03e5309b-1968-4102-9d24-9f7bc8ce3c27-kube-api-access-fwzpd\") pod \"console-operator-86d7c6cc77-xlb82\" (UID: \"03e5309b-1968-4102-9d24-9f7bc8ce3c27\") " pod="openshift-console-operator/console-operator-86d7c6cc77-xlb82" May 29 17:33:16.652142 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.652148 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/03e5309b-1968-4102-9d24-9f7bc8ce3c27-config\") pod \"console-operator-86d7c6cc77-xlb82\" (UID: \"03e5309b-1968-4102-9d24-9f7bc8ce3c27\") " pod="openshift-console-operator/console-operator-86d7c6cc77-xlb82" May 29 17:33:16.652368 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.652174 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f033a789-974f-4bfb-a4e5-a654ee03e80a-stats-auth\") pod \"router-default-b67975c55-zmgg7\" (UID: \"f033a789-974f-4bfb-a4e5-a654ee03e80a\") " pod="openshift-ingress/router-default-b67975c55-zmgg7" May 29 17:33:16.652368 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.652270 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f033a789-974f-4bfb-a4e5-a654ee03e80a-default-certificate\") pod \"router-default-b67975c55-zmgg7\" (UID: \"f033a789-974f-4bfb-a4e5-a654ee03e80a\") " pod="openshift-ingress/router-default-b67975c55-zmgg7" May 29 17:33:16.652368 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.652302 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f033a789-974f-4bfb-a4e5-a654ee03e80a-metrics-certs\") pod \"router-default-b67975c55-zmgg7\" (UID: \"f033a789-974f-4bfb-a4e5-a654ee03e80a\") " pod="openshift-ingress/router-default-b67975c55-zmgg7" May 29 17:33:16.652368 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.652323 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/03e5309b-1968-4102-9d24-9f7bc8ce3c27-trusted-ca\") pod \"console-operator-86d7c6cc77-xlb82\" (UID: \"03e5309b-1968-4102-9d24-9f7bc8ce3c27\") " pod="openshift-console-operator/console-operator-86d7c6cc77-xlb82" May 29 17:33:16.652498 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.652391 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/03e5309b-1968-4102-9d24-9f7bc8ce3c27-serving-cert\") pod \"console-operator-86d7c6cc77-xlb82\" (UID: \"03e5309b-1968-4102-9d24-9f7bc8ce3c27\") " pod="openshift-console-operator/console-operator-86d7c6cc77-xlb82" May 29 17:33:16.652498 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.652421 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f033a789-974f-4bfb-a4e5-a654ee03e80a-service-ca-bundle\") pod \"router-default-b67975c55-zmgg7\" (UID: \"f033a789-974f-4bfb-a4e5-a654ee03e80a\") " pod="openshift-ingress/router-default-b67975c55-zmgg7" May 29 17:33:16.652498 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.652438 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rdxs\" (UniqueName: \"kubernetes.io/projected/f033a789-974f-4bfb-a4e5-a654ee03e80a-kube-api-access-2rdxs\") pod \"router-default-b67975c55-zmgg7\" (UID: \"f033a789-974f-4bfb-a4e5-a654ee03e80a\") " pod="openshift-ingress/router-default-b67975c55-zmgg7" May 29 17:33:16.753578 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.753534 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/03e5309b-1968-4102-9d24-9f7bc8ce3c27-serving-cert\") pod \"console-operator-86d7c6cc77-xlb82\" (UID: \"03e5309b-1968-4102-9d24-9f7bc8ce3c27\") " pod="openshift-console-operator/console-operator-86d7c6cc77-xlb82" May 29 17:33:16.753798 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.753597 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f033a789-974f-4bfb-a4e5-a654ee03e80a-service-ca-bundle\") pod \"router-default-b67975c55-zmgg7\" (UID: \"f033a789-974f-4bfb-a4e5-a654ee03e80a\") " pod="openshift-ingress/router-default-b67975c55-zmgg7" May 29 17:33:16.753798 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.753628 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2rdxs\" (UniqueName: \"kubernetes.io/projected/f033a789-974f-4bfb-a4e5-a654ee03e80a-kube-api-access-2rdxs\") pod \"router-default-b67975c55-zmgg7\" (UID: \"f033a789-974f-4bfb-a4e5-a654ee03e80a\") " pod="openshift-ingress/router-default-b67975c55-zmgg7" May 29 17:33:16.753798 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.753654 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fwzpd\" (UniqueName: \"kubernetes.io/projected/03e5309b-1968-4102-9d24-9f7bc8ce3c27-kube-api-access-fwzpd\") pod \"console-operator-86d7c6cc77-xlb82\" (UID: \"03e5309b-1968-4102-9d24-9f7bc8ce3c27\") " pod="openshift-console-operator/console-operator-86d7c6cc77-xlb82" May 29 17:33:16.753798 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.753683 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/03e5309b-1968-4102-9d24-9f7bc8ce3c27-config\") pod \"console-operator-86d7c6cc77-xlb82\" (UID: \"03e5309b-1968-4102-9d24-9f7bc8ce3c27\") " pod="openshift-console-operator/console-operator-86d7c6cc77-xlb82" May 29 17:33:16.754034 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:33:16.753840 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f033a789-974f-4bfb-a4e5-a654ee03e80a-service-ca-bundle podName:f033a789-974f-4bfb-a4e5-a654ee03e80a nodeName:}" failed. No retries permitted until 2026-05-29 17:33:17.253822658 +0000 UTC m=+91.527050019 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f033a789-974f-4bfb-a4e5-a654ee03e80a-service-ca-bundle") pod "router-default-b67975c55-zmgg7" (UID: "f033a789-974f-4bfb-a4e5-a654ee03e80a") : configmap references non-existent config key: service-ca.crt May 29 17:33:16.754034 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.753968 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f033a789-974f-4bfb-a4e5-a654ee03e80a-stats-auth\") pod \"router-default-b67975c55-zmgg7\" (UID: \"f033a789-974f-4bfb-a4e5-a654ee03e80a\") " pod="openshift-ingress/router-default-b67975c55-zmgg7" May 29 17:33:16.754144 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.754033 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f033a789-974f-4bfb-a4e5-a654ee03e80a-default-certificate\") pod \"router-default-b67975c55-zmgg7\" (UID: \"f033a789-974f-4bfb-a4e5-a654ee03e80a\") " pod="openshift-ingress/router-default-b67975c55-zmgg7" May 29 17:33:16.754144 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.754056 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f033a789-974f-4bfb-a4e5-a654ee03e80a-metrics-certs\") pod \"router-default-b67975c55-zmgg7\" (UID: \"f033a789-974f-4bfb-a4e5-a654ee03e80a\") " pod="openshift-ingress/router-default-b67975c55-zmgg7" May 29 17:33:16.754144 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.754079 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/03e5309b-1968-4102-9d24-9f7bc8ce3c27-trusted-ca\") pod \"console-operator-86d7c6cc77-xlb82\" (UID: \"03e5309b-1968-4102-9d24-9f7bc8ce3c27\") " pod="openshift-console-operator/console-operator-86d7c6cc77-xlb82" May 29 17:33:16.754294 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:33:16.754167 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 29 17:33:16.754294 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:33:16.754226 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f033a789-974f-4bfb-a4e5-a654ee03e80a-metrics-certs podName:f033a789-974f-4bfb-a4e5-a654ee03e80a nodeName:}" failed. No retries permitted until 2026-05-29 17:33:17.254209086 +0000 UTC m=+91.527436444 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f033a789-974f-4bfb-a4e5-a654ee03e80a-metrics-certs") pod "router-default-b67975c55-zmgg7" (UID: "f033a789-974f-4bfb-a4e5-a654ee03e80a") : secret "router-metrics-certs-default" not found May 29 17:33:16.754566 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.754537 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/03e5309b-1968-4102-9d24-9f7bc8ce3c27-config\") pod \"console-operator-86d7c6cc77-xlb82\" (UID: \"03e5309b-1968-4102-9d24-9f7bc8ce3c27\") " pod="openshift-console-operator/console-operator-86d7c6cc77-xlb82" May 29 17:33:16.755260 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.755239 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/03e5309b-1968-4102-9d24-9f7bc8ce3c27-trusted-ca\") pod \"console-operator-86d7c6cc77-xlb82\" (UID: \"03e5309b-1968-4102-9d24-9f7bc8ce3c27\") " pod="openshift-console-operator/console-operator-86d7c6cc77-xlb82" May 29 17:33:16.756113 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.756091 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/03e5309b-1968-4102-9d24-9f7bc8ce3c27-serving-cert\") pod \"console-operator-86d7c6cc77-xlb82\" (UID: \"03e5309b-1968-4102-9d24-9f7bc8ce3c27\") " pod="openshift-console-operator/console-operator-86d7c6cc77-xlb82" May 29 17:33:16.756490 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.756469 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f033a789-974f-4bfb-a4e5-a654ee03e80a-default-certificate\") pod \"router-default-b67975c55-zmgg7\" (UID: \"f033a789-974f-4bfb-a4e5-a654ee03e80a\") " pod="openshift-ingress/router-default-b67975c55-zmgg7" May 29 17:33:16.756562 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.756547 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f033a789-974f-4bfb-a4e5-a654ee03e80a-stats-auth\") pod \"router-default-b67975c55-zmgg7\" (UID: \"f033a789-974f-4bfb-a4e5-a654ee03e80a\") " pod="openshift-ingress/router-default-b67975c55-zmgg7" May 29 17:33:16.764959 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.764937 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwzpd\" (UniqueName: \"kubernetes.io/projected/03e5309b-1968-4102-9d24-9f7bc8ce3c27-kube-api-access-fwzpd\") pod \"console-operator-86d7c6cc77-xlb82\" (UID: \"03e5309b-1968-4102-9d24-9f7bc8ce3c27\") " pod="openshift-console-operator/console-operator-86d7c6cc77-xlb82" May 29 17:33:16.765100 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.765085 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rdxs\" (UniqueName: \"kubernetes.io/projected/f033a789-974f-4bfb-a4e5-a654ee03e80a-kube-api-access-2rdxs\") pod \"router-default-b67975c55-zmgg7\" (UID: \"f033a789-974f-4bfb-a4e5-a654ee03e80a\") " pod="openshift-ingress/router-default-b67975c55-zmgg7" May 29 17:33:16.860152 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.860069 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-xlb82" May 29 17:33:16.977833 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:16.977789 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-xlb82"] May 29 17:33:16.982391 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:33:16.982362 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03e5309b_1968_4102_9d24_9f7bc8ce3c27.slice/crio-6535e02e248059009ab6568538ec963c9ff353acdda2c9840e8e233cacd9b30d WatchSource:0}: Error finding container 6535e02e248059009ab6568538ec963c9ff353acdda2c9840e8e233cacd9b30d: Status 404 returned error can't find the container with id 6535e02e248059009ab6568538ec963c9ff353acdda2c9840e8e233cacd9b30d May 29 17:33:17.258652 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:17.258556 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f033a789-974f-4bfb-a4e5-a654ee03e80a-metrics-certs\") pod \"router-default-b67975c55-zmgg7\" (UID: \"f033a789-974f-4bfb-a4e5-a654ee03e80a\") " pod="openshift-ingress/router-default-b67975c55-zmgg7" May 29 17:33:17.258826 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:17.258698 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f033a789-974f-4bfb-a4e5-a654ee03e80a-service-ca-bundle\") pod \"router-default-b67975c55-zmgg7\" (UID: \"f033a789-974f-4bfb-a4e5-a654ee03e80a\") " pod="openshift-ingress/router-default-b67975c55-zmgg7" May 29 17:33:17.258826 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:33:17.258709 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 29 17:33:17.258826 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:33:17.258802 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f033a789-974f-4bfb-a4e5-a654ee03e80a-metrics-certs podName:f033a789-974f-4bfb-a4e5-a654ee03e80a nodeName:}" failed. No retries permitted until 2026-05-29 17:33:18.258783096 +0000 UTC m=+92.532010470 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f033a789-974f-4bfb-a4e5-a654ee03e80a-metrics-certs") pod "router-default-b67975c55-zmgg7" (UID: "f033a789-974f-4bfb-a4e5-a654ee03e80a") : secret "router-metrics-certs-default" not found May 29 17:33:17.258826 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:33:17.258816 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f033a789-974f-4bfb-a4e5-a654ee03e80a-service-ca-bundle podName:f033a789-974f-4bfb-a4e5-a654ee03e80a nodeName:}" failed. No retries permitted until 2026-05-29 17:33:18.258810374 +0000 UTC m=+92.532037736 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f033a789-974f-4bfb-a4e5-a654ee03e80a-service-ca-bundle") pod "router-default-b67975c55-zmgg7" (UID: "f033a789-974f-4bfb-a4e5-a654ee03e80a") : configmap references non-existent config key: service-ca.crt May 29 17:33:17.722163 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:17.722128 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-xlb82" event={"ID":"03e5309b-1968-4102-9d24-9f7bc8ce3c27","Type":"ContainerStarted","Data":"6535e02e248059009ab6568538ec963c9ff353acdda2c9840e8e233cacd9b30d"} May 29 17:33:18.268992 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:18.268953 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f033a789-974f-4bfb-a4e5-a654ee03e80a-service-ca-bundle\") pod \"router-default-b67975c55-zmgg7\" (UID: \"f033a789-974f-4bfb-a4e5-a654ee03e80a\") " pod="openshift-ingress/router-default-b67975c55-zmgg7" May 29 17:33:18.269195 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:18.269027 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f033a789-974f-4bfb-a4e5-a654ee03e80a-metrics-certs\") pod \"router-default-b67975c55-zmgg7\" (UID: \"f033a789-974f-4bfb-a4e5-a654ee03e80a\") " pod="openshift-ingress/router-default-b67975c55-zmgg7" May 29 17:33:18.269195 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:33:18.269122 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 29 17:33:18.269195 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:33:18.269151 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f033a789-974f-4bfb-a4e5-a654ee03e80a-service-ca-bundle podName:f033a789-974f-4bfb-a4e5-a654ee03e80a nodeName:}" failed. No retries permitted until 2026-05-29 17:33:20.269129892 +0000 UTC m=+94.542357254 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f033a789-974f-4bfb-a4e5-a654ee03e80a-service-ca-bundle") pod "router-default-b67975c55-zmgg7" (UID: "f033a789-974f-4bfb-a4e5-a654ee03e80a") : configmap references non-existent config key: service-ca.crt May 29 17:33:18.269195 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:33:18.269184 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f033a789-974f-4bfb-a4e5-a654ee03e80a-metrics-certs podName:f033a789-974f-4bfb-a4e5-a654ee03e80a nodeName:}" failed. No retries permitted until 2026-05-29 17:33:20.269170882 +0000 UTC m=+94.542398254 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f033a789-974f-4bfb-a4e5-a654ee03e80a-metrics-certs") pod "router-default-b67975c55-zmgg7" (UID: "f033a789-974f-4bfb-a4e5-a654ee03e80a") : secret "router-metrics-certs-default" not found May 29 17:33:19.727983 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:19.727950 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-xlb82_03e5309b-1968-4102-9d24-9f7bc8ce3c27/console-operator/0.log" May 29 17:33:19.728363 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:19.727993 2567 generic.go:358] "Generic (PLEG): container finished" podID="03e5309b-1968-4102-9d24-9f7bc8ce3c27" containerID="d5ce9d9c0242526e1b8ea82291960449ba1af580669bcba75ae7b170150f413a" exitCode=255 May 29 17:33:19.728363 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:19.728029 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-xlb82" event={"ID":"03e5309b-1968-4102-9d24-9f7bc8ce3c27","Type":"ContainerDied","Data":"d5ce9d9c0242526e1b8ea82291960449ba1af580669bcba75ae7b170150f413a"} May 29 17:33:19.728363 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:19.728262 2567 scope.go:117] "RemoveContainer" containerID="d5ce9d9c0242526e1b8ea82291960449ba1af580669bcba75ae7b170150f413a" May 29 17:33:20.286086 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:20.286052 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f033a789-974f-4bfb-a4e5-a654ee03e80a-metrics-certs\") pod \"router-default-b67975c55-zmgg7\" (UID: \"f033a789-974f-4bfb-a4e5-a654ee03e80a\") " pod="openshift-ingress/router-default-b67975c55-zmgg7" May 29 17:33:20.286292 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:20.286119 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f033a789-974f-4bfb-a4e5-a654ee03e80a-service-ca-bundle\") pod \"router-default-b67975c55-zmgg7\" (UID: \"f033a789-974f-4bfb-a4e5-a654ee03e80a\") " pod="openshift-ingress/router-default-b67975c55-zmgg7" May 29 17:33:20.286292 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:33:20.286221 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 29 17:33:20.286292 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:33:20.286242 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f033a789-974f-4bfb-a4e5-a654ee03e80a-service-ca-bundle podName:f033a789-974f-4bfb-a4e5-a654ee03e80a nodeName:}" failed. No retries permitted until 2026-05-29 17:33:24.286228815 +0000 UTC m=+98.559456176 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f033a789-974f-4bfb-a4e5-a654ee03e80a-service-ca-bundle") pod "router-default-b67975c55-zmgg7" (UID: "f033a789-974f-4bfb-a4e5-a654ee03e80a") : configmap references non-existent config key: service-ca.crt May 29 17:33:20.286292 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:33:20.286288 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f033a789-974f-4bfb-a4e5-a654ee03e80a-metrics-certs podName:f033a789-974f-4bfb-a4e5-a654ee03e80a nodeName:}" failed. No retries permitted until 2026-05-29 17:33:24.286269714 +0000 UTC m=+98.559497072 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f033a789-974f-4bfb-a4e5-a654ee03e80a-metrics-certs") pod "router-default-b67975c55-zmgg7" (UID: "f033a789-974f-4bfb-a4e5-a654ee03e80a") : secret "router-metrics-certs-default" not found May 29 17:33:20.732517 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:20.732488 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-xlb82_03e5309b-1968-4102-9d24-9f7bc8ce3c27/console-operator/1.log" May 29 17:33:20.732930 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:20.732887 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-xlb82_03e5309b-1968-4102-9d24-9f7bc8ce3c27/console-operator/0.log" May 29 17:33:20.732930 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:20.732917 2567 generic.go:358] "Generic (PLEG): container finished" podID="03e5309b-1968-4102-9d24-9f7bc8ce3c27" containerID="5c75166211ab3ed823c2a75d8666b75fb199bdac04b8a48c26126b530d58acb6" exitCode=255 May 29 17:33:20.733001 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:20.732959 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-xlb82" event={"ID":"03e5309b-1968-4102-9d24-9f7bc8ce3c27","Type":"ContainerDied","Data":"5c75166211ab3ed823c2a75d8666b75fb199bdac04b8a48c26126b530d58acb6"} May 29 17:33:20.733001 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:20.732986 2567 scope.go:117] "RemoveContainer" containerID="d5ce9d9c0242526e1b8ea82291960449ba1af580669bcba75ae7b170150f413a" May 29 17:33:20.733247 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:20.733229 2567 scope.go:117] "RemoveContainer" containerID="5c75166211ab3ed823c2a75d8666b75fb199bdac04b8a48c26126b530d58acb6" May 29 17:33:20.733445 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:33:20.733428 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-xlb82_openshift-console-operator(03e5309b-1968-4102-9d24-9f7bc8ce3c27)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-xlb82" podUID="03e5309b-1968-4102-9d24-9f7bc8ce3c27" May 29 17:33:21.303512 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:21.303480 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-2qbp4"] May 29 17:33:21.307416 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:21.307399 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-2qbp4" May 29 17:33:21.309884 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:21.309864 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-j6qgc\"" May 29 17:33:21.313564 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:21.313522 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-2qbp4"] May 29 17:33:21.395044 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:21.394999 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mwjw\" (UniqueName: \"kubernetes.io/projected/14edb090-7039-431f-bc73-65b04217d587-kube-api-access-7mwjw\") pod \"network-check-source-56d84b9f44-2qbp4\" (UID: \"14edb090-7039-431f-bc73-65b04217d587\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-2qbp4" May 29 17:33:21.496350 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:21.496309 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7mwjw\" (UniqueName: \"kubernetes.io/projected/14edb090-7039-431f-bc73-65b04217d587-kube-api-access-7mwjw\") pod \"network-check-source-56d84b9f44-2qbp4\" (UID: \"14edb090-7039-431f-bc73-65b04217d587\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-2qbp4" May 29 17:33:21.508040 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:21.508005 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mwjw\" (UniqueName: \"kubernetes.io/projected/14edb090-7039-431f-bc73-65b04217d587-kube-api-access-7mwjw\") pod \"network-check-source-56d84b9f44-2qbp4\" (UID: \"14edb090-7039-431f-bc73-65b04217d587\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-2qbp4" May 29 17:33:21.616251 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:21.616163 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-2qbp4" May 29 17:33:21.733493 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:21.733464 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-2qbp4"] May 29 17:33:21.736481 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:21.736463 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-xlb82_03e5309b-1968-4102-9d24-9f7bc8ce3c27/console-operator/1.log" May 29 17:33:21.736844 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:21.736830 2567 scope.go:117] "RemoveContainer" containerID="5c75166211ab3ed823c2a75d8666b75fb199bdac04b8a48c26126b530d58acb6" May 29 17:33:21.737045 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:33:21.737022 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-xlb82_openshift-console-operator(03e5309b-1968-4102-9d24-9f7bc8ce3c27)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-xlb82" podUID="03e5309b-1968-4102-9d24-9f7bc8ce3c27" May 29 17:33:21.737172 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:33:21.737150 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14edb090_7039_431f_bc73_65b04217d587.slice/crio-32cfc4151a66353f4fe6f2b41e0332109ca0d4c8362cc7510c58a273eb9439d9 WatchSource:0}: Error finding container 32cfc4151a66353f4fe6f2b41e0332109ca0d4c8362cc7510c58a273eb9439d9: Status 404 returned error can't find the container with id 32cfc4151a66353f4fe6f2b41e0332109ca0d4c8362cc7510c58a273eb9439d9 May 29 17:33:22.642854 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:22.642830 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8lmqz_8743123a-c7a3-4dba-b656-622c9a23c6e6/dns-node-resolver/0.log" May 29 17:33:22.741296 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:22.741249 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-2qbp4" event={"ID":"14edb090-7039-431f-bc73-65b04217d587","Type":"ContainerStarted","Data":"f95cd4e5713b33d70f11037be101d5e06839248f440ec044bf1dca88e7c2712e"} May 29 17:33:22.741296 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:22.741300 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-2qbp4" event={"ID":"14edb090-7039-431f-bc73-65b04217d587","Type":"ContainerStarted","Data":"32cfc4151a66353f4fe6f2b41e0332109ca0d4c8362cc7510c58a273eb9439d9"} May 29 17:33:22.756371 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:22.756329 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-2qbp4" podStartSLOduration=1.75631698 podStartE2EDuration="1.75631698s" podCreationTimestamp="2026-05-29 17:33:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:33:22.755402819 +0000 UTC m=+97.028630195" watchObservedRunningTime="2026-05-29 17:33:22.75631698 +0000 UTC m=+97.029544359" May 29 17:33:23.513549 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:23.513504 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee552438-fa19-400b-a3f8-f2c6711e7721-cert\") pod \"ingress-canary-2kcrl\" (UID: \"ee552438-fa19-400b-a3f8-f2c6711e7721\") " pod="openshift-ingress-canary/ingress-canary-2kcrl" May 29 17:33:23.513549 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:23.513555 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25-metrics-tls\") pod \"dns-default-4g6sj\" (UID: \"200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25\") " pod="openshift-dns/dns-default-4g6sj" May 29 17:33:23.513823 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:23.513596 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-registry-tls\") pod \"image-registry-745dfbbf78-w5ws8\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " pod="openshift-image-registry/image-registry-745dfbbf78-w5ws8" May 29 17:33:23.513823 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:33:23.513668 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 17:33:23.513823 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:33:23.513702 2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 17:33:23.513823 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:33:23.513713 2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-745dfbbf78-w5ws8: secret "image-registry-tls" not found May 29 17:33:23.513823 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:33:23.513712 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 17:33:23.513823 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:33:23.513753 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee552438-fa19-400b-a3f8-f2c6711e7721-cert podName:ee552438-fa19-400b-a3f8-f2c6711e7721 nodeName:}" failed. No retries permitted until 2026-05-29 17:34:27.513718356 +0000 UTC m=+161.786945713 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ee552438-fa19-400b-a3f8-f2c6711e7721-cert") pod "ingress-canary-2kcrl" (UID: "ee552438-fa19-400b-a3f8-f2c6711e7721") : secret "canary-serving-cert" not found May 29 17:33:23.513823 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:33:23.513775 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25-metrics-tls podName:200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25 nodeName:}" failed. No retries permitted until 2026-05-29 17:34:27.513761566 +0000 UTC m=+161.786988929 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25-metrics-tls") pod "dns-default-4g6sj" (UID: "200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25") : secret "dns-default-metrics-tls" not found May 29 17:33:23.513823 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:33:23.513794 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-registry-tls podName:015a10aa-8188-41f4-8c50-ee5cdf0c3727 nodeName:}" failed. No retries permitted until 2026-05-29 17:34:27.513788172 +0000 UTC m=+161.787015534 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-registry-tls") pod "image-registry-745dfbbf78-w5ws8" (UID: "015a10aa-8188-41f4-8c50-ee5cdf0c3727") : secret "image-registry-tls" not found May 29 17:33:23.840534 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:23.840511 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v8trn_92b4d776-17cd-4b31-9dea-c4fb783ed515/node-ca/0.log" May 29 17:33:24.328663 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:24.328631 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f033a789-974f-4bfb-a4e5-a654ee03e80a-service-ca-bundle\") pod \"router-default-b67975c55-zmgg7\" (UID: \"f033a789-974f-4bfb-a4e5-a654ee03e80a\") " pod="openshift-ingress/router-default-b67975c55-zmgg7" May 29 17:33:24.328815 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:24.328708 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f033a789-974f-4bfb-a4e5-a654ee03e80a-metrics-certs\") pod \"router-default-b67975c55-zmgg7\" (UID: \"f033a789-974f-4bfb-a4e5-a654ee03e80a\") " pod="openshift-ingress/router-default-b67975c55-zmgg7" May 29 17:33:24.328815 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:33:24.328807 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f033a789-974f-4bfb-a4e5-a654ee03e80a-service-ca-bundle podName:f033a789-974f-4bfb-a4e5-a654ee03e80a nodeName:}" failed. No retries permitted until 2026-05-29 17:33:32.328790019 +0000 UTC m=+106.602017375 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f033a789-974f-4bfb-a4e5-a654ee03e80a-service-ca-bundle") pod "router-default-b67975c55-zmgg7" (UID: "f033a789-974f-4bfb-a4e5-a654ee03e80a") : configmap references non-existent config key: service-ca.crt May 29 17:33:24.328909 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:33:24.328807 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 29 17:33:24.328909 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:33:24.328846 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f033a789-974f-4bfb-a4e5-a654ee03e80a-metrics-certs podName:f033a789-974f-4bfb-a4e5-a654ee03e80a nodeName:}" failed. No retries permitted until 2026-05-29 17:33:32.328835521 +0000 UTC m=+106.602062911 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f033a789-974f-4bfb-a4e5-a654ee03e80a-metrics-certs") pod "router-default-b67975c55-zmgg7" (UID: "f033a789-974f-4bfb-a4e5-a654ee03e80a") : secret "router-metrics-certs-default" not found May 29 17:33:26.860411 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:26.860364 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-xlb82" May 29 17:33:26.860411 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:26.860400 2567 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-xlb82" May 29 17:33:26.860873 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:26.860821 2567 scope.go:117] "RemoveContainer" containerID="5c75166211ab3ed823c2a75d8666b75fb199bdac04b8a48c26126b530d58acb6" May 29 17:33:26.861006 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:33:26.860988 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-xlb82_openshift-console-operator(03e5309b-1968-4102-9d24-9f7bc8ce3c27)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-xlb82" podUID="03e5309b-1968-4102-9d24-9f7bc8ce3c27" May 29 17:33:27.685185 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:27.685152 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-95vg5" May 29 17:33:32.390391 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:32.390358 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f033a789-974f-4bfb-a4e5-a654ee03e80a-metrics-certs\") pod \"router-default-b67975c55-zmgg7\" (UID: \"f033a789-974f-4bfb-a4e5-a654ee03e80a\") " pod="openshift-ingress/router-default-b67975c55-zmgg7" May 29 17:33:32.390798 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:32.390406 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f033a789-974f-4bfb-a4e5-a654ee03e80a-service-ca-bundle\") pod \"router-default-b67975c55-zmgg7\" (UID: \"f033a789-974f-4bfb-a4e5-a654ee03e80a\") " pod="openshift-ingress/router-default-b67975c55-zmgg7" May 29 17:33:32.390798 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:33:32.390560 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f033a789-974f-4bfb-a4e5-a654ee03e80a-service-ca-bundle podName:f033a789-974f-4bfb-a4e5-a654ee03e80a nodeName:}" failed. No retries permitted until 2026-05-29 17:33:48.390545866 +0000 UTC m=+122.663773228 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f033a789-974f-4bfb-a4e5-a654ee03e80a-service-ca-bundle") pod "router-default-b67975c55-zmgg7" (UID: "f033a789-974f-4bfb-a4e5-a654ee03e80a") : configmap references non-existent config key: service-ca.crt May 29 17:33:32.392826 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:32.392805 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f033a789-974f-4bfb-a4e5-a654ee03e80a-metrics-certs\") pod \"router-default-b67975c55-zmgg7\" (UID: \"f033a789-974f-4bfb-a4e5-a654ee03e80a\") " pod="openshift-ingress/router-default-b67975c55-zmgg7" May 29 17:33:39.309134 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:39.309102 2567 scope.go:117] "RemoveContainer" containerID="5c75166211ab3ed823c2a75d8666b75fb199bdac04b8a48c26126b530d58acb6" May 29 17:33:39.785060 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:39.784982 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-xlb82_03e5309b-1968-4102-9d24-9f7bc8ce3c27/console-operator/1.log" May 29 17:33:39.785199 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:39.785063 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-xlb82" event={"ID":"03e5309b-1968-4102-9d24-9f7bc8ce3c27","Type":"ContainerStarted","Data":"17e098e16cf2a0a9196a9c3d1cde6fa86be52ba8cc213f8ce7b1737934244385"} May 29 17:33:39.785365 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:39.785337 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-xlb82" May 29 17:33:39.801371 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:39.801324 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-xlb82" podStartSLOduration=21.767178562 podStartE2EDuration="23.801311429s" podCreationTimestamp="2026-05-29 17:33:16 +0000 UTC" firstStartedPulling="2026-05-29 17:33:16.984239526 +0000 UTC m=+91.257466882" lastFinishedPulling="2026-05-29 17:33:19.01837239 +0000 UTC m=+93.291599749" observedRunningTime="2026-05-29 17:33:39.800552526 +0000 UTC m=+114.073779905" watchObservedRunningTime="2026-05-29 17:33:39.801311429 +0000 UTC m=+114.074538838" May 29 17:33:40.007673 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:40.007643 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-xlb82" May 29 17:33:46.541539 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:46.541508 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-s427h"] May 29 17:33:46.544558 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:46.544541 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s427h" May 29 17:33:46.547508 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:46.547476 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 29 17:33:46.548482 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:46.548459 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 29 17:33:46.548482 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:46.548475 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f8qql\"" May 29 17:33:46.548616 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:46.548486 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 29 17:33:46.548616 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:46.548497 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 29 17:33:46.560552 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:46.560524 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s427h"] May 29 17:33:46.596100 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:46.596072 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f3f3b2c9-46d3-4ab2-9a21-2f6018959680-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s427h\" (UID: \"f3f3b2c9-46d3-4ab2-9a21-2f6018959680\") " pod="openshift-insights/insights-runtime-extractor-s427h" May 29 17:33:46.596243 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:46.596121 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f3f3b2c9-46d3-4ab2-9a21-2f6018959680-crio-socket\") pod \"insights-runtime-extractor-s427h\" (UID: \"f3f3b2c9-46d3-4ab2-9a21-2f6018959680\") " pod="openshift-insights/insights-runtime-extractor-s427h" May 29 17:33:46.596243 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:46.596150 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f3f3b2c9-46d3-4ab2-9a21-2f6018959680-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s427h\" (UID: \"f3f3b2c9-46d3-4ab2-9a21-2f6018959680\") " pod="openshift-insights/insights-runtime-extractor-s427h" May 29 17:33:46.596243 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:46.596197 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3f3b2c9-46d3-4ab2-9a21-2f6018959680-data-volume\") pod \"insights-runtime-extractor-s427h\" (UID: \"f3f3b2c9-46d3-4ab2-9a21-2f6018959680\") " pod="openshift-insights/insights-runtime-extractor-s427h" May 29 17:33:46.596346 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:46.596264 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8kdz\" (UniqueName: \"kubernetes.io/projected/f3f3b2c9-46d3-4ab2-9a21-2f6018959680-kube-api-access-s8kdz\") pod \"insights-runtime-extractor-s427h\" (UID: \"f3f3b2c9-46d3-4ab2-9a21-2f6018959680\") " pod="openshift-insights/insights-runtime-extractor-s427h" May 29 17:33:46.697556 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:46.697523 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3f3b2c9-46d3-4ab2-9a21-2f6018959680-data-volume\") pod \"insights-runtime-extractor-s427h\" (UID: \"f3f3b2c9-46d3-4ab2-9a21-2f6018959680\") " pod="openshift-insights/insights-runtime-extractor-s427h" May 29 17:33:46.697720 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:46.697594 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s8kdz\" (UniqueName: \"kubernetes.io/projected/f3f3b2c9-46d3-4ab2-9a21-2f6018959680-kube-api-access-s8kdz\") pod \"insights-runtime-extractor-s427h\" (UID: \"f3f3b2c9-46d3-4ab2-9a21-2f6018959680\") " pod="openshift-insights/insights-runtime-extractor-s427h" May 29 17:33:46.697720 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:46.697647 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f3f3b2c9-46d3-4ab2-9a21-2f6018959680-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s427h\" (UID: \"f3f3b2c9-46d3-4ab2-9a21-2f6018959680\") " pod="openshift-insights/insights-runtime-extractor-s427h" May 29 17:33:46.697720 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:46.697686 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f3f3b2c9-46d3-4ab2-9a21-2f6018959680-crio-socket\") pod \"insights-runtime-extractor-s427h\" (UID: \"f3f3b2c9-46d3-4ab2-9a21-2f6018959680\") " pod="openshift-insights/insights-runtime-extractor-s427h" May 29 17:33:46.697720 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:46.697714 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f3f3b2c9-46d3-4ab2-9a21-2f6018959680-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s427h\" (UID: \"f3f3b2c9-46d3-4ab2-9a21-2f6018959680\") " pod="openshift-insights/insights-runtime-extractor-s427h" May 29 17:33:46.697923 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:46.697875 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3f3b2c9-46d3-4ab2-9a21-2f6018959680-data-volume\") pod \"insights-runtime-extractor-s427h\" (UID: \"f3f3b2c9-46d3-4ab2-9a21-2f6018959680\") " pod="openshift-insights/insights-runtime-extractor-s427h" May 29 17:33:46.697923 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:46.697885 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f3f3b2c9-46d3-4ab2-9a21-2f6018959680-crio-socket\") pod \"insights-runtime-extractor-s427h\" (UID: \"f3f3b2c9-46d3-4ab2-9a21-2f6018959680\") " pod="openshift-insights/insights-runtime-extractor-s427h" May 29 17:33:46.698187 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:46.698169 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f3f3b2c9-46d3-4ab2-9a21-2f6018959680-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s427h\" (UID: \"f3f3b2c9-46d3-4ab2-9a21-2f6018959680\") " pod="openshift-insights/insights-runtime-extractor-s427h" May 29 17:33:46.699950 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:46.699931 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f3f3b2c9-46d3-4ab2-9a21-2f6018959680-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s427h\" (UID: \"f3f3b2c9-46d3-4ab2-9a21-2f6018959680\") " pod="openshift-insights/insights-runtime-extractor-s427h" May 29 17:33:46.720953 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:46.720933 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8kdz\" (UniqueName: \"kubernetes.io/projected/f3f3b2c9-46d3-4ab2-9a21-2f6018959680-kube-api-access-s8kdz\") pod \"insights-runtime-extractor-s427h\" (UID: \"f3f3b2c9-46d3-4ab2-9a21-2f6018959680\") " pod="openshift-insights/insights-runtime-extractor-s427h" May 29 17:33:46.853746 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:46.853645 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s427h" May 29 17:33:46.981870 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:46.981838 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s427h"] May 29 17:33:46.985123 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:33:46.985095 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3f3b2c9_46d3_4ab2_9a21_2f6018959680.slice/crio-31a0a22638bb0b22cb9a47779dde70bfd1cf86b58836da926992eb1a1521a362 WatchSource:0}: Error finding container 31a0a22638bb0b22cb9a47779dde70bfd1cf86b58836da926992eb1a1521a362: Status 404 returned error can't find the container with id 31a0a22638bb0b22cb9a47779dde70bfd1cf86b58836da926992eb1a1521a362 May 29 17:33:47.804181 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:47.804144 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s427h" event={"ID":"f3f3b2c9-46d3-4ab2-9a21-2f6018959680","Type":"ContainerStarted","Data":"74d96fffc1914756f0d19ec2c708fc6b7d51eddacdc7fb0a12f9bc09399bf990"} May 29 17:33:47.804181 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:47.804177 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s427h" event={"ID":"f3f3b2c9-46d3-4ab2-9a21-2f6018959680","Type":"ContainerStarted","Data":"ad200807a4806a536211fdbb66989380ba8607e17f914ff536863a2090b19713"} May 29 17:33:47.804575 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:47.804192 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s427h" event={"ID":"f3f3b2c9-46d3-4ab2-9a21-2f6018959680","Type":"ContainerStarted","Data":"31a0a22638bb0b22cb9a47779dde70bfd1cf86b58836da926992eb1a1521a362"} May 29 17:33:48.412781 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:48.412743 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f033a789-974f-4bfb-a4e5-a654ee03e80a-service-ca-bundle\") pod \"router-default-b67975c55-zmgg7\" (UID: \"f033a789-974f-4bfb-a4e5-a654ee03e80a\") " pod="openshift-ingress/router-default-b67975c55-zmgg7" May 29 17:33:48.413448 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:48.413421 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f033a789-974f-4bfb-a4e5-a654ee03e80a-service-ca-bundle\") pod \"router-default-b67975c55-zmgg7\" (UID: \"f033a789-974f-4bfb-a4e5-a654ee03e80a\") " pod="openshift-ingress/router-default-b67975c55-zmgg7" May 29 17:33:48.666229 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:48.666147 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-f8wqq\"" May 29 17:33:48.675201 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:48.675166 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-b67975c55-zmgg7" May 29 17:33:48.813059 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:48.812904 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-b67975c55-zmgg7"] May 29 17:33:49.283339 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:33:49.283305 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf033a789_974f_4bfb_a4e5_a654ee03e80a.slice/crio-36ce9ad1f6654cdb360878e7b954a7b6f48d8077feacd2115071d9efa4fd2223 WatchSource:0}: Error finding container 36ce9ad1f6654cdb360878e7b954a7b6f48d8077feacd2115071d9efa4fd2223: Status 404 returned error can't find the container with id 36ce9ad1f6654cdb360878e7b954a7b6f48d8077feacd2115071d9efa4fd2223 May 29 17:33:49.810795 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:49.810738 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-b67975c55-zmgg7" event={"ID":"f033a789-974f-4bfb-a4e5-a654ee03e80a","Type":"ContainerStarted","Data":"41d195b109fa03583f97e1ca420b43e0fb16f7c7d03f08c2c349280f5f46a2e9"} May 29 17:33:49.810795 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:49.810797 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-b67975c55-zmgg7" event={"ID":"f033a789-974f-4bfb-a4e5-a654ee03e80a","Type":"ContainerStarted","Data":"36ce9ad1f6654cdb360878e7b954a7b6f48d8077feacd2115071d9efa4fd2223"} May 29 17:33:49.812365 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:49.812340 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s427h" event={"ID":"f3f3b2c9-46d3-4ab2-9a21-2f6018959680","Type":"ContainerStarted","Data":"c709b2de7108fcedf0c2161d781efb4fc9496d3c6c454650f9b4a05cc46f109c"} May 29 17:33:49.829130 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:49.829087 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-b67975c55-zmgg7" podStartSLOduration=33.829076298 podStartE2EDuration="33.829076298s" podCreationTimestamp="2026-05-29 17:33:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:33:49.827510906 +0000 UTC m=+124.100738284" watchObservedRunningTime="2026-05-29 17:33:49.829076298 +0000 UTC m=+124.102303676" May 29 17:33:49.845108 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:49.845061 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-s427h" podStartSLOduration=1.556498412 podStartE2EDuration="3.845047808s" podCreationTimestamp="2026-05-29 17:33:46 +0000 UTC" firstStartedPulling="2026-05-29 17:33:47.045389332 +0000 UTC m=+121.318616689" lastFinishedPulling="2026-05-29 17:33:49.333938725 +0000 UTC m=+123.607166085" observedRunningTime="2026-05-29 17:33:49.844043274 +0000 UTC m=+124.117270653" watchObservedRunningTime="2026-05-29 17:33:49.845047808 +0000 UTC m=+124.118275187" May 29 17:33:50.676419 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:50.676382 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-b67975c55-zmgg7" May 29 17:33:50.678860 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:50.678835 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-b67975c55-zmgg7" May 29 17:33:50.814619 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:50.814581 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-b67975c55-zmgg7" May 29 17:33:50.815841 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:50.815821 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-b67975c55-zmgg7" May 29 17:33:54.642495 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:54.642461 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-qc4lb"] May 29 17:33:54.647444 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:54.647427 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qc4lb" May 29 17:33:54.649824 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:54.649798 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 29 17:33:54.649941 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:54.649802 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 29 17:33:54.649941 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:54.649903 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 29 17:33:54.649941 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:54.649925 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 29 17:33:54.650562 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:54.650548 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6n52x\"" May 29 17:33:54.650638 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:54.650626 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 29 17:33:54.652782 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:54.652757 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-qc4lb"] May 29 17:33:54.764101 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:54.764061 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/122d1e62-67fc-4c6f-99ed-d6fc8782f0c9-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-qc4lb\" (UID: \"122d1e62-67fc-4c6f-99ed-d6fc8782f0c9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qc4lb" May 29 17:33:54.764101 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:54.764106 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/122d1e62-67fc-4c6f-99ed-d6fc8782f0c9-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-qc4lb\" (UID: \"122d1e62-67fc-4c6f-99ed-d6fc8782f0c9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qc4lb" May 29 17:33:54.764326 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:54.764125 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlkc4\" (UniqueName: \"kubernetes.io/projected/122d1e62-67fc-4c6f-99ed-d6fc8782f0c9-kube-api-access-qlkc4\") pod \"prometheus-operator-658bcd8bdf-qc4lb\" (UID: \"122d1e62-67fc-4c6f-99ed-d6fc8782f0c9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qc4lb" May 29 17:33:54.764326 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:54.764190 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/122d1e62-67fc-4c6f-99ed-d6fc8782f0c9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-qc4lb\" (UID: \"122d1e62-67fc-4c6f-99ed-d6fc8782f0c9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qc4lb" May 29 17:33:54.865148 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:54.865112 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/122d1e62-67fc-4c6f-99ed-d6fc8782f0c9-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-qc4lb\" (UID: \"122d1e62-67fc-4c6f-99ed-d6fc8782f0c9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qc4lb" May 29 17:33:54.865148 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:54.865158 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/122d1e62-67fc-4c6f-99ed-d6fc8782f0c9-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-qc4lb\" (UID: \"122d1e62-67fc-4c6f-99ed-d6fc8782f0c9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qc4lb" May 29 17:33:54.865398 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:54.865178 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qlkc4\" (UniqueName: \"kubernetes.io/projected/122d1e62-67fc-4c6f-99ed-d6fc8782f0c9-kube-api-access-qlkc4\") pod \"prometheus-operator-658bcd8bdf-qc4lb\" (UID: \"122d1e62-67fc-4c6f-99ed-d6fc8782f0c9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qc4lb" May 29 17:33:54.865398 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:54.865275 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/122d1e62-67fc-4c6f-99ed-d6fc8782f0c9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-qc4lb\" (UID: \"122d1e62-67fc-4c6f-99ed-d6fc8782f0c9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qc4lb" May 29 17:33:54.865504 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:33:54.865427 2567 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found May 29 17:33:54.865504 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:33:54.865498 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/122d1e62-67fc-4c6f-99ed-d6fc8782f0c9-prometheus-operator-tls podName:122d1e62-67fc-4c6f-99ed-d6fc8782f0c9 nodeName:}" failed. No retries permitted until 2026-05-29 17:33:55.365482306 +0000 UTC m=+129.638709663 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/122d1e62-67fc-4c6f-99ed-d6fc8782f0c9-prometheus-operator-tls") pod "prometheus-operator-658bcd8bdf-qc4lb" (UID: "122d1e62-67fc-4c6f-99ed-d6fc8782f0c9") : secret "prometheus-operator-tls" not found May 29 17:33:54.865857 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:54.865837 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/122d1e62-67fc-4c6f-99ed-d6fc8782f0c9-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-qc4lb\" (UID: \"122d1e62-67fc-4c6f-99ed-d6fc8782f0c9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qc4lb" May 29 17:33:54.867682 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:54.867660 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/122d1e62-67fc-4c6f-99ed-d6fc8782f0c9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-qc4lb\" (UID: \"122d1e62-67fc-4c6f-99ed-d6fc8782f0c9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qc4lb" May 29 17:33:54.879822 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:54.879789 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlkc4\" (UniqueName: \"kubernetes.io/projected/122d1e62-67fc-4c6f-99ed-d6fc8782f0c9-kube-api-access-qlkc4\") pod \"prometheus-operator-658bcd8bdf-qc4lb\" (UID: \"122d1e62-67fc-4c6f-99ed-d6fc8782f0c9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qc4lb" May 29 17:33:55.167880 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:55.167841 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49-metrics-certs\") pod \"network-metrics-daemon-bcp7w\" (UID: \"d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49\") " pod="openshift-multus/network-metrics-daemon-bcp7w" May 29 17:33:55.170162 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:55.170138 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49-metrics-certs\") pod \"network-metrics-daemon-bcp7w\" (UID: \"d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49\") " pod="openshift-multus/network-metrics-daemon-bcp7w" May 29 17:33:55.221918 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:55.221881 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nlz48\"" May 29 17:33:55.229833 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:55.229804 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcp7w" May 29 17:33:55.369588 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:55.369544 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/122d1e62-67fc-4c6f-99ed-d6fc8782f0c9-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-qc4lb\" (UID: \"122d1e62-67fc-4c6f-99ed-d6fc8782f0c9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qc4lb" May 29 17:33:55.371347 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:55.371322 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bcp7w"] May 29 17:33:55.372446 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:55.372424 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/122d1e62-67fc-4c6f-99ed-d6fc8782f0c9-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-qc4lb\" (UID: \"122d1e62-67fc-4c6f-99ed-d6fc8782f0c9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qc4lb" May 29 17:33:55.375359 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:33:55.375333 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7ed6fb2_5896_4e9e_a2e6_2d7d433c8b49.slice/crio-bede910cef79977cbcd24a149bc98e12f475bc9035bccabdf3216f4927a439ee WatchSource:0}: Error finding container bede910cef79977cbcd24a149bc98e12f475bc9035bccabdf3216f4927a439ee: Status 404 returned error can't find the container with id bede910cef79977cbcd24a149bc98e12f475bc9035bccabdf3216f4927a439ee May 29 17:33:55.558393 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:55.558352 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qc4lb" May 29 17:33:55.675887 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:55.675852 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-qc4lb"] May 29 17:33:55.679641 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:33:55.679614 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod122d1e62_67fc_4c6f_99ed_d6fc8782f0c9.slice/crio-c40f52fb3094c8352c738f46a6c4812e86f45d011fa1b559dcc1c107685e444d WatchSource:0}: Error finding container c40f52fb3094c8352c738f46a6c4812e86f45d011fa1b559dcc1c107685e444d: Status 404 returned error can't find the container with id c40f52fb3094c8352c738f46a6c4812e86f45d011fa1b559dcc1c107685e444d May 29 17:33:55.828421 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:55.828323 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bcp7w" event={"ID":"d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49","Type":"ContainerStarted","Data":"bede910cef79977cbcd24a149bc98e12f475bc9035bccabdf3216f4927a439ee"} May 29 17:33:55.829332 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:55.829310 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qc4lb" event={"ID":"122d1e62-67fc-4c6f-99ed-d6fc8782f0c9","Type":"ContainerStarted","Data":"c40f52fb3094c8352c738f46a6c4812e86f45d011fa1b559dcc1c107685e444d"} May 29 17:33:57.836160 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:57.836115 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bcp7w" event={"ID":"d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49","Type":"ContainerStarted","Data":"8713e71efdff88045fbcb74337cd2c93d156ca288689aae126db7c5ef6f07e21"} May 29 17:33:57.836160 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:57.836159 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bcp7w" event={"ID":"d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49","Type":"ContainerStarted","Data":"bf75a42bec6619bf104482bae09ed21f0acaf2000896975508a0bc4eaabbf533"} May 29 17:33:57.837498 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:57.837473 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qc4lb" event={"ID":"122d1e62-67fc-4c6f-99ed-d6fc8782f0c9","Type":"ContainerStarted","Data":"b4a05923662497b7590bb030811d7ff7cdacc1d9b04a9c3d3e68ee343a1da1ed"} May 29 17:33:57.837547 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:57.837507 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qc4lb" event={"ID":"122d1e62-67fc-4c6f-99ed-d6fc8782f0c9","Type":"ContainerStarted","Data":"f36f261572cda36e4615143efaaf47371945b61fd5b0b2b74b55061ac2774d25"} May 29 17:33:57.851472 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:57.851408 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bcp7w" podStartSLOduration=130.217906585 podStartE2EDuration="2m11.851391867s" podCreationTimestamp="2026-05-29 17:31:46 +0000 UTC" firstStartedPulling="2026-05-29 17:33:55.377006073 +0000 UTC m=+129.650233434" lastFinishedPulling="2026-05-29 17:33:57.010491339 +0000 UTC m=+131.283718716" observedRunningTime="2026-05-29 17:33:57.849588659 +0000 UTC m=+132.122816049" watchObservedRunningTime="2026-05-29 17:33:57.851391867 +0000 UTC m=+132.124619248" May 29 17:33:57.870571 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:57.870506 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qc4lb" podStartSLOduration=2.49735165 podStartE2EDuration="3.870489913s" podCreationTimestamp="2026-05-29 17:33:54 +0000 UTC" firstStartedPulling="2026-05-29 17:33:55.681378853 +0000 UTC m=+129.954606210" lastFinishedPulling="2026-05-29 17:33:57.054517116 +0000 UTC m=+131.327744473" observedRunningTime="2026-05-29 17:33:57.869927606 +0000 UTC m=+132.143154977" watchObservedRunningTime="2026-05-29 17:33:57.870489913 +0000 UTC m=+132.143717293" May 29 17:33:59.952297 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:59.952261 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-dbf6h"] May 29 17:33:59.955631 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:59.955604 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-dbf6h" May 29 17:33:59.958101 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:59.958077 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 29 17:33:59.958194 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:59.958152 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-z9xt6\"" May 29 17:33:59.958254 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:59.958212 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 29 17:33:59.966832 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:59.966806 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-dbf6h"] May 29 17:33:59.968149 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:59.968125 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-x8c2q"] May 29 17:33:59.971295 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:59.971278 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x8c2q" May 29 17:33:59.973533 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:59.973512 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qrw66\"" May 29 17:33:59.973639 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:59.973513 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 29 17:33:59.973639 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:59.973572 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 29 17:33:59.973639 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:59.973608 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 29 17:33:59.975210 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:59.975190 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-b76x9"] May 29 17:33:59.978262 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:59.978240 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-b76x9" May 29 17:33:59.980247 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:59.980223 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 29 17:33:59.980549 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:59.980532 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 29 17:33:59.980647 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:59.980599 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 29 17:33:59.980701 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:59.980644 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-c24mv\"" May 29 17:33:59.988264 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:33:59.988244 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-b76x9"] May 29 17:34:00.011192 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.011165 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7bcbde0-7343-4891-9f11-6fc7e61b929e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-dbf6h\" (UID: \"e7bcbde0-7343-4891-9f11-6fc7e61b929e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-dbf6h" May 29 17:34:00.011321 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.011245 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7bcbde0-7343-4891-9f11-6fc7e61b929e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-dbf6h\" (UID: \"e7bcbde0-7343-4891-9f11-6fc7e61b929e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-dbf6h" May 29 17:34:00.011321 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.011273 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpjrf\" (UniqueName: \"kubernetes.io/projected/e7bcbde0-7343-4891-9f11-6fc7e61b929e-kube-api-access-vpjrf\") pod \"openshift-state-metrics-85658796db-dbf6h\" (UID: \"e7bcbde0-7343-4891-9f11-6fc7e61b929e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-dbf6h" May 29 17:34:00.011389 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.011354 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7bcbde0-7343-4891-9f11-6fc7e61b929e-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-dbf6h\" (UID: \"e7bcbde0-7343-4891-9f11-6fc7e61b929e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-dbf6h" May 29 17:34:00.112033 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.111993 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f684ebf3-917e-4699-b6a7-acad9b6a60fa-node-exporter-wtmp\") pod \"node-exporter-x8c2q\" (UID: \"f684ebf3-917e-4699-b6a7-acad9b6a60fa\") " pod="openshift-monitoring/node-exporter-x8c2q" May 29 17:34:00.112033 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.112034 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f684ebf3-917e-4699-b6a7-acad9b6a60fa-metrics-client-ca\") pod \"node-exporter-x8c2q\" (UID: \"f684ebf3-917e-4699-b6a7-acad9b6a60fa\") " pod="openshift-monitoring/node-exporter-x8c2q" May 29 17:34:00.112238 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.112064 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbg57\" (UniqueName: \"kubernetes.io/projected/a8b8947d-14c0-40bd-a664-1c9002bc29af-kube-api-access-vbg57\") pod \"kube-state-metrics-8469c486bb-b76x9\" (UID: \"a8b8947d-14c0-40bd-a664-1c9002bc29af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-b76x9" May 29 17:34:00.112238 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.112123 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f684ebf3-917e-4699-b6a7-acad9b6a60fa-node-exporter-tls\") pod \"node-exporter-x8c2q\" (UID: \"f684ebf3-917e-4699-b6a7-acad9b6a60fa\") " pod="openshift-monitoring/node-exporter-x8c2q" May 29 17:34:00.112238 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.112183 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8b8947d-14c0-40bd-a664-1c9002bc29af-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-b76x9\" (UID: \"a8b8947d-14c0-40bd-a664-1c9002bc29af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-b76x9" May 29 17:34:00.112238 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.112216 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7bcbde0-7343-4891-9f11-6fc7e61b929e-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-dbf6h\" (UID: \"e7bcbde0-7343-4891-9f11-6fc7e61b929e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-dbf6h" May 29 17:34:00.112352 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.112246 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a8b8947d-14c0-40bd-a664-1c9002bc29af-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-b76x9\" (UID: \"a8b8947d-14c0-40bd-a664-1c9002bc29af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-b76x9" May 29 17:34:00.112352 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.112270 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8b8947d-14c0-40bd-a664-1c9002bc29af-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-b76x9\" (UID: \"a8b8947d-14c0-40bd-a664-1c9002bc29af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-b76x9" May 29 17:34:00.112352 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.112291 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8b8947d-14c0-40bd-a664-1c9002bc29af-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-b76x9\" (UID: \"a8b8947d-14c0-40bd-a664-1c9002bc29af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-b76x9" May 29 17:34:00.112352 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.112325 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7bcbde0-7343-4891-9f11-6fc7e61b929e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-dbf6h\" (UID: \"e7bcbde0-7343-4891-9f11-6fc7e61b929e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-dbf6h" May 29 17:34:00.112463 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.112356 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f684ebf3-917e-4699-b6a7-acad9b6a60fa-node-exporter-accelerators-collector-config\") pod \"node-exporter-x8c2q\" (UID: \"f684ebf3-917e-4699-b6a7-acad9b6a60fa\") " pod="openshift-monitoring/node-exporter-x8c2q" May 29 17:34:00.112463 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.112375 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f684ebf3-917e-4699-b6a7-acad9b6a60fa-root\") pod \"node-exporter-x8c2q\" (UID: \"f684ebf3-917e-4699-b6a7-acad9b6a60fa\") " pod="openshift-monitoring/node-exporter-x8c2q" May 29 17:34:00.112463 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.112404 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxz2h\" (UniqueName: \"kubernetes.io/projected/f684ebf3-917e-4699-b6a7-acad9b6a60fa-kube-api-access-qxz2h\") pod \"node-exporter-x8c2q\" (UID: \"f684ebf3-917e-4699-b6a7-acad9b6a60fa\") " pod="openshift-monitoring/node-exporter-x8c2q" May 29 17:34:00.112463 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:34:00.112410 2567 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found May 29 17:34:00.112463 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.112434 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f684ebf3-917e-4699-b6a7-acad9b6a60fa-node-exporter-textfile\") pod \"node-exporter-x8c2q\" (UID: \"f684ebf3-917e-4699-b6a7-acad9b6a60fa\") " pod="openshift-monitoring/node-exporter-x8c2q" May 29 17:34:00.112602 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:34:00.112487 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7bcbde0-7343-4891-9f11-6fc7e61b929e-openshift-state-metrics-tls podName:e7bcbde0-7343-4891-9f11-6fc7e61b929e nodeName:}" failed. No retries permitted until 2026-05-29 17:34:00.612466738 +0000 UTC m=+134.885694100 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e7bcbde0-7343-4891-9f11-6fc7e61b929e-openshift-state-metrics-tls") pod "openshift-state-metrics-85658796db-dbf6h" (UID: "e7bcbde0-7343-4891-9f11-6fc7e61b929e") : secret "openshift-state-metrics-tls" not found May 29 17:34:00.112602 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.112511 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a8b8947d-14c0-40bd-a664-1c9002bc29af-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-b76x9\" (UID: \"a8b8947d-14c0-40bd-a664-1c9002bc29af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-b76x9" May 29 17:34:00.112602 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.112560 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7bcbde0-7343-4891-9f11-6fc7e61b929e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-dbf6h\" (UID: \"e7bcbde0-7343-4891-9f11-6fc7e61b929e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-dbf6h" May 29 17:34:00.112695 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.112668 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f684ebf3-917e-4699-b6a7-acad9b6a60fa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x8c2q\" (UID: \"f684ebf3-917e-4699-b6a7-acad9b6a60fa\") " pod="openshift-monitoring/node-exporter-x8c2q" May 29 17:34:00.112759 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.112697 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vpjrf\" (UniqueName: \"kubernetes.io/projected/e7bcbde0-7343-4891-9f11-6fc7e61b929e-kube-api-access-vpjrf\") pod \"openshift-state-metrics-85658796db-dbf6h\" (UID: \"e7bcbde0-7343-4891-9f11-6fc7e61b929e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-dbf6h" May 29 17:34:00.112819 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.112797 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f684ebf3-917e-4699-b6a7-acad9b6a60fa-sys\") pod \"node-exporter-x8c2q\" (UID: \"f684ebf3-917e-4699-b6a7-acad9b6a60fa\") " pod="openshift-monitoring/node-exporter-x8c2q" May 29 17:34:00.112984 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.112968 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7bcbde0-7343-4891-9f11-6fc7e61b929e-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-dbf6h\" (UID: \"e7bcbde0-7343-4891-9f11-6fc7e61b929e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-dbf6h" May 29 17:34:00.114811 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.114792 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7bcbde0-7343-4891-9f11-6fc7e61b929e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-dbf6h\" (UID: \"e7bcbde0-7343-4891-9f11-6fc7e61b929e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-dbf6h" May 29 17:34:00.120765 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.120744 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpjrf\" (UniqueName: \"kubernetes.io/projected/e7bcbde0-7343-4891-9f11-6fc7e61b929e-kube-api-access-vpjrf\") pod \"openshift-state-metrics-85658796db-dbf6h\" (UID: \"e7bcbde0-7343-4891-9f11-6fc7e61b929e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-dbf6h" May 29 17:34:00.213643 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.213571 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f684ebf3-917e-4699-b6a7-acad9b6a60fa-node-exporter-wtmp\") pod \"node-exporter-x8c2q\" (UID: \"f684ebf3-917e-4699-b6a7-acad9b6a60fa\") " pod="openshift-monitoring/node-exporter-x8c2q" May 29 17:34:00.213643 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.213607 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f684ebf3-917e-4699-b6a7-acad9b6a60fa-metrics-client-ca\") pod \"node-exporter-x8c2q\" (UID: \"f684ebf3-917e-4699-b6a7-acad9b6a60fa\") " pod="openshift-monitoring/node-exporter-x8c2q" May 29 17:34:00.213643 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.213630 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vbg57\" (UniqueName: \"kubernetes.io/projected/a8b8947d-14c0-40bd-a664-1c9002bc29af-kube-api-access-vbg57\") pod \"kube-state-metrics-8469c486bb-b76x9\" (UID: \"a8b8947d-14c0-40bd-a664-1c9002bc29af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-b76x9" May 29 17:34:00.214146 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.213668 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f684ebf3-917e-4699-b6a7-acad9b6a60fa-node-exporter-tls\") pod \"node-exporter-x8c2q\" (UID: \"f684ebf3-917e-4699-b6a7-acad9b6a60fa\") " pod="openshift-monitoring/node-exporter-x8c2q" May 29 17:34:00.214146 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.213752 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f684ebf3-917e-4699-b6a7-acad9b6a60fa-node-exporter-wtmp\") pod \"node-exporter-x8c2q\" (UID: \"f684ebf3-917e-4699-b6a7-acad9b6a60fa\") " pod="openshift-monitoring/node-exporter-x8c2q" May 29 17:34:00.214146 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.213767 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8b8947d-14c0-40bd-a664-1c9002bc29af-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-b76x9\" (UID: \"a8b8947d-14c0-40bd-a664-1c9002bc29af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-b76x9" May 29 17:34:00.214146 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.213822 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a8b8947d-14c0-40bd-a664-1c9002bc29af-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-b76x9\" (UID: \"a8b8947d-14c0-40bd-a664-1c9002bc29af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-b76x9" May 29 17:34:00.214146 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.213859 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8b8947d-14c0-40bd-a664-1c9002bc29af-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-b76x9\" (UID: \"a8b8947d-14c0-40bd-a664-1c9002bc29af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-b76x9" May 29 17:34:00.214146 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.213892 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8b8947d-14c0-40bd-a664-1c9002bc29af-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-b76x9\" (UID: \"a8b8947d-14c0-40bd-a664-1c9002bc29af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-b76x9" May 29 17:34:00.214146 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.213956 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f684ebf3-917e-4699-b6a7-acad9b6a60fa-node-exporter-accelerators-collector-config\") pod \"node-exporter-x8c2q\" (UID: \"f684ebf3-917e-4699-b6a7-acad9b6a60fa\") " pod="openshift-monitoring/node-exporter-x8c2q" May 29 17:34:00.214146 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.213986 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f684ebf3-917e-4699-b6a7-acad9b6a60fa-root\") pod \"node-exporter-x8c2q\" (UID: \"f684ebf3-917e-4699-b6a7-acad9b6a60fa\") " pod="openshift-monitoring/node-exporter-x8c2q" May 29 17:34:00.214146 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.214035 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qxz2h\" (UniqueName: \"kubernetes.io/projected/f684ebf3-917e-4699-b6a7-acad9b6a60fa-kube-api-access-qxz2h\") pod \"node-exporter-x8c2q\" (UID: \"f684ebf3-917e-4699-b6a7-acad9b6a60fa\") " pod="openshift-monitoring/node-exporter-x8c2q" May 29 17:34:00.214146 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:34:00.214047 2567 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found May 29 17:34:00.214146 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.214069 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f684ebf3-917e-4699-b6a7-acad9b6a60fa-node-exporter-textfile\") pod \"node-exporter-x8c2q\" (UID: \"f684ebf3-917e-4699-b6a7-acad9b6a60fa\") " pod="openshift-monitoring/node-exporter-x8c2q" May 29 17:34:00.214146 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.214096 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a8b8947d-14c0-40bd-a664-1c9002bc29af-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-b76x9\" (UID: \"a8b8947d-14c0-40bd-a664-1c9002bc29af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-b76x9" May 29 17:34:00.214146 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.214105 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f684ebf3-917e-4699-b6a7-acad9b6a60fa-root\") pod \"node-exporter-x8c2q\" (UID: \"f684ebf3-917e-4699-b6a7-acad9b6a60fa\") " pod="openshift-monitoring/node-exporter-x8c2q" May 29 17:34:00.214146 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:34:00.214140 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8b8947d-14c0-40bd-a664-1c9002bc29af-kube-state-metrics-tls podName:a8b8947d-14c0-40bd-a664-1c9002bc29af nodeName:}" failed. No retries permitted until 2026-05-29 17:34:00.714120664 +0000 UTC m=+134.987348043 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/a8b8947d-14c0-40bd-a664-1c9002bc29af-kube-state-metrics-tls") pod "kube-state-metrics-8469c486bb-b76x9" (UID: "a8b8947d-14c0-40bd-a664-1c9002bc29af") : secret "kube-state-metrics-tls" not found May 29 17:34:00.214876 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.214185 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f684ebf3-917e-4699-b6a7-acad9b6a60fa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x8c2q\" (UID: \"f684ebf3-917e-4699-b6a7-acad9b6a60fa\") " pod="openshift-monitoring/node-exporter-x8c2q" May 29 17:34:00.214876 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.214240 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f684ebf3-917e-4699-b6a7-acad9b6a60fa-sys\") pod \"node-exporter-x8c2q\" (UID: \"f684ebf3-917e-4699-b6a7-acad9b6a60fa\") " pod="openshift-monitoring/node-exporter-x8c2q" May 29 17:34:00.214876 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.214325 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f684ebf3-917e-4699-b6a7-acad9b6a60fa-sys\") pod \"node-exporter-x8c2q\" (UID: \"f684ebf3-917e-4699-b6a7-acad9b6a60fa\") " pod="openshift-monitoring/node-exporter-x8c2q" May 29 17:34:00.214876 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.214401 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f684ebf3-917e-4699-b6a7-acad9b6a60fa-metrics-client-ca\") pod \"node-exporter-x8c2q\" (UID: \"f684ebf3-917e-4699-b6a7-acad9b6a60fa\") " pod="openshift-monitoring/node-exporter-x8c2q" May 29 17:34:00.214876 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.214564 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f684ebf3-917e-4699-b6a7-acad9b6a60fa-node-exporter-accelerators-collector-config\") pod \"node-exporter-x8c2q\" (UID: \"f684ebf3-917e-4699-b6a7-acad9b6a60fa\") " pod="openshift-monitoring/node-exporter-x8c2q" May 29 17:34:00.214876 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.214645 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f684ebf3-917e-4699-b6a7-acad9b6a60fa-node-exporter-textfile\") pod \"node-exporter-x8c2q\" (UID: \"f684ebf3-917e-4699-b6a7-acad9b6a60fa\") " pod="openshift-monitoring/node-exporter-x8c2q" May 29 17:34:00.214876 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.214797 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a8b8947d-14c0-40bd-a664-1c9002bc29af-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-b76x9\" (UID: \"a8b8947d-14c0-40bd-a664-1c9002bc29af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-b76x9" May 29 17:34:00.215956 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.215374 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a8b8947d-14c0-40bd-a664-1c9002bc29af-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-b76x9\" (UID: \"a8b8947d-14c0-40bd-a664-1c9002bc29af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-b76x9" May 29 17:34:00.215956 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.215550 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8b8947d-14c0-40bd-a664-1c9002bc29af-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-b76x9\" (UID: \"a8b8947d-14c0-40bd-a664-1c9002bc29af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-b76x9" May 29 17:34:00.220191 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.216741 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f684ebf3-917e-4699-b6a7-acad9b6a60fa-node-exporter-tls\") pod \"node-exporter-x8c2q\" (UID: \"f684ebf3-917e-4699-b6a7-acad9b6a60fa\") " pod="openshift-monitoring/node-exporter-x8c2q" May 29 17:34:00.220191 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.218161 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f684ebf3-917e-4699-b6a7-acad9b6a60fa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x8c2q\" (UID: \"f684ebf3-917e-4699-b6a7-acad9b6a60fa\") " pod="openshift-monitoring/node-exporter-x8c2q" May 29 17:34:00.220191 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.218341 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8b8947d-14c0-40bd-a664-1c9002bc29af-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-b76x9\" (UID: \"a8b8947d-14c0-40bd-a664-1c9002bc29af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-b76x9" May 29 17:34:00.222512 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.222492 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbg57\" (UniqueName: \"kubernetes.io/projected/a8b8947d-14c0-40bd-a664-1c9002bc29af-kube-api-access-vbg57\") pod \"kube-state-metrics-8469c486bb-b76x9\" (UID: \"a8b8947d-14c0-40bd-a664-1c9002bc29af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-b76x9" May 29 17:34:00.222753 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.222719 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxz2h\" (UniqueName: \"kubernetes.io/projected/f684ebf3-917e-4699-b6a7-acad9b6a60fa-kube-api-access-qxz2h\") pod \"node-exporter-x8c2q\" (UID: \"f684ebf3-917e-4699-b6a7-acad9b6a60fa\") " pod="openshift-monitoring/node-exporter-x8c2q" May 29 17:34:00.281960 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.281920 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x8c2q" May 29 17:34:00.290045 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:34:00.290012 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf684ebf3_917e_4699_b6a7_acad9b6a60fa.slice/crio-aa4d2161b01bbcb7ccfa00e4a8e8707cd9b0cd98733b2f18ce297202e036bc93 WatchSource:0}: Error finding container aa4d2161b01bbcb7ccfa00e4a8e8707cd9b0cd98733b2f18ce297202e036bc93: Status 404 returned error can't find the container with id aa4d2161b01bbcb7ccfa00e4a8e8707cd9b0cd98733b2f18ce297202e036bc93 May 29 17:34:00.618803 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.618767 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7bcbde0-7343-4891-9f11-6fc7e61b929e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-dbf6h\" (UID: \"e7bcbde0-7343-4891-9f11-6fc7e61b929e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-dbf6h" May 29 17:34:00.621237 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.621196 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7bcbde0-7343-4891-9f11-6fc7e61b929e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-dbf6h\" (UID: \"e7bcbde0-7343-4891-9f11-6fc7e61b929e\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-dbf6h" May 29 17:34:00.720199 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.720165 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8b8947d-14c0-40bd-a664-1c9002bc29af-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-b76x9\" (UID: \"a8b8947d-14c0-40bd-a664-1c9002bc29af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-b76x9" May 29 17:34:00.722453 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.722435 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8b8947d-14c0-40bd-a664-1c9002bc29af-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-b76x9\" (UID: \"a8b8947d-14c0-40bd-a664-1c9002bc29af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-b76x9" May 29 17:34:00.851090 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.851048 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x8c2q" event={"ID":"f684ebf3-917e-4699-b6a7-acad9b6a60fa","Type":"ContainerStarted","Data":"aa4d2161b01bbcb7ccfa00e4a8e8707cd9b0cd98733b2f18ce297202e036bc93"} May 29 17:34:00.864305 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.864270 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-dbf6h" May 29 17:34:00.887780 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:00.887750 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-b76x9" May 29 17:34:01.019246 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:01.019187 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-dbf6h"] May 29 17:34:01.024560 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:34:01.024531 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7bcbde0_7343_4891_9f11_6fc7e61b929e.slice/crio-0e9dee1934016b147411850c832c9f7641076c504f6350d9efe18c76e77284bd WatchSource:0}: Error finding container 0e9dee1934016b147411850c832c9f7641076c504f6350d9efe18c76e77284bd: Status 404 returned error can't find the container with id 0e9dee1934016b147411850c832c9f7641076c504f6350d9efe18c76e77284bd May 29 17:34:01.043204 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:01.043180 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-b76x9"] May 29 17:34:01.047710 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:34:01.047678 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8b8947d_14c0_40bd_a664_1c9002bc29af.slice/crio-a4acfb351bfc4085bc32814ef18b0e5076a6f490a4ede6822abcc0526a93a5ec WatchSource:0}: Error finding container a4acfb351bfc4085bc32814ef18b0e5076a6f490a4ede6822abcc0526a93a5ec: Status 404 returned error can't find the container with id a4acfb351bfc4085bc32814ef18b0e5076a6f490a4ede6822abcc0526a93a5ec May 29 17:34:01.856348 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:01.856304 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-b76x9" event={"ID":"a8b8947d-14c0-40bd-a664-1c9002bc29af","Type":"ContainerStarted","Data":"a4acfb351bfc4085bc32814ef18b0e5076a6f490a4ede6822abcc0526a93a5ec"} May 29 17:34:01.858341 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:01.858306 2567 generic.go:358] "Generic (PLEG): container finished" podID="f684ebf3-917e-4699-b6a7-acad9b6a60fa" containerID="39f36065ddf62467e46a9d475c05a6aac777cb4c07bbc92b243e7068b9c9d7c6" exitCode=0 May 29 17:34:01.858473 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:01.858398 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x8c2q" event={"ID":"f684ebf3-917e-4699-b6a7-acad9b6a60fa","Type":"ContainerDied","Data":"39f36065ddf62467e46a9d475c05a6aac777cb4c07bbc92b243e7068b9c9d7c6"} May 29 17:34:01.860869 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:01.860840 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-dbf6h" event={"ID":"e7bcbde0-7343-4891-9f11-6fc7e61b929e","Type":"ContainerStarted","Data":"a7887f7c56a65ca5392e3ca87e011254e3037d871d91278bed1413f8f682b57f"} May 29 17:34:01.860984 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:01.860874 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-dbf6h" event={"ID":"e7bcbde0-7343-4891-9f11-6fc7e61b929e","Type":"ContainerStarted","Data":"a905d37cd5dae17c9b94fe9efb0b2f2bb3d2e869a8fccfa18b0ff0991b93c899"} May 29 17:34:01.860984 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:01.860889 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-dbf6h" event={"ID":"e7bcbde0-7343-4891-9f11-6fc7e61b929e","Type":"ContainerStarted","Data":"0e9dee1934016b147411850c832c9f7641076c504f6350d9efe18c76e77284bd"} May 29 17:34:02.866445 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:02.865581 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x8c2q" event={"ID":"f684ebf3-917e-4699-b6a7-acad9b6a60fa","Type":"ContainerStarted","Data":"f817173e11d12655a6f267084c65b0e863c0da47e608e6cc7e19435a9eee2de1"} May 29 17:34:02.866445 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:02.865622 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x8c2q" event={"ID":"f684ebf3-917e-4699-b6a7-acad9b6a60fa","Type":"ContainerStarted","Data":"bace7659bd97eeb907efe0449838d18e1902edc9f6f76cfdfdabfe197a0320eb"} May 29 17:34:02.869159 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:02.869128 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-dbf6h" event={"ID":"e7bcbde0-7343-4891-9f11-6fc7e61b929e","Type":"ContainerStarted","Data":"f826813d12e24e2f090f6d848fb4bd3b826e95cd300e02930e19873017d42581"} May 29 17:34:02.875545 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:02.875517 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-b76x9" event={"ID":"a8b8947d-14c0-40bd-a664-1c9002bc29af","Type":"ContainerStarted","Data":"a2f924835c7c979ccdc8a533b2b4523abc2c5852b14a35192b2353603052ebeb"} May 29 17:34:02.875668 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:02.875551 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-b76x9" event={"ID":"a8b8947d-14c0-40bd-a664-1c9002bc29af","Type":"ContainerStarted","Data":"6a658a7424d3eab3d2e5eb0c29781c7612eeca3c9f36cf0e4096df72739b9eed"} May 29 17:34:02.875668 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:02.875567 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-b76x9" event={"ID":"a8b8947d-14c0-40bd-a664-1c9002bc29af","Type":"ContainerStarted","Data":"20059314eb7750fa2fb7de95fa3cd76b6355afb2632b9dbf84c3b767a93e4d75"} May 29 17:34:02.894063 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:02.894000 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-x8c2q" podStartSLOduration=2.797123976 podStartE2EDuration="3.893981623s" podCreationTimestamp="2026-05-29 17:33:59 +0000 UTC" firstStartedPulling="2026-05-29 17:34:00.291752104 +0000 UTC m=+134.564979460" lastFinishedPulling="2026-05-29 17:34:01.388609743 +0000 UTC m=+135.661837107" observedRunningTime="2026-05-29 17:34:02.893099357 +0000 UTC m=+137.166326739" watchObservedRunningTime="2026-05-29 17:34:02.893981623 +0000 UTC m=+137.167209002" May 29 17:34:02.911585 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:02.911519 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-dbf6h" podStartSLOduration=2.67794535 podStartE2EDuration="3.911500793s" podCreationTimestamp="2026-05-29 17:33:59 +0000 UTC" firstStartedPulling="2026-05-29 17:34:01.175714758 +0000 UTC m=+135.448942115" lastFinishedPulling="2026-05-29 17:34:02.409270202 +0000 UTC m=+136.682497558" observedRunningTime="2026-05-29 17:34:02.910876847 +0000 UTC m=+137.184104225" watchObservedRunningTime="2026-05-29 17:34:02.911500793 +0000 UTC m=+137.184728173" May 29 17:34:02.928613 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:02.928566 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-b76x9" podStartSLOduration=2.571515377 podStartE2EDuration="3.928552652s" podCreationTimestamp="2026-05-29 17:33:59 +0000 UTC" firstStartedPulling="2026-05-29 17:34:01.050591972 +0000 UTC m=+135.323819342" lastFinishedPulling="2026-05-29 17:34:02.407629246 +0000 UTC m=+136.680856617" observedRunningTime="2026-05-29 17:34:02.927096581 +0000 UTC m=+137.200323972" watchObservedRunningTime="2026-05-29 17:34:02.928552652 +0000 UTC m=+137.201780031" May 29 17:34:04.373356 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:04.373319 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-54f9fd7769-wqvv2"] May 29 17:34:04.377043 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:04.377022 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-54f9fd7769-wqvv2" May 29 17:34:04.379331 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:04.379304 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 29 17:34:04.379460 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:04.379389 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 29 17:34:04.379460 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:04.379399 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 29 17:34:04.380240 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:04.380219 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-f79qr\"" May 29 17:34:04.380240 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:04.380231 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 29 17:34:04.380411 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:04.380326 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-89pn183gb10p0\"" May 29 17:34:04.384869 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:04.384849 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-54f9fd7769-wqvv2"] May 29 17:34:04.458458 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:04.458420 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1cf3f7fc-a23a-417a-b611-331eba92e9bb-secret-metrics-server-client-certs\") pod \"metrics-server-54f9fd7769-wqvv2\" (UID: \"1cf3f7fc-a23a-417a-b611-331eba92e9bb\") " pod="openshift-monitoring/metrics-server-54f9fd7769-wqvv2" May 29 17:34:04.458458 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:04.458457 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1cf3f7fc-a23a-417a-b611-331eba92e9bb-metrics-server-audit-profiles\") pod \"metrics-server-54f9fd7769-wqvv2\" (UID: \"1cf3f7fc-a23a-417a-b611-331eba92e9bb\") " pod="openshift-monitoring/metrics-server-54f9fd7769-wqvv2" May 29 17:34:04.458665 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:04.458492 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1cf3f7fc-a23a-417a-b611-331eba92e9bb-client-ca-bundle\") pod \"metrics-server-54f9fd7769-wqvv2\" (UID: \"1cf3f7fc-a23a-417a-b611-331eba92e9bb\") " pod="openshift-monitoring/metrics-server-54f9fd7769-wqvv2" May 29 17:34:04.458665 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:04.458572 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j894p\" (UniqueName: \"kubernetes.io/projected/1cf3f7fc-a23a-417a-b611-331eba92e9bb-kube-api-access-j894p\") pod \"metrics-server-54f9fd7769-wqvv2\" (UID: \"1cf3f7fc-a23a-417a-b611-331eba92e9bb\") " pod="openshift-monitoring/metrics-server-54f9fd7769-wqvv2" May 29 17:34:04.458665 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:04.458607 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1cf3f7fc-a23a-417a-b611-331eba92e9bb-secret-metrics-server-tls\") pod \"metrics-server-54f9fd7769-wqvv2\" (UID: \"1cf3f7fc-a23a-417a-b611-331eba92e9bb\") " pod="openshift-monitoring/metrics-server-54f9fd7769-wqvv2" May 29 17:34:04.458795 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:04.458673 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cf3f7fc-a23a-417a-b611-331eba92e9bb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-54f9fd7769-wqvv2\" (UID: \"1cf3f7fc-a23a-417a-b611-331eba92e9bb\") " pod="openshift-monitoring/metrics-server-54f9fd7769-wqvv2" May 29 17:34:04.458795 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:04.458691 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1cf3f7fc-a23a-417a-b611-331eba92e9bb-audit-log\") pod \"metrics-server-54f9fd7769-wqvv2\" (UID: \"1cf3f7fc-a23a-417a-b611-331eba92e9bb\") " pod="openshift-monitoring/metrics-server-54f9fd7769-wqvv2" May 29 17:34:04.560033 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:04.559997 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1cf3f7fc-a23a-417a-b611-331eba92e9bb-secret-metrics-server-client-certs\") pod \"metrics-server-54f9fd7769-wqvv2\" (UID: \"1cf3f7fc-a23a-417a-b611-331eba92e9bb\") " pod="openshift-monitoring/metrics-server-54f9fd7769-wqvv2" May 29 17:34:04.560033 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:04.560035 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1cf3f7fc-a23a-417a-b611-331eba92e9bb-metrics-server-audit-profiles\") pod \"metrics-server-54f9fd7769-wqvv2\" (UID: \"1cf3f7fc-a23a-417a-b611-331eba92e9bb\") " pod="openshift-monitoring/metrics-server-54f9fd7769-wqvv2" May 29 17:34:04.560265 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:04.560074 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1cf3f7fc-a23a-417a-b611-331eba92e9bb-client-ca-bundle\") pod \"metrics-server-54f9fd7769-wqvv2\" (UID: \"1cf3f7fc-a23a-417a-b611-331eba92e9bb\") " pod="openshift-monitoring/metrics-server-54f9fd7769-wqvv2" May 29 17:34:04.560265 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:04.560189 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j894p\" (UniqueName: \"kubernetes.io/projected/1cf3f7fc-a23a-417a-b611-331eba92e9bb-kube-api-access-j894p\") pod \"metrics-server-54f9fd7769-wqvv2\" (UID: \"1cf3f7fc-a23a-417a-b611-331eba92e9bb\") " pod="openshift-monitoring/metrics-server-54f9fd7769-wqvv2" May 29 17:34:04.560265 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:04.560229 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1cf3f7fc-a23a-417a-b611-331eba92e9bb-secret-metrics-server-tls\") pod \"metrics-server-54f9fd7769-wqvv2\" (UID: \"1cf3f7fc-a23a-417a-b611-331eba92e9bb\") " pod="openshift-monitoring/metrics-server-54f9fd7769-wqvv2" May 29 17:34:04.560405 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:04.560292 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cf3f7fc-a23a-417a-b611-331eba92e9bb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-54f9fd7769-wqvv2\" (UID: \"1cf3f7fc-a23a-417a-b611-331eba92e9bb\") " pod="openshift-monitoring/metrics-server-54f9fd7769-wqvv2" May 29 17:34:04.560405 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:04.560310 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1cf3f7fc-a23a-417a-b611-331eba92e9bb-audit-log\") pod \"metrics-server-54f9fd7769-wqvv2\" (UID: \"1cf3f7fc-a23a-417a-b611-331eba92e9bb\") " pod="openshift-monitoring/metrics-server-54f9fd7769-wqvv2" May 29 17:34:04.560707 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:04.560686 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1cf3f7fc-a23a-417a-b611-331eba92e9bb-audit-log\") pod \"metrics-server-54f9fd7769-wqvv2\" (UID: \"1cf3f7fc-a23a-417a-b611-331eba92e9bb\") " pod="openshift-monitoring/metrics-server-54f9fd7769-wqvv2" May 29 17:34:04.560982 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:04.560964 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cf3f7fc-a23a-417a-b611-331eba92e9bb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-54f9fd7769-wqvv2\" (UID: \"1cf3f7fc-a23a-417a-b611-331eba92e9bb\") " pod="openshift-monitoring/metrics-server-54f9fd7769-wqvv2" May 29 17:34:04.561064 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:04.561045 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1cf3f7fc-a23a-417a-b611-331eba92e9bb-metrics-server-audit-profiles\") pod \"metrics-server-54f9fd7769-wqvv2\" (UID: \"1cf3f7fc-a23a-417a-b611-331eba92e9bb\") " pod="openshift-monitoring/metrics-server-54f9fd7769-wqvv2" May 29 17:34:04.562574 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:04.562557 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1cf3f7fc-a23a-417a-b611-331eba92e9bb-secret-metrics-server-tls\") pod \"metrics-server-54f9fd7769-wqvv2\" (UID: \"1cf3f7fc-a23a-417a-b611-331eba92e9bb\") " pod="openshift-monitoring/metrics-server-54f9fd7769-wqvv2" May 29 17:34:04.562978 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:04.562959 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1cf3f7fc-a23a-417a-b611-331eba92e9bb-secret-metrics-server-client-certs\") pod \"metrics-server-54f9fd7769-wqvv2\" (UID: \"1cf3f7fc-a23a-417a-b611-331eba92e9bb\") " pod="openshift-monitoring/metrics-server-54f9fd7769-wqvv2" May 29 17:34:04.563109 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:04.563089 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1cf3f7fc-a23a-417a-b611-331eba92e9bb-client-ca-bundle\") pod \"metrics-server-54f9fd7769-wqvv2\" (UID: \"1cf3f7fc-a23a-417a-b611-331eba92e9bb\") " pod="openshift-monitoring/metrics-server-54f9fd7769-wqvv2" May 29 17:34:04.567767 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:04.567719 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j894p\" (UniqueName: \"kubernetes.io/projected/1cf3f7fc-a23a-417a-b611-331eba92e9bb-kube-api-access-j894p\") pod \"metrics-server-54f9fd7769-wqvv2\" (UID: \"1cf3f7fc-a23a-417a-b611-331eba92e9bb\") " pod="openshift-monitoring/metrics-server-54f9fd7769-wqvv2" May 29 17:34:04.687630 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:04.687546 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-54f9fd7769-wqvv2" May 29 17:34:04.829648 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:04.829585 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-54f9fd7769-wqvv2"] May 29 17:34:04.832192 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:34:04.832167 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cf3f7fc_a23a_417a_b611_331eba92e9bb.slice/crio-3dc484e62a163c0476717a8d9c878970a73ceb722ecaa42fc146b0571b2ece04 WatchSource:0}: Error finding container 3dc484e62a163c0476717a8d9c878970a73ceb722ecaa42fc146b0571b2ece04: Status 404 returned error can't find the container with id 3dc484e62a163c0476717a8d9c878970a73ceb722ecaa42fc146b0571b2ece04 May 29 17:34:04.883804 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:04.883766 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-54f9fd7769-wqvv2" event={"ID":"1cf3f7fc-a23a-417a-b611-331eba92e9bb","Type":"ContainerStarted","Data":"3dc484e62a163c0476717a8d9c878970a73ceb722ecaa42fc146b0571b2ece04"} May 29 17:34:06.213420 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.213356 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 17:34:06.218879 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.218851 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.224790 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.224714 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 29 17:34:06.224997 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.224975 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 29 17:34:06.225092 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.225003 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 29 17:34:06.225457 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.225349 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 29 17:34:06.225457 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.225368 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-v6ksr\"" May 29 17:34:06.225942 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.225686 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 29 17:34:06.225942 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.225763 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 29 17:34:06.225942 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.225775 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 29 17:34:06.225942 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.225693 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 29 17:34:06.225942 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.225881 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 29 17:34:06.226244 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.226140 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 29 17:34:06.226294 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.226139 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-erkjehf8frhoc\"" May 29 17:34:06.240604 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.239930 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 17:34:06.240604 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.240140 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 29 17:34:06.241595 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.241574 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 29 17:34:06.377602 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.377578 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.377714 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.377610 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-config\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.377714 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.377632 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.377714 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.377654 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwgmd\" (UniqueName: \"kubernetes.io/projected/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-kube-api-access-pwgmd\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.377840 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.377783 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.377840 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.377820 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.377922 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.377909 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.377967 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.377955 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-web-config\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.378003 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.377986 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.378036 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.378015 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-config-out\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.378065 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.378041 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.378065 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.378059 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.378119 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.378080 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.378164 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.378149 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.378195 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.378177 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.378224 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.378205 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.378256 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.378224 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.378256 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.378238 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.478763 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.478652 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.478763 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.478702 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-config\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.478763 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.478738 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.478763 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.478762 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwgmd\" (UniqueName: \"kubernetes.io/projected/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-kube-api-access-pwgmd\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.479013 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.478864 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.479013 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.478905 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.479013 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.478944 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.479013 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.479005 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-web-config\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.479128 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.479043 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.479128 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.479075 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-config-out\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.479128 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.479104 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.479214 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.479135 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.479214 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.479165 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.479271 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.479228 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.479311 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.479279 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.479471 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.479446 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.479970 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.479686 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.479970 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.479792 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.479970 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.479831 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.479970 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.479859 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.479970 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.479930 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.481019 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.480363 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.484602 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.481538 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.484602 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.484359 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-web-config\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.484602 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.484558 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.485903 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.485849 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.487085 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.486836 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.487085 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.486935 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-config\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.487085 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.487007 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.487326 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.487138 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-config-out\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.487326 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.487249 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.487427 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.487392 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.487897 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.487870 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.487983 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.487953 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.488505 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.488462 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.489558 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.489534 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwgmd\" (UniqueName: \"kubernetes.io/projected/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-kube-api-access-pwgmd\") pod \"prometheus-k8s-0\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.532674 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.532632 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:06.698379 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.698273 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 17:34:06.700889 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:34:06.700844 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5588932f_c41d_4b73_84a0_6a6d0d0a09ac.slice/crio-53b758897419f28d3c3118813d749dfa934b497a209963b9df8ece948bca95fd WatchSource:0}: Error finding container 53b758897419f28d3c3118813d749dfa934b497a209963b9df8ece948bca95fd: Status 404 returned error can't find the container with id 53b758897419f28d3c3118813d749dfa934b497a209963b9df8ece948bca95fd May 29 17:34:06.891250 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.891215 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-54f9fd7769-wqvv2" event={"ID":"1cf3f7fc-a23a-417a-b611-331eba92e9bb","Type":"ContainerStarted","Data":"a6f09fe88d6c9cc0f8e03948d69a64c487d5b5df76d556a26a89d3ca5e52f64a"} May 29 17:34:06.892307 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.892282 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5588932f-c41d-4b73-84a0-6a6d0d0a09ac","Type":"ContainerStarted","Data":"53b758897419f28d3c3118813d749dfa934b497a209963b9df8ece948bca95fd"} May 29 17:34:06.909823 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:06.909763 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-54f9fd7769-wqvv2" podStartSLOduration=1.390923095 podStartE2EDuration="2.909747548s" podCreationTimestamp="2026-05-29 17:34:04 +0000 UTC" firstStartedPulling="2026-05-29 17:34:04.834166792 +0000 UTC m=+139.107394149" lastFinishedPulling="2026-05-29 17:34:06.352991245 +0000 UTC m=+140.626218602" observedRunningTime="2026-05-29 17:34:06.906923497 +0000 UTC m=+141.180150878" watchObservedRunningTime="2026-05-29 17:34:06.909747548 +0000 UTC m=+141.182974927" May 29 17:34:07.896759 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:07.896709 2567 generic.go:358] "Generic (PLEG): container finished" podID="5588932f-c41d-4b73-84a0-6a6d0d0a09ac" containerID="789020a1abb10c6a4a5a934e31924630370d81862cedb5093fe9f028c82e1a45" exitCode=0 May 29 17:34:07.897199 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:07.896782 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5588932f-c41d-4b73-84a0-6a6d0d0a09ac","Type":"ContainerDied","Data":"789020a1abb10c6a4a5a934e31924630370d81862cedb5093fe9f028c82e1a45"} May 29 17:34:08.796717 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:08.796679 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-745dfbbf78-w5ws8"] May 29 17:34:08.797100 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:34:08.796972 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-745dfbbf78-w5ws8" podUID="015a10aa-8188-41f4-8c50-ee5cdf0c3727" May 29 17:34:08.899387 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:08.899355 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-745dfbbf78-w5ws8" May 29 17:34:08.904199 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:08.904174 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-745dfbbf78-w5ws8" May 29 17:34:09.003519 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:09.003479 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/015a10aa-8188-41f4-8c50-ee5cdf0c3727-image-registry-private-configuration\") pod \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " May 29 17:34:09.003682 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:09.003534 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59flr\" (UniqueName: \"kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-kube-api-access-59flr\") pod \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " May 29 17:34:09.003682 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:09.003559 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-bound-sa-token\") pod \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " May 29 17:34:09.003682 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:09.003595 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/015a10aa-8188-41f4-8c50-ee5cdf0c3727-trusted-ca\") pod \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " May 29 17:34:09.003682 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:09.003642 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/015a10aa-8188-41f4-8c50-ee5cdf0c3727-registry-certificates\") pod \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " May 29 17:34:09.003682 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:09.003671 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/015a10aa-8188-41f4-8c50-ee5cdf0c3727-installation-pull-secrets\") pod \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " May 29 17:34:09.003899 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:09.003754 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/015a10aa-8188-41f4-8c50-ee5cdf0c3727-ca-trust-extracted\") pod \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\" (UID: \"015a10aa-8188-41f4-8c50-ee5cdf0c3727\") " May 29 17:34:09.004081 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:09.004053 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/015a10aa-8188-41f4-8c50-ee5cdf0c3727-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "015a10aa-8188-41f4-8c50-ee5cdf0c3727" (UID: "015a10aa-8188-41f4-8c50-ee5cdf0c3727"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 17:34:09.004550 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:09.004235 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/015a10aa-8188-41f4-8c50-ee5cdf0c3727-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "015a10aa-8188-41f4-8c50-ee5cdf0c3727" (UID: "015a10aa-8188-41f4-8c50-ee5cdf0c3727"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 17:34:09.004550 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:09.004235 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/015a10aa-8188-41f4-8c50-ee5cdf0c3727-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "015a10aa-8188-41f4-8c50-ee5cdf0c3727" (UID: "015a10aa-8188-41f4-8c50-ee5cdf0c3727"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 17:34:09.006508 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:09.006477 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "015a10aa-8188-41f4-8c50-ee5cdf0c3727" (UID: "015a10aa-8188-41f4-8c50-ee5cdf0c3727"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 17:34:09.006639 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:09.006599 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-kube-api-access-59flr" (OuterVolumeSpecName: "kube-api-access-59flr") pod "015a10aa-8188-41f4-8c50-ee5cdf0c3727" (UID: "015a10aa-8188-41f4-8c50-ee5cdf0c3727"). InnerVolumeSpecName "kube-api-access-59flr". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 17:34:09.006762 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:09.006692 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/015a10aa-8188-41f4-8c50-ee5cdf0c3727-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "015a10aa-8188-41f4-8c50-ee5cdf0c3727" (UID: "015a10aa-8188-41f4-8c50-ee5cdf0c3727"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 17:34:09.006834 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:09.006786 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/015a10aa-8188-41f4-8c50-ee5cdf0c3727-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "015a10aa-8188-41f4-8c50-ee5cdf0c3727" (UID: "015a10aa-8188-41f4-8c50-ee5cdf0c3727"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 17:34:09.104577 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:09.104492 2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/015a10aa-8188-41f4-8c50-ee5cdf0c3727-ca-trust-extracted\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" May 29 17:34:09.104577 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:09.104540 2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/015a10aa-8188-41f4-8c50-ee5cdf0c3727-image-registry-private-configuration\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" May 29 17:34:09.104577 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:09.104560 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59flr\" (UniqueName: \"kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-kube-api-access-59flr\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" May 29 17:34:09.104577 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:09.104575 2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-bound-sa-token\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" May 29 17:34:09.104861 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:09.104590 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/015a10aa-8188-41f4-8c50-ee5cdf0c3727-trusted-ca\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" May 29 17:34:09.104861 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:09.104603 2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/015a10aa-8188-41f4-8c50-ee5cdf0c3727-registry-certificates\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" May 29 17:34:09.104861 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:09.104617 2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/015a10aa-8188-41f4-8c50-ee5cdf0c3727-installation-pull-secrets\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" May 29 17:34:09.902968 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:09.902934 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-745dfbbf78-w5ws8" May 29 17:34:09.936858 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:09.936826 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-745dfbbf78-w5ws8"] May 29 17:34:09.939547 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:09.939522 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-745dfbbf78-w5ws8"] May 29 17:34:10.114329 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:10.114294 2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/015a10aa-8188-41f4-8c50-ee5cdf0c3727-registry-tls\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" May 29 17:34:10.313427 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:10.313394 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="015a10aa-8188-41f4-8c50-ee5cdf0c3727" path="/var/lib/kubelet/pods/015a10aa-8188-41f4-8c50-ee5cdf0c3727/volumes" May 29 17:34:10.908140 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:10.908055 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5588932f-c41d-4b73-84a0-6a6d0d0a09ac","Type":"ContainerStarted","Data":"08e7160ed75193af051152b8e838f2f53f1ca36d4cdce400b343ab4186e81a3c"} May 29 17:34:10.908140 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:10.908090 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5588932f-c41d-4b73-84a0-6a6d0d0a09ac","Type":"ContainerStarted","Data":"6f2332b52c62791e959075082d4263fa6cdb47e6f9ea48da96341b931a062893"} May 29 17:34:12.916744 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:12.916689 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5588932f-c41d-4b73-84a0-6a6d0d0a09ac","Type":"ContainerStarted","Data":"0365a12984dae74cff55186d4e80029931ed2c77b9af4444ebb3281f0669572f"} May 29 17:34:12.916744 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:12.916743 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5588932f-c41d-4b73-84a0-6a6d0d0a09ac","Type":"ContainerStarted","Data":"d8516bfd3e003614bf5ef13fd1bdca6cd39a384da174bfeaa5c6f05f50f4f611"} May 29 17:34:12.917140 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:12.916755 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5588932f-c41d-4b73-84a0-6a6d0d0a09ac","Type":"ContainerStarted","Data":"45da8c5904e8cfc04e4e2296f736e8065299e1cabbdfe5b9097b66b879cebbd3"} May 29 17:34:12.917140 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:12.916766 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5588932f-c41d-4b73-84a0-6a6d0d0a09ac","Type":"ContainerStarted","Data":"f220261585d95b9c45e2aa68430a1eebd09aa0903283be435e3fb1500beb2484"} May 29 17:34:12.943154 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:12.943098 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.389678939 podStartE2EDuration="6.943079885s" podCreationTimestamp="2026-05-29 17:34:06 +0000 UTC" firstStartedPulling="2026-05-29 17:34:06.703269498 +0000 UTC m=+140.976496870" lastFinishedPulling="2026-05-29 17:34:12.256670447 +0000 UTC m=+146.529897816" observedRunningTime="2026-05-29 17:34:12.942184087 +0000 UTC m=+147.215411493" watchObservedRunningTime="2026-05-29 17:34:12.943079885 +0000 UTC m=+147.216307265" May 29 17:34:16.533558 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:16.533521 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 29 17:34:22.589874 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:34:22.589816 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4g6sj" podUID="200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25" May 29 17:34:22.595930 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:34:22.595898 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-2kcrl" podUID="ee552438-fa19-400b-a3f8-f2c6711e7721" May 29 17:34:22.944415 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:22.944336 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4g6sj" May 29 17:34:22.944415 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:22.944375 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2kcrl" May 29 17:34:24.687875 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:24.687827 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-54f9fd7769-wqvv2" May 29 17:34:24.687875 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:24.687882 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-54f9fd7769-wqvv2" May 29 17:34:27.561783 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:27.561646 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee552438-fa19-400b-a3f8-f2c6711e7721-cert\") pod \"ingress-canary-2kcrl\" (UID: \"ee552438-fa19-400b-a3f8-f2c6711e7721\") " pod="openshift-ingress-canary/ingress-canary-2kcrl" May 29 17:34:27.561783 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:27.561744 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25-metrics-tls\") pod \"dns-default-4g6sj\" (UID: \"200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25\") " pod="openshift-dns/dns-default-4g6sj" May 29 17:34:27.564093 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:27.564063 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee552438-fa19-400b-a3f8-f2c6711e7721-cert\") pod \"ingress-canary-2kcrl\" (UID: \"ee552438-fa19-400b-a3f8-f2c6711e7721\") " pod="openshift-ingress-canary/ingress-canary-2kcrl" May 29 17:34:27.564093 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:27.564076 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25-metrics-tls\") pod \"dns-default-4g6sj\" (UID: \"200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25\") " pod="openshift-dns/dns-default-4g6sj" May 29 17:34:27.747574 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:27.747535 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7x9xz\"" May 29 17:34:27.748326 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:27.748308 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-sf6m9\"" May 29 17:34:27.755171 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:27.755154 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2kcrl" May 29 17:34:27.755274 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:27.755242 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4g6sj" May 29 17:34:27.905125 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:27.905095 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4g6sj"] May 29 17:34:27.908667 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:34:27.908625 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod200ce3d9_d1a6_4350_88c1_5cc7cf6b7c25.slice/crio-5ecf0769ca3e25c46a1f18433bd8b761f09e10cd77b8f4ddba19748432b1f2d7 WatchSource:0}: Error finding container 5ecf0769ca3e25c46a1f18433bd8b761f09e10cd77b8f4ddba19748432b1f2d7: Status 404 returned error can't find the container with id 5ecf0769ca3e25c46a1f18433bd8b761f09e10cd77b8f4ddba19748432b1f2d7 May 29 17:34:27.929586 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:27.929560 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2kcrl"] May 29 17:34:27.932300 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:34:27.932270 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee552438_fa19_400b_a3f8_f2c6711e7721.slice/crio-1f89bed898668a678aa7e55857085bac9e0bcd7ac8f20a93bfc4183ebfce2c4d WatchSource:0}: Error finding container 1f89bed898668a678aa7e55857085bac9e0bcd7ac8f20a93bfc4183ebfce2c4d: Status 404 returned error can't find the container with id 1f89bed898668a678aa7e55857085bac9e0bcd7ac8f20a93bfc4183ebfce2c4d May 29 17:34:27.958226 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:27.958188 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2kcrl" event={"ID":"ee552438-fa19-400b-a3f8-f2c6711e7721","Type":"ContainerStarted","Data":"1f89bed898668a678aa7e55857085bac9e0bcd7ac8f20a93bfc4183ebfce2c4d"} May 29 17:34:27.959390 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:27.959352 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4g6sj" event={"ID":"200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25","Type":"ContainerStarted","Data":"5ecf0769ca3e25c46a1f18433bd8b761f09e10cd77b8f4ddba19748432b1f2d7"} May 29 17:34:29.970435 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:29.970400 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4g6sj" event={"ID":"200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25","Type":"ContainerStarted","Data":"3c03b60aac0c5fd02bc5ccde40b515f5a0d1150450f7cd8dc5ec7cf2014cf574"} May 29 17:34:29.972044 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:29.972010 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2kcrl" event={"ID":"ee552438-fa19-400b-a3f8-f2c6711e7721","Type":"ContainerStarted","Data":"4df2730e992b620bd8464f4a60b063777aa27ebe2a31ba37bc840a03252926ce"} May 29 17:34:29.991007 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:29.990939 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2kcrl" podStartSLOduration=129.069472516 podStartE2EDuration="2m10.990923817s" podCreationTimestamp="2026-05-29 17:32:19 +0000 UTC" firstStartedPulling="2026-05-29 17:34:27.934095581 +0000 UTC m=+162.207322939" lastFinishedPulling="2026-05-29 17:34:29.855546883 +0000 UTC m=+164.128774240" observedRunningTime="2026-05-29 17:34:29.988417668 +0000 UTC m=+164.261645047" watchObservedRunningTime="2026-05-29 17:34:29.990923817 +0000 UTC m=+164.264151197" May 29 17:34:30.975867 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:30.975833 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4g6sj" event={"ID":"200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25","Type":"ContainerStarted","Data":"b0862fb54c9cc8dd0febd96ef1b034f67563e8684f87a768cf12e84bdc7af0e1"} May 29 17:34:30.995822 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:30.995767 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-4g6sj" podStartSLOduration=130.054778245 podStartE2EDuration="2m11.995753434s" podCreationTimestamp="2026-05-29 17:32:19 +0000 UTC" firstStartedPulling="2026-05-29 17:34:27.911054909 +0000 UTC m=+162.184282285" lastFinishedPulling="2026-05-29 17:34:29.852030098 +0000 UTC m=+164.125257474" observedRunningTime="2026-05-29 17:34:30.995200974 +0000 UTC m=+165.268428356" watchObservedRunningTime="2026-05-29 17:34:30.995753434 +0000 UTC m=+165.268980813" May 29 17:34:31.979920 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:31.979882 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4g6sj" May 29 17:34:41.985264 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:41.985227 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4g6sj" May 29 17:34:44.692879 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:44.692849 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-54f9fd7769-wqvv2" May 29 17:34:44.696778 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:34:44.696753 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-54f9fd7769-wqvv2" May 29 17:35:06.533655 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:06.533616 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:06.549678 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:06.549640 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:07.098030 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:07.098004 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:24.556060 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:24.556018 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 17:35:24.556703 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:24.556647 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5588932f-c41d-4b73-84a0-6a6d0d0a09ac" containerName="prometheus" containerID="cri-o://6f2332b52c62791e959075082d4263fa6cdb47e6f9ea48da96341b931a062893" gracePeriod=600 May 29 17:35:24.556703 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:24.556689 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5588932f-c41d-4b73-84a0-6a6d0d0a09ac" containerName="kube-rbac-proxy-thanos" containerID="cri-o://0365a12984dae74cff55186d4e80029931ed2c77b9af4444ebb3281f0669572f" gracePeriod=600 May 29 17:35:24.556929 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:24.556843 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5588932f-c41d-4b73-84a0-6a6d0d0a09ac" containerName="thanos-sidecar" containerID="cri-o://f220261585d95b9c45e2aa68430a1eebd09aa0903283be435e3fb1500beb2484" gracePeriod=600 May 29 17:35:24.556929 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:24.556845 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5588932f-c41d-4b73-84a0-6a6d0d0a09ac" containerName="config-reloader" containerID="cri-o://08e7160ed75193af051152b8e838f2f53f1ca36d4cdce400b343ab4186e81a3c" gracePeriod=600 May 29 17:35:24.557039 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:24.556950 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5588932f-c41d-4b73-84a0-6a6d0d0a09ac" containerName="kube-rbac-proxy" containerID="cri-o://d8516bfd3e003614bf5ef13fd1bdca6cd39a384da174bfeaa5c6f05f50f4f611" gracePeriod=600 May 29 17:35:24.557039 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:24.557007 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5588932f-c41d-4b73-84a0-6a6d0d0a09ac" containerName="kube-rbac-proxy-web" containerID="cri-o://45da8c5904e8cfc04e4e2296f736e8065299e1cabbdfe5b9097b66b879cebbd3" gracePeriod=600 May 29 17:35:25.139334 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.139300 2567 generic.go:358] "Generic (PLEG): container finished" podID="5588932f-c41d-4b73-84a0-6a6d0d0a09ac" containerID="0365a12984dae74cff55186d4e80029931ed2c77b9af4444ebb3281f0669572f" exitCode=0 May 29 17:35:25.139334 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.139326 2567 generic.go:358] "Generic (PLEG): container finished" podID="5588932f-c41d-4b73-84a0-6a6d0d0a09ac" containerID="d8516bfd3e003614bf5ef13fd1bdca6cd39a384da174bfeaa5c6f05f50f4f611" exitCode=0 May 29 17:35:25.139334 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.139333 2567 generic.go:358] "Generic (PLEG): container finished" podID="5588932f-c41d-4b73-84a0-6a6d0d0a09ac" containerID="f220261585d95b9c45e2aa68430a1eebd09aa0903283be435e3fb1500beb2484" exitCode=0 May 29 17:35:25.139334 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.139339 2567 generic.go:358] "Generic (PLEG): container finished" podID="5588932f-c41d-4b73-84a0-6a6d0d0a09ac" containerID="08e7160ed75193af051152b8e838f2f53f1ca36d4cdce400b343ab4186e81a3c" exitCode=0 May 29 17:35:25.139334 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.139346 2567 generic.go:358] "Generic (PLEG): container finished" podID="5588932f-c41d-4b73-84a0-6a6d0d0a09ac" containerID="6f2332b52c62791e959075082d4263fa6cdb47e6f9ea48da96341b931a062893" exitCode=0 May 29 17:35:25.139629 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.139377 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5588932f-c41d-4b73-84a0-6a6d0d0a09ac","Type":"ContainerDied","Data":"0365a12984dae74cff55186d4e80029931ed2c77b9af4444ebb3281f0669572f"} May 29 17:35:25.139629 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.139412 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5588932f-c41d-4b73-84a0-6a6d0d0a09ac","Type":"ContainerDied","Data":"d8516bfd3e003614bf5ef13fd1bdca6cd39a384da174bfeaa5c6f05f50f4f611"} May 29 17:35:25.139629 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.139421 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5588932f-c41d-4b73-84a0-6a6d0d0a09ac","Type":"ContainerDied","Data":"f220261585d95b9c45e2aa68430a1eebd09aa0903283be435e3fb1500beb2484"} May 29 17:35:25.139629 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.139432 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5588932f-c41d-4b73-84a0-6a6d0d0a09ac","Type":"ContainerDied","Data":"08e7160ed75193af051152b8e838f2f53f1ca36d4cdce400b343ab4186e81a3c"} May 29 17:35:25.139629 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.139441 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5588932f-c41d-4b73-84a0-6a6d0d0a09ac","Type":"ContainerDied","Data":"6f2332b52c62791e959075082d4263fa6cdb47e6f9ea48da96341b931a062893"} May 29 17:35:25.796467 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.796442 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:25.874333 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.874241 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-secret-metrics-client-certs\") pod \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " May 29 17:35:25.874333 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.874295 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-thanos-prometheus-http-client-file\") pod \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " May 29 17:35:25.874548 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.874459 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-prometheus-k8s-db\") pod \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " May 29 17:35:25.874548 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.874502 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-secret-kube-rbac-proxy\") pod \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " May 29 17:35:25.874548 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.874539 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-web-config\") pod \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " May 29 17:35:25.874703 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.874560 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-config\") pod \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " May 29 17:35:25.874703 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.874583 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-prometheus-trusted-ca-bundle\") pod \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " May 29 17:35:25.874703 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.874608 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwgmd\" (UniqueName: \"kubernetes.io/projected/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-kube-api-access-pwgmd\") pod \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " May 29 17:35:25.874703 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.874633 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-configmap-kubelet-serving-ca-bundle\") pod \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " May 29 17:35:25.874703 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.874659 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-config-out\") pod \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " May 29 17:35:25.874703 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.874685 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " May 29 17:35:25.875016 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.874749 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-configmap-serving-certs-ca-bundle\") pod \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " May 29 17:35:25.875016 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.874784 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " May 29 17:35:25.875016 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.874810 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-prometheus-k8s-rulefiles-0\") pod \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " May 29 17:35:25.875016 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.874842 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-secret-grpc-tls\") pod \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " May 29 17:35:25.875016 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.874877 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-tls-assets\") pod \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " May 29 17:35:25.875016 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.874907 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-secret-prometheus-k8s-tls\") pod \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " May 29 17:35:25.875016 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.874947 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-configmap-metrics-client-ca\") pod \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\" (UID: \"5588932f-c41d-4b73-84a0-6a6d0d0a09ac\") " May 29 17:35:25.875545 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.875513 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "5588932f-c41d-4b73-84a0-6a6d0d0a09ac" (UID: "5588932f-c41d-4b73-84a0-6a6d0d0a09ac"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 17:35:25.876137 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.875850 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "5588932f-c41d-4b73-84a0-6a6d0d0a09ac" (UID: "5588932f-c41d-4b73-84a0-6a6d0d0a09ac"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 17:35:25.877290 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.876549 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "5588932f-c41d-4b73-84a0-6a6d0d0a09ac" (UID: "5588932f-c41d-4b73-84a0-6a6d0d0a09ac"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 17:35:25.877290 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.877152 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "5588932f-c41d-4b73-84a0-6a6d0d0a09ac" (UID: "5588932f-c41d-4b73-84a0-6a6d0d0a09ac"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 17:35:25.877290 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.877269 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "5588932f-c41d-4b73-84a0-6a6d0d0a09ac" (UID: "5588932f-c41d-4b73-84a0-6a6d0d0a09ac"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 17:35:25.878129 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.878105 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "5588932f-c41d-4b73-84a0-6a6d0d0a09ac" (UID: "5588932f-c41d-4b73-84a0-6a6d0d0a09ac"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 17:35:25.878626 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.878374 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "5588932f-c41d-4b73-84a0-6a6d0d0a09ac" (UID: "5588932f-c41d-4b73-84a0-6a6d0d0a09ac"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 17:35:25.878626 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.878398 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "5588932f-c41d-4b73-84a0-6a6d0d0a09ac" (UID: "5588932f-c41d-4b73-84a0-6a6d0d0a09ac"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 17:35:25.879697 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.879650 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "5588932f-c41d-4b73-84a0-6a6d0d0a09ac" (UID: "5588932f-c41d-4b73-84a0-6a6d0d0a09ac"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 17:35:25.880039 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.879981 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "5588932f-c41d-4b73-84a0-6a6d0d0a09ac" (UID: "5588932f-c41d-4b73-84a0-6a6d0d0a09ac"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 17:35:25.880131 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.880092 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-config" (OuterVolumeSpecName: "config") pod "5588932f-c41d-4b73-84a0-6a6d0d0a09ac" (UID: "5588932f-c41d-4b73-84a0-6a6d0d0a09ac"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 17:35:25.880297 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.880255 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "5588932f-c41d-4b73-84a0-6a6d0d0a09ac" (UID: "5588932f-c41d-4b73-84a0-6a6d0d0a09ac"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 17:35:25.880557 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.880531 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "5588932f-c41d-4b73-84a0-6a6d0d0a09ac" (UID: "5588932f-c41d-4b73-84a0-6a6d0d0a09ac"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 17:35:25.880814 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.880779 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5588932f-c41d-4b73-84a0-6a6d0d0a09ac" (UID: "5588932f-c41d-4b73-84a0-6a6d0d0a09ac"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 17:35:25.881045 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.881025 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "5588932f-c41d-4b73-84a0-6a6d0d0a09ac" (UID: "5588932f-c41d-4b73-84a0-6a6d0d0a09ac"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 17:35:25.881585 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.881556 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-config-out" (OuterVolumeSpecName: "config-out") pod "5588932f-c41d-4b73-84a0-6a6d0d0a09ac" (UID: "5588932f-c41d-4b73-84a0-6a6d0d0a09ac"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 17:35:25.881585 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.881566 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-kube-api-access-pwgmd" (OuterVolumeSpecName: "kube-api-access-pwgmd") pod "5588932f-c41d-4b73-84a0-6a6d0d0a09ac" (UID: "5588932f-c41d-4b73-84a0-6a6d0d0a09ac"). InnerVolumeSpecName "kube-api-access-pwgmd". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 17:35:25.889779 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.889709 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-web-config" (OuterVolumeSpecName: "web-config") pod "5588932f-c41d-4b73-84a0-6a6d0d0a09ac" (UID: "5588932f-c41d-4b73-84a0-6a6d0d0a09ac"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 17:35:25.976305 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.976265 2567 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-secret-grpc-tls\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" May 29 17:35:25.976305 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.976297 2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-tls-assets\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" May 29 17:35:25.976305 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.976307 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" May 29 17:35:25.976537 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.976318 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-configmap-metrics-client-ca\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" May 29 17:35:25.976537 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.976328 2567 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-secret-metrics-client-certs\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" May 29 17:35:25.976537 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.976340 2567 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" May 29 17:35:25.976537 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.976349 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-prometheus-k8s-db\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" May 29 17:35:25.976537 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.976357 2567 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-secret-kube-rbac-proxy\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" May 29 17:35:25.976537 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.976366 2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-web-config\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" May 29 17:35:25.976537 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.976376 2567 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-config\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" May 29 17:35:25.976537 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.976384 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" May 29 17:35:25.976537 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.976392 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwgmd\" (UniqueName: \"kubernetes.io/projected/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-kube-api-access-pwgmd\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" May 29 17:35:25.976537 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.976402 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" May 29 17:35:25.976537 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.976410 2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-config-out\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" May 29 17:35:25.976537 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.976419 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" May 29 17:35:25.976537 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.976428 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" May 29 17:35:25.976537 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.976437 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" May 29 17:35:25.976537 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:25.976446 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5588932f-c41d-4b73-84a0-6a6d0d0a09ac-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" May 29 17:35:26.144699 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.144608 2567 generic.go:358] "Generic (PLEG): container finished" podID="5588932f-c41d-4b73-84a0-6a6d0d0a09ac" containerID="45da8c5904e8cfc04e4e2296f736e8065299e1cabbdfe5b9097b66b879cebbd3" exitCode=0 May 29 17:35:26.144699 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.144687 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5588932f-c41d-4b73-84a0-6a6d0d0a09ac","Type":"ContainerDied","Data":"45da8c5904e8cfc04e4e2296f736e8065299e1cabbdfe5b9097b66b879cebbd3"} May 29 17:35:26.144915 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.144743 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5588932f-c41d-4b73-84a0-6a6d0d0a09ac","Type":"ContainerDied","Data":"53b758897419f28d3c3118813d749dfa934b497a209963b9df8ece948bca95fd"} May 29 17:35:26.144915 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.144759 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.144915 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.144765 2567 scope.go:117] "RemoveContainer" containerID="0365a12984dae74cff55186d4e80029931ed2c77b9af4444ebb3281f0669572f" May 29 17:35:26.152248 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.152232 2567 scope.go:117] "RemoveContainer" containerID="d8516bfd3e003614bf5ef13fd1bdca6cd39a384da174bfeaa5c6f05f50f4f611" May 29 17:35:26.159054 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.159033 2567 scope.go:117] "RemoveContainer" containerID="45da8c5904e8cfc04e4e2296f736e8065299e1cabbdfe5b9097b66b879cebbd3" May 29 17:35:26.165440 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.165424 2567 scope.go:117] "RemoveContainer" containerID="f220261585d95b9c45e2aa68430a1eebd09aa0903283be435e3fb1500beb2484" May 29 17:35:26.168235 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.168214 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 17:35:26.172350 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.172334 2567 scope.go:117] "RemoveContainer" containerID="08e7160ed75193af051152b8e838f2f53f1ca36d4cdce400b343ab4186e81a3c" May 29 17:35:26.177062 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.177042 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 17:35:26.179352 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.179334 2567 scope.go:117] "RemoveContainer" containerID="6f2332b52c62791e959075082d4263fa6cdb47e6f9ea48da96341b931a062893" May 29 17:35:26.186277 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.186262 2567 scope.go:117] "RemoveContainer" containerID="789020a1abb10c6a4a5a934e31924630370d81862cedb5093fe9f028c82e1a45" May 29 17:35:26.193076 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.193058 2567 scope.go:117] "RemoveContainer" containerID="0365a12984dae74cff55186d4e80029931ed2c77b9af4444ebb3281f0669572f" May 29 17:35:26.193331 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:35:26.193310 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0365a12984dae74cff55186d4e80029931ed2c77b9af4444ebb3281f0669572f\": container with ID starting with 0365a12984dae74cff55186d4e80029931ed2c77b9af4444ebb3281f0669572f not found: ID does not exist" containerID="0365a12984dae74cff55186d4e80029931ed2c77b9af4444ebb3281f0669572f" May 29 17:35:26.193382 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.193339 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0365a12984dae74cff55186d4e80029931ed2c77b9af4444ebb3281f0669572f"} err="failed to get container status \"0365a12984dae74cff55186d4e80029931ed2c77b9af4444ebb3281f0669572f\": rpc error: code = NotFound desc = could not find container \"0365a12984dae74cff55186d4e80029931ed2c77b9af4444ebb3281f0669572f\": container with ID starting with 0365a12984dae74cff55186d4e80029931ed2c77b9af4444ebb3281f0669572f not found: ID does not exist" May 29 17:35:26.193382 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.193375 2567 scope.go:117] "RemoveContainer" containerID="d8516bfd3e003614bf5ef13fd1bdca6cd39a384da174bfeaa5c6f05f50f4f611" May 29 17:35:26.193619 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:35:26.193602 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8516bfd3e003614bf5ef13fd1bdca6cd39a384da174bfeaa5c6f05f50f4f611\": container with ID starting with d8516bfd3e003614bf5ef13fd1bdca6cd39a384da174bfeaa5c6f05f50f4f611 not found: ID does not exist" containerID="d8516bfd3e003614bf5ef13fd1bdca6cd39a384da174bfeaa5c6f05f50f4f611" May 29 17:35:26.193660 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.193626 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8516bfd3e003614bf5ef13fd1bdca6cd39a384da174bfeaa5c6f05f50f4f611"} err="failed to get container status \"d8516bfd3e003614bf5ef13fd1bdca6cd39a384da174bfeaa5c6f05f50f4f611\": rpc error: code = NotFound desc = could not find container \"d8516bfd3e003614bf5ef13fd1bdca6cd39a384da174bfeaa5c6f05f50f4f611\": container with ID starting with d8516bfd3e003614bf5ef13fd1bdca6cd39a384da174bfeaa5c6f05f50f4f611 not found: ID does not exist" May 29 17:35:26.193660 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.193646 2567 scope.go:117] "RemoveContainer" containerID="45da8c5904e8cfc04e4e2296f736e8065299e1cabbdfe5b9097b66b879cebbd3" May 29 17:35:26.193890 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:35:26.193872 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45da8c5904e8cfc04e4e2296f736e8065299e1cabbdfe5b9097b66b879cebbd3\": container with ID starting with 45da8c5904e8cfc04e4e2296f736e8065299e1cabbdfe5b9097b66b879cebbd3 not found: ID does not exist" containerID="45da8c5904e8cfc04e4e2296f736e8065299e1cabbdfe5b9097b66b879cebbd3" May 29 17:35:26.193938 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.193896 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45da8c5904e8cfc04e4e2296f736e8065299e1cabbdfe5b9097b66b879cebbd3"} err="failed to get container status \"45da8c5904e8cfc04e4e2296f736e8065299e1cabbdfe5b9097b66b879cebbd3\": rpc error: code = NotFound desc = could not find container \"45da8c5904e8cfc04e4e2296f736e8065299e1cabbdfe5b9097b66b879cebbd3\": container with ID starting with 45da8c5904e8cfc04e4e2296f736e8065299e1cabbdfe5b9097b66b879cebbd3 not found: ID does not exist" May 29 17:35:26.193938 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.193911 2567 scope.go:117] "RemoveContainer" containerID="f220261585d95b9c45e2aa68430a1eebd09aa0903283be435e3fb1500beb2484" May 29 17:35:26.194117 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:35:26.194099 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f220261585d95b9c45e2aa68430a1eebd09aa0903283be435e3fb1500beb2484\": container with ID starting with f220261585d95b9c45e2aa68430a1eebd09aa0903283be435e3fb1500beb2484 not found: ID does not exist" containerID="f220261585d95b9c45e2aa68430a1eebd09aa0903283be435e3fb1500beb2484" May 29 17:35:26.194178 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.194127 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f220261585d95b9c45e2aa68430a1eebd09aa0903283be435e3fb1500beb2484"} err="failed to get container status \"f220261585d95b9c45e2aa68430a1eebd09aa0903283be435e3fb1500beb2484\": rpc error: code = NotFound desc = could not find container \"f220261585d95b9c45e2aa68430a1eebd09aa0903283be435e3fb1500beb2484\": container with ID starting with f220261585d95b9c45e2aa68430a1eebd09aa0903283be435e3fb1500beb2484 not found: ID does not exist" May 29 17:35:26.194178 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.194149 2567 scope.go:117] "RemoveContainer" containerID="08e7160ed75193af051152b8e838f2f53f1ca36d4cdce400b343ab4186e81a3c" May 29 17:35:26.194387 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:35:26.194370 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08e7160ed75193af051152b8e838f2f53f1ca36d4cdce400b343ab4186e81a3c\": container with ID starting with 08e7160ed75193af051152b8e838f2f53f1ca36d4cdce400b343ab4186e81a3c not found: ID does not exist" containerID="08e7160ed75193af051152b8e838f2f53f1ca36d4cdce400b343ab4186e81a3c" May 29 17:35:26.194431 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.194392 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08e7160ed75193af051152b8e838f2f53f1ca36d4cdce400b343ab4186e81a3c"} err="failed to get container status \"08e7160ed75193af051152b8e838f2f53f1ca36d4cdce400b343ab4186e81a3c\": rpc error: code = NotFound desc = could not find container \"08e7160ed75193af051152b8e838f2f53f1ca36d4cdce400b343ab4186e81a3c\": container with ID starting with 08e7160ed75193af051152b8e838f2f53f1ca36d4cdce400b343ab4186e81a3c not found: ID does not exist" May 29 17:35:26.194431 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.194406 2567 scope.go:117] "RemoveContainer" containerID="6f2332b52c62791e959075082d4263fa6cdb47e6f9ea48da96341b931a062893" May 29 17:35:26.194596 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:35:26.194581 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f2332b52c62791e959075082d4263fa6cdb47e6f9ea48da96341b931a062893\": container with ID starting with 6f2332b52c62791e959075082d4263fa6cdb47e6f9ea48da96341b931a062893 not found: ID does not exist" containerID="6f2332b52c62791e959075082d4263fa6cdb47e6f9ea48da96341b931a062893" May 29 17:35:26.194634 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.194599 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f2332b52c62791e959075082d4263fa6cdb47e6f9ea48da96341b931a062893"} err="failed to get container status \"6f2332b52c62791e959075082d4263fa6cdb47e6f9ea48da96341b931a062893\": rpc error: code = NotFound desc = could not find container \"6f2332b52c62791e959075082d4263fa6cdb47e6f9ea48da96341b931a062893\": container with ID starting with 6f2332b52c62791e959075082d4263fa6cdb47e6f9ea48da96341b931a062893 not found: ID does not exist" May 29 17:35:26.194634 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.194611 2567 scope.go:117] "RemoveContainer" containerID="789020a1abb10c6a4a5a934e31924630370d81862cedb5093fe9f028c82e1a45" May 29 17:35:26.194806 ip-10-0-128-221 kubenswrapper[2567]: E0529 17:35:26.194791 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"789020a1abb10c6a4a5a934e31924630370d81862cedb5093fe9f028c82e1a45\": container with ID starting with 789020a1abb10c6a4a5a934e31924630370d81862cedb5093fe9f028c82e1a45 not found: ID does not exist" containerID="789020a1abb10c6a4a5a934e31924630370d81862cedb5093fe9f028c82e1a45" May 29 17:35:26.194850 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.194809 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"789020a1abb10c6a4a5a934e31924630370d81862cedb5093fe9f028c82e1a45"} err="failed to get container status \"789020a1abb10c6a4a5a934e31924630370d81862cedb5093fe9f028c82e1a45\": rpc error: code = NotFound desc = could not find container \"789020a1abb10c6a4a5a934e31924630370d81862cedb5093fe9f028c82e1a45\": container with ID starting with 789020a1abb10c6a4a5a934e31924630370d81862cedb5093fe9f028c82e1a45 not found: ID does not exist" May 29 17:35:26.202403 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.202376 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 17:35:26.202688 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.202675 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5588932f-c41d-4b73-84a0-6a6d0d0a09ac" containerName="kube-rbac-proxy-thanos" May 29 17:35:26.202756 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.202690 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5588932f-c41d-4b73-84a0-6a6d0d0a09ac" containerName="kube-rbac-proxy-thanos" May 29 17:35:26.202756 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.202700 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5588932f-c41d-4b73-84a0-6a6d0d0a09ac" containerName="config-reloader" May 29 17:35:26.202756 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.202706 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5588932f-c41d-4b73-84a0-6a6d0d0a09ac" containerName="config-reloader" May 29 17:35:26.202756 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.202716 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5588932f-c41d-4b73-84a0-6a6d0d0a09ac" containerName="kube-rbac-proxy" May 29 17:35:26.202756 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.202736 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5588932f-c41d-4b73-84a0-6a6d0d0a09ac" containerName="kube-rbac-proxy" May 29 17:35:26.202756 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.202752 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5588932f-c41d-4b73-84a0-6a6d0d0a09ac" containerName="init-config-reloader" May 29 17:35:26.202930 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.202760 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5588932f-c41d-4b73-84a0-6a6d0d0a09ac" containerName="init-config-reloader" May 29 17:35:26.202930 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.202768 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5588932f-c41d-4b73-84a0-6a6d0d0a09ac" containerName="prometheus" May 29 17:35:26.202930 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.202773 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5588932f-c41d-4b73-84a0-6a6d0d0a09ac" containerName="prometheus" May 29 17:35:26.202930 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.202781 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5588932f-c41d-4b73-84a0-6a6d0d0a09ac" containerName="thanos-sidecar" May 29 17:35:26.202930 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.202786 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5588932f-c41d-4b73-84a0-6a6d0d0a09ac" containerName="thanos-sidecar" May 29 17:35:26.202930 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.202792 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5588932f-c41d-4b73-84a0-6a6d0d0a09ac" containerName="kube-rbac-proxy-web" May 29 17:35:26.202930 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.202797 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5588932f-c41d-4b73-84a0-6a6d0d0a09ac" containerName="kube-rbac-proxy-web" May 29 17:35:26.202930 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.202838 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="5588932f-c41d-4b73-84a0-6a6d0d0a09ac" containerName="prometheus" May 29 17:35:26.202930 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.202845 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="5588932f-c41d-4b73-84a0-6a6d0d0a09ac" containerName="kube-rbac-proxy-web" May 29 17:35:26.202930 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.202851 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="5588932f-c41d-4b73-84a0-6a6d0d0a09ac" containerName="thanos-sidecar" May 29 17:35:26.202930 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.202857 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="5588932f-c41d-4b73-84a0-6a6d0d0a09ac" containerName="kube-rbac-proxy-thanos" May 29 17:35:26.202930 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.202863 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="5588932f-c41d-4b73-84a0-6a6d0d0a09ac" containerName="kube-rbac-proxy" May 29 17:35:26.202930 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.202869 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="5588932f-c41d-4b73-84a0-6a6d0d0a09ac" containerName="config-reloader" May 29 17:35:26.208271 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.208256 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.210948 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.210926 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 29 17:35:26.211045 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.211007 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 29 17:35:26.211045 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.211013 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 29 17:35:26.211151 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.211058 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-v6ksr\"" May 29 17:35:26.211151 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.211058 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 29 17:35:26.211151 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.211119 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 29 17:35:26.211151 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.211147 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 29 17:35:26.211387 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.211245 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 29 17:35:26.211469 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.211452 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 29 17:35:26.211665 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.211651 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-erkjehf8frhoc\"" May 29 17:35:26.211911 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.211896 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 29 17:35:26.211991 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.211938 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 29 17:35:26.213911 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.213892 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 29 17:35:26.217190 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.217170 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 29 17:35:26.219244 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.219225 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 17:35:26.280107 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.280071 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b4e98d1c-c206-4972-ba73-83f95af4c30c-web-config\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.280107 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.280111 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b4e98d1c-c206-4972-ba73-83f95af4c30c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.280373 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.280141 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b4e98d1c-c206-4972-ba73-83f95af4c30c-config-out\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.280373 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.280198 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4e98d1c-c206-4972-ba73-83f95af4c30c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.280373 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.280236 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jzzm\" (UniqueName: \"kubernetes.io/projected/b4e98d1c-c206-4972-ba73-83f95af4c30c-kube-api-access-5jzzm\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.280373 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.280273 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b4e98d1c-c206-4972-ba73-83f95af4c30c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.280373 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.280302 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b4e98d1c-c206-4972-ba73-83f95af4c30c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.280373 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.280345 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b4e98d1c-c206-4972-ba73-83f95af4c30c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.280373 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.280373 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b4e98d1c-c206-4972-ba73-83f95af4c30c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.280707 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.280399 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b4e98d1c-c206-4972-ba73-83f95af4c30c-config\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.280707 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.280445 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4e98d1c-c206-4972-ba73-83f95af4c30c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.280707 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.280469 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b4e98d1c-c206-4972-ba73-83f95af4c30c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.280707 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.280499 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4e98d1c-c206-4972-ba73-83f95af4c30c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.280707 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.280545 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b4e98d1c-c206-4972-ba73-83f95af4c30c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.280707 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.280576 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b4e98d1c-c206-4972-ba73-83f95af4c30c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.280707 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.280613 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b4e98d1c-c206-4972-ba73-83f95af4c30c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.280707 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.280659 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b4e98d1c-c206-4972-ba73-83f95af4c30c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.280707 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.280688 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4e98d1c-c206-4972-ba73-83f95af4c30c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.313526 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.313492 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5588932f-c41d-4b73-84a0-6a6d0d0a09ac" path="/var/lib/kubelet/pods/5588932f-c41d-4b73-84a0-6a6d0d0a09ac/volumes" May 29 17:35:26.381610 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.381567 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4e98d1c-c206-4972-ba73-83f95af4c30c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.381610 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.381609 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b4e98d1c-c206-4972-ba73-83f95af4c30c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.381860 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.381630 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4e98d1c-c206-4972-ba73-83f95af4c30c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.381860 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.381755 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b4e98d1c-c206-4972-ba73-83f95af4c30c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.381860 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.381788 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b4e98d1c-c206-4972-ba73-83f95af4c30c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.381860 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.381819 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b4e98d1c-c206-4972-ba73-83f95af4c30c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.381860 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.381861 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b4e98d1c-c206-4972-ba73-83f95af4c30c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.382102 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.381887 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4e98d1c-c206-4972-ba73-83f95af4c30c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.382102 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.381915 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b4e98d1c-c206-4972-ba73-83f95af4c30c-web-config\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.382102 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.381956 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b4e98d1c-c206-4972-ba73-83f95af4c30c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.382102 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.381983 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b4e98d1c-c206-4972-ba73-83f95af4c30c-config-out\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.382102 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.382010 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4e98d1c-c206-4972-ba73-83f95af4c30c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.382102 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.382037 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5jzzm\" (UniqueName: \"kubernetes.io/projected/b4e98d1c-c206-4972-ba73-83f95af4c30c-kube-api-access-5jzzm\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.382102 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.382068 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b4e98d1c-c206-4972-ba73-83f95af4c30c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.382102 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.382102 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b4e98d1c-c206-4972-ba73-83f95af4c30c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.382462 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.382151 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b4e98d1c-c206-4972-ba73-83f95af4c30c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.382462 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.382183 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b4e98d1c-c206-4972-ba73-83f95af4c30c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.382462 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.382212 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b4e98d1c-c206-4972-ba73-83f95af4c30c-config\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.382607 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.382530 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4e98d1c-c206-4972-ba73-83f95af4c30c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.382881 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.382858 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b4e98d1c-c206-4972-ba73-83f95af4c30c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.383056 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.383033 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4e98d1c-c206-4972-ba73-83f95af4c30c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.384747 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.383576 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4e98d1c-c206-4972-ba73-83f95af4c30c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.384747 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.384672 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4e98d1c-c206-4972-ba73-83f95af4c30c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.385066 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.385020 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b4e98d1c-c206-4972-ba73-83f95af4c30c-config\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.385202 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.385178 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b4e98d1c-c206-4972-ba73-83f95af4c30c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.386060 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.385883 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b4e98d1c-c206-4972-ba73-83f95af4c30c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.386060 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.386003 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b4e98d1c-c206-4972-ba73-83f95af4c30c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.386220 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.386063 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b4e98d1c-c206-4972-ba73-83f95af4c30c-config-out\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.386220 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.386152 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b4e98d1c-c206-4972-ba73-83f95af4c30c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.386328 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.386273 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b4e98d1c-c206-4972-ba73-83f95af4c30c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.387032 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.387012 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b4e98d1c-c206-4972-ba73-83f95af4c30c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.387125 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.387050 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b4e98d1c-c206-4972-ba73-83f95af4c30c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.387125 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.387075 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b4e98d1c-c206-4972-ba73-83f95af4c30c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.387659 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.387644 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b4e98d1c-c206-4972-ba73-83f95af4c30c-web-config\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.387834 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.387816 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b4e98d1c-c206-4972-ba73-83f95af4c30c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.391380 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.391364 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jzzm\" (UniqueName: \"kubernetes.io/projected/b4e98d1c-c206-4972-ba73-83f95af4c30c-kube-api-access-5jzzm\") pod \"prometheus-k8s-0\" (UID: \"b4e98d1c-c206-4972-ba73-83f95af4c30c\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.519692 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.519595 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 29 17:35:26.654304 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:26.654274 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 17:35:26.658632 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:35:26.658604 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4e98d1c_c206_4972_ba73_83f95af4c30c.slice/crio-f84fa8eca0f38a528425a1af9fe886865ee0c3e0e978c414d3585e39b4a6bf17 WatchSource:0}: Error finding container f84fa8eca0f38a528425a1af9fe886865ee0c3e0e978c414d3585e39b4a6bf17: Status 404 returned error can't find the container with id f84fa8eca0f38a528425a1af9fe886865ee0c3e0e978c414d3585e39b4a6bf17 May 29 17:35:27.149090 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:27.149053 2567 generic.go:358] "Generic (PLEG): container finished" podID="b4e98d1c-c206-4972-ba73-83f95af4c30c" containerID="513d21dbc290733a7be9489fe0e5b048d31fcc1bcb1ab306f8cb0db0faad1214" exitCode=0 May 29 17:35:27.149546 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:27.149144 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b4e98d1c-c206-4972-ba73-83f95af4c30c","Type":"ContainerDied","Data":"513d21dbc290733a7be9489fe0e5b048d31fcc1bcb1ab306f8cb0db0faad1214"} May 29 17:35:27.149546 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:27.149190 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b4e98d1c-c206-4972-ba73-83f95af4c30c","Type":"ContainerStarted","Data":"f84fa8eca0f38a528425a1af9fe886865ee0c3e0e978c414d3585e39b4a6bf17"} May 29 17:35:28.155949 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:28.155914 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b4e98d1c-c206-4972-ba73-83f95af4c30c","Type":"ContainerStarted","Data":"5b0863b2d12dddaff1897b48866135528c14b289a8ba7a050159a05fd009b082"} May 29 17:35:28.155949 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:28.155951 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b4e98d1c-c206-4972-ba73-83f95af4c30c","Type":"ContainerStarted","Data":"9a3b6f8dcf943d296d291a95acf48f5a1a9a2009ed83e5dd533df556f78d8824"} May 29 17:35:28.156348 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:28.155959 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b4e98d1c-c206-4972-ba73-83f95af4c30c","Type":"ContainerStarted","Data":"25497f4a5ab1d05851bec0b12f4d9dcb93871571c9aacfd621cfed1ebf5061fe"} May 29 17:35:28.156348 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:28.155968 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b4e98d1c-c206-4972-ba73-83f95af4c30c","Type":"ContainerStarted","Data":"0456317b76f635a70503840b5bf7247293f5ba77d4fdb82d7720fca86e4f3bf4"} May 29 17:35:28.156348 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:28.155977 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b4e98d1c-c206-4972-ba73-83f95af4c30c","Type":"ContainerStarted","Data":"0ce72e9943c95bc387d703b7778eab7ab8884de10ccd6f4da468f30b5bc91e11"} May 29 17:35:28.156348 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:28.155985 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b4e98d1c-c206-4972-ba73-83f95af4c30c","Type":"ContainerStarted","Data":"56cd00462d1bff60d5423920bfc84f0341df84320affb6bede45a700b7efc589"} May 29 17:35:28.184306 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:28.184258 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.184243418 podStartE2EDuration="2.184243418s" podCreationTimestamp="2026-05-29 17:35:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:35:28.181609653 +0000 UTC m=+222.454837032" watchObservedRunningTime="2026-05-29 17:35:28.184243418 +0000 UTC m=+222.457470796" May 29 17:35:31.520068 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:35:31.520025 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 29 17:36:26.520688 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:36:26.520634 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 29 17:36:26.536032 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:36:26.535999 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 29 17:36:27.338152 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:36:27.338126 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 29 17:36:46.253591 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:36:46.253557 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-xlb82_03e5309b-1968-4102-9d24-9f7bc8ce3c27/console-operator/1.log" May 29 17:36:46.254650 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:36:46.254624 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-xlb82_03e5309b-1968-4102-9d24-9f7bc8ce3c27/console-operator/1.log" May 29 17:36:46.256633 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:36:46.256611 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w49xp_b127b743-ab2d-443c-beda-d0e62ec97544/ovn-acl-logging/0.log" May 29 17:36:46.257872 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:36:46.257847 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w49xp_b127b743-ab2d-443c-beda-d0e62ec97544/ovn-acl-logging/0.log" May 29 17:36:46.263801 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:36:46.263780 2567 kubelet.go:1628] "Image garbage collection succeeded" May 29 17:41:46.275274 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:41:46.275241 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-xlb82_03e5309b-1968-4102-9d24-9f7bc8ce3c27/console-operator/1.log" May 29 17:41:46.275767 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:41:46.275291 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-xlb82_03e5309b-1968-4102-9d24-9f7bc8ce3c27/console-operator/1.log" May 29 17:41:46.277841 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:41:46.277815 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w49xp_b127b743-ab2d-443c-beda-d0e62ec97544/ovn-acl-logging/0.log" May 29 17:41:46.277973 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:41:46.277948 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w49xp_b127b743-ab2d-443c-beda-d0e62ec97544/ovn-acl-logging/0.log" May 29 17:45:37.890903 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:45:37.890862 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-test-apply-zc4wd"] May 29 17:45:37.894445 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:45:37.894421 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-zc4wd" May 29 17:45:37.896920 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:45:37.896897 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" May 29 17:45:37.897014 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:45:37.896940 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" May 29 17:45:37.897661 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:45:37.897644 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-xb84v\"" May 29 17:45:37.897759 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:45:37.897644 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" May 29 17:45:37.902183 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:45:37.902161 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-zc4wd"] May 29 17:45:37.936001 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:45:37.935969 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw898\" (UniqueName: \"kubernetes.io/projected/41fd39b9-2b69-45e7-99f5-0f9b525639a4-kube-api-access-pw898\") pod \"feast-test-apply-zc4wd\" (UID: \"41fd39b9-2b69-45e7-99f5-0f9b525639a4\") " pod="test-ns-feast/feast-test-apply-zc4wd" May 29 17:45:38.036513 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:45:38.036472 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pw898\" (UniqueName: \"kubernetes.io/projected/41fd39b9-2b69-45e7-99f5-0f9b525639a4-kube-api-access-pw898\") pod \"feast-test-apply-zc4wd\" (UID: \"41fd39b9-2b69-45e7-99f5-0f9b525639a4\") " pod="test-ns-feast/feast-test-apply-zc4wd" May 29 17:45:38.044751 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:45:38.044698 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw898\" (UniqueName: \"kubernetes.io/projected/41fd39b9-2b69-45e7-99f5-0f9b525639a4-kube-api-access-pw898\") pod \"feast-test-apply-zc4wd\" (UID: \"41fd39b9-2b69-45e7-99f5-0f9b525639a4\") " pod="test-ns-feast/feast-test-apply-zc4wd" May 29 17:45:38.212981 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:45:38.212901 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-zc4wd" May 29 17:45:38.337100 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:45:38.337073 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-zc4wd"] May 29 17:45:38.339176 ip-10-0-128-221 kubenswrapper[2567]: W0529 17:45:38.339146 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod41fd39b9_2b69_45e7_99f5_0f9b525639a4.slice/crio-b8ff9d4c447ccc7c3b3ac0dde4fb27a942666527ea46d8f1fc37ac5506540a0f WatchSource:0}: Error finding container b8ff9d4c447ccc7c3b3ac0dde4fb27a942666527ea46d8f1fc37ac5506540a0f: Status 404 returned error can't find the container with id b8ff9d4c447ccc7c3b3ac0dde4fb27a942666527ea46d8f1fc37ac5506540a0f May 29 17:45:38.340894 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:45:38.340876 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 17:45:38.833639 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:45:38.833608 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-zc4wd" event={"ID":"41fd39b9-2b69-45e7-99f5-0f9b525639a4","Type":"ContainerStarted","Data":"b8ff9d4c447ccc7c3b3ac0dde4fb27a942666527ea46d8f1fc37ac5506540a0f"} May 29 17:45:44.855747 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:45:44.855697 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-zc4wd" event={"ID":"41fd39b9-2b69-45e7-99f5-0f9b525639a4","Type":"ContainerStarted","Data":"cd7734341c672b2d969c02a6deef4fca336c3fbd768d6a6cda507b8ed382b3e9"} May 29 17:45:50.873479 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:45:50.873443 2567 generic.go:358] "Generic (PLEG): container finished" podID="41fd39b9-2b69-45e7-99f5-0f9b525639a4" containerID="cd7734341c672b2d969c02a6deef4fca336c3fbd768d6a6cda507b8ed382b3e9" exitCode=0 May 29 17:45:50.873848 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:45:50.873479 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-zc4wd" event={"ID":"41fd39b9-2b69-45e7-99f5-0f9b525639a4","Type":"ContainerDied","Data":"cd7734341c672b2d969c02a6deef4fca336c3fbd768d6a6cda507b8ed382b3e9"} May 29 17:45:51.878310 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:45:51.878270 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-zc4wd" event={"ID":"41fd39b9-2b69-45e7-99f5-0f9b525639a4","Type":"ContainerStarted","Data":"6a24f6a4648f53612e62e924d6fd1c7575211764e42199275751593df35b9c69"} May 29 17:45:51.896769 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:45:51.896704 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-test-apply-zc4wd" podStartSLOduration=8.764332261 podStartE2EDuration="14.896689267s" podCreationTimestamp="2026-05-29 17:45:37 +0000 UTC" firstStartedPulling="2026-05-29 17:45:38.341010429 +0000 UTC m=+832.614237786" lastFinishedPulling="2026-05-29 17:45:44.473367421 +0000 UTC m=+838.746594792" observedRunningTime="2026-05-29 17:45:51.895164749 +0000 UTC m=+846.168392128" watchObservedRunningTime="2026-05-29 17:45:51.896689267 +0000 UTC m=+846.169916643" May 29 17:46:00.903864 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:46:00.903828 2567 generic.go:358] "Generic (PLEG): container finished" podID="41fd39b9-2b69-45e7-99f5-0f9b525639a4" containerID="6a24f6a4648f53612e62e924d6fd1c7575211764e42199275751593df35b9c69" exitCode=0 May 29 17:46:00.904327 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:46:00.903904 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-zc4wd" event={"ID":"41fd39b9-2b69-45e7-99f5-0f9b525639a4","Type":"ContainerDied","Data":"6a24f6a4648f53612e62e924d6fd1c7575211764e42199275751593df35b9c69"} May 29 17:46:02.028721 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:46:02.028694 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-zc4wd" May 29 17:46:02.152474 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:46:02.152437 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pw898\" (UniqueName: \"kubernetes.io/projected/41fd39b9-2b69-45e7-99f5-0f9b525639a4-kube-api-access-pw898\") pod \"41fd39b9-2b69-45e7-99f5-0f9b525639a4\" (UID: \"41fd39b9-2b69-45e7-99f5-0f9b525639a4\") " May 29 17:46:02.155065 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:46:02.155032 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41fd39b9-2b69-45e7-99f5-0f9b525639a4-kube-api-access-pw898" (OuterVolumeSpecName: "kube-api-access-pw898") pod "41fd39b9-2b69-45e7-99f5-0f9b525639a4" (UID: "41fd39b9-2b69-45e7-99f5-0f9b525639a4"). InnerVolumeSpecName "kube-api-access-pw898". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 17:46:02.253482 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:46:02.253445 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pw898\" (UniqueName: \"kubernetes.io/projected/41fd39b9-2b69-45e7-99f5-0f9b525639a4-kube-api-access-pw898\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" May 29 17:46:02.910078 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:46:02.910047 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-zc4wd" May 29 17:46:02.910267 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:46:02.910052 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-zc4wd" event={"ID":"41fd39b9-2b69-45e7-99f5-0f9b525639a4","Type":"ContainerDied","Data":"b8ff9d4c447ccc7c3b3ac0dde4fb27a942666527ea46d8f1fc37ac5506540a0f"} May 29 17:46:02.910267 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:46:02.910156 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b8ff9d4c447ccc7c3b3ac0dde4fb27a942666527ea46d8f1fc37ac5506540a0f" May 29 17:46:03.090768 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:46:03.090718 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-zc4wd_41fd39b9-2b69-45e7-99f5-0f9b525639a4/feast-0/0.log" May 29 17:46:03.097565 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:46:03.097531 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-zc4wd_41fd39b9-2b69-45e7-99f5-0f9b525639a4/feast-1/0.log" May 29 17:46:39.847089 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:46:39.847050 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-test-apply-zc4wd"] May 29 17:46:39.855822 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:46:39.855779 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-test-apply-zc4wd"] May 29 17:46:40.312391 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:46:40.312353 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41fd39b9-2b69-45e7-99f5-0f9b525639a4" path="/var/lib/kubelet/pods/41fd39b9-2b69-45e7-99f5-0f9b525639a4/volumes" May 29 17:46:46.296860 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:46:46.296829 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-xlb82_03e5309b-1968-4102-9d24-9f7bc8ce3c27/console-operator/1.log" May 29 17:46:46.297423 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:46:46.297405 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-xlb82_03e5309b-1968-4102-9d24-9f7bc8ce3c27/console-operator/1.log" May 29 17:46:46.299648 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:46:46.299627 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w49xp_b127b743-ab2d-443c-beda-d0e62ec97544/ovn-acl-logging/0.log" May 29 17:46:46.300066 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:46:46.300048 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w49xp_b127b743-ab2d-443c-beda-d0e62ec97544/ovn-acl-logging/0.log" May 29 17:51:46.321581 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:51:46.321555 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-xlb82_03e5309b-1968-4102-9d24-9f7bc8ce3c27/console-operator/1.log" May 29 17:51:46.323132 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:51:46.323109 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-xlb82_03e5309b-1968-4102-9d24-9f7bc8ce3c27/console-operator/1.log" May 29 17:51:46.323248 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:51:46.323233 2567 scope.go:117] "RemoveContainer" containerID="cd7734341c672b2d969c02a6deef4fca336c3fbd768d6a6cda507b8ed382b3e9" May 29 17:51:46.324698 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:51:46.324676 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w49xp_b127b743-ab2d-443c-beda-d0e62ec97544/ovn-acl-logging/0.log" May 29 17:51:46.325922 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:51:46.325901 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w49xp_b127b743-ab2d-443c-beda-d0e62ec97544/ovn-acl-logging/0.log" May 29 17:52:46.336404 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:52:46.336370 2567 scope.go:117] "RemoveContainer" containerID="6a24f6a4648f53612e62e924d6fd1c7575211764e42199275751593df35b9c69" May 29 17:56:46.340539 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:56:46.340506 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-xlb82_03e5309b-1968-4102-9d24-9f7bc8ce3c27/console-operator/1.log" May 29 17:56:46.344534 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:56:46.344510 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-xlb82_03e5309b-1968-4102-9d24-9f7bc8ce3c27/console-operator/1.log" May 29 17:56:46.344849 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:56:46.344826 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w49xp_b127b743-ab2d-443c-beda-d0e62ec97544/ovn-acl-logging/0.log" May 29 17:56:46.347102 ip-10-0-128-221 kubenswrapper[2567]: I0529 17:56:46.347083 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w49xp_b127b743-ab2d-443c-beda-d0e62ec97544/ovn-acl-logging/0.log" May 29 18:01:46.361776 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:01:46.361744 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-xlb82_03e5309b-1968-4102-9d24-9f7bc8ce3c27/console-operator/1.log" May 29 18:01:46.365243 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:01:46.365213 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-xlb82_03e5309b-1968-4102-9d24-9f7bc8ce3c27/console-operator/1.log" May 29 18:01:46.365488 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:01:46.365464 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w49xp_b127b743-ab2d-443c-beda-d0e62ec97544/ovn-acl-logging/0.log" May 29 18:01:46.369115 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:01:46.369094 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w49xp_b127b743-ab2d-443c-beda-d0e62ec97544/ovn-acl-logging/0.log" May 29 18:02:19.672037 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:19.672001 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-r8mnd_7ee27fe1-5b5c-469c-b841-914fb8f1eb48/global-pull-secret-syncer/0.log" May 29 18:02:19.884424 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:19.884393 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ttrl9_e75f1628-0b78-4da8-8842-714be82d7308/konnectivity-agent/0.log" May 29 18:02:19.904023 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:19.903988 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-221.ec2.internal_4855e81ed8bee2be722afee434bf936b/haproxy/0.log" May 29 18:02:23.699530 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:23.699501 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-b76x9_a8b8947d-14c0-40bd-a664-1c9002bc29af/kube-state-metrics/0.log" May 29 18:02:23.718378 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:23.718347 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-b76x9_a8b8947d-14c0-40bd-a664-1c9002bc29af/kube-rbac-proxy-main/0.log" May 29 18:02:23.741257 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:23.741226 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-b76x9_a8b8947d-14c0-40bd-a664-1c9002bc29af/kube-rbac-proxy-self/0.log" May 29 18:02:23.768451 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:23.768425 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-54f9fd7769-wqvv2_1cf3f7fc-a23a-417a-b611-331eba92e9bb/metrics-server/0.log" May 29 18:02:24.023400 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:24.023371 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x8c2q_f684ebf3-917e-4699-b6a7-acad9b6a60fa/node-exporter/0.log" May 29 18:02:24.044472 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:24.044441 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x8c2q_f684ebf3-917e-4699-b6a7-acad9b6a60fa/kube-rbac-proxy/0.log" May 29 18:02:24.065511 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:24.065482 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x8c2q_f684ebf3-917e-4699-b6a7-acad9b6a60fa/init-textfile/0.log" May 29 18:02:24.092739 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:24.092696 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-dbf6h_e7bcbde0-7343-4891-9f11-6fc7e61b929e/kube-rbac-proxy-main/0.log" May 29 18:02:24.112564 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:24.112538 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-dbf6h_e7bcbde0-7343-4891-9f11-6fc7e61b929e/kube-rbac-proxy-self/0.log" May 29 18:02:24.131957 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:24.131931 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-dbf6h_e7bcbde0-7343-4891-9f11-6fc7e61b929e/openshift-state-metrics/0.log" May 29 18:02:24.167305 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:24.167278 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b4e98d1c-c206-4972-ba73-83f95af4c30c/prometheus/0.log" May 29 18:02:24.189744 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:24.189699 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b4e98d1c-c206-4972-ba73-83f95af4c30c/config-reloader/0.log" May 29 18:02:24.210830 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:24.210807 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b4e98d1c-c206-4972-ba73-83f95af4c30c/thanos-sidecar/0.log" May 29 18:02:24.230994 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:24.230915 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b4e98d1c-c206-4972-ba73-83f95af4c30c/kube-rbac-proxy-web/0.log" May 29 18:02:24.251141 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:24.251109 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b4e98d1c-c206-4972-ba73-83f95af4c30c/kube-rbac-proxy/0.log" May 29 18:02:24.272028 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:24.271995 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b4e98d1c-c206-4972-ba73-83f95af4c30c/kube-rbac-proxy-thanos/0.log" May 29 18:02:24.296125 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:24.296102 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b4e98d1c-c206-4972-ba73-83f95af4c30c/init-config-reloader/0.log" May 29 18:02:24.326209 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:24.326176 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-qc4lb_122d1e62-67fc-4c6f-99ed-d6fc8782f0c9/prometheus-operator/0.log" May 29 18:02:24.348188 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:24.348145 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-qc4lb_122d1e62-67fc-4c6f-99ed-d6fc8782f0c9/kube-rbac-proxy/0.log" May 29 18:02:26.029504 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:26.029474 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-xlb82_03e5309b-1968-4102-9d24-9f7bc8ce3c27/console-operator/1.log" May 29 18:02:26.033781 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:26.033759 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-xlb82_03e5309b-1968-4102-9d24-9f7bc8ce3c27/console-operator/2.log" May 29 18:02:26.678480 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:26.678448 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-h2jk7/perf-node-gather-daemonset-lflr6"] May 29 18:02:26.678768 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:26.678755 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41fd39b9-2b69-45e7-99f5-0f9b525639a4" containerName="feast-1" May 29 18:02:26.678814 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:26.678770 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="41fd39b9-2b69-45e7-99f5-0f9b525639a4" containerName="feast-1" May 29 18:02:26.678814 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:26.678790 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41fd39b9-2b69-45e7-99f5-0f9b525639a4" containerName="feast-0" May 29 18:02:26.678814 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:26.678796 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="41fd39b9-2b69-45e7-99f5-0f9b525639a4" containerName="feast-0" May 29 18:02:26.678911 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:26.678842 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="41fd39b9-2b69-45e7-99f5-0f9b525639a4" containerName="feast-1" May 29 18:02:26.681686 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:26.681665 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-lflr6" May 29 18:02:26.684123 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:26.684103 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h2jk7\"/\"openshift-service-ca.crt\"" May 29 18:02:26.684988 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:26.684968 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-h2jk7\"/\"default-dockercfg-8mglv\"" May 29 18:02:26.685058 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:26.685017 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h2jk7\"/\"kube-root-ca.crt\"" May 29 18:02:26.689194 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:26.689175 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h2jk7/perf-node-gather-daemonset-lflr6"] May 29 18:02:26.831911 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:26.831866 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38beb783-8328-4047-b0ab-a92088e74826-sys\") pod \"perf-node-gather-daemonset-lflr6\" (UID: \"38beb783-8328-4047-b0ab-a92088e74826\") " pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-lflr6" May 29 18:02:26.831911 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:26.831911 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38beb783-8328-4047-b0ab-a92088e74826-lib-modules\") pod \"perf-node-gather-daemonset-lflr6\" (UID: \"38beb783-8328-4047-b0ab-a92088e74826\") " pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-lflr6" May 29 18:02:26.832117 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:26.831931 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/38beb783-8328-4047-b0ab-a92088e74826-proc\") pod \"perf-node-gather-daemonset-lflr6\" (UID: \"38beb783-8328-4047-b0ab-a92088e74826\") " pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-lflr6" May 29 18:02:26.832117 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:26.831972 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xcfg\" (UniqueName: \"kubernetes.io/projected/38beb783-8328-4047-b0ab-a92088e74826-kube-api-access-7xcfg\") pod \"perf-node-gather-daemonset-lflr6\" (UID: \"38beb783-8328-4047-b0ab-a92088e74826\") " pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-lflr6" May 29 18:02:26.832117 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:26.832044 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/38beb783-8328-4047-b0ab-a92088e74826-podres\") pod \"perf-node-gather-daemonset-lflr6\" (UID: \"38beb783-8328-4047-b0ab-a92088e74826\") " pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-lflr6" May 29 18:02:26.933267 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:26.933179 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38beb783-8328-4047-b0ab-a92088e74826-sys\") pod \"perf-node-gather-daemonset-lflr6\" (UID: \"38beb783-8328-4047-b0ab-a92088e74826\") " pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-lflr6" May 29 18:02:26.933267 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:26.933219 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38beb783-8328-4047-b0ab-a92088e74826-lib-modules\") pod \"perf-node-gather-daemonset-lflr6\" (UID: \"38beb783-8328-4047-b0ab-a92088e74826\") " pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-lflr6" May 29 18:02:26.933267 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:26.933247 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/38beb783-8328-4047-b0ab-a92088e74826-proc\") pod \"perf-node-gather-daemonset-lflr6\" (UID: \"38beb783-8328-4047-b0ab-a92088e74826\") " pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-lflr6" May 29 18:02:26.933510 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:26.933309 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/38beb783-8328-4047-b0ab-a92088e74826-proc\") pod \"perf-node-gather-daemonset-lflr6\" (UID: \"38beb783-8328-4047-b0ab-a92088e74826\") " pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-lflr6" May 29 18:02:26.933510 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:26.933313 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38beb783-8328-4047-b0ab-a92088e74826-sys\") pod \"perf-node-gather-daemonset-lflr6\" (UID: \"38beb783-8328-4047-b0ab-a92088e74826\") " pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-lflr6" May 29 18:02:26.933510 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:26.933341 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7xcfg\" (UniqueName: \"kubernetes.io/projected/38beb783-8328-4047-b0ab-a92088e74826-kube-api-access-7xcfg\") pod \"perf-node-gather-daemonset-lflr6\" (UID: \"38beb783-8328-4047-b0ab-a92088e74826\") " pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-lflr6" May 29 18:02:26.933510 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:26.933374 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38beb783-8328-4047-b0ab-a92088e74826-lib-modules\") pod \"perf-node-gather-daemonset-lflr6\" (UID: \"38beb783-8328-4047-b0ab-a92088e74826\") " pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-lflr6" May 29 18:02:26.933510 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:26.933389 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/38beb783-8328-4047-b0ab-a92088e74826-podres\") pod \"perf-node-gather-daemonset-lflr6\" (UID: \"38beb783-8328-4047-b0ab-a92088e74826\") " pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-lflr6" May 29 18:02:26.933510 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:26.933471 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/38beb783-8328-4047-b0ab-a92088e74826-podres\") pod \"perf-node-gather-daemonset-lflr6\" (UID: \"38beb783-8328-4047-b0ab-a92088e74826\") " pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-lflr6" May 29 18:02:26.941572 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:26.941542 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xcfg\" (UniqueName: \"kubernetes.io/projected/38beb783-8328-4047-b0ab-a92088e74826-kube-api-access-7xcfg\") pod \"perf-node-gather-daemonset-lflr6\" (UID: \"38beb783-8328-4047-b0ab-a92088e74826\") " pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-lflr6" May 29 18:02:26.992166 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:26.992133 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-lflr6" May 29 18:02:27.117081 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:27.117052 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h2jk7/perf-node-gather-daemonset-lflr6"] May 29 18:02:27.121420 ip-10-0-128-221 kubenswrapper[2567]: W0529 18:02:27.121396 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod38beb783_8328_4047_b0ab_a92088e74826.slice/crio-9f12f0c0feb5bd16feb7911f4cc019f11e137f5bb96b1913ee7c83a3eb8068c8 WatchSource:0}: Error finding container 9f12f0c0feb5bd16feb7911f4cc019f11e137f5bb96b1913ee7c83a3eb8068c8: Status 404 returned error can't find the container with id 9f12f0c0feb5bd16feb7911f4cc019f11e137f5bb96b1913ee7c83a3eb8068c8 May 29 18:02:27.123243 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:27.123228 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 18:02:27.465157 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:27.465131 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4g6sj_200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25/dns/0.log" May 29 18:02:27.485171 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:27.485083 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4g6sj_200ce3d9-d1a6-4350-88c1-5cc7cf6b7c25/kube-rbac-proxy/0.log" May 29 18:02:27.627234 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:27.627199 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-lflr6" event={"ID":"38beb783-8328-4047-b0ab-a92088e74826","Type":"ContainerStarted","Data":"306580300f9d45430d4d0bb61cd6d009ba50e3758899589b7b0a389f636457c7"} May 29 18:02:27.627234 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:27.627234 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-lflr6" event={"ID":"38beb783-8328-4047-b0ab-a92088e74826","Type":"ContainerStarted","Data":"9f12f0c0feb5bd16feb7911f4cc019f11e137f5bb96b1913ee7c83a3eb8068c8"} May 29 18:02:27.627454 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:27.627309 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-lflr6" May 29 18:02:27.642848 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:27.642795 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-lflr6" podStartSLOduration=1.6427811110000001 podStartE2EDuration="1.642781111s" podCreationTimestamp="2026-05-29 18:02:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 18:02:27.642368048 +0000 UTC m=+1841.915595426" watchObservedRunningTime="2026-05-29 18:02:27.642781111 +0000 UTC m=+1841.916008489" May 29 18:02:27.663500 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:27.663473 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8lmqz_8743123a-c7a3-4dba-b656-622c9a23c6e6/dns-node-resolver/0.log" May 29 18:02:28.147841 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:28.147806 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v8trn_92b4d776-17cd-4b31-9dea-c4fb783ed515/node-ca/0.log" May 29 18:02:28.799773 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:28.799714 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b67975c55-zmgg7_f033a789-974f-4bfb-a4e5-a654ee03e80a/router/0.log" May 29 18:02:29.114707 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:29.114619 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2kcrl_ee552438-fa19-400b-a3f8-f2c6711e7721/serve-healthcheck-canary/0.log" May 29 18:02:29.650350 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:29.650298 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s427h_f3f3b2c9-46d3-4ab2-9a21-2f6018959680/kube-rbac-proxy/0.log" May 29 18:02:29.669547 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:29.669520 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s427h_f3f3b2c9-46d3-4ab2-9a21-2f6018959680/exporter/0.log" May 29 18:02:29.689048 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:29.689018 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s427h_f3f3b2c9-46d3-4ab2-9a21-2f6018959680/extractor/0.log" May 29 18:02:33.638941 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:33.638917 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-lflr6" May 29 18:02:34.893984 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:34.893958 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-95w4p_8f600c44-f078-461d-b75f-bac51676fd2d/kube-multus-additional-cni-plugins/0.log" May 29 18:02:34.914527 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:34.914505 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-95w4p_8f600c44-f078-461d-b75f-bac51676fd2d/egress-router-binary-copy/0.log" May 29 18:02:34.937502 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:34.937472 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-95w4p_8f600c44-f078-461d-b75f-bac51676fd2d/cni-plugins/0.log" May 29 18:02:34.957792 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:34.957759 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-95w4p_8f600c44-f078-461d-b75f-bac51676fd2d/bond-cni-plugin/0.log" May 29 18:02:34.976973 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:34.976947 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-95w4p_8f600c44-f078-461d-b75f-bac51676fd2d/routeoverride-cni/0.log" May 29 18:02:35.001420 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:35.001385 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-95w4p_8f600c44-f078-461d-b75f-bac51676fd2d/whereabouts-cni-bincopy/0.log" May 29 18:02:35.025308 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:35.025283 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-95w4p_8f600c44-f078-461d-b75f-bac51676fd2d/whereabouts-cni/0.log" May 29 18:02:35.222311 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:35.222217 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jp89n_75241da4-b76f-468e-b501-eeab92ff75d7/kube-multus/0.log" May 29 18:02:35.317405 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:35.317363 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bcp7w_d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49/network-metrics-daemon/0.log" May 29 18:02:35.337999 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:35.337975 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bcp7w_d7ed6fb2-5896-4e9e-a2e6-2d7d433c8b49/kube-rbac-proxy/0.log" May 29 18:02:36.257027 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:36.256941 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w49xp_b127b743-ab2d-443c-beda-d0e62ec97544/ovn-controller/0.log" May 29 18:02:36.280912 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:36.280880 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w49xp_b127b743-ab2d-443c-beda-d0e62ec97544/ovn-acl-logging/0.log" May 29 18:02:36.288272 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:36.288252 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w49xp_b127b743-ab2d-443c-beda-d0e62ec97544/ovn-acl-logging/1.log" May 29 18:02:36.308170 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:36.308130 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w49xp_b127b743-ab2d-443c-beda-d0e62ec97544/kube-rbac-proxy-node/0.log" May 29 18:02:36.336116 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:36.336084 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w49xp_b127b743-ab2d-443c-beda-d0e62ec97544/kube-rbac-proxy-ovn-metrics/0.log" May 29 18:02:36.361781 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:36.361753 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w49xp_b127b743-ab2d-443c-beda-d0e62ec97544/northd/0.log" May 29 18:02:36.392099 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:36.392066 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w49xp_b127b743-ab2d-443c-beda-d0e62ec97544/nbdb/0.log" May 29 18:02:36.415161 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:36.415133 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w49xp_b127b743-ab2d-443c-beda-d0e62ec97544/sbdb/0.log" May 29 18:02:36.508047 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:36.507972 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w49xp_b127b743-ab2d-443c-beda-d0e62ec97544/ovnkube-controller/0.log" May 29 18:02:38.251220 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:38.251144 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-56d84b9f44-2qbp4_14edb090-7039-431f-bc73-65b04217d587/check-endpoints/0.log" May 29 18:02:38.272362 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:38.272336 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-95vg5_c3c798e6-b4da-4967-89c3-cf3d1e94cd4a/network-check-target-container/0.log" May 29 18:02:39.130330 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:39.130277 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-mfs9d_f3395817-65a6-4c39-9a0c-a610c2dda031/iptables-alerter/0.log" May 29 18:02:39.906949 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:39.906919 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-zlvq6_09f1ad69-c9d7-4fbb-817a-af2956d532e8/tuned/0.log" May 29 18:02:43.323184 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:43.323154 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-mzntn_6a6a5a92-9a66-4acb-86d8-7bd102357b41/csi-driver/0.log" May 29 18:02:43.342410 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:43.342380 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-mzntn_6a6a5a92-9a66-4acb-86d8-7bd102357b41/csi-node-driver-registrar/0.log" May 29 18:02:43.361469 ip-10-0-128-221 kubenswrapper[2567]: I0529 18:02:43.361438 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-mzntn_6a6a5a92-9a66-4acb-86d8-7bd102357b41/csi-liveness-probe/0.log"