May 21 20:35:45.764770 ip-10-0-132-7 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 21 20:35:45.764780 ip-10-0-132-7 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 21 20:35:45.764789 ip-10-0-132-7 systemd[1]: kubelet.service: Failed with result 'resources'. May 21 20:35:45.765071 ip-10-0-132-7 systemd[1]: Failed to start Kubernetes Kubelet. May 21 20:35:55.160978 ip-10-0-132-7 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. May 21 20:35:55.160991 ip-10-0-132-7 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot eacaa72ca76f428a9d07acc310955aff -- May 21 20:38:11.935674 ip-10-0-132-7 systemd[1]: Starting Kubernetes Kubelet... May 21 20:38:12.446736 ip-10-0-132-7 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 20:38:12.446736 ip-10-0-132-7 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 20:38:12.446736 ip-10-0-132-7 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 20:38:12.446736 ip-10-0-132-7 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 20:38:12.446736 ip-10-0-132-7 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 20:38:12.449011 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.448859 2556 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 20:38:12.454432 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454407 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 20:38:12.454432 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454431 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 20:38:12.454432 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454434 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 20:38:12.454432 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454437 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 20:38:12.454566 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454440 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 20:38:12.454566 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454443 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 20:38:12.454566 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454448 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 20:38:12.454566 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454452 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 20:38:12.454566 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454455 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 20:38:12.454566 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454459 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 20:38:12.454566 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454462 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 20:38:12.454566 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454465 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 20:38:12.454566 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454468 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 20:38:12.454566 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454477 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 20:38:12.454566 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454480 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 20:38:12.454566 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454483 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 20:38:12.454566 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454486 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 20:38:12.454566 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454489 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 20:38:12.454566 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454491 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 20:38:12.454566 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454493 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 20:38:12.454566 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454496 2556 feature_gate.go:328] unrecognized feature gate: Example2 May 21 20:38:12.454566 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454498 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 20:38:12.454566 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454501 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 20:38:12.454566 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454504 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 20:38:12.455149 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454506 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 20:38:12.455149 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454509 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 20:38:12.455149 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454511 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 20:38:12.455149 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454514 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 20:38:12.455149 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454516 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 20:38:12.455149 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454519 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 20:38:12.455149 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454521 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 20:38:12.455149 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454524 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 20:38:12.455149 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454528 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 20:38:12.455149 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454531 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 20:38:12.455149 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454534 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 20:38:12.455149 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454536 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 20:38:12.455149 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454540 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 20:38:12.455149 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454544 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 20:38:12.455149 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454548 2556 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 20:38:12.455149 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454550 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 20:38:12.455149 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454553 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 20:38:12.455149 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454556 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 20:38:12.455149 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454558 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 20:38:12.455149 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454561 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 20:38:12.456078 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454563 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 20:38:12.456078 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454566 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 20:38:12.456078 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454569 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 20:38:12.456078 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454572 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 20:38:12.456078 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454575 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 20:38:12.456078 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454578 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 20:38:12.456078 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454581 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 20:38:12.456078 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454583 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 20:38:12.456078 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454586 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 20:38:12.456078 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454588 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 20:38:12.456078 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454591 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 20:38:12.456078 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454594 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 20:38:12.456078 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454596 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 20:38:12.456078 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454598 2556 feature_gate.go:328] unrecognized feature gate: Example May 21 20:38:12.456078 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454601 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 20:38:12.456078 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454603 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 20:38:12.456078 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454606 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 20:38:12.456078 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454609 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 20:38:12.456078 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454611 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 20:38:12.456078 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454614 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 20:38:12.456942 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454617 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 20:38:12.456942 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454619 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 20:38:12.456942 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454622 2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 20:38:12.456942 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454624 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 20:38:12.456942 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454627 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 20:38:12.456942 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454630 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 20:38:12.456942 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454633 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 20:38:12.456942 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454636 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 20:38:12.456942 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454638 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 20:38:12.456942 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454641 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 20:38:12.456942 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454643 2556 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 20:38:12.456942 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454646 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 20:38:12.456942 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454649 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 20:38:12.456942 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454651 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 20:38:12.456942 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454654 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 20:38:12.456942 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454656 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 20:38:12.456942 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454659 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 20:38:12.456942 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454661 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 20:38:12.456942 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454663 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 20:38:12.456942 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454666 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 20:38:12.457810 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454668 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 20:38:12.457810 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.454670 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 20:38:12.457810 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456503 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 20:38:12.457810 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456520 2556 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 20:38:12.457810 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456525 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 20:38:12.457810 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456529 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 20:38:12.457810 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456533 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 20:38:12.457810 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456538 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 20:38:12.457810 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456543 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 20:38:12.457810 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456548 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 20:38:12.457810 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456552 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 20:38:12.457810 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456556 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 20:38:12.457810 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456560 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 20:38:12.457810 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456565 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 20:38:12.457810 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456569 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 20:38:12.457810 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456573 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 20:38:12.457810 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456577 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 20:38:12.457810 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456581 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 20:38:12.457810 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456585 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 20:38:12.457810 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456590 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 20:38:12.458605 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456594 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 20:38:12.458605 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456598 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 20:38:12.458605 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456603 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 20:38:12.458605 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456607 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 20:38:12.458605 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456611 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 20:38:12.458605 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456615 2556 feature_gate.go:328] unrecognized feature gate: Example2 May 21 20:38:12.458605 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456619 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 20:38:12.458605 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456624 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 20:38:12.458605 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456633 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 20:38:12.458605 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456637 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 20:38:12.458605 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456641 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 20:38:12.458605 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456646 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 20:38:12.458605 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456653 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 20:38:12.458605 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456658 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 20:38:12.458605 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456664 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 20:38:12.458605 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456670 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 20:38:12.458605 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456675 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 20:38:12.458605 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456680 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 20:38:12.458605 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456684 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 20:38:12.458605 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456692 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 20:38:12.459124 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456696 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 20:38:12.459124 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456700 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 20:38:12.459124 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456704 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 20:38:12.459124 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456708 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 20:38:12.459124 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456713 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 20:38:12.459124 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456717 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 20:38:12.459124 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456721 2556 feature_gate.go:328] unrecognized feature gate: Example May 21 20:38:12.459124 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456726 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 20:38:12.459124 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456730 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 20:38:12.459124 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456735 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 20:38:12.459124 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456739 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 20:38:12.459124 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456743 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 20:38:12.459124 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456747 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 20:38:12.459124 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456752 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 20:38:12.459124 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456757 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 20:38:12.459124 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456761 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 20:38:12.459124 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456765 2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 20:38:12.459124 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456769 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 20:38:12.459124 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456772 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 20:38:12.459124 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456776 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 20:38:12.459736 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456780 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 20:38:12.459736 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456784 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 20:38:12.459736 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456788 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 20:38:12.459736 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456793 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 20:38:12.459736 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456798 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 20:38:12.459736 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456802 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 20:38:12.459736 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456806 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 20:38:12.459736 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456810 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 20:38:12.459736 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456815 2556 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 20:38:12.459736 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456818 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 20:38:12.459736 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456822 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 20:38:12.459736 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456827 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 20:38:12.459736 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456831 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 20:38:12.459736 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456835 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 20:38:12.459736 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456841 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 20:38:12.459736 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456845 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 20:38:12.459736 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456849 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 20:38:12.459736 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456856 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 20:38:12.459736 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456862 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 20:38:12.460219 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456868 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 20:38:12.460219 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456873 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 20:38:12.460219 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456877 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 20:38:12.460219 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456881 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 20:38:12.460219 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456885 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 20:38:12.460219 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456889 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 20:38:12.460219 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456893 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 20:38:12.460219 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456897 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 20:38:12.460219 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.456900 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 20:38:12.460219 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457002 2556 flags.go:64] FLAG: --address="0.0.0.0" May 21 20:38:12.460219 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457014 2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 20:38:12.460219 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457025 2556 flags.go:64] FLAG: --anonymous-auth="true" May 21 20:38:12.460219 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457032 2556 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 20:38:12.460219 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457039 2556 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 20:38:12.460219 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457044 2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 20:38:12.460219 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457051 2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 20:38:12.460219 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457058 2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 20:38:12.460219 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457063 2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 20:38:12.460219 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457068 2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 20:38:12.460219 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457074 2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 20:38:12.460219 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457085 2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 20:38:12.460219 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457090 2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 20:38:12.461041 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457095 2556 flags.go:64] FLAG: --cgroup-root="" May 21 20:38:12.461041 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457100 2556 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 20:38:12.461041 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457105 2556 flags.go:64] FLAG: --client-ca-file="" May 21 20:38:12.461041 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457110 2556 flags.go:64] FLAG: --cloud-config="" May 21 20:38:12.461041 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457114 2556 flags.go:64] FLAG: --cloud-provider="external" May 21 20:38:12.461041 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457119 2556 flags.go:64] FLAG: --cluster-dns="[]" May 21 20:38:12.461041 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457126 2556 flags.go:64] FLAG: --cluster-domain="" May 21 20:38:12.461041 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457131 2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 20:38:12.461041 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457136 2556 flags.go:64] FLAG: --config-dir="" May 21 20:38:12.461041 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457141 2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 20:38:12.461041 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457146 2556 flags.go:64] FLAG: --container-log-max-files="5" May 21 20:38:12.461041 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457154 2556 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 20:38:12.461041 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457159 2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 20:38:12.461041 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457164 2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 20:38:12.461041 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457170 2556 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 20:38:12.461041 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457174 2556 flags.go:64] FLAG: --contention-profiling="false" May 21 20:38:12.461041 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457179 2556 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 20:38:12.461041 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457184 2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 20:38:12.461041 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457190 2556 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 20:38:12.461041 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457194 2556 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 20:38:12.461041 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457201 2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 20:38:12.461041 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457206 2556 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 20:38:12.461041 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457211 2556 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 20:38:12.461041 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457216 2556 flags.go:64] FLAG: --enable-load-reader="false" May 21 20:38:12.461041 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457221 2556 flags.go:64] FLAG: --enable-server="true" May 21 20:38:12.461686 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457226 2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 20:38:12.461686 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457234 2556 flags.go:64] FLAG: --event-burst="100" May 21 20:38:12.461686 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457240 2556 flags.go:64] FLAG: --event-qps="50" May 21 20:38:12.461686 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457244 2556 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 20:38:12.461686 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457249 2556 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 20:38:12.461686 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457257 2556 flags.go:64] FLAG: --eviction-hard="" May 21 20:38:12.461686 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457263 2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 20:38:12.461686 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457268 2556 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 20:38:12.461686 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457273 2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 20:38:12.461686 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457279 2556 flags.go:64] FLAG: --eviction-soft="" May 21 20:38:12.461686 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457284 2556 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 20:38:12.461686 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457289 2556 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 20:38:12.461686 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457294 2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 20:38:12.461686 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457298 2556 flags.go:64] FLAG: --experimental-mounter-path="" May 21 20:38:12.461686 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457303 2556 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 20:38:12.461686 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457308 2556 flags.go:64] FLAG: --fail-swap-on="true" May 21 20:38:12.461686 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457313 2556 flags.go:64] FLAG: --feature-gates="" May 21 20:38:12.461686 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457319 2556 flags.go:64] FLAG: --file-check-frequency="20s" May 21 20:38:12.461686 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457324 2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 20:38:12.461686 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457330 2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 20:38:12.461686 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457335 2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 20:38:12.461686 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457340 2556 flags.go:64] FLAG: --healthz-port="10248" May 21 20:38:12.461686 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457345 2556 flags.go:64] FLAG: --help="false" May 21 20:38:12.461686 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457350 2556 flags.go:64] FLAG: --hostname-override="ip-10-0-132-7.ec2.internal" May 21 20:38:12.461686 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457355 2556 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 20:38:12.462411 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457360 2556 flags.go:64] FLAG: --http-check-frequency="20s" May 21 20:38:12.462411 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457385 2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 20:38:12.462411 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457391 2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 20:38:12.462411 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457397 2556 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 20:38:12.462411 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457401 2556 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 20:38:12.462411 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457406 2556 flags.go:64] FLAG: --image-service-endpoint="" May 21 20:38:12.462411 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457410 2556 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 20:38:12.462411 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457415 2556 flags.go:64] FLAG: --kube-api-burst="100" May 21 20:38:12.462411 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457420 2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 20:38:12.462411 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457425 2556 flags.go:64] FLAG: --kube-api-qps="50" May 21 20:38:12.462411 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457429 2556 flags.go:64] FLAG: --kube-reserved="" May 21 20:38:12.462411 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457434 2556 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 20:38:12.462411 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457440 2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 20:38:12.462411 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457445 2556 flags.go:64] FLAG: --kubelet-cgroups="" May 21 20:38:12.462411 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457450 2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 20:38:12.462411 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457454 2556 flags.go:64] FLAG: --lock-file="" May 21 20:38:12.462411 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457459 2556 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 20:38:12.462411 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457464 2556 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 20:38:12.462411 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457469 2556 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 20:38:12.462411 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457482 2556 flags.go:64] FLAG: --log-json-split-stream="false" May 21 20:38:12.462411 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457487 2556 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 20:38:12.462411 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457492 2556 flags.go:64] FLAG: --log-text-split-stream="false" May 21 20:38:12.462411 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457496 2556 flags.go:64] FLAG: --logging-format="text" May 21 20:38:12.463023 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457501 2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 20:38:12.463023 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457506 2556 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 20:38:12.463023 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457511 2556 flags.go:64] FLAG: --manifest-url="" May 21 20:38:12.463023 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457516 2556 flags.go:64] FLAG: --manifest-url-header="" May 21 20:38:12.463023 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457524 2556 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 20:38:12.463023 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457530 2556 flags.go:64] FLAG: --max-open-files="1000000" May 21 20:38:12.463023 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457537 2556 flags.go:64] FLAG: --max-pods="110" May 21 20:38:12.463023 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457542 2556 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 20:38:12.463023 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457547 2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 20:38:12.463023 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457552 2556 flags.go:64] FLAG: --memory-manager-policy="None" May 21 20:38:12.463023 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457557 2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 20:38:12.463023 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457561 2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 20:38:12.463023 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457566 2556 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 20:38:12.463023 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457570 2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 20:38:12.463023 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457582 2556 flags.go:64] FLAG: --node-status-max-images="50" May 21 20:38:12.463023 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457587 2556 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 20:38:12.463023 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457591 2556 flags.go:64] FLAG: --oom-score-adj="-999" May 21 20:38:12.463023 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457596 2556 flags.go:64] FLAG: --pod-cidr="" May 21 20:38:12.463023 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457601 2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 20:38:12.463023 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457609 2556 flags.go:64] FLAG: --pod-manifest-path="" May 21 20:38:12.463023 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457614 2556 flags.go:64] FLAG: --pod-max-pids="-1" May 21 20:38:12.463023 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457622 2556 flags.go:64] FLAG: --pods-per-core="0" May 21 20:38:12.463023 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457627 2556 flags.go:64] FLAG: --port="10250" May 21 20:38:12.463023 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457632 2556 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 20:38:12.463632 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457637 2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c851cfeeebca6bde" May 21 20:38:12.463632 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457642 2556 flags.go:64] FLAG: --qos-reserved="" May 21 20:38:12.463632 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457646 2556 flags.go:64] FLAG: --read-only-port="10255" May 21 20:38:12.463632 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457651 2556 flags.go:64] FLAG: --register-node="true" May 21 20:38:12.463632 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457655 2556 flags.go:64] FLAG: --register-schedulable="true" May 21 20:38:12.463632 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457660 2556 flags.go:64] FLAG: --register-with-taints="" May 21 20:38:12.463632 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457666 2556 flags.go:64] FLAG: --registry-burst="10" May 21 20:38:12.463632 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457671 2556 flags.go:64] FLAG: --registry-qps="5" May 21 20:38:12.463632 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457675 2556 flags.go:64] FLAG: --reserved-cpus="" May 21 20:38:12.463632 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457679 2556 flags.go:64] FLAG: --reserved-memory="" May 21 20:38:12.463632 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457685 2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 20:38:12.463632 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457690 2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 20:38:12.463632 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457694 2556 flags.go:64] FLAG: --rotate-certificates="false" May 21 20:38:12.463632 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457701 2556 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 20:38:12.463632 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457706 2556 flags.go:64] FLAG: --runonce="false" May 21 20:38:12.463632 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457711 2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 20:38:12.463632 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457715 2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 20:38:12.463632 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457720 2556 flags.go:64] FLAG: --seccomp-default="false" May 21 20:38:12.463632 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457725 2556 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 20:38:12.463632 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457730 2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 20:38:12.463632 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457734 2556 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 20:38:12.463632 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457739 2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 20:38:12.463632 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457745 2556 flags.go:64] FLAG: --storage-driver-password="root" May 21 20:38:12.463632 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457750 2556 flags.go:64] FLAG: --storage-driver-secure="false" May 21 20:38:12.463632 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457754 2556 flags.go:64] FLAG: --storage-driver-table="stats" May 21 20:38:12.463632 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457759 2556 flags.go:64] FLAG: --storage-driver-user="root" May 21 20:38:12.464296 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457764 2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 20:38:12.464296 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457769 2556 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 20:38:12.464296 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457774 2556 flags.go:64] FLAG: --system-cgroups="" May 21 20:38:12.464296 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457780 2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 20:38:12.464296 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457791 2556 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 20:38:12.464296 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457796 2556 flags.go:64] FLAG: --tls-cert-file="" May 21 20:38:12.464296 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457801 2556 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 20:38:12.464296 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457806 2556 flags.go:64] FLAG: --tls-min-version="" May 21 20:38:12.464296 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457811 2556 flags.go:64] FLAG: --tls-private-key-file="" May 21 20:38:12.464296 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457815 2556 flags.go:64] FLAG: --topology-manager-policy="none" May 21 20:38:12.464296 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457820 2556 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 20:38:12.464296 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457829 2556 flags.go:64] FLAG: --topology-manager-scope="container" May 21 20:38:12.464296 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457834 2556 flags.go:64] FLAG: --v="2" May 21 20:38:12.464296 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457841 2556 flags.go:64] FLAG: --version="false" May 21 20:38:12.464296 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457848 2556 flags.go:64] FLAG: --vmodule="" May 21 20:38:12.464296 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457856 2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 20:38:12.464296 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.457861 2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 20:38:12.464296 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458018 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 20:38:12.464296 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458025 2556 feature_gate.go:328] unrecognized feature gate: Example2 May 21 20:38:12.464296 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458030 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 20:38:12.464296 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458036 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 20:38:12.464296 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458040 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 20:38:12.464296 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458045 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 20:38:12.464888 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458049 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 20:38:12.464888 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458054 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 20:38:12.464888 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458058 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 20:38:12.464888 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458062 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 20:38:12.464888 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458066 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 20:38:12.464888 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458070 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 20:38:12.464888 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458074 2556 feature_gate.go:328] unrecognized feature gate: Example May 21 20:38:12.464888 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458078 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 20:38:12.464888 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458083 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 20:38:12.464888 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458087 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 20:38:12.464888 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458091 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 20:38:12.464888 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458095 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 20:38:12.464888 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458100 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 20:38:12.464888 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458106 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 20:38:12.464888 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458110 2556 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 20:38:12.464888 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458114 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 20:38:12.464888 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458119 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 20:38:12.464888 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458123 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 20:38:12.464888 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458127 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 20:38:12.464888 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458131 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 20:38:12.464888 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458136 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 20:38:12.465432 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458140 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 20:38:12.465432 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458144 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 20:38:12.465432 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458151 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 20:38:12.465432 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458157 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 20:38:12.465432 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458162 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 20:38:12.465432 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458166 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 20:38:12.465432 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458170 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 20:38:12.465432 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458175 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 20:38:12.465432 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458180 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 20:38:12.465432 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458185 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 20:38:12.465432 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458189 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 20:38:12.465432 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458193 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 20:38:12.465432 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458197 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 20:38:12.465432 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458201 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 20:38:12.465432 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458205 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 20:38:12.465432 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458209 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 20:38:12.465432 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458213 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 20:38:12.465432 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458217 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 20:38:12.465432 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458221 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 20:38:12.465962 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458225 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 20:38:12.465962 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458229 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 20:38:12.465962 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458233 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 20:38:12.465962 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458237 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 20:38:12.465962 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458241 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 20:38:12.465962 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458247 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 20:38:12.465962 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458252 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 20:38:12.465962 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458257 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 20:38:12.465962 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458261 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 20:38:12.465962 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458265 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 20:38:12.465962 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458269 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 20:38:12.465962 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458273 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 20:38:12.465962 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458277 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 20:38:12.465962 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458281 2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 20:38:12.465962 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458286 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 20:38:12.465962 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458290 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 20:38:12.465962 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458294 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 20:38:12.465962 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458298 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 20:38:12.465962 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458302 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 20:38:12.466479 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458306 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 20:38:12.466479 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458311 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 20:38:12.466479 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458317 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 20:38:12.466479 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458323 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 20:38:12.466479 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458329 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 20:38:12.466479 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458333 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 20:38:12.466479 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458337 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 20:38:12.466479 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458341 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 20:38:12.466479 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458345 2556 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 20:38:12.466479 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458358 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 20:38:12.466479 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458380 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 20:38:12.466479 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458386 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 20:38:12.466479 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458390 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 20:38:12.466479 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458394 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 20:38:12.466479 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458398 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 20:38:12.466479 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458402 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 20:38:12.466479 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458406 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 20:38:12.466479 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458411 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 20:38:12.466479 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458417 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 20:38:12.466939 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458421 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 20:38:12.466939 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.458426 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 20:38:12.466939 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.459395 2556 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 20:38:12.467229 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.467204 2556 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 20:38:12.467258 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.467231 2556 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 20:38:12.467298 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467289 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 20:38:12.467326 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467298 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 20:38:12.467326 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467302 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 20:38:12.467326 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467306 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 20:38:12.467326 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467309 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 20:38:12.467326 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467312 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 20:38:12.467326 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467315 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 20:38:12.467326 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467318 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 20:38:12.467326 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467321 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 20:38:12.467326 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467324 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 20:38:12.467326 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467326 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 20:38:12.467326 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467330 2556 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 20:38:12.467326 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467332 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 20:38:12.467654 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467335 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 20:38:12.467654 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467338 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 20:38:12.467654 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467341 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 20:38:12.467654 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467343 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 20:38:12.467654 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467346 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 20:38:12.467654 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467350 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 20:38:12.467654 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467355 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 20:38:12.467654 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467358 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 20:38:12.467654 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467360 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 20:38:12.467654 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467380 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 20:38:12.467654 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467385 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 20:38:12.467654 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467389 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 20:38:12.467654 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467391 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 20:38:12.467654 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467394 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 20:38:12.467654 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467396 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 20:38:12.467654 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467399 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 20:38:12.467654 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467401 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 20:38:12.467654 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467404 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 20:38:12.467654 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467409 2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 20:38:12.468169 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467411 2556 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 20:38:12.468169 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467414 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 20:38:12.468169 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467416 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 20:38:12.468169 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467419 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 20:38:12.468169 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467421 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 20:38:12.468169 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467424 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 20:38:12.468169 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467426 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 20:38:12.468169 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467429 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 20:38:12.468169 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467432 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 20:38:12.468169 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467434 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 20:38:12.468169 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467437 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 20:38:12.468169 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467439 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 20:38:12.468169 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467442 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 20:38:12.468169 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467445 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 20:38:12.468169 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467448 2556 feature_gate.go:328] unrecognized feature gate: Example2 May 21 20:38:12.468169 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467451 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 20:38:12.468169 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467454 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 20:38:12.468169 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467456 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 20:38:12.468169 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467459 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 20:38:12.468169 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467461 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 20:38:12.468714 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467464 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 20:38:12.468714 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467467 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 20:38:12.468714 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467469 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 20:38:12.468714 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467471 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 20:38:12.468714 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467474 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 20:38:12.468714 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467476 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 20:38:12.468714 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467479 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 20:38:12.468714 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467481 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 20:38:12.468714 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467483 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 20:38:12.468714 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467486 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 20:38:12.468714 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467488 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 20:38:12.468714 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467491 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 20:38:12.468714 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467494 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 20:38:12.468714 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467496 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 20:38:12.468714 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467499 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 20:38:12.468714 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467501 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 20:38:12.468714 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467504 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 20:38:12.468714 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467506 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 20:38:12.468714 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467509 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 20:38:12.468714 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467512 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 20:38:12.469211 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467514 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 20:38:12.469211 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467517 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 20:38:12.469211 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467519 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 20:38:12.469211 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467522 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 20:38:12.469211 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467524 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 20:38:12.469211 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467526 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 20:38:12.469211 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467529 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 20:38:12.469211 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467532 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 20:38:12.469211 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467534 2556 feature_gate.go:328] unrecognized feature gate: Example May 21 20:38:12.469211 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467537 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 20:38:12.469211 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467540 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 20:38:12.469211 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467542 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 20:38:12.469211 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467544 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 20:38:12.469211 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467547 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 20:38:12.469211 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.467552 2556 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 20:38:12.469676 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467664 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 20:38:12.469676 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467669 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 20:38:12.469676 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467672 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 20:38:12.469676 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467675 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 20:38:12.469676 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467677 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 20:38:12.469676 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467680 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 20:38:12.469676 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467683 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 20:38:12.469676 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467685 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 20:38:12.469676 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467688 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 20:38:12.469676 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467691 2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 20:38:12.469676 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467694 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 20:38:12.469676 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467696 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 20:38:12.469676 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467699 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 20:38:12.469676 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467702 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 20:38:12.469676 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467704 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 20:38:12.469676 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467707 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 20:38:12.469676 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467710 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 20:38:12.469676 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467712 2556 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 20:38:12.469676 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467715 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 20:38:12.469676 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467718 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 20:38:12.470153 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467720 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 20:38:12.470153 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467723 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 20:38:12.470153 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467725 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 20:38:12.470153 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467729 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 20:38:12.470153 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467731 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 20:38:12.470153 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467734 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 20:38:12.470153 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467736 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 20:38:12.470153 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467739 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 20:38:12.470153 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467741 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 20:38:12.470153 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467744 2556 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 20:38:12.470153 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467746 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 20:38:12.470153 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467749 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 20:38:12.470153 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467751 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 20:38:12.470153 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467753 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 20:38:12.470153 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467756 2556 feature_gate.go:328] unrecognized feature gate: Example2 May 21 20:38:12.470153 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467758 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 20:38:12.470153 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467762 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 20:38:12.470153 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467766 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 20:38:12.470153 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467768 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 20:38:12.470665 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467771 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 20:38:12.470665 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467773 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 20:38:12.470665 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467776 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 20:38:12.470665 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467779 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 20:38:12.470665 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467782 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 20:38:12.470665 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467785 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 20:38:12.470665 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467788 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 20:38:12.470665 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467790 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 20:38:12.470665 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467793 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 20:38:12.470665 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467795 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 20:38:12.470665 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467798 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 20:38:12.470665 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467800 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 20:38:12.470665 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467803 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 20:38:12.470665 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467805 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 20:38:12.470665 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467808 2556 feature_gate.go:328] unrecognized feature gate: Example May 21 20:38:12.470665 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467810 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 20:38:12.470665 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467813 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 20:38:12.470665 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467816 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 20:38:12.470665 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467818 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 20:38:12.471136 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467821 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 20:38:12.471136 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467823 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 20:38:12.471136 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467826 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 20:38:12.471136 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467828 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 20:38:12.471136 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467831 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 20:38:12.471136 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467833 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 20:38:12.471136 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467836 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 20:38:12.471136 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467838 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 20:38:12.471136 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467841 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 20:38:12.471136 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467843 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 20:38:12.471136 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467846 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 20:38:12.471136 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467848 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 20:38:12.471136 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467851 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 20:38:12.471136 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467853 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 20:38:12.471136 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467856 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 20:38:12.471136 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467858 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 20:38:12.471136 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467861 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 20:38:12.471136 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467864 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 20:38:12.471136 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467870 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 20:38:12.471136 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467873 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 20:38:12.471678 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467876 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 20:38:12.471678 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467878 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 20:38:12.471678 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467881 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 20:38:12.471678 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467884 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 20:38:12.471678 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467886 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 20:38:12.471678 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467889 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 20:38:12.471678 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467891 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 20:38:12.471678 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:12.467894 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 20:38:12.471678 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.467899 2556 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 20:38:12.471678 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.468750 2556 server.go:962] "Client rotation is on, will bootstrap in background" May 21 20:38:12.471678 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.471248 2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 20:38:12.472417 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.472403 2556 server.go:1019] "Starting client certificate rotation" May 21 20:38:12.472533 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.472512 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 20:38:12.472568 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.472559 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 20:38:12.503166 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.503143 2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 20:38:12.505124 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.505075 2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 20:38:12.518915 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.518891 2556 log.go:25] "Validated CRI v1 runtime API" May 21 20:38:12.525293 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.525273 2556 log.go:25] "Validated CRI v1 image API" May 21 20:38:12.528077 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.528058 2556 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 20:38:12.531782 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.531761 2556 fs.go:135] Filesystem UUIDs: map[72019a78-9791-49a1-9b99-7f3d9365a87d:/dev/nvme0n1p4 73ba11e0-c0d1-45c8-b5b4-0d0490b600d3:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] May 21 20:38:12.531842 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.531783 2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 20:38:12.536163 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.536046 2556 manager.go:217] Machine: {Timestamp:2026-05-21 20:38:12.535528715 +0000 UTC m=+0.466303788 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093288 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ea8360df59fdf7fd141f40a37f468 SystemUUID:ec2ea836-0df5-9fdf-7fd1-41f40a37f468 BootID:eacaa72c-a76f-428a-9d07-acc310955aff Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:15:79:0d:bf:59 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:15:79:0d:bf:59 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:cd:18:51:f6:b4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 20:38:12.536935 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.536924 2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 20:38:12.537024 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.537011 2556 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 20:38:12.539069 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.539040 2556 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 20:38:12.539235 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.539074 2556 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-7.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 20:38:12.539296 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.539246 2556 topology_manager.go:138] "Creating topology manager with none policy" May 21 20:38:12.539296 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.539257 2556 container_manager_linux.go:306] "Creating device plugin manager" May 21 20:38:12.539296 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.539277 2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 20:38:12.540195 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.540179 2556 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 20:38:12.542726 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.542713 2556 state_mem.go:36] "Initialized new in-memory state store" May 21 20:38:12.543023 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.543013 2556 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 20:38:12.546188 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.546173 2556 kubelet.go:491] "Attempting to sync node with API server" May 21 20:38:12.546255 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.546204 2556 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 20:38:12.546255 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.546219 2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 20:38:12.546255 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.546228 2556 kubelet.go:397] "Adding apiserver pod source" May 21 20:38:12.546255 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.546238 2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 20:38:12.546517 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.546498 2556 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 20:38:12.547482 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.547468 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 20:38:12.547558 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.547488 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 20:38:12.551736 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.551709 2556 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 20:38:12.553963 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.553950 2556 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 20:38:12.554868 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.554856 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 20:38:12.554902 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.554874 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 20:38:12.554902 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.554881 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 20:38:12.554902 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.554887 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 20:38:12.554902 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.554896 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 20:38:12.554902 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.554902 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 20:38:12.555043 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.554909 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 20:38:12.555043 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.554915 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 20:38:12.555043 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.554922 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 20:38:12.555043 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.554927 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 20:38:12.555043 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.554936 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 20:38:12.555360 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.555351 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 20:38:12.557378 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.557355 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 20:38:12.557418 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.557384 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 20:38:12.561054 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.561035 2556 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 20:38:12.561120 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.561084 2556 server.go:1295] "Started kubelet" May 21 20:38:12.561220 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.561187 2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 20:38:12.561272 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.561196 2556 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 20:38:12.561316 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.561270 2556 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 20:38:12.562092 ip-10-0-132-7 systemd[1]: Started Kubernetes Kubelet. May 21 20:38:12.565882 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.565854 2556 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 20:38:12.566022 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:12.565990 2556 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-7.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 20:38:12.566022 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.566016 2556 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-7.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 21 20:38:12.566384 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:12.566338 2556 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 20:38:12.568714 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.568697 2556 server.go:317] "Adding debug handlers to kubelet server" May 21 20:38:12.573038 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:12.573015 2556 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 20:38:12.574502 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.574471 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 20:38:12.575080 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.575064 2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 20:38:12.575246 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.575228 2556 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 20:38:12.575306 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.575248 2556 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 20:38:12.575381 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.575318 2556 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 20:38:12.575438 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.575429 2556 reconstruct.go:97] "Volume reconstruction finished" May 21 20:38:12.575438 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.575437 2556 reconciler.go:26] "Reconciler: start to sync state" May 21 20:38:12.575594 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:12.574204 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-7.ec2.internal.18b1af22fae405d4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-7.ec2.internal,UID:ip-10-0-132-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-7.ec2.internal,},FirstTimestamp:2026-05-21 20:38:12.56105314 +0000 UTC m=+0.491828214,LastTimestamp:2026-05-21 20:38:12.56105314 +0000 UTC m=+0.491828214,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-7.ec2.internal,}" May 21 20:38:12.576131 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:12.576114 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-7.ec2.internal\" not found" May 21 20:38:12.577279 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.577263 2556 factory.go:55] Registering systemd factory May 21 20:38:12.577454 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.577436 2556 factory.go:223] Registration of the systemd container factory successfully May 21 20:38:12.578173 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.578140 2556 factory.go:153] Registering CRI-O factory May 21 20:38:12.578173 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.578158 2556 factory.go:223] Registration of the crio container factory successfully May 21 20:38:12.578311 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.578211 2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 20:38:12.578311 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.578229 2556 factory.go:103] Registering Raw factory May 21 20:38:12.578311 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.578246 2556 manager.go:1196] Started watching for new ooms in manager May 21 20:38:12.578728 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.578701 2556 manager.go:319] Starting recovery of all containers May 21 20:38:12.580715 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:12.580673 2556 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 21 20:38:12.584010 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:12.583815 2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-7.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 21 20:38:12.587350 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.587309 2556 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 20:38:12.589699 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.589681 2556 manager.go:324] Recovery completed May 21 20:38:12.594660 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.594642 2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 20:38:12.597176 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.597151 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasSufficientMemory" May 21 20:38:12.597237 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.597193 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasNoDiskPressure" May 21 20:38:12.597237 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.597203 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasSufficientPID" May 21 20:38:12.598163 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.598149 2556 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 20:38:12.598163 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.598160 2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 20:38:12.598255 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.598177 2556 state_mem.go:36] "Initialized new in-memory state store" May 21 20:38:12.599360 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:12.599293 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-7.ec2.internal.18b1af22fd0b4209 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-7.ec2.internal,UID:ip-10-0-132-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-7.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-7.ec2.internal,},FirstTimestamp:2026-05-21 20:38:12.597178889 +0000 UTC m=+0.527953964,LastTimestamp:2026-05-21 20:38:12.597178889 +0000 UTC m=+0.527953964,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-7.ec2.internal,}" May 21 20:38:12.601278 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.601261 2556 policy_none.go:49] "None policy: Start" May 21 20:38:12.601360 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.601281 2556 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 20:38:12.601360 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.601292 2556 state_mem.go:35] "Initializing new in-memory state store" May 21 20:38:12.621585 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:12.621485 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-7.ec2.internal.18b1af22fd0b8e60 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-7.ec2.internal,UID:ip-10-0-132-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-7.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-7.ec2.internal,},FirstTimestamp:2026-05-21 20:38:12.597198432 +0000 UTC m=+0.527973508,LastTimestamp:2026-05-21 20:38:12.597198432 +0000 UTC m=+0.527973508,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-7.ec2.internal,}" May 21 20:38:12.632908 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:12.632829 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-7.ec2.internal.18b1af22fd0bb014 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-7.ec2.internal,UID:ip-10-0-132-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-7.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-7.ec2.internal,},FirstTimestamp:2026-05-21 20:38:12.59720706 +0000 UTC m=+0.527982134,LastTimestamp:2026-05-21 20:38:12.59720706 +0000 UTC m=+0.527982134,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-7.ec2.internal,}" May 21 20:38:12.646105 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.646084 2556 manager.go:341] "Starting Device Plugin manager" May 21 20:38:12.658681 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:12.646124 2556 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 20:38:12.658681 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.646135 2556 server.go:85] "Starting device plugin registration server" May 21 20:38:12.658681 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.646464 2556 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 20:38:12.658681 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.646479 2556 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 20:38:12.658681 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.646550 2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 20:38:12.658681 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.646639 2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 20:38:12.658681 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.646648 2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 20:38:12.658681 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:12.647286 2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 20:38:12.658681 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:12.647325 2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-7.ec2.internal\" not found" May 21 20:38:12.662529 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:12.660433 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-7.ec2.internal.18b1af23001a472b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-7.ec2.internal,UID:ip-10-0-132-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-132-7.ec2.internal,},FirstTimestamp:2026-05-21 20:38:12.648494891 +0000 UTC m=+0.579269951,LastTimestamp:2026-05-21 20:38:12.648494891 +0000 UTC m=+0.579269951,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-7.ec2.internal,}" May 21 20:38:12.663128 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.663107 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5rdpt" May 21 20:38:12.678590 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.678566 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5rdpt" May 21 20:38:12.683111 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.683077 2556 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 20:38:12.683111 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.683106 2556 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 20:38:12.683263 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.683128 2556 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 20:38:12.683263 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.683135 2556 kubelet.go:2451] "Starting kubelet main sync loop" May 21 20:38:12.683263 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:12.683174 2556 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 21 20:38:12.696150 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.696115 2556 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 20:38:12.746852 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.746753 2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 20:38:12.748137 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.748117 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasSufficientMemory" May 21 20:38:12.748232 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.748152 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasNoDiskPressure" May 21 20:38:12.748232 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.748163 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasSufficientPID" May 21 20:38:12.748232 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.748193 2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-7.ec2.internal" May 21 20:38:12.761146 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.761118 2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-7.ec2.internal" May 21 20:38:12.761225 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:12.761149 2556 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-7.ec2.internal\": node \"ip-10-0-132-7.ec2.internal\" not found" May 21 20:38:12.781771 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:12.781741 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-7.ec2.internal\" not found" May 21 20:38:12.783803 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.783778 2556 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-7.ec2.internal"] May 21 20:38:12.783865 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.783854 2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 20:38:12.784806 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.784790 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasSufficientMemory" May 21 20:38:12.784899 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.784818 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasNoDiskPressure" May 21 20:38:12.784899 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.784827 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasSufficientPID" May 21 20:38:12.787161 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.787150 2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 20:38:12.787320 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.787306 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal" May 21 20:38:12.787400 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.787360 2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 20:38:12.787932 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.787916 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasSufficientMemory" May 21 20:38:12.787996 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.787946 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasNoDiskPressure" May 21 20:38:12.787996 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.787918 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasSufficientMemory" May 21 20:38:12.787996 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.787964 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasSufficientPID" May 21 20:38:12.787996 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.787976 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasNoDiskPressure" May 21 20:38:12.787996 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.787989 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasSufficientPID" May 21 20:38:12.790288 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.790271 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-7.ec2.internal" May 21 20:38:12.790342 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.790309 2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 20:38:12.791092 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.791074 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasSufficientMemory" May 21 20:38:12.791156 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.791114 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasNoDiskPressure" May 21 20:38:12.791156 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.791132 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasSufficientPID" May 21 20:38:12.822385 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:12.822334 2556 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-7.ec2.internal\" not found" node="ip-10-0-132-7.ec2.internal" May 21 20:38:12.826909 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:12.826887 2556 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-7.ec2.internal\" not found" node="ip-10-0-132-7.ec2.internal" May 21 20:38:12.877916 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.877875 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6a6d6310ed9f89eb0421916b93d38e57-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal\" (UID: \"6a6d6310ed9f89eb0421916b93d38e57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal" May 21 20:38:12.877916 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.877914 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a6d6310ed9f89eb0421916b93d38e57-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal\" (UID: \"6a6d6310ed9f89eb0421916b93d38e57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal" May 21 20:38:12.878118 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.877934 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0d4dbf022829d1830e4448f0950dd717-config\") pod \"kube-apiserver-proxy-ip-10-0-132-7.ec2.internal\" (UID: \"0d4dbf022829d1830e4448f0950dd717\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-7.ec2.internal" May 21 20:38:12.882215 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:12.882196 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-7.ec2.internal\" not found" May 21 20:38:12.978485 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.978449 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6a6d6310ed9f89eb0421916b93d38e57-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal\" (UID: \"6a6d6310ed9f89eb0421916b93d38e57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal" May 21 20:38:12.978653 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.978488 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a6d6310ed9f89eb0421916b93d38e57-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal\" (UID: \"6a6d6310ed9f89eb0421916b93d38e57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal" May 21 20:38:12.978653 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.978524 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0d4dbf022829d1830e4448f0950dd717-config\") pod \"kube-apiserver-proxy-ip-10-0-132-7.ec2.internal\" (UID: \"0d4dbf022829d1830e4448f0950dd717\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-7.ec2.internal" May 21 20:38:12.978653 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.978559 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6a6d6310ed9f89eb0421916b93d38e57-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal\" (UID: \"6a6d6310ed9f89eb0421916b93d38e57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal" May 21 20:38:12.978653 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.978568 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0d4dbf022829d1830e4448f0950dd717-config\") pod \"kube-apiserver-proxy-ip-10-0-132-7.ec2.internal\" (UID: \"0d4dbf022829d1830e4448f0950dd717\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-7.ec2.internal" May 21 20:38:12.978653 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:12.978589 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a6d6310ed9f89eb0421916b93d38e57-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal\" (UID: \"6a6d6310ed9f89eb0421916b93d38e57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal" May 21 20:38:12.982510 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:12.982487 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-7.ec2.internal\" not found" May 21 20:38:13.083502 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:13.083437 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-7.ec2.internal\" not found" May 21 20:38:13.124699 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:13.124664 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal" May 21 20:38:13.129469 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:13.129442 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-7.ec2.internal" May 21 20:38:13.184385 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:13.184332 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-7.ec2.internal\" not found" May 21 20:38:13.284861 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:13.284835 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-7.ec2.internal\" not found" May 21 20:38:13.385436 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:13.385341 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-7.ec2.internal\" not found" May 21 20:38:13.473610 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:13.473565 2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 20:38:13.474157 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:13.473756 2556 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 20:38:13.486039 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:13.486011 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-7.ec2.internal\" not found" May 21 20:38:13.576066 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:13.576035 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 20:38:13.586149 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:13.586123 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-7.ec2.internal\" not found" May 21 20:38:13.587020 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:13.587002 2556 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 20:38:13.613828 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:13.613798 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gv4wn" May 21 20:38:13.622553 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:13.622526 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gv4wn" May 21 20:38:13.654941 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:13.654900 2556 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 20:38:13.680555 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:13.680506 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 20:33:12 +0000 UTC" deadline="2027-12-27 00:52:16.617647065 +0000 UTC" May 21 20:38:13.680555 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:13.680545 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14020h14m2.937106369s" May 21 20:38:13.686778 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:13.686753 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-7.ec2.internal\" not found" May 21 20:38:13.697205 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:13.697180 2556 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 20:38:13.775973 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:13.775938 2556 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal" May 21 20:38:13.780824 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:13.780786 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a6d6310ed9f89eb0421916b93d38e57.slice/crio-99e50b2ed6a5bdb57160b483780432f0792a470a4da3e48afc1cb392ac89bdef WatchSource:0}: Error finding container 99e50b2ed6a5bdb57160b483780432f0792a470a4da3e48afc1cb392ac89bdef: Status 404 returned error can't find the container with id 99e50b2ed6a5bdb57160b483780432f0792a470a4da3e48afc1cb392ac89bdef May 21 20:38:13.781122 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:13.781102 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d4dbf022829d1830e4448f0950dd717.slice/crio-36884aadcff44c8940b1f9a9fa2d33eae88002f18dac89ec2e5fe0fa0dc1fba0 WatchSource:0}: Error finding container 36884aadcff44c8940b1f9a9fa2d33eae88002f18dac89ec2e5fe0fa0dc1fba0: Status 404 returned error can't find the container with id 36884aadcff44c8940b1f9a9fa2d33eae88002f18dac89ec2e5fe0fa0dc1fba0 May 21 20:38:13.784405 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:13.784387 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 20:38:13.790004 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:13.789985 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 20:38:13.791437 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:13.791422 2556 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-7.ec2.internal" May 21 20:38:13.798792 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:13.798774 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 20:38:14.028775 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.028684 2556 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 20:38:14.445621 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.445542 2556 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 20:38:14.548237 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.548204 2556 apiserver.go:52] "Watching apiserver" May 21 20:38:14.556479 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.556445 2556 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 20:38:14.559439 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.559401 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-n8gtw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal","openshift-multus/multus-6ldcp","openshift-network-operator/iptables-alerter-fpsh2","openshift-ovn-kubernetes/ovnkube-node-v7n7h","openshift-cluster-node-tuning-operator/tuned-bv824","openshift-dns/node-resolver-6p4ps","openshift-multus/multus-additional-cni-plugins-hlljl","openshift-multus/network-metrics-daemon-dgrfc","openshift-network-diagnostics/network-check-target-hr8nm","kube-system/konnectivity-agent-nbcfl","kube-system/kube-apiserver-proxy-ip-10-0-132-7.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldk4c"] May 21 20:38:14.564123 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.564093 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6ldcp" May 21 20:38:14.566719 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.566691 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 20:38:14.566848 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.566738 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.567085 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.567067 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 20:38:14.567409 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.567073 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 20:38:14.567589 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.567413 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gfml6\"" May 21 20:38:14.567589 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.567462 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 20:38:14.568434 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.568412 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 20:38:14.568725 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.568706 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-88bm8\"" May 21 20:38:14.568808 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.568728 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 20:38:14.570603 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.570580 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr8nm" May 21 20:38:14.570692 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.570659 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6p4ps" May 21 20:38:14.570903 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:14.570655 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hr8nm" podUID="fc75acb2-0d8e-462c-98b4-1e8f5a06054d" May 21 20:38:14.573144 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.573126 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 20:38:14.573456 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.573440 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qs6q6\"" May 21 20:38:14.573632 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.573619 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 20:38:14.575069 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.575049 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hlljl" May 21 20:38:14.576940 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.576922 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 20:38:14.577471 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.577451 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrfc" May 21 20:38:14.577560 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:14.577536 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dgrfc" podUID="3bdf9a6b-e989-4794-bbe7-3396ae7ddc07" May 21 20:38:14.577711 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.577688 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qj84r\"" May 21 20:38:14.577838 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.577817 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 20:38:14.579864 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.579747 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n8gtw" May 21 20:38:14.579864 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.579851 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldk4c" May 21 20:38:14.581787 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.581718 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 20:38:14.581959 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.581849 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 20:38:14.582049 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.581971 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7dcsz\"" May 21 20:38:14.582268 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.582147 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 20:38:14.582268 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.582225 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 20:38:14.582598 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.582579 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 20:38:14.582836 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.582800 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jq7r2\"" May 21 20:38:14.583240 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.583080 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 20:38:14.585951 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.585152 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fpsh2" May 21 20:38:14.585951 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.585315 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.587077 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.587052 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f8bece9-7239-4ec3-8778-826a470d2793-lib-modules\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.587155 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.587102 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/84d7fb93-5212-4b3f-a963-296ed4cae5b0-hosts-file\") pod \"node-resolver-6p4ps\" (UID: \"84d7fb93-5212-4b3f-a963-296ed4cae5b0\") " pod="openshift-dns/node-resolver-6p4ps" May 21 20:38:14.587155 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.587132 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl7mv\" (UniqueName: \"kubernetes.io/projected/84d7fb93-5212-4b3f-a963-296ed4cae5b0-kube-api-access-rl7mv\") pod \"node-resolver-6p4ps\" (UID: \"84d7fb93-5212-4b3f-a963-296ed4cae5b0\") " pod="openshift-dns/node-resolver-6p4ps" May 21 20:38:14.587245 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.587157 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0f3e31a1-421b-4147-8fe1-70facdf3c1b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hlljl\" (UID: \"0f3e31a1-421b-4147-8fe1-70facdf3c1b4\") " pod="openshift-multus/multus-additional-cni-plugins-hlljl" May 21 20:38:14.587245 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.587181 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-host-run-netns\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.587245 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.587213 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-host-run-multus-certs\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.587245 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.587238 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q288m\" (UniqueName: \"kubernetes.io/projected/233b9c5d-8fb6-4d7f-a394-6f35c388074e-kube-api-access-q288m\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.587403 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.587264 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3f8bece9-7239-4ec3-8778-826a470d2793-etc-modprobe-d\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.587403 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.587290 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0f3e31a1-421b-4147-8fe1-70facdf3c1b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hlljl\" (UID: \"0f3e31a1-421b-4147-8fe1-70facdf3c1b4\") " pod="openshift-multus/multus-additional-cni-plugins-hlljl" May 21 20:38:14.587403 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.587318 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/233b9c5d-8fb6-4d7f-a394-6f35c388074e-cni-binary-copy\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.587403 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.587342 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-multus-socket-dir-parent\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.587637 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.587413 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f8bece9-7239-4ec3-8778-826a470d2793-etc-kubernetes\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.587637 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.587478 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3f8bece9-7239-4ec3-8778-826a470d2793-run\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.587637 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.587503 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f3e31a1-421b-4147-8fe1-70facdf3c1b4-system-cni-dir\") pod \"multus-additional-cni-plugins-hlljl\" (UID: \"0f3e31a1-421b-4147-8fe1-70facdf3c1b4\") " pod="openshift-multus/multus-additional-cni-plugins-hlljl" May 21 20:38:14.587637 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.587543 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkkbw\" (UniqueName: \"kubernetes.io/projected/0f3e31a1-421b-4147-8fe1-70facdf3c1b4-kube-api-access-zkkbw\") pod \"multus-additional-cni-plugins-hlljl\" (UID: \"0f3e31a1-421b-4147-8fe1-70facdf3c1b4\") " pod="openshift-multus/multus-additional-cni-plugins-hlljl" May 21 20:38:14.587637 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.587578 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-cnibin\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.587637 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.587602 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-host-run-k8s-cni-cncf-io\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.587637 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.587630 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9pgw\" (UniqueName: \"kubernetes.io/projected/3bdf9a6b-e989-4794-bbe7-3396ae7ddc07-kube-api-access-z9pgw\") pod \"network-metrics-daemon-dgrfc\" (UID: \"3bdf9a6b-e989-4794-bbe7-3396ae7ddc07\") " pod="openshift-multus/network-metrics-daemon-dgrfc" May 21 20:38:14.587956 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.587652 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f8bece9-7239-4ec3-8778-826a470d2793-tmp\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.587956 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.587655 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nbcfl" May 21 20:38:14.587956 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.587675 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84d7fb93-5212-4b3f-a963-296ed4cae5b0-tmp-dir\") pod \"node-resolver-6p4ps\" (UID: \"84d7fb93-5212-4b3f-a963-296ed4cae5b0\") " pod="openshift-dns/node-resolver-6p4ps" May 21 20:38:14.587956 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.587688 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 20:38:14.587956 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.587700 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-system-cni-dir\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.587956 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.587725 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-os-release\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.587956 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.587748 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-host-var-lib-cni-multus\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.587956 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.587769 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-hostroot\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.587956 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.587794 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3cef130e-0ffb-400e-ba51-f4947d952456-host\") pod \"node-ca-n8gtw\" (UID: \"3cef130e-0ffb-400e-ba51-f4947d952456\") " pod="openshift-image-registry/node-ca-n8gtw" May 21 20:38:14.587956 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.587838 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-host-var-lib-cni-bin\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.587956 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.587853 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jdphn\"" May 21 20:38:14.587956 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.587864 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/233b9c5d-8fb6-4d7f-a394-6f35c388074e-multus-daemon-config\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.587956 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.587888 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3bdf9a6b-e989-4794-bbe7-3396ae7ddc07-metrics-certs\") pod \"network-metrics-daemon-dgrfc\" (UID: \"3bdf9a6b-e989-4794-bbe7-3396ae7ddc07\") " pod="openshift-multus/network-metrics-daemon-dgrfc" May 21 20:38:14.587956 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.587913 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3f8bece9-7239-4ec3-8778-826a470d2793-etc-sysconfig\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.587956 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.587937 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3f8bece9-7239-4ec3-8778-826a470d2793-etc-sysctl-conf\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.588648 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.587959 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3f8bece9-7239-4ec3-8778-826a470d2793-etc-tuned\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.588648 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.588008 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-q4fz6\"" May 21 20:38:14.588648 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.588004 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0f3e31a1-421b-4147-8fe1-70facdf3c1b4-os-release\") pod \"multus-additional-cni-plugins-hlljl\" (UID: \"0f3e31a1-421b-4147-8fe1-70facdf3c1b4\") " pod="openshift-multus/multus-additional-cni-plugins-hlljl" May 21 20:38:14.588648 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.588048 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0f3e31a1-421b-4147-8fe1-70facdf3c1b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-hlljl\" (UID: \"0f3e31a1-421b-4147-8fe1-70facdf3c1b4\") " pod="openshift-multus/multus-additional-cni-plugins-hlljl" May 21 20:38:14.588648 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.588067 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-multus-cni-dir\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.588648 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.588080 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3f8bece9-7239-4ec3-8778-826a470d2793-etc-sysctl-d\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.588648 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.588096 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f8bece9-7239-4ec3-8778-826a470d2793-host\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.588648 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.588111 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0f3e31a1-421b-4147-8fe1-70facdf3c1b4-cnibin\") pod \"multus-additional-cni-plugins-hlljl\" (UID: \"0f3e31a1-421b-4147-8fe1-70facdf3c1b4\") " pod="openshift-multus/multus-additional-cni-plugins-hlljl" May 21 20:38:14.588648 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.588125 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-host-var-lib-kubelet\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.588648 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.588136 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 20:38:14.588648 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.588140 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-multus-conf-dir\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.588648 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.588173 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-etc-kubernetes\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.588648 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.588191 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m8t5\" (UniqueName: \"kubernetes.io/projected/fc75acb2-0d8e-462c-98b4-1e8f5a06054d-kube-api-access-8m8t5\") pod \"network-check-target-hr8nm\" (UID: \"fc75acb2-0d8e-462c-98b4-1e8f5a06054d\") " pod="openshift-network-diagnostics/network-check-target-hr8nm" May 21 20:38:14.588648 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.588207 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3f8bece9-7239-4ec3-8778-826a470d2793-etc-systemd\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.588648 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.588221 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f8bece9-7239-4ec3-8778-826a470d2793-var-lib-kubelet\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.588648 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.588237 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8g4t\" (UniqueName: \"kubernetes.io/projected/3f8bece9-7239-4ec3-8778-826a470d2793-kube-api-access-l8g4t\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.588648 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.588254 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0f3e31a1-421b-4147-8fe1-70facdf3c1b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hlljl\" (UID: \"0f3e31a1-421b-4147-8fe1-70facdf3c1b4\") " pod="openshift-multus/multus-additional-cni-plugins-hlljl" May 21 20:38:14.589408 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.588268 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3cef130e-0ffb-400e-ba51-f4947d952456-serviceca\") pod \"node-ca-n8gtw\" (UID: \"3cef130e-0ffb-400e-ba51-f4947d952456\") " pod="openshift-image-registry/node-ca-n8gtw" May 21 20:38:14.589408 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.588283 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c8zd\" (UniqueName: \"kubernetes.io/projected/3cef130e-0ffb-400e-ba51-f4947d952456-kube-api-access-8c8zd\") pod \"node-ca-n8gtw\" (UID: \"3cef130e-0ffb-400e-ba51-f4947d952456\") " pod="openshift-image-registry/node-ca-n8gtw" May 21 20:38:14.589408 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.588298 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f8bece9-7239-4ec3-8778-826a470d2793-sys\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.589408 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.588318 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 20:38:14.589408 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.588504 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 20:38:14.589408 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.588690 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 20:38:14.589408 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.588792 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 20:38:14.589408 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.589057 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 20:38:14.589408 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.589091 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 20:38:14.589408 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.588688 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 20:38:14.589408 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.589252 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 20:38:14.589773 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.589698 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9j9ft\"" May 21 20:38:14.589934 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.589918 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 20:38:14.623179 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.623144 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 20:33:13 +0000 UTC" deadline="2027-10-24 01:12:23.77912067 +0000 UTC" May 21 20:38:14.623347 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.623319 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12484h34m9.155807125s" May 21 20:38:14.676290 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.676257 2556 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 20:38:14.687526 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.687464 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-7.ec2.internal" event={"ID":"0d4dbf022829d1830e4448f0950dd717","Type":"ContainerStarted","Data":"36884aadcff44c8940b1f9a9fa2d33eae88002f18dac89ec2e5fe0fa0dc1fba0"} May 21 20:38:14.688504 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.688478 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/233b9c5d-8fb6-4d7f-a394-6f35c388074e-cni-binary-copy\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.688697 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.688512 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f3e31a1-421b-4147-8fe1-70facdf3c1b4-system-cni-dir\") pod \"multus-additional-cni-plugins-hlljl\" (UID: \"0f3e31a1-421b-4147-8fe1-70facdf3c1b4\") " pod="openshift-multus/multus-additional-cni-plugins-hlljl" May 21 20:38:14.688697 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.688540 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-run-ovn\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.688697 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.688562 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2b22953d-24b1-4a5a-9ad2-870f2414a537-ovnkube-config\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.688697 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.688566 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal" event={"ID":"6a6d6310ed9f89eb0421916b93d38e57","Type":"ContainerStarted","Data":"99e50b2ed6a5bdb57160b483780432f0792a470a4da3e48afc1cb392ac89bdef"} May 21 20:38:14.688697 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.688587 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f8bece9-7239-4ec3-8778-826a470d2793-tmp\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.688697 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.688611 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84d7fb93-5212-4b3f-a963-296ed4cae5b0-tmp-dir\") pod \"node-resolver-6p4ps\" (UID: \"84d7fb93-5212-4b3f-a963-296ed4cae5b0\") " pod="openshift-dns/node-resolver-6p4ps" May 21 20:38:14.688697 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.688619 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f3e31a1-421b-4147-8fe1-70facdf3c1b4-system-cni-dir\") pod \"multus-additional-cni-plugins-hlljl\" (UID: \"0f3e31a1-421b-4147-8fe1-70facdf3c1b4\") " pod="openshift-multus/multus-additional-cni-plugins-hlljl" May 21 20:38:14.688697 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.688636 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-system-cni-dir\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.688697 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.688660 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-os-release\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.688697 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.688682 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-host-var-lib-cni-multus\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.689048 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.688709 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0bb2289a-99a2-40ee-9985-ca05ace4e538-registration-dir\") pod \"aws-ebs-csi-driver-node-ldk4c\" (UID: \"0bb2289a-99a2-40ee-9985-ca05ace4e538\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldk4c" May 21 20:38:14.689048 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.688736 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3cef130e-0ffb-400e-ba51-f4947d952456-host\") pod \"node-ca-n8gtw\" (UID: \"3cef130e-0ffb-400e-ba51-f4947d952456\") " pod="openshift-image-registry/node-ca-n8gtw" May 21 20:38:14.689048 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.688761 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/233b9c5d-8fb6-4d7f-a394-6f35c388074e-multus-daemon-config\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.689048 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.688785 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-etc-openvswitch\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.689048 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.688812 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1ae06c65-3e3e-4c07-a621-b12942dd11bf-agent-certs\") pod \"konnectivity-agent-nbcfl\" (UID: \"1ae06c65-3e3e-4c07-a621-b12942dd11bf\") " pod="kube-system/konnectivity-agent-nbcfl" May 21 20:38:14.689048 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.688838 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3f8bece9-7239-4ec3-8778-826a470d2793-etc-sysctl-conf\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.689048 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.688864 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0f3e31a1-421b-4147-8fe1-70facdf3c1b4-os-release\") pod \"multus-additional-cni-plugins-hlljl\" (UID: \"0f3e31a1-421b-4147-8fe1-70facdf3c1b4\") " pod="openshift-multus/multus-additional-cni-plugins-hlljl" May 21 20:38:14.689048 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.688868 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84d7fb93-5212-4b3f-a963-296ed4cae5b0-tmp-dir\") pod \"node-resolver-6p4ps\" (UID: \"84d7fb93-5212-4b3f-a963-296ed4cae5b0\") " pod="openshift-dns/node-resolver-6p4ps" May 21 20:38:14.689048 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.688889 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2b22953d-24b1-4a5a-9ad2-870f2414a537-ovnkube-script-lib\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.689048 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.688915 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3f8bece9-7239-4ec3-8778-826a470d2793-etc-sysctl-d\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.689048 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.688884 2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 20:38:14.689048 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.688950 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-host-var-lib-cni-multus\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.689048 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.688993 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-os-release\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.689427 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.689076 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3f8bece9-7239-4ec3-8778-826a470d2793-etc-sysctl-conf\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.689427 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.689101 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.689427 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.689119 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-host-kubelet\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.689427 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.689155 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0f3e31a1-421b-4147-8fe1-70facdf3c1b4-os-release\") pod \"multus-additional-cni-plugins-hlljl\" (UID: \"0f3e31a1-421b-4147-8fe1-70facdf3c1b4\") " pod="openshift-multus/multus-additional-cni-plugins-hlljl" May 21 20:38:14.689427 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.689153 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3cef130e-0ffb-400e-ba51-f4947d952456-host\") pod \"node-ca-n8gtw\" (UID: \"3cef130e-0ffb-400e-ba51-f4947d952456\") " pod="openshift-image-registry/node-ca-n8gtw" May 21 20:38:14.689427 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.689185 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-run-systemd\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.689427 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.689118 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/233b9c5d-8fb6-4d7f-a394-6f35c388074e-cni-binary-copy\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.689427 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.689244 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3f8bece9-7239-4ec3-8778-826a470d2793-etc-systemd\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.689427 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.689261 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f8bece9-7239-4ec3-8778-826a470d2793-var-lib-kubelet\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.689427 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.689261 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3f8bece9-7239-4ec3-8778-826a470d2793-etc-sysctl-d\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.689427 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.689278 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-system-cni-dir\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.689427 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.689287 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l8g4t\" (UniqueName: \"kubernetes.io/projected/3f8bece9-7239-4ec3-8778-826a470d2793-kube-api-access-l8g4t\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.689427 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.689243 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/233b9c5d-8fb6-4d7f-a394-6f35c388074e-multus-daemon-config\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.689427 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.689323 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3f8bece9-7239-4ec3-8778-826a470d2793-etc-systemd\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.689427 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.689337 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f8bece9-7239-4ec3-8778-826a470d2793-var-lib-kubelet\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.689427 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.689348 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8c8zd\" (UniqueName: \"kubernetes.io/projected/3cef130e-0ffb-400e-ba51-f4947d952456-kube-api-access-8c8zd\") pod \"node-ca-n8gtw\" (UID: \"3cef130e-0ffb-400e-ba51-f4947d952456\") " pod="openshift-image-registry/node-ca-n8gtw" May 21 20:38:14.689427 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.689404 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q288m\" (UniqueName: \"kubernetes.io/projected/233b9c5d-8fb6-4d7f-a394-6f35c388074e-kube-api-access-q288m\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.690094 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.689430 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f8bece9-7239-4ec3-8778-826a470d2793-sys\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.690094 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.689468 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/84d7fb93-5212-4b3f-a963-296ed4cae5b0-hosts-file\") pod \"node-resolver-6p4ps\" (UID: \"84d7fb93-5212-4b3f-a963-296ed4cae5b0\") " pod="openshift-dns/node-resolver-6p4ps" May 21 20:38:14.690094 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.689489 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rl7mv\" (UniqueName: \"kubernetes.io/projected/84d7fb93-5212-4b3f-a963-296ed4cae5b0-kube-api-access-rl7mv\") pod \"node-resolver-6p4ps\" (UID: \"84d7fb93-5212-4b3f-a963-296ed4cae5b0\") " pod="openshift-dns/node-resolver-6p4ps" May 21 20:38:14.690094 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.689512 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0f3e31a1-421b-4147-8fe1-70facdf3c1b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hlljl\" (UID: \"0f3e31a1-421b-4147-8fe1-70facdf3c1b4\") " pod="openshift-multus/multus-additional-cni-plugins-hlljl" May 21 20:38:14.690094 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.689538 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-host-cni-netd\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.690094 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.689582 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f8bece9-7239-4ec3-8778-826a470d2793-sys\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.690094 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.689603 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0bb2289a-99a2-40ee-9985-ca05ace4e538-socket-dir\") pod \"aws-ebs-csi-driver-node-ldk4c\" (UID: \"0bb2289a-99a2-40ee-9985-ca05ace4e538\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldk4c" May 21 20:38:14.690094 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.689616 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/84d7fb93-5212-4b3f-a963-296ed4cae5b0-hosts-file\") pod \"node-resolver-6p4ps\" (UID: \"84d7fb93-5212-4b3f-a963-296ed4cae5b0\") " pod="openshift-dns/node-resolver-6p4ps" May 21 20:38:14.690094 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.689644 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3f8bece9-7239-4ec3-8778-826a470d2793-etc-modprobe-d\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.690094 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.689684 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0f3e31a1-421b-4147-8fe1-70facdf3c1b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hlljl\" (UID: \"0f3e31a1-421b-4147-8fe1-70facdf3c1b4\") " pod="openshift-multus/multus-additional-cni-plugins-hlljl" May 21 20:38:14.690094 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.689718 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-multus-socket-dir-parent\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.690094 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.689759 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-host-slash\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.690094 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.689786 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-run-openvswitch\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.690094 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.689866 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0f3e31a1-421b-4147-8fe1-70facdf3c1b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hlljl\" (UID: \"0f3e31a1-421b-4147-8fe1-70facdf3c1b4\") " pod="openshift-multus/multus-additional-cni-plugins-hlljl" May 21 20:38:14.690094 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.689914 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3f8bece9-7239-4ec3-8778-826a470d2793-etc-modprobe-d\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.690094 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.689914 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-host-cni-bin\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.690094 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.689956 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2840efa6-0ecd-48b1-8372-ecaac60323f6-host-slash\") pod \"iptables-alerter-fpsh2\" (UID: \"2840efa6-0ecd-48b1-8372-ecaac60323f6\") " pod="openshift-network-operator/iptables-alerter-fpsh2" May 21 20:38:14.690848 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.689965 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-multus-socket-dir-parent\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.690848 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.690104 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f8bece9-7239-4ec3-8778-826a470d2793-etc-kubernetes\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.690848 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.690127 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3f8bece9-7239-4ec3-8778-826a470d2793-run\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.690848 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.690166 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zkkbw\" (UniqueName: \"kubernetes.io/projected/0f3e31a1-421b-4147-8fe1-70facdf3c1b4-kube-api-access-zkkbw\") pod \"multus-additional-cni-plugins-hlljl\" (UID: \"0f3e31a1-421b-4147-8fe1-70facdf3c1b4\") " pod="openshift-multus/multus-additional-cni-plugins-hlljl" May 21 20:38:14.690848 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.690186 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-cnibin\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.690848 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.690240 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f8bece9-7239-4ec3-8778-826a470d2793-etc-kubernetes\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.690848 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.690289 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-host-run-k8s-cni-cncf-io\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.690848 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.690413 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3f8bece9-7239-4ec3-8778-826a470d2793-run\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.690848 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.690423 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-cnibin\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.690848 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.690451 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z9pgw\" (UniqueName: \"kubernetes.io/projected/3bdf9a6b-e989-4794-bbe7-3396ae7ddc07-kube-api-access-z9pgw\") pod \"network-metrics-daemon-dgrfc\" (UID: \"3bdf9a6b-e989-4794-bbe7-3396ae7ddc07\") " pod="openshift-multus/network-metrics-daemon-dgrfc" May 21 20:38:14.690848 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.690469 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-host-run-k8s-cni-cncf-io\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.690848 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.690513 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-host-run-ovn-kubernetes\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.690848 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.690545 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-hostroot\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.690848 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.690587 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-hostroot\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.690848 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.690591 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-systemd-units\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.690848 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.690613 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0f3e31a1-421b-4147-8fe1-70facdf3c1b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hlljl\" (UID: \"0f3e31a1-421b-4147-8fe1-70facdf3c1b4\") " pod="openshift-multus/multus-additional-cni-plugins-hlljl" May 21 20:38:14.690848 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.690629 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-log-socket\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.691623 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.690658 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2b22953d-24b1-4a5a-9ad2-870f2414a537-ovn-node-metrics-cert\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.691623 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.690695 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qdg2\" (UniqueName: \"kubernetes.io/projected/2b22953d-24b1-4a5a-9ad2-870f2414a537-kube-api-access-8qdg2\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.691623 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.690719 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6xmd\" (UniqueName: \"kubernetes.io/projected/2840efa6-0ecd-48b1-8372-ecaac60323f6-kube-api-access-m6xmd\") pod \"iptables-alerter-fpsh2\" (UID: \"2840efa6-0ecd-48b1-8372-ecaac60323f6\") " pod="openshift-network-operator/iptables-alerter-fpsh2" May 21 20:38:14.691623 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.690757 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1ae06c65-3e3e-4c07-a621-b12942dd11bf-konnectivity-ca\") pod \"konnectivity-agent-nbcfl\" (UID: \"1ae06c65-3e3e-4c07-a621-b12942dd11bf\") " pod="kube-system/konnectivity-agent-nbcfl" May 21 20:38:14.691623 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.690785 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0bb2289a-99a2-40ee-9985-ca05ace4e538-device-dir\") pod \"aws-ebs-csi-driver-node-ldk4c\" (UID: \"0bb2289a-99a2-40ee-9985-ca05ace4e538\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldk4c" May 21 20:38:14.691623 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.690819 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-host-var-lib-cni-bin\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.691623 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.690845 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3bdf9a6b-e989-4794-bbe7-3396ae7ddc07-metrics-certs\") pod \"network-metrics-daemon-dgrfc\" (UID: \"3bdf9a6b-e989-4794-bbe7-3396ae7ddc07\") " pod="openshift-multus/network-metrics-daemon-dgrfc" May 21 20:38:14.691623 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.690870 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0bb2289a-99a2-40ee-9985-ca05ace4e538-etc-selinux\") pod \"aws-ebs-csi-driver-node-ldk4c\" (UID: \"0bb2289a-99a2-40ee-9985-ca05ace4e538\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldk4c" May 21 20:38:14.691623 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.690897 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3f8bece9-7239-4ec3-8778-826a470d2793-etc-sysconfig\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.691623 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.690906 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-host-var-lib-cni-bin\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.691623 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.690924 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3f8bece9-7239-4ec3-8778-826a470d2793-etc-tuned\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.691623 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:14.690946 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:14.691623 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.690951 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0f3e31a1-421b-4147-8fe1-70facdf3c1b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-hlljl\" (UID: \"0f3e31a1-421b-4147-8fe1-70facdf3c1b4\") " pod="openshift-multus/multus-additional-cni-plugins-hlljl" May 21 20:38:14.691623 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.690959 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3f8bece9-7239-4ec3-8778-826a470d2793-etc-sysconfig\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.691623 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.690978 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-multus-cni-dir\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.691623 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.691059 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-multus-cni-dir\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.691623 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:14.691081 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bdf9a6b-e989-4794-bbe7-3396ae7ddc07-metrics-certs podName:3bdf9a6b-e989-4794-bbe7-3396ae7ddc07 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:15.191003803 +0000 UTC m=+3.121778877 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3bdf9a6b-e989-4794-bbe7-3396ae7ddc07-metrics-certs") pod "network-metrics-daemon-dgrfc" (UID: "3bdf9a6b-e989-4794-bbe7-3396ae7ddc07") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:14.692286 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.691106 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-host-run-netns\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.692286 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.691137 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0bb2289a-99a2-40ee-9985-ca05ace4e538-sys-fs\") pod \"aws-ebs-csi-driver-node-ldk4c\" (UID: \"0bb2289a-99a2-40ee-9985-ca05ace4e538\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldk4c" May 21 20:38:14.692286 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.691163 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f8bece9-7239-4ec3-8778-826a470d2793-host\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.692286 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.691187 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0f3e31a1-421b-4147-8fe1-70facdf3c1b4-cnibin\") pod \"multus-additional-cni-plugins-hlljl\" (UID: \"0f3e31a1-421b-4147-8fe1-70facdf3c1b4\") " pod="openshift-multus/multus-additional-cni-plugins-hlljl" May 21 20:38:14.692286 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.691217 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-host-var-lib-kubelet\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.692286 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.691242 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-multus-conf-dir\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.692286 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.691264 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-etc-kubernetes\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.692286 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.691285 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f8bece9-7239-4ec3-8778-826a470d2793-host\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.692286 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.691303 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-var-lib-openvswitch\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.692286 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.691313 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-etc-kubernetes\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.692286 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.691335 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-multus-conf-dir\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.692286 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.691338 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2840efa6-0ecd-48b1-8372-ecaac60323f6-iptables-alerter-script\") pod \"iptables-alerter-fpsh2\" (UID: \"2840efa6-0ecd-48b1-8372-ecaac60323f6\") " pod="openshift-network-operator/iptables-alerter-fpsh2" May 21 20:38:14.692286 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.691361 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-host-var-lib-kubelet\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.692286 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.691399 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0bb2289a-99a2-40ee-9985-ca05ace4e538-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ldk4c\" (UID: \"0bb2289a-99a2-40ee-9985-ca05ace4e538\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldk4c" May 21 20:38:14.692286 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.691420 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0f3e31a1-421b-4147-8fe1-70facdf3c1b4-cnibin\") pod \"multus-additional-cni-plugins-hlljl\" (UID: \"0f3e31a1-421b-4147-8fe1-70facdf3c1b4\") " pod="openshift-multus/multus-additional-cni-plugins-hlljl" May 21 20:38:14.692286 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.691418 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0f3e31a1-421b-4147-8fe1-70facdf3c1b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-hlljl\" (UID: \"0f3e31a1-421b-4147-8fe1-70facdf3c1b4\") " pod="openshift-multus/multus-additional-cni-plugins-hlljl" May 21 20:38:14.692286 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.691431 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8m8t5\" (UniqueName: \"kubernetes.io/projected/fc75acb2-0d8e-462c-98b4-1e8f5a06054d-kube-api-access-8m8t5\") pod \"network-check-target-hr8nm\" (UID: \"fc75acb2-0d8e-462c-98b4-1e8f5a06054d\") " pod="openshift-network-diagnostics/network-check-target-hr8nm" May 21 20:38:14.692954 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.691473 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0f3e31a1-421b-4147-8fe1-70facdf3c1b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hlljl\" (UID: \"0f3e31a1-421b-4147-8fe1-70facdf3c1b4\") " pod="openshift-multus/multus-additional-cni-plugins-hlljl" May 21 20:38:14.692954 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.691499 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3cef130e-0ffb-400e-ba51-f4947d952456-serviceca\") pod \"node-ca-n8gtw\" (UID: \"3cef130e-0ffb-400e-ba51-f4947d952456\") " pod="openshift-image-registry/node-ca-n8gtw" May 21 20:38:14.692954 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.691522 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-host-run-netns\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.692954 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.691545 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-host-run-multus-certs\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.692954 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.691584 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-host-run-netns\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.692954 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.691642 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/233b9c5d-8fb6-4d7f-a394-6f35c388074e-host-run-multus-certs\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.692954 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.691675 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-node-log\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.692954 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.691702 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2b22953d-24b1-4a5a-9ad2-870f2414a537-env-overrides\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.692954 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.691729 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dschd\" (UniqueName: \"kubernetes.io/projected/0bb2289a-99a2-40ee-9985-ca05ace4e538-kube-api-access-dschd\") pod \"aws-ebs-csi-driver-node-ldk4c\" (UID: \"0bb2289a-99a2-40ee-9985-ca05ace4e538\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldk4c" May 21 20:38:14.692954 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.691756 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f8bece9-7239-4ec3-8778-826a470d2793-lib-modules\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.692954 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.691907 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f8bece9-7239-4ec3-8778-826a470d2793-lib-modules\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.692954 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.691934 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3cef130e-0ffb-400e-ba51-f4947d952456-serviceca\") pod \"node-ca-n8gtw\" (UID: \"3cef130e-0ffb-400e-ba51-f4947d952456\") " pod="openshift-image-registry/node-ca-n8gtw" May 21 20:38:14.692954 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.691962 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0f3e31a1-421b-4147-8fe1-70facdf3c1b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hlljl\" (UID: \"0f3e31a1-421b-4147-8fe1-70facdf3c1b4\") " pod="openshift-multus/multus-additional-cni-plugins-hlljl" May 21 20:38:14.693554 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.693000 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f8bece9-7239-4ec3-8778-826a470d2793-tmp\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.693928 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.693906 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3f8bece9-7239-4ec3-8778-826a470d2793-etc-tuned\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.698102 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.698049 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl7mv\" (UniqueName: \"kubernetes.io/projected/84d7fb93-5212-4b3f-a963-296ed4cae5b0-kube-api-access-rl7mv\") pod \"node-resolver-6p4ps\" (UID: \"84d7fb93-5212-4b3f-a963-296ed4cae5b0\") " pod="openshift-dns/node-resolver-6p4ps" May 21 20:38:14.698244 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:14.698226 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 20:38:14.698301 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:14.698252 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 20:38:14.698301 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:14.698265 2556 projected.go:194] Error preparing data for projected volume kube-api-access-8m8t5 for pod openshift-network-diagnostics/network-check-target-hr8nm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:14.698506 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:14.698331 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc75acb2-0d8e-462c-98b4-1e8f5a06054d-kube-api-access-8m8t5 podName:fc75acb2-0d8e-462c-98b4-1e8f5a06054d nodeName:}" failed. No retries permitted until 2026-05-21 20:38:15.198313889 +0000 UTC m=+3.129088964 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8m8t5" (UniqueName: "kubernetes.io/projected/fc75acb2-0d8e-462c-98b4-1e8f5a06054d-kube-api-access-8m8t5") pod "network-check-target-hr8nm" (UID: "fc75acb2-0d8e-462c-98b4-1e8f5a06054d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:14.700056 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.700031 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8g4t\" (UniqueName: \"kubernetes.io/projected/3f8bece9-7239-4ec3-8778-826a470d2793-kube-api-access-l8g4t\") pod \"tuned-bv824\" (UID: \"3f8bece9-7239-4ec3-8778-826a470d2793\") " pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.700851 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.700830 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c8zd\" (UniqueName: \"kubernetes.io/projected/3cef130e-0ffb-400e-ba51-f4947d952456-kube-api-access-8c8zd\") pod \"node-ca-n8gtw\" (UID: \"3cef130e-0ffb-400e-ba51-f4947d952456\") " pod="openshift-image-registry/node-ca-n8gtw" May 21 20:38:14.700974 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.700913 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkkbw\" (UniqueName: \"kubernetes.io/projected/0f3e31a1-421b-4147-8fe1-70facdf3c1b4-kube-api-access-zkkbw\") pod \"multus-additional-cni-plugins-hlljl\" (UID: \"0f3e31a1-421b-4147-8fe1-70facdf3c1b4\") " pod="openshift-multus/multus-additional-cni-plugins-hlljl" May 21 20:38:14.701071 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.701050 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9pgw\" (UniqueName: \"kubernetes.io/projected/3bdf9a6b-e989-4794-bbe7-3396ae7ddc07-kube-api-access-z9pgw\") pod \"network-metrics-daemon-dgrfc\" (UID: \"3bdf9a6b-e989-4794-bbe7-3396ae7ddc07\") " pod="openshift-multus/network-metrics-daemon-dgrfc" May 21 20:38:14.701665 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.701641 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q288m\" (UniqueName: \"kubernetes.io/projected/233b9c5d-8fb6-4d7f-a394-6f35c388074e-kube-api-access-q288m\") pod \"multus-6ldcp\" (UID: \"233b9c5d-8fb6-4d7f-a394-6f35c388074e\") " pod="openshift-multus/multus-6ldcp" May 21 20:38:14.792473 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.792429 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.792655 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.792483 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-host-kubelet\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.792655 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.792507 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-run-systemd\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.792655 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.792537 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-host-cni-netd\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.792655 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.792557 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0bb2289a-99a2-40ee-9985-ca05ace4e538-socket-dir\") pod \"aws-ebs-csi-driver-node-ldk4c\" (UID: \"0bb2289a-99a2-40ee-9985-ca05ace4e538\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldk4c" May 21 20:38:14.792655 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.792561 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.792655 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.792583 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-host-slash\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.792655 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.792592 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-run-systemd\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.792655 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.792562 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-host-kubelet\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.792655 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.792628 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-run-openvswitch\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.792655 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.792643 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-host-cni-netd\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.793128 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.792656 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-host-cni-bin\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.793128 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.792685 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-host-cni-bin\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.793128 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.792714 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2840efa6-0ecd-48b1-8372-ecaac60323f6-host-slash\") pod \"iptables-alerter-fpsh2\" (UID: \"2840efa6-0ecd-48b1-8372-ecaac60323f6\") " pod="openshift-network-operator/iptables-alerter-fpsh2" May 21 20:38:14.793128 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.792720 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-host-slash\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.793128 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.792727 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0bb2289a-99a2-40ee-9985-ca05ace4e538-socket-dir\") pod \"aws-ebs-csi-driver-node-ldk4c\" (UID: \"0bb2289a-99a2-40ee-9985-ca05ace4e538\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldk4c" May 21 20:38:14.793128 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.792722 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-run-openvswitch\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.793128 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.792752 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-host-run-ovn-kubernetes\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.793128 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.792779 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-systemd-units\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.793128 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.792801 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-host-run-ovn-kubernetes\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.793128 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.792794 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2840efa6-0ecd-48b1-8372-ecaac60323f6-host-slash\") pod \"iptables-alerter-fpsh2\" (UID: \"2840efa6-0ecd-48b1-8372-ecaac60323f6\") " pod="openshift-network-operator/iptables-alerter-fpsh2" May 21 20:38:14.793128 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.792804 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-log-socket\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.793128 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.792831 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-systemd-units\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.793128 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.792846 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-log-socket\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.793128 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.792858 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2b22953d-24b1-4a5a-9ad2-870f2414a537-ovn-node-metrics-cert\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.793128 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.792886 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8qdg2\" (UniqueName: \"kubernetes.io/projected/2b22953d-24b1-4a5a-9ad2-870f2414a537-kube-api-access-8qdg2\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.793128 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.792912 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m6xmd\" (UniqueName: \"kubernetes.io/projected/2840efa6-0ecd-48b1-8372-ecaac60323f6-kube-api-access-m6xmd\") pod \"iptables-alerter-fpsh2\" (UID: \"2840efa6-0ecd-48b1-8372-ecaac60323f6\") " pod="openshift-network-operator/iptables-alerter-fpsh2" May 21 20:38:14.793128 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.792939 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1ae06c65-3e3e-4c07-a621-b12942dd11bf-konnectivity-ca\") pod \"konnectivity-agent-nbcfl\" (UID: \"1ae06c65-3e3e-4c07-a621-b12942dd11bf\") " pod="kube-system/konnectivity-agent-nbcfl" May 21 20:38:14.793972 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.793067 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0bb2289a-99a2-40ee-9985-ca05ace4e538-device-dir\") pod \"aws-ebs-csi-driver-node-ldk4c\" (UID: \"0bb2289a-99a2-40ee-9985-ca05ace4e538\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldk4c" May 21 20:38:14.793972 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.793111 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0bb2289a-99a2-40ee-9985-ca05ace4e538-etc-selinux\") pod \"aws-ebs-csi-driver-node-ldk4c\" (UID: \"0bb2289a-99a2-40ee-9985-ca05ace4e538\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldk4c" May 21 20:38:14.793972 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.793136 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-host-run-netns\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.793972 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.793161 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0bb2289a-99a2-40ee-9985-ca05ace4e538-sys-fs\") pod \"aws-ebs-csi-driver-node-ldk4c\" (UID: \"0bb2289a-99a2-40ee-9985-ca05ace4e538\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldk4c" May 21 20:38:14.793972 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.793192 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-var-lib-openvswitch\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.793972 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.793216 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2840efa6-0ecd-48b1-8372-ecaac60323f6-iptables-alerter-script\") pod \"iptables-alerter-fpsh2\" (UID: \"2840efa6-0ecd-48b1-8372-ecaac60323f6\") " pod="openshift-network-operator/iptables-alerter-fpsh2" May 21 20:38:14.793972 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.793239 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0bb2289a-99a2-40ee-9985-ca05ace4e538-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ldk4c\" (UID: \"0bb2289a-99a2-40ee-9985-ca05ace4e538\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldk4c" May 21 20:38:14.793972 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.793279 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-node-log\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.793972 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.793298 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2b22953d-24b1-4a5a-9ad2-870f2414a537-env-overrides\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.793972 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.793322 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dschd\" (UniqueName: \"kubernetes.io/projected/0bb2289a-99a2-40ee-9985-ca05ace4e538-kube-api-access-dschd\") pod \"aws-ebs-csi-driver-node-ldk4c\" (UID: \"0bb2289a-99a2-40ee-9985-ca05ace4e538\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldk4c" May 21 20:38:14.793972 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.793346 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0bb2289a-99a2-40ee-9985-ca05ace4e538-sys-fs\") pod \"aws-ebs-csi-driver-node-ldk4c\" (UID: \"0bb2289a-99a2-40ee-9985-ca05ace4e538\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldk4c" May 21 20:38:14.793972 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.793356 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-run-ovn\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.793972 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.793409 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-run-ovn\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.793972 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.793405 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2b22953d-24b1-4a5a-9ad2-870f2414a537-ovnkube-config\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.793972 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.793430 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0bb2289a-99a2-40ee-9985-ca05ace4e538-etc-selinux\") pod \"aws-ebs-csi-driver-node-ldk4c\" (UID: \"0bb2289a-99a2-40ee-9985-ca05ace4e538\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldk4c" May 21 20:38:14.793972 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.793454 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-var-lib-openvswitch\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.793972 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.793455 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0bb2289a-99a2-40ee-9985-ca05ace4e538-registration-dir\") pod \"aws-ebs-csi-driver-node-ldk4c\" (UID: \"0bb2289a-99a2-40ee-9985-ca05ace4e538\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldk4c" May 21 20:38:14.794623 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.793481 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0bb2289a-99a2-40ee-9985-ca05ace4e538-device-dir\") pod \"aws-ebs-csi-driver-node-ldk4c\" (UID: \"0bb2289a-99a2-40ee-9985-ca05ace4e538\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldk4c" May 21 20:38:14.794623 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.793492 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-etc-openvswitch\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.794623 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.793493 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1ae06c65-3e3e-4c07-a621-b12942dd11bf-konnectivity-ca\") pod \"konnectivity-agent-nbcfl\" (UID: \"1ae06c65-3e3e-4c07-a621-b12942dd11bf\") " pod="kube-system/konnectivity-agent-nbcfl" May 21 20:38:14.794623 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.793517 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-host-run-netns\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.794623 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.793524 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1ae06c65-3e3e-4c07-a621-b12942dd11bf-agent-certs\") pod \"konnectivity-agent-nbcfl\" (UID: \"1ae06c65-3e3e-4c07-a621-b12942dd11bf\") " pod="kube-system/konnectivity-agent-nbcfl" May 21 20:38:14.794623 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.793551 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2b22953d-24b1-4a5a-9ad2-870f2414a537-ovnkube-script-lib\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.794623 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.793567 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-node-log\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.794623 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.793610 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2b22953d-24b1-4a5a-9ad2-870f2414a537-etc-openvswitch\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.794623 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.793494 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0bb2289a-99a2-40ee-9985-ca05ace4e538-registration-dir\") pod \"aws-ebs-csi-driver-node-ldk4c\" (UID: \"0bb2289a-99a2-40ee-9985-ca05ace4e538\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldk4c" May 21 20:38:14.794623 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.793863 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0bb2289a-99a2-40ee-9985-ca05ace4e538-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ldk4c\" (UID: \"0bb2289a-99a2-40ee-9985-ca05ace4e538\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldk4c" May 21 20:38:14.794623 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.794022 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2840efa6-0ecd-48b1-8372-ecaac60323f6-iptables-alerter-script\") pod \"iptables-alerter-fpsh2\" (UID: \"2840efa6-0ecd-48b1-8372-ecaac60323f6\") " pod="openshift-network-operator/iptables-alerter-fpsh2" May 21 20:38:14.794623 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.794080 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2b22953d-24b1-4a5a-9ad2-870f2414a537-ovnkube-config\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.795048 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.794633 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2b22953d-24b1-4a5a-9ad2-870f2414a537-ovnkube-script-lib\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.795048 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.794922 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2b22953d-24b1-4a5a-9ad2-870f2414a537-env-overrides\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.795965 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.795933 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2b22953d-24b1-4a5a-9ad2-870f2414a537-ovn-node-metrics-cert\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.796299 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.796284 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1ae06c65-3e3e-4c07-a621-b12942dd11bf-agent-certs\") pod \"konnectivity-agent-nbcfl\" (UID: \"1ae06c65-3e3e-4c07-a621-b12942dd11bf\") " pod="kube-system/konnectivity-agent-nbcfl" May 21 20:38:14.803436 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.803410 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dschd\" (UniqueName: \"kubernetes.io/projected/0bb2289a-99a2-40ee-9985-ca05ace4e538-kube-api-access-dschd\") pod \"aws-ebs-csi-driver-node-ldk4c\" (UID: \"0bb2289a-99a2-40ee-9985-ca05ace4e538\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldk4c" May 21 20:38:14.803608 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.803583 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qdg2\" (UniqueName: \"kubernetes.io/projected/2b22953d-24b1-4a5a-9ad2-870f2414a537-kube-api-access-8qdg2\") pod \"ovnkube-node-v7n7h\" (UID: \"2b22953d-24b1-4a5a-9ad2-870f2414a537\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.803729 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.803634 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6xmd\" (UniqueName: \"kubernetes.io/projected/2840efa6-0ecd-48b1-8372-ecaac60323f6-kube-api-access-m6xmd\") pod \"iptables-alerter-fpsh2\" (UID: \"2840efa6-0ecd-48b1-8372-ecaac60323f6\") " pod="openshift-network-operator/iptables-alerter-fpsh2" May 21 20:38:14.876910 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.876871 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6ldcp" May 21 20:38:14.886875 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.886834 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bv824" May 21 20:38:14.896870 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.896840 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6p4ps" May 21 20:38:14.902910 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.902583 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hlljl" May 21 20:38:14.913295 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.913263 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldk4c" May 21 20:38:14.923023 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.922995 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n8gtw" May 21 20:38:14.929635 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.929607 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fpsh2" May 21 20:38:14.935318 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.935299 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:14.941022 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:14.940997 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nbcfl" May 21 20:38:15.197389 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:15.197273 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3bdf9a6b-e989-4794-bbe7-3396ae7ddc07-metrics-certs\") pod \"network-metrics-daemon-dgrfc\" (UID: \"3bdf9a6b-e989-4794-bbe7-3396ae7ddc07\") " pod="openshift-multus/network-metrics-daemon-dgrfc" May 21 20:38:15.197532 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:15.197464 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:15.197593 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:15.197559 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bdf9a6b-e989-4794-bbe7-3396ae7ddc07-metrics-certs podName:3bdf9a6b-e989-4794-bbe7-3396ae7ddc07 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:16.197534702 +0000 UTC m=+4.128309776 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3bdf9a6b-e989-4794-bbe7-3396ae7ddc07-metrics-certs") pod "network-metrics-daemon-dgrfc" (UID: "3bdf9a6b-e989-4794-bbe7-3396ae7ddc07") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:15.297909 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:15.297872 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8m8t5\" (UniqueName: \"kubernetes.io/projected/fc75acb2-0d8e-462c-98b4-1e8f5a06054d-kube-api-access-8m8t5\") pod \"network-check-target-hr8nm\" (UID: \"fc75acb2-0d8e-462c-98b4-1e8f5a06054d\") " pod="openshift-network-diagnostics/network-check-target-hr8nm" May 21 20:38:15.298087 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:15.298005 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 20:38:15.298087 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:15.298027 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 20:38:15.298087 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:15.298040 2556 projected.go:194] Error preparing data for projected volume kube-api-access-8m8t5 for pod openshift-network-diagnostics/network-check-target-hr8nm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:15.298197 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:15.298108 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc75acb2-0d8e-462c-98b4-1e8f5a06054d-kube-api-access-8m8t5 podName:fc75acb2-0d8e-462c-98b4-1e8f5a06054d nodeName:}" failed. No retries permitted until 2026-05-21 20:38:16.298088896 +0000 UTC m=+4.228863958 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8m8t5" (UniqueName: "kubernetes.io/projected/fc75acb2-0d8e-462c-98b4-1e8f5a06054d-kube-api-access-8m8t5") pod "network-check-target-hr8nm" (UID: "fc75acb2-0d8e-462c-98b4-1e8f5a06054d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:15.438518 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:15.438315 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cef130e_0ffb_400e_ba51_f4947d952456.slice/crio-2b45c13610f7f6a9f9a71aa0b50df97b5dd33c5ba3b54e68cb0c9d5b31b4b65d WatchSource:0}: Error finding container 2b45c13610f7f6a9f9a71aa0b50df97b5dd33c5ba3b54e68cb0c9d5b31b4b65d: Status 404 returned error can't find the container with id 2b45c13610f7f6a9f9a71aa0b50df97b5dd33c5ba3b54e68cb0c9d5b31b4b65d May 21 20:38:15.442935 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:15.442870 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2840efa6_0ecd_48b1_8372_ecaac60323f6.slice/crio-053143d8c5981b26b7570cbdd4cf6ae9e5437e88d935def1dffd25f7b1007fd6 WatchSource:0}: Error finding container 053143d8c5981b26b7570cbdd4cf6ae9e5437e88d935def1dffd25f7b1007fd6: Status 404 returned error can't find the container with id 053143d8c5981b26b7570cbdd4cf6ae9e5437e88d935def1dffd25f7b1007fd6 May 21 20:38:15.443657 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:15.443632 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bb2289a_99a2_40ee_9985_ca05ace4e538.slice/crio-accb6367ac551355bc9933830c37d2363595dc80c4c20daaf2e9183c4c534119 WatchSource:0}: Error finding container accb6367ac551355bc9933830c37d2363595dc80c4c20daaf2e9183c4c534119: Status 404 returned error can't find the container with id accb6367ac551355bc9933830c37d2363595dc80c4c20daaf2e9183c4c534119 May 21 20:38:15.444501 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:15.444477 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b22953d_24b1_4a5a_9ad2_870f2414a537.slice/crio-0be79a846ff1abec1687063fff3122143f9c5fc502ecd19433d70cdb28a0e9ed WatchSource:0}: Error finding container 0be79a846ff1abec1687063fff3122143f9c5fc502ecd19433d70cdb28a0e9ed: Status 404 returned error can't find the container with id 0be79a846ff1abec1687063fff3122143f9c5fc502ecd19433d70cdb28a0e9ed May 21 20:38:15.623981 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:15.623943 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 20:33:13 +0000 UTC" deadline="2027-11-13 00:08:52.709730964 +0000 UTC" May 21 20:38:15.623981 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:15.623974 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12963h30m37.085759639s" May 21 20:38:15.692419 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:15.692359 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" event={"ID":"2b22953d-24b1-4a5a-9ad2-870f2414a537","Type":"ContainerStarted","Data":"0be79a846ff1abec1687063fff3122143f9c5fc502ecd19433d70cdb28a0e9ed"} May 21 20:38:15.693523 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:15.693495 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldk4c" event={"ID":"0bb2289a-99a2-40ee-9985-ca05ace4e538","Type":"ContainerStarted","Data":"accb6367ac551355bc9933830c37d2363595dc80c4c20daaf2e9183c4c534119"} May 21 20:38:15.694423 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:15.694402 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n8gtw" event={"ID":"3cef130e-0ffb-400e-ba51-f4947d952456","Type":"ContainerStarted","Data":"2b45c13610f7f6a9f9a71aa0b50df97b5dd33c5ba3b54e68cb0c9d5b31b4b65d"} May 21 20:38:15.696114 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:15.696083 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-7.ec2.internal" event={"ID":"0d4dbf022829d1830e4448f0950dd717","Type":"ContainerStarted","Data":"a5995e28e97f142e436e1708a7be174436c0fea031eb4602cbac0bb4aa963ff5"} May 21 20:38:15.697138 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:15.697120 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hlljl" event={"ID":"0f3e31a1-421b-4147-8fe1-70facdf3c1b4","Type":"ContainerStarted","Data":"18fa4862a6f9832fece0a301f05eab96892f578668ad3c7d57f3940c3d43f98f"} May 21 20:38:15.698281 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:15.698163 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bv824" event={"ID":"3f8bece9-7239-4ec3-8778-826a470d2793","Type":"ContainerStarted","Data":"8bbcb0762125ac6079d9dd7aee7e6ff0917014c93894d0d4a0696199987f9f6e"} May 21 20:38:15.699199 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:15.699170 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fpsh2" event={"ID":"2840efa6-0ecd-48b1-8372-ecaac60323f6","Type":"ContainerStarted","Data":"053143d8c5981b26b7570cbdd4cf6ae9e5437e88d935def1dffd25f7b1007fd6"} May 21 20:38:15.700231 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:15.700211 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nbcfl" event={"ID":"1ae06c65-3e3e-4c07-a621-b12942dd11bf","Type":"ContainerStarted","Data":"a97e2d303d184f84faf1326b283de3f52f123f3e58351cde7dd6a21ec0a22a73"} May 21 20:38:15.701400 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:15.701358 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6p4ps" event={"ID":"84d7fb93-5212-4b3f-a963-296ed4cae5b0","Type":"ContainerStarted","Data":"97f7861ba9300a1cb58ce41e8b6b2af40563814aa51731dc01f2ee48243c630c"} May 21 20:38:15.702356 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:15.702334 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6ldcp" event={"ID":"233b9c5d-8fb6-4d7f-a394-6f35c388074e","Type":"ContainerStarted","Data":"6bab19381799870cc243f23d76dee3002221c18df228c0642edacac6f319c9cb"} May 21 20:38:15.708764 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:15.708725 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-7.ec2.internal" podStartSLOduration=2.708713419 podStartE2EDuration="2.708713419s" podCreationTimestamp="2026-05-21 20:38:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 20:38:15.708413779 +0000 UTC m=+3.639188861" watchObservedRunningTime="2026-05-21 20:38:15.708713419 +0000 UTC m=+3.639488498" May 21 20:38:16.206548 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:16.206330 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3bdf9a6b-e989-4794-bbe7-3396ae7ddc07-metrics-certs\") pod \"network-metrics-daemon-dgrfc\" (UID: \"3bdf9a6b-e989-4794-bbe7-3396ae7ddc07\") " pod="openshift-multus/network-metrics-daemon-dgrfc" May 21 20:38:16.206548 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:16.206512 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:16.206800 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:16.206601 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bdf9a6b-e989-4794-bbe7-3396ae7ddc07-metrics-certs podName:3bdf9a6b-e989-4794-bbe7-3396ae7ddc07 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:18.206581078 +0000 UTC m=+6.137356140 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3bdf9a6b-e989-4794-bbe7-3396ae7ddc07-metrics-certs") pod "network-metrics-daemon-dgrfc" (UID: "3bdf9a6b-e989-4794-bbe7-3396ae7ddc07") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:16.307457 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:16.307292 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8m8t5\" (UniqueName: \"kubernetes.io/projected/fc75acb2-0d8e-462c-98b4-1e8f5a06054d-kube-api-access-8m8t5\") pod \"network-check-target-hr8nm\" (UID: \"fc75acb2-0d8e-462c-98b4-1e8f5a06054d\") " pod="openshift-network-diagnostics/network-check-target-hr8nm" May 21 20:38:16.307642 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:16.307474 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 20:38:16.307642 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:16.307495 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 20:38:16.307642 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:16.307508 2556 projected.go:194] Error preparing data for projected volume kube-api-access-8m8t5 for pod openshift-network-diagnostics/network-check-target-hr8nm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:16.307642 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:16.307571 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc75acb2-0d8e-462c-98b4-1e8f5a06054d-kube-api-access-8m8t5 podName:fc75acb2-0d8e-462c-98b4-1e8f5a06054d nodeName:}" failed. No retries permitted until 2026-05-21 20:38:18.307552301 +0000 UTC m=+6.238327375 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8m8t5" (UniqueName: "kubernetes.io/projected/fc75acb2-0d8e-462c-98b4-1e8f5a06054d-kube-api-access-8m8t5") pod "network-check-target-hr8nm" (UID: "fc75acb2-0d8e-462c-98b4-1e8f5a06054d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:16.686004 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:16.685965 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrfc" May 21 20:38:16.686480 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:16.686126 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dgrfc" podUID="3bdf9a6b-e989-4794-bbe7-3396ae7ddc07" May 21 20:38:16.686759 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:16.686708 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr8nm" May 21 20:38:16.686885 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:16.686862 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hr8nm" podUID="fc75acb2-0d8e-462c-98b4-1e8f5a06054d" May 21 20:38:16.740676 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:16.740625 2556 generic.go:358] "Generic (PLEG): container finished" podID="6a6d6310ed9f89eb0421916b93d38e57" containerID="ba7a50a38f904ed0e16d3bc831831b98d049235000e2d51cc66ee8208377a1ae" exitCode=0 May 21 20:38:16.741489 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:16.741169 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal" event={"ID":"6a6d6310ed9f89eb0421916b93d38e57","Type":"ContainerDied","Data":"ba7a50a38f904ed0e16d3bc831831b98d049235000e2d51cc66ee8208377a1ae"} May 21 20:38:17.749501 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:17.749465 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal" event={"ID":"6a6d6310ed9f89eb0421916b93d38e57","Type":"ContainerStarted","Data":"5fe1d60397e59b81844e0abb6fe4ae952c706e644e1076788cfe7703eec301b9"} May 21 20:38:17.766325 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:17.765845 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal" podStartSLOduration=4.765823423 podStartE2EDuration="4.765823423s" podCreationTimestamp="2026-05-21 20:38:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 20:38:17.765292097 +0000 UTC m=+5.696067181" watchObservedRunningTime="2026-05-21 20:38:17.765823423 +0000 UTC m=+5.696598509" May 21 20:38:18.228756 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:18.228663 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3bdf9a6b-e989-4794-bbe7-3396ae7ddc07-metrics-certs\") pod \"network-metrics-daemon-dgrfc\" (UID: \"3bdf9a6b-e989-4794-bbe7-3396ae7ddc07\") " pod="openshift-multus/network-metrics-daemon-dgrfc" May 21 20:38:18.228916 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:18.228846 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:18.229034 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:18.228917 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bdf9a6b-e989-4794-bbe7-3396ae7ddc07-metrics-certs podName:3bdf9a6b-e989-4794-bbe7-3396ae7ddc07 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:22.228895331 +0000 UTC m=+10.159670399 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3bdf9a6b-e989-4794-bbe7-3396ae7ddc07-metrics-certs") pod "network-metrics-daemon-dgrfc" (UID: "3bdf9a6b-e989-4794-bbe7-3396ae7ddc07") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:18.329456 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:18.329414 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8m8t5\" (UniqueName: \"kubernetes.io/projected/fc75acb2-0d8e-462c-98b4-1e8f5a06054d-kube-api-access-8m8t5\") pod \"network-check-target-hr8nm\" (UID: \"fc75acb2-0d8e-462c-98b4-1e8f5a06054d\") " pod="openshift-network-diagnostics/network-check-target-hr8nm" May 21 20:38:18.329630 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:18.329593 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 20:38:18.329630 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:18.329614 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 20:38:18.329630 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:18.329627 2556 projected.go:194] Error preparing data for projected volume kube-api-access-8m8t5 for pod openshift-network-diagnostics/network-check-target-hr8nm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:18.329739 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:18.329686 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc75acb2-0d8e-462c-98b4-1e8f5a06054d-kube-api-access-8m8t5 podName:fc75acb2-0d8e-462c-98b4-1e8f5a06054d nodeName:}" failed. No retries permitted until 2026-05-21 20:38:22.329667324 +0000 UTC m=+10.260442400 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8m8t5" (UniqueName: "kubernetes.io/projected/fc75acb2-0d8e-462c-98b4-1e8f5a06054d-kube-api-access-8m8t5") pod "network-check-target-hr8nm" (UID: "fc75acb2-0d8e-462c-98b4-1e8f5a06054d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:18.685653 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:18.685565 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr8nm" May 21 20:38:18.685822 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:18.685695 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hr8nm" podUID="fc75acb2-0d8e-462c-98b4-1e8f5a06054d" May 21 20:38:18.686043 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:18.686022 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrfc" May 21 20:38:18.686166 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:18.686142 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dgrfc" podUID="3bdf9a6b-e989-4794-bbe7-3396ae7ddc07" May 21 20:38:20.481600 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:20.480773 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-wvzdl"] May 21 20:38:20.485597 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:20.485128 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvzdl" May 21 20:38:20.485597 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:20.485216 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvzdl" podUID="4615b277-5db1-4fdc-a5f8-42b00145b04c" May 21 20:38:20.548499 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:20.548291 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4615b277-5db1-4fdc-a5f8-42b00145b04c-dbus\") pod \"global-pull-secret-syncer-wvzdl\" (UID: \"4615b277-5db1-4fdc-a5f8-42b00145b04c\") " pod="kube-system/global-pull-secret-syncer-wvzdl" May 21 20:38:20.548499 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:20.548342 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4615b277-5db1-4fdc-a5f8-42b00145b04c-kubelet-config\") pod \"global-pull-secret-syncer-wvzdl\" (UID: \"4615b277-5db1-4fdc-a5f8-42b00145b04c\") " pod="kube-system/global-pull-secret-syncer-wvzdl" May 21 20:38:20.548499 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:20.548409 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4615b277-5db1-4fdc-a5f8-42b00145b04c-original-pull-secret\") pod \"global-pull-secret-syncer-wvzdl\" (UID: \"4615b277-5db1-4fdc-a5f8-42b00145b04c\") " pod="kube-system/global-pull-secret-syncer-wvzdl" May 21 20:38:20.649339 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:20.649297 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4615b277-5db1-4fdc-a5f8-42b00145b04c-original-pull-secret\") pod \"global-pull-secret-syncer-wvzdl\" (UID: \"4615b277-5db1-4fdc-a5f8-42b00145b04c\") " pod="kube-system/global-pull-secret-syncer-wvzdl" May 21 20:38:20.649543 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:20.649413 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4615b277-5db1-4fdc-a5f8-42b00145b04c-dbus\") pod \"global-pull-secret-syncer-wvzdl\" (UID: \"4615b277-5db1-4fdc-a5f8-42b00145b04c\") " pod="kube-system/global-pull-secret-syncer-wvzdl" May 21 20:38:20.649543 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:20.649444 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4615b277-5db1-4fdc-a5f8-42b00145b04c-kubelet-config\") pod \"global-pull-secret-syncer-wvzdl\" (UID: \"4615b277-5db1-4fdc-a5f8-42b00145b04c\") " pod="kube-system/global-pull-secret-syncer-wvzdl" May 21 20:38:20.649543 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:20.649470 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 20:38:20.649543 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:20.649536 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4615b277-5db1-4fdc-a5f8-42b00145b04c-original-pull-secret podName:4615b277-5db1-4fdc-a5f8-42b00145b04c nodeName:}" failed. No retries permitted until 2026-05-21 20:38:21.149518919 +0000 UTC m=+9.080293997 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4615b277-5db1-4fdc-a5f8-42b00145b04c-original-pull-secret") pod "global-pull-secret-syncer-wvzdl" (UID: "4615b277-5db1-4fdc-a5f8-42b00145b04c") : object "kube-system"/"original-pull-secret" not registered May 21 20:38:20.649543 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:20.649543 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4615b277-5db1-4fdc-a5f8-42b00145b04c-kubelet-config\") pod \"global-pull-secret-syncer-wvzdl\" (UID: \"4615b277-5db1-4fdc-a5f8-42b00145b04c\") " pod="kube-system/global-pull-secret-syncer-wvzdl" May 21 20:38:20.649724 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:20.649647 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4615b277-5db1-4fdc-a5f8-42b00145b04c-dbus\") pod \"global-pull-secret-syncer-wvzdl\" (UID: \"4615b277-5db1-4fdc-a5f8-42b00145b04c\") " pod="kube-system/global-pull-secret-syncer-wvzdl" May 21 20:38:20.684362 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:20.684324 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr8nm" May 21 20:38:20.684551 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:20.684471 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrfc" May 21 20:38:20.684629 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:20.684583 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dgrfc" podUID="3bdf9a6b-e989-4794-bbe7-3396ae7ddc07" May 21 20:38:20.684930 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:20.684907 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hr8nm" podUID="fc75acb2-0d8e-462c-98b4-1e8f5a06054d" May 21 20:38:21.153866 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:21.153814 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4615b277-5db1-4fdc-a5f8-42b00145b04c-original-pull-secret\") pod \"global-pull-secret-syncer-wvzdl\" (UID: \"4615b277-5db1-4fdc-a5f8-42b00145b04c\") " pod="kube-system/global-pull-secret-syncer-wvzdl" May 21 20:38:21.154131 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:21.154115 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 20:38:21.154201 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:21.154190 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4615b277-5db1-4fdc-a5f8-42b00145b04c-original-pull-secret podName:4615b277-5db1-4fdc-a5f8-42b00145b04c nodeName:}" failed. No retries permitted until 2026-05-21 20:38:22.154171844 +0000 UTC m=+10.084946925 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4615b277-5db1-4fdc-a5f8-42b00145b04c-original-pull-secret") pod "global-pull-secret-syncer-wvzdl" (UID: "4615b277-5db1-4fdc-a5f8-42b00145b04c") : object "kube-system"/"original-pull-secret" not registered May 21 20:38:21.684565 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:21.684268 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvzdl" May 21 20:38:21.684565 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:21.684521 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvzdl" podUID="4615b277-5db1-4fdc-a5f8-42b00145b04c" May 21 20:38:22.163246 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:22.163147 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4615b277-5db1-4fdc-a5f8-42b00145b04c-original-pull-secret\") pod \"global-pull-secret-syncer-wvzdl\" (UID: \"4615b277-5db1-4fdc-a5f8-42b00145b04c\") " pod="kube-system/global-pull-secret-syncer-wvzdl" May 21 20:38:22.163426 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:22.163289 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 20:38:22.163426 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:22.163383 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4615b277-5db1-4fdc-a5f8-42b00145b04c-original-pull-secret podName:4615b277-5db1-4fdc-a5f8-42b00145b04c nodeName:}" failed. No retries permitted until 2026-05-21 20:38:24.163345218 +0000 UTC m=+12.094120292 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4615b277-5db1-4fdc-a5f8-42b00145b04c-original-pull-secret") pod "global-pull-secret-syncer-wvzdl" (UID: "4615b277-5db1-4fdc-a5f8-42b00145b04c") : object "kube-system"/"original-pull-secret" not registered May 21 20:38:22.263618 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:22.263579 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3bdf9a6b-e989-4794-bbe7-3396ae7ddc07-metrics-certs\") pod \"network-metrics-daemon-dgrfc\" (UID: \"3bdf9a6b-e989-4794-bbe7-3396ae7ddc07\") " pod="openshift-multus/network-metrics-daemon-dgrfc" May 21 20:38:22.263813 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:22.263748 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:22.263873 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:22.263830 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bdf9a6b-e989-4794-bbe7-3396ae7ddc07-metrics-certs podName:3bdf9a6b-e989-4794-bbe7-3396ae7ddc07 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:30.263810955 +0000 UTC m=+18.194586015 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3bdf9a6b-e989-4794-bbe7-3396ae7ddc07-metrics-certs") pod "network-metrics-daemon-dgrfc" (UID: "3bdf9a6b-e989-4794-bbe7-3396ae7ddc07") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:22.364526 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:22.364487 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8m8t5\" (UniqueName: \"kubernetes.io/projected/fc75acb2-0d8e-462c-98b4-1e8f5a06054d-kube-api-access-8m8t5\") pod \"network-check-target-hr8nm\" (UID: \"fc75acb2-0d8e-462c-98b4-1e8f5a06054d\") " pod="openshift-network-diagnostics/network-check-target-hr8nm" May 21 20:38:22.364700 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:22.364654 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 20:38:22.364700 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:22.364674 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 20:38:22.364700 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:22.364687 2556 projected.go:194] Error preparing data for projected volume kube-api-access-8m8t5 for pod openshift-network-diagnostics/network-check-target-hr8nm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:22.364881 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:22.364745 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc75acb2-0d8e-462c-98b4-1e8f5a06054d-kube-api-access-8m8t5 podName:fc75acb2-0d8e-462c-98b4-1e8f5a06054d nodeName:}" failed. No retries permitted until 2026-05-21 20:38:30.364725949 +0000 UTC m=+18.295501016 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8m8t5" (UniqueName: "kubernetes.io/projected/fc75acb2-0d8e-462c-98b4-1e8f5a06054d-kube-api-access-8m8t5") pod "network-check-target-hr8nm" (UID: "fc75acb2-0d8e-462c-98b4-1e8f5a06054d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:22.685412 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:22.685351 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrfc" May 21 20:38:22.685842 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:22.685498 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dgrfc" podUID="3bdf9a6b-e989-4794-bbe7-3396ae7ddc07" May 21 20:38:22.685983 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:22.685965 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr8nm" May 21 20:38:22.686071 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:22.686052 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hr8nm" podUID="fc75acb2-0d8e-462c-98b4-1e8f5a06054d" May 21 20:38:23.684282 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:23.684111 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvzdl" May 21 20:38:23.684282 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:23.684235 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvzdl" podUID="4615b277-5db1-4fdc-a5f8-42b00145b04c" May 21 20:38:24.178728 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:24.178617 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4615b277-5db1-4fdc-a5f8-42b00145b04c-original-pull-secret\") pod \"global-pull-secret-syncer-wvzdl\" (UID: \"4615b277-5db1-4fdc-a5f8-42b00145b04c\") " pod="kube-system/global-pull-secret-syncer-wvzdl" May 21 20:38:24.179169 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:24.178847 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 20:38:24.179169 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:24.178922 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4615b277-5db1-4fdc-a5f8-42b00145b04c-original-pull-secret podName:4615b277-5db1-4fdc-a5f8-42b00145b04c nodeName:}" failed. No retries permitted until 2026-05-21 20:38:28.17890156 +0000 UTC m=+16.109676639 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4615b277-5db1-4fdc-a5f8-42b00145b04c-original-pull-secret") pod "global-pull-secret-syncer-wvzdl" (UID: "4615b277-5db1-4fdc-a5f8-42b00145b04c") : object "kube-system"/"original-pull-secret" not registered May 21 20:38:24.685014 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:24.684504 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrfc" May 21 20:38:24.685014 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:24.684659 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dgrfc" podUID="3bdf9a6b-e989-4794-bbe7-3396ae7ddc07" May 21 20:38:24.685014 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:24.684715 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr8nm" May 21 20:38:24.685014 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:24.684825 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hr8nm" podUID="fc75acb2-0d8e-462c-98b4-1e8f5a06054d" May 21 20:38:25.683708 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:25.683665 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvzdl" May 21 20:38:25.684118 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:25.683816 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvzdl" podUID="4615b277-5db1-4fdc-a5f8-42b00145b04c" May 21 20:38:26.683761 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:26.683637 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrfc" May 21 20:38:26.683761 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:26.683678 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr8nm" May 21 20:38:26.684324 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:26.683780 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dgrfc" podUID="3bdf9a6b-e989-4794-bbe7-3396ae7ddc07" May 21 20:38:26.684324 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:26.683890 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hr8nm" podUID="fc75acb2-0d8e-462c-98b4-1e8f5a06054d" May 21 20:38:27.683576 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:27.683533 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvzdl" May 21 20:38:27.683762 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:27.683687 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvzdl" podUID="4615b277-5db1-4fdc-a5f8-42b00145b04c" May 21 20:38:28.206989 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:28.206949 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4615b277-5db1-4fdc-a5f8-42b00145b04c-original-pull-secret\") pod \"global-pull-secret-syncer-wvzdl\" (UID: \"4615b277-5db1-4fdc-a5f8-42b00145b04c\") " pod="kube-system/global-pull-secret-syncer-wvzdl" May 21 20:38:28.207450 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:28.207123 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 20:38:28.207450 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:28.207201 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4615b277-5db1-4fdc-a5f8-42b00145b04c-original-pull-secret podName:4615b277-5db1-4fdc-a5f8-42b00145b04c nodeName:}" failed. No retries permitted until 2026-05-21 20:38:36.207184725 +0000 UTC m=+24.137959785 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4615b277-5db1-4fdc-a5f8-42b00145b04c-original-pull-secret") pod "global-pull-secret-syncer-wvzdl" (UID: "4615b277-5db1-4fdc-a5f8-42b00145b04c") : object "kube-system"/"original-pull-secret" not registered May 21 20:38:28.684156 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:28.684112 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr8nm" May 21 20:38:28.684331 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:28.684112 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrfc" May 21 20:38:28.684331 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:28.684245 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hr8nm" podUID="fc75acb2-0d8e-462c-98b4-1e8f5a06054d" May 21 20:38:28.684468 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:28.684359 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dgrfc" podUID="3bdf9a6b-e989-4794-bbe7-3396ae7ddc07" May 21 20:38:29.683948 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:29.683912 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvzdl" May 21 20:38:29.684415 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:29.684048 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvzdl" podUID="4615b277-5db1-4fdc-a5f8-42b00145b04c" May 21 20:38:30.324710 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:30.324659 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3bdf9a6b-e989-4794-bbe7-3396ae7ddc07-metrics-certs\") pod \"network-metrics-daemon-dgrfc\" (UID: \"3bdf9a6b-e989-4794-bbe7-3396ae7ddc07\") " pod="openshift-multus/network-metrics-daemon-dgrfc" May 21 20:38:30.324918 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:30.324830 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:30.324918 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:30.324911 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bdf9a6b-e989-4794-bbe7-3396ae7ddc07-metrics-certs podName:3bdf9a6b-e989-4794-bbe7-3396ae7ddc07 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:46.324892353 +0000 UTC m=+34.255667429 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3bdf9a6b-e989-4794-bbe7-3396ae7ddc07-metrics-certs") pod "network-metrics-daemon-dgrfc" (UID: "3bdf9a6b-e989-4794-bbe7-3396ae7ddc07") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:30.425602 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:30.425560 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8m8t5\" (UniqueName: \"kubernetes.io/projected/fc75acb2-0d8e-462c-98b4-1e8f5a06054d-kube-api-access-8m8t5\") pod \"network-check-target-hr8nm\" (UID: \"fc75acb2-0d8e-462c-98b4-1e8f5a06054d\") " pod="openshift-network-diagnostics/network-check-target-hr8nm" May 21 20:38:30.425769 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:30.425708 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 20:38:30.425769 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:30.425729 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 20:38:30.425769 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:30.425741 2556 projected.go:194] Error preparing data for projected volume kube-api-access-8m8t5 for pod openshift-network-diagnostics/network-check-target-hr8nm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:30.425925 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:30.425809 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc75acb2-0d8e-462c-98b4-1e8f5a06054d-kube-api-access-8m8t5 podName:fc75acb2-0d8e-462c-98b4-1e8f5a06054d nodeName:}" failed. No retries permitted until 2026-05-21 20:38:46.42578984 +0000 UTC m=+34.356564917 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8m8t5" (UniqueName: "kubernetes.io/projected/fc75acb2-0d8e-462c-98b4-1e8f5a06054d-kube-api-access-8m8t5") pod "network-check-target-hr8nm" (UID: "fc75acb2-0d8e-462c-98b4-1e8f5a06054d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:30.683671 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:30.683633 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr8nm" May 21 20:38:30.683841 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:30.683633 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrfc" May 21 20:38:30.683841 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:30.683752 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hr8nm" podUID="fc75acb2-0d8e-462c-98b4-1e8f5a06054d" May 21 20:38:30.683946 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:30.683859 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dgrfc" podUID="3bdf9a6b-e989-4794-bbe7-3396ae7ddc07" May 21 20:38:31.683589 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:31.683549 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvzdl" May 21 20:38:31.684118 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:31.683681 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvzdl" podUID="4615b277-5db1-4fdc-a5f8-42b00145b04c" May 21 20:38:32.684149 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:32.684112 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrfc" May 21 20:38:32.684650 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:32.684162 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr8nm" May 21 20:38:32.684650 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:32.684243 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dgrfc" podUID="3bdf9a6b-e989-4794-bbe7-3396ae7ddc07" May 21 20:38:32.684650 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:32.684359 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hr8nm" podUID="fc75acb2-0d8e-462c-98b4-1e8f5a06054d" May 21 20:38:33.684061 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:33.684023 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvzdl" May 21 20:38:33.684206 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:33.684156 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvzdl" podUID="4615b277-5db1-4fdc-a5f8-42b00145b04c" May 21 20:38:34.684568 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:34.684238 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr8nm" May 21 20:38:34.685422 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:34.684238 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrfc" May 21 20:38:34.685422 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:34.684680 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hr8nm" podUID="fc75acb2-0d8e-462c-98b4-1e8f5a06054d" May 21 20:38:34.685422 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:34.684784 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dgrfc" podUID="3bdf9a6b-e989-4794-bbe7-3396ae7ddc07" May 21 20:38:34.781636 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:34.781596 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6p4ps" event={"ID":"84d7fb93-5212-4b3f-a963-296ed4cae5b0","Type":"ContainerStarted","Data":"c51abe2e6684e7b7107008fcd9eba312cdbcb4d10e9ea0431f2448b3d5815adf"} May 21 20:38:34.782873 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:34.782845 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6ldcp" event={"ID":"233b9c5d-8fb6-4d7f-a394-6f35c388074e","Type":"ContainerStarted","Data":"424559d0f7b5aeb53ea13304664144e72add18309d7030ce8b8a107ac07ffbe3"} May 21 20:38:34.785168 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:34.785145 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7n7h_2b22953d-24b1-4a5a-9ad2-870f2414a537/ovn-acl-logging/0.log" May 21 20:38:34.785496 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:34.785473 2556 generic.go:358] "Generic (PLEG): container finished" podID="2b22953d-24b1-4a5a-9ad2-870f2414a537" containerID="bb659b640d9034e04b40cf127619e22a420182ec4278630130cb925cf5f949fc" exitCode=1 May 21 20:38:34.785587 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:34.785542 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" event={"ID":"2b22953d-24b1-4a5a-9ad2-870f2414a537","Type":"ContainerStarted","Data":"0817c4ed5f407b245e5bf471a86c5fdec02a53fd3f6c3404b1caf5485f9dbc00"} May 21 20:38:34.785587 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:34.785566 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" event={"ID":"2b22953d-24b1-4a5a-9ad2-870f2414a537","Type":"ContainerStarted","Data":"1de4cecfa971f7b93441645d22fff55a3bdc4b4ce7dde29089ce4705c28cb4f8"} May 21 20:38:34.785587 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:34.785575 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" event={"ID":"2b22953d-24b1-4a5a-9ad2-870f2414a537","Type":"ContainerStarted","Data":"87c2e4025ef74d941cb856eba4a22c763448a017316b741d776105d7f1d28467"} May 21 20:38:34.785693 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:34.785586 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" event={"ID":"2b22953d-24b1-4a5a-9ad2-870f2414a537","Type":"ContainerStarted","Data":"9df81d63a690b193c93b3e4400e77d2f31e96128d4bf8e182596e021e6f63cfd"} May 21 20:38:34.785693 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:34.785600 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" event={"ID":"2b22953d-24b1-4a5a-9ad2-870f2414a537","Type":"ContainerDied","Data":"bb659b640d9034e04b40cf127619e22a420182ec4278630130cb925cf5f949fc"} May 21 20:38:34.785693 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:34.785611 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" event={"ID":"2b22953d-24b1-4a5a-9ad2-870f2414a537","Type":"ContainerStarted","Data":"de5b5cc9a9556064ce31685f0a2839380d840f6822ffeeade7b81c7cb68bae01"} May 21 20:38:34.786686 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:34.786667 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldk4c" event={"ID":"0bb2289a-99a2-40ee-9985-ca05ace4e538","Type":"ContainerStarted","Data":"c05caa767599c82654572d53046786356666f7b0020168067264c66fb97fe285"} May 21 20:38:34.787830 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:34.787811 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n8gtw" event={"ID":"3cef130e-0ffb-400e-ba51-f4947d952456","Type":"ContainerStarted","Data":"139ed455a8dffedd717a5e43b022ae4dc36131b11c989762c749749467bcd219"} May 21 20:38:34.789147 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:34.789127 2556 generic.go:358] "Generic (PLEG): container finished" podID="0f3e31a1-421b-4147-8fe1-70facdf3c1b4" containerID="73d333e533f222333bb94b6f30537dcc7c8d9283eaa16b28bf6ed066631a3e52" exitCode=0 May 21 20:38:34.789245 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:34.789203 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hlljl" event={"ID":"0f3e31a1-421b-4147-8fe1-70facdf3c1b4","Type":"ContainerDied","Data":"73d333e533f222333bb94b6f30537dcc7c8d9283eaa16b28bf6ed066631a3e52"} May 21 20:38:34.790585 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:34.790452 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bv824" event={"ID":"3f8bece9-7239-4ec3-8778-826a470d2793","Type":"ContainerStarted","Data":"a12cd465f73458f34cc34fa9a89c4b3076690f399f4d8d8a86ec46166f9449dc"} May 21 20:38:34.791917 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:34.791892 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nbcfl" event={"ID":"1ae06c65-3e3e-4c07-a621-b12942dd11bf","Type":"ContainerStarted","Data":"6f25f684707f46393a51fd6760a29213539015b0d694f2586fe958aa4915027b"} May 21 20:38:34.806652 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:34.806606 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-6p4ps" podStartSLOduration=4.438743567 podStartE2EDuration="22.806590978s" podCreationTimestamp="2026-05-21 20:38:12 +0000 UTC" firstStartedPulling="2026-05-21 20:38:15.450551608 +0000 UTC m=+3.381326669" lastFinishedPulling="2026-05-21 20:38:33.818399007 +0000 UTC m=+21.749174080" observedRunningTime="2026-05-21 20:38:34.806193485 +0000 UTC m=+22.736968568" watchObservedRunningTime="2026-05-21 20:38:34.806590978 +0000 UTC m=+22.737366060" May 21 20:38:34.843761 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:34.843713 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-n8gtw" podStartSLOduration=4.466563806 podStartE2EDuration="22.84369705s" podCreationTimestamp="2026-05-21 20:38:12 +0000 UTC" firstStartedPulling="2026-05-21 20:38:15.441230042 +0000 UTC m=+3.372005103" lastFinishedPulling="2026-05-21 20:38:33.81836328 +0000 UTC m=+21.749138347" observedRunningTime="2026-05-21 20:38:34.843103371 +0000 UTC m=+22.773878453" watchObservedRunningTime="2026-05-21 20:38:34.84369705 +0000 UTC m=+22.774472132" May 21 20:38:34.858023 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:34.857974 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-6ldcp" podStartSLOduration=4.449785592 podStartE2EDuration="22.85794065s" podCreationTimestamp="2026-05-21 20:38:12 +0000 UTC" firstStartedPulling="2026-05-21 20:38:15.44851263 +0000 UTC m=+3.379287704" lastFinishedPulling="2026-05-21 20:38:33.856667701 +0000 UTC m=+21.787442762" observedRunningTime="2026-05-21 20:38:34.857729447 +0000 UTC m=+22.788504529" watchObservedRunningTime="2026-05-21 20:38:34.85794065 +0000 UTC m=+22.788715778" May 21 20:38:34.878017 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:34.877966 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bv824" podStartSLOduration=4.489199001 podStartE2EDuration="22.87794817s" podCreationTimestamp="2026-05-21 20:38:12 +0000 UTC" firstStartedPulling="2026-05-21 20:38:15.449710379 +0000 UTC m=+3.380485459" lastFinishedPulling="2026-05-21 20:38:33.838459568 +0000 UTC m=+21.769234628" observedRunningTime="2026-05-21 20:38:34.877842415 +0000 UTC m=+22.808617499" watchObservedRunningTime="2026-05-21 20:38:34.87794817 +0000 UTC m=+22.808723281" May 21 20:38:34.902943 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:34.902889 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nbcfl" podStartSLOduration=3.559233883 podStartE2EDuration="21.90287602s" podCreationTimestamp="2026-05-21 20:38:13 +0000 UTC" firstStartedPulling="2026-05-21 20:38:15.474742256 +0000 UTC m=+3.405517317" lastFinishedPulling="2026-05-21 20:38:33.818384378 +0000 UTC m=+21.749159454" observedRunningTime="2026-05-21 20:38:34.90250103 +0000 UTC m=+22.833276124" watchObservedRunningTime="2026-05-21 20:38:34.90287602 +0000 UTC m=+22.833651102" May 21 20:38:35.024721 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:35.024694 2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 20:38:35.662580 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:35.662449 2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T20:38:35.024718084Z","UUID":"c638bc39-2e66-4460-9dc6-130f0e84f004","Handler":null,"Name":"","Endpoint":""} May 21 20:38:35.664305 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:35.664266 2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 20:38:35.664305 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:35.664302 2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 20:38:35.683476 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:35.683441 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvzdl" May 21 20:38:35.683650 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:35.683555 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvzdl" podUID="4615b277-5db1-4fdc-a5f8-42b00145b04c" May 21 20:38:35.796638 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:35.796602 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldk4c" event={"ID":"0bb2289a-99a2-40ee-9985-ca05ace4e538","Type":"ContainerStarted","Data":"a46ef4dbc888944ff0db2300b340b0cb1fca4becc5514eb2c98295a06625ef12"} May 21 20:38:35.799571 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:35.799531 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fpsh2" event={"ID":"2840efa6-0ecd-48b1-8372-ecaac60323f6","Type":"ContainerStarted","Data":"1d9ddc2ddeadd59d6a24979d1b62109064545b90db7de62c890ed8243cb1c0a1"} May 21 20:38:35.812774 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:35.812708 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fpsh2" podStartSLOduration=4.418981582 podStartE2EDuration="22.812687249s" podCreationTimestamp="2026-05-21 20:38:13 +0000 UTC" firstStartedPulling="2026-05-21 20:38:15.445266983 +0000 UTC m=+3.376042046" lastFinishedPulling="2026-05-21 20:38:33.838972651 +0000 UTC m=+21.769747713" observedRunningTime="2026-05-21 20:38:35.812043085 +0000 UTC m=+23.742818169" watchObservedRunningTime="2026-05-21 20:38:35.812687249 +0000 UTC m=+23.743462337" May 21 20:38:36.272600 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:36.272565 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4615b277-5db1-4fdc-a5f8-42b00145b04c-original-pull-secret\") pod \"global-pull-secret-syncer-wvzdl\" (UID: \"4615b277-5db1-4fdc-a5f8-42b00145b04c\") " pod="kube-system/global-pull-secret-syncer-wvzdl" May 21 20:38:36.272761 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:36.272733 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 20:38:36.272881 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:36.272832 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4615b277-5db1-4fdc-a5f8-42b00145b04c-original-pull-secret podName:4615b277-5db1-4fdc-a5f8-42b00145b04c nodeName:}" failed. No retries permitted until 2026-05-21 20:38:52.272810481 +0000 UTC m=+40.203585547 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4615b277-5db1-4fdc-a5f8-42b00145b04c-original-pull-secret") pod "global-pull-secret-syncer-wvzdl" (UID: "4615b277-5db1-4fdc-a5f8-42b00145b04c") : object "kube-system"/"original-pull-secret" not registered May 21 20:38:36.477110 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:36.477073 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nbcfl" May 21 20:38:36.477771 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:36.477749 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nbcfl" May 21 20:38:36.683423 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:36.683396 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrfc" May 21 20:38:36.683584 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:36.683541 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr8nm" May 21 20:38:36.683584 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:36.683541 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dgrfc" podUID="3bdf9a6b-e989-4794-bbe7-3396ae7ddc07" May 21 20:38:36.683679 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:36.683635 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hr8nm" podUID="fc75acb2-0d8e-462c-98b4-1e8f5a06054d" May 21 20:38:36.805101 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:36.804858 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7n7h_2b22953d-24b1-4a5a-9ad2-870f2414a537/ovn-acl-logging/0.log" May 21 20:38:36.805713 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:36.805649 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" event={"ID":"2b22953d-24b1-4a5a-9ad2-870f2414a537","Type":"ContainerStarted","Data":"5882daee2c1e354bee7f685c29b45ac084a1d7c856dafdc18c23d39ffa7b6ac7"} May 21 20:38:36.807998 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:36.807970 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldk4c" event={"ID":"0bb2289a-99a2-40ee-9985-ca05ace4e538","Type":"ContainerStarted","Data":"ccd003613dc73d3d001d9ad84a79583354819f49d3893132e2589b4135b10c66"} May 21 20:38:36.825725 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:36.825494 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ldk4c" podStartSLOduration=4.034882348 podStartE2EDuration="24.825478423s" podCreationTimestamp="2026-05-21 20:38:12 +0000 UTC" firstStartedPulling="2026-05-21 20:38:15.446927236 +0000 UTC m=+3.377702296" lastFinishedPulling="2026-05-21 20:38:36.237523302 +0000 UTC m=+24.168298371" observedRunningTime="2026-05-21 20:38:36.825329027 +0000 UTC m=+24.756104111" watchObservedRunningTime="2026-05-21 20:38:36.825478423 +0000 UTC m=+24.756253505" May 21 20:38:37.684271 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:37.684232 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvzdl" May 21 20:38:37.684478 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:37.684396 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvzdl" podUID="4615b277-5db1-4fdc-a5f8-42b00145b04c" May 21 20:38:37.809849 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:37.809818 2556 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 21 20:38:38.683785 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:38.683747 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr8nm" May 21 20:38:38.684002 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:38.683857 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hr8nm" podUID="fc75acb2-0d8e-462c-98b4-1e8f5a06054d" May 21 20:38:38.684002 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:38.683911 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrfc" May 21 20:38:38.684119 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:38.684039 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dgrfc" podUID="3bdf9a6b-e989-4794-bbe7-3396ae7ddc07" May 21 20:38:38.813046 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:38.813009 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hlljl" event={"ID":"0f3e31a1-421b-4147-8fe1-70facdf3c1b4","Type":"ContainerStarted","Data":"940b96e622d034d46d6324ce03bb0b098f13af3ebfdfac0f4472bc73c65bc05f"} May 21 20:38:39.059356 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:39.059107 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nbcfl" May 21 20:38:39.059682 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:39.059485 2556 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 21 20:38:39.059977 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:39.059951 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nbcfl" May 21 20:38:39.684014 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:39.683976 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvzdl" May 21 20:38:39.684169 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:39.684085 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvzdl" podUID="4615b277-5db1-4fdc-a5f8-42b00145b04c" May 21 20:38:39.816462 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:39.816429 2556 generic.go:358] "Generic (PLEG): container finished" podID="0f3e31a1-421b-4147-8fe1-70facdf3c1b4" containerID="940b96e622d034d46d6324ce03bb0b098f13af3ebfdfac0f4472bc73c65bc05f" exitCode=0 May 21 20:38:39.817262 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:39.816522 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hlljl" event={"ID":"0f3e31a1-421b-4147-8fe1-70facdf3c1b4","Type":"ContainerDied","Data":"940b96e622d034d46d6324ce03bb0b098f13af3ebfdfac0f4472bc73c65bc05f"} May 21 20:38:39.820128 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:39.820109 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7n7h_2b22953d-24b1-4a5a-9ad2-870f2414a537/ovn-acl-logging/0.log" May 21 20:38:39.820531 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:39.820495 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" event={"ID":"2b22953d-24b1-4a5a-9ad2-870f2414a537","Type":"ContainerStarted","Data":"e593a86ea9b4bb7e8714cd072c917a01d01bba1dd996171474408770a90f7961"} May 21 20:38:39.820766 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:39.820743 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:39.820766 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:39.820775 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:39.820906 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:39.820788 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:39.820961 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:39.820941 2556 scope.go:117] "RemoveContainer" containerID="bb659b640d9034e04b40cf127619e22a420182ec4278630130cb925cf5f949fc" May 21 20:38:39.838177 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:39.838151 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:39.838444 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:39.838428 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:38:40.683867 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:40.683832 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr8nm" May 21 20:38:40.684030 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:40.683873 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrfc" May 21 20:38:40.684030 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:40.683957 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hr8nm" podUID="fc75acb2-0d8e-462c-98b4-1e8f5a06054d" May 21 20:38:40.684162 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:40.684065 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dgrfc" podUID="3bdf9a6b-e989-4794-bbe7-3396ae7ddc07" May 21 20:38:40.828330 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:40.828244 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7n7h_2b22953d-24b1-4a5a-9ad2-870f2414a537/ovn-acl-logging/0.log" May 21 20:38:40.828789 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:40.828596 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" event={"ID":"2b22953d-24b1-4a5a-9ad2-870f2414a537","Type":"ContainerStarted","Data":"15bd6de9020939a5b3c4d207673a22a241aa459895c8e2a2f45c41ef63cfbf7c"} May 21 20:38:40.830530 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:40.830507 2556 generic.go:358] "Generic (PLEG): container finished" podID="0f3e31a1-421b-4147-8fe1-70facdf3c1b4" containerID="c397a82d2d83843422aa50c1ac464e75477b2bfd3186cb704ab117d98f250bef" exitCode=0 May 21 20:38:40.830635 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:40.830542 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hlljl" event={"ID":"0f3e31a1-421b-4147-8fe1-70facdf3c1b4","Type":"ContainerDied","Data":"c397a82d2d83843422aa50c1ac464e75477b2bfd3186cb704ab117d98f250bef"} May 21 20:38:40.853941 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:40.853893 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" podStartSLOduration=9.416333343 podStartE2EDuration="27.853880001s" podCreationTimestamp="2026-05-21 20:38:13 +0000 UTC" firstStartedPulling="2026-05-21 20:38:15.447537777 +0000 UTC m=+3.378312839" lastFinishedPulling="2026-05-21 20:38:33.885084421 +0000 UTC m=+21.815859497" observedRunningTime="2026-05-21 20:38:40.852847936 +0000 UTC m=+28.783623079" watchObservedRunningTime="2026-05-21 20:38:40.853880001 +0000 UTC m=+28.784655084" May 21 20:38:40.868967 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:40.868936 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wvzdl"] May 21 20:38:40.869101 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:40.869063 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvzdl" May 21 20:38:40.869172 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:40.869150 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvzdl" podUID="4615b277-5db1-4fdc-a5f8-42b00145b04c" May 21 20:38:40.871798 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:40.871751 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hr8nm"] May 21 20:38:40.871925 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:40.871890 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr8nm" May 21 20:38:40.872017 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:40.871995 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hr8nm" podUID="fc75acb2-0d8e-462c-98b4-1e8f5a06054d" May 21 20:38:40.872412 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:40.872350 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dgrfc"] May 21 20:38:40.872523 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:40.872509 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrfc" May 21 20:38:40.872631 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:40.872613 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dgrfc" podUID="3bdf9a6b-e989-4794-bbe7-3396ae7ddc07" May 21 20:38:41.834544 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:41.834505 2556 generic.go:358] "Generic (PLEG): container finished" podID="0f3e31a1-421b-4147-8fe1-70facdf3c1b4" containerID="442fb68f843a86630b6fba004f28cd6f2b49e5429f4cec598dd6bef41fd45240" exitCode=0 May 21 20:38:41.834950 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:41.834566 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hlljl" event={"ID":"0f3e31a1-421b-4147-8fe1-70facdf3c1b4","Type":"ContainerDied","Data":"442fb68f843a86630b6fba004f28cd6f2b49e5429f4cec598dd6bef41fd45240"} May 21 20:38:42.686249 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:42.686205 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvzdl" May 21 20:38:42.687357 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:42.687333 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrfc" May 21 20:38:42.687491 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:42.687428 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvzdl" podUID="4615b277-5db1-4fdc-a5f8-42b00145b04c" May 21 20:38:42.687563 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:42.687536 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr8nm" May 21 20:38:42.688048 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:42.688019 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dgrfc" podUID="3bdf9a6b-e989-4794-bbe7-3396ae7ddc07" May 21 20:38:42.688184 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:42.688157 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hr8nm" podUID="fc75acb2-0d8e-462c-98b4-1e8f5a06054d" May 21 20:38:44.684271 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:44.684073 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvzdl" May 21 20:38:44.684769 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:44.684073 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrfc" May 21 20:38:44.684769 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:44.684383 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvzdl" podUID="4615b277-5db1-4fdc-a5f8-42b00145b04c" May 21 20:38:44.684769 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:44.684639 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dgrfc" podUID="3bdf9a6b-e989-4794-bbe7-3396ae7ddc07" May 21 20:38:44.684769 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:44.684073 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr8nm" May 21 20:38:44.684769 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:44.684756 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hr8nm" podUID="fc75acb2-0d8e-462c-98b4-1e8f5a06054d" May 21 20:38:46.348487 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:46.348454 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3bdf9a6b-e989-4794-bbe7-3396ae7ddc07-metrics-certs\") pod \"network-metrics-daemon-dgrfc\" (UID: \"3bdf9a6b-e989-4794-bbe7-3396ae7ddc07\") " pod="openshift-multus/network-metrics-daemon-dgrfc" May 21 20:38:46.349217 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:46.348602 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:46.349217 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:46.348670 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bdf9a6b-e989-4794-bbe7-3396ae7ddc07-metrics-certs podName:3bdf9a6b-e989-4794-bbe7-3396ae7ddc07 nodeName:}" failed. No retries permitted until 2026-05-21 20:39:18.348647886 +0000 UTC m=+66.279423006 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3bdf9a6b-e989-4794-bbe7-3396ae7ddc07-metrics-certs") pod "network-metrics-daemon-dgrfc" (UID: "3bdf9a6b-e989-4794-bbe7-3396ae7ddc07") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:46.448816 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:46.448776 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8m8t5\" (UniqueName: \"kubernetes.io/projected/fc75acb2-0d8e-462c-98b4-1e8f5a06054d-kube-api-access-8m8t5\") pod \"network-check-target-hr8nm\" (UID: \"fc75acb2-0d8e-462c-98b4-1e8f5a06054d\") " pod="openshift-network-diagnostics/network-check-target-hr8nm" May 21 20:38:46.449002 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:46.448933 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 20:38:46.449002 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:46.448949 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 20:38:46.449002 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:46.448961 2556 projected.go:194] Error preparing data for projected volume kube-api-access-8m8t5 for pod openshift-network-diagnostics/network-check-target-hr8nm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:46.449169 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:46.449021 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc75acb2-0d8e-462c-98b4-1e8f5a06054d-kube-api-access-8m8t5 podName:fc75acb2-0d8e-462c-98b4-1e8f5a06054d nodeName:}" failed. No retries permitted until 2026-05-21 20:39:18.449001271 +0000 UTC m=+66.379776332 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8m8t5" (UniqueName: "kubernetes.io/projected/fc75acb2-0d8e-462c-98b4-1e8f5a06054d-kube-api-access-8m8t5") pod "network-check-target-hr8nm" (UID: "fc75acb2-0d8e-462c-98b4-1e8f5a06054d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:46.684158 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:46.683569 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr8nm" May 21 20:38:46.684158 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:46.683587 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvzdl" May 21 20:38:46.684158 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:46.683709 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hr8nm" podUID="fc75acb2-0d8e-462c-98b4-1e8f5a06054d" May 21 20:38:46.684158 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:46.683732 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrfc" May 21 20:38:46.684158 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:46.683841 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvzdl" podUID="4615b277-5db1-4fdc-a5f8-42b00145b04c" May 21 20:38:46.684158 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:46.683937 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dgrfc" podUID="3bdf9a6b-e989-4794-bbe7-3396ae7ddc07" May 21 20:38:46.856108 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:46.856075 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeReady" May 21 20:38:46.856291 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:46.856219 2556 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 20:38:46.889468 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:46.889434 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-759df6c9-tpdgh"] May 21 20:38:46.947741 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:46.947656 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-hn2r7"] May 21 20:38:46.947902 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:46.947823 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-759df6c9-tpdgh" May 21 20:38:46.950190 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:46.950028 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-f29vq\"" May 21 20:38:46.950190 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:46.950028 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 21 20:38:46.950190 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:46.950130 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 21 20:38:46.950190 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:46.950031 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 21 20:38:46.955127 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:46.955103 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 21 20:38:46.970643 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:46.970618 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-hn2r7"] May 21 20:38:46.970643 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:46.970650 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-759df6c9-tpdgh"] May 21 20:38:46.970643 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:46.970663 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-z7tv2"] May 21 20:38:46.970906 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:46.970783 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-hn2r7" May 21 20:38:46.972560 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:46.972539 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" May 21 20:38:46.972560 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:46.972554 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-56rzl\"" May 21 20:38:46.972718 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:46.972562 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" May 21 20:38:46.988935 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:46.988901 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kql5p"] May 21 20:38:46.989105 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:46.989083 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z7tv2" May 21 20:38:46.990909 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:46.990877 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 20:38:46.991042 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:46.990920 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 20:38:46.991042 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:46.990881 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-25972\"" May 21 20:38:47.011113 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.011072 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z7tv2"] May 21 20:38:47.011113 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.011104 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kql5p"] May 21 20:38:47.011327 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.011237 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kql5p" May 21 20:38:47.013385 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.013344 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 20:38:47.013535 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.013430 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 20:38:47.013535 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.013455 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 20:38:47.013627 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.013562 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-f4n69\"" May 21 20:38:47.052288 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.052246 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-trusted-ca\") pod \"image-registry-759df6c9-tpdgh\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " pod="openshift-image-registry/image-registry-759df6c9-tpdgh" May 21 20:38:47.052506 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.052320 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-registry-tls\") pod \"image-registry-759df6c9-tpdgh\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " pod="openshift-image-registry/image-registry-759df6c9-tpdgh" May 21 20:38:47.052506 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.052410 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-installation-pull-secrets\") pod \"image-registry-759df6c9-tpdgh\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " pod="openshift-image-registry/image-registry-759df6c9-tpdgh" May 21 20:38:47.052506 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.052468 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-ca-trust-extracted\") pod \"image-registry-759df6c9-tpdgh\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " pod="openshift-image-registry/image-registry-759df6c9-tpdgh" May 21 20:38:47.052506 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.052493 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc66w\" (UniqueName: \"kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-kube-api-access-hc66w\") pod \"image-registry-759df6c9-tpdgh\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " pod="openshift-image-registry/image-registry-759df6c9-tpdgh" May 21 20:38:47.052721 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.052529 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0a2f603e-8e52-4c17-9f71-0518c657f864-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-hn2r7\" (UID: \"0a2f603e-8e52-4c17-9f71-0518c657f864\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-hn2r7" May 21 20:38:47.052721 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.052580 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-registry-certificates\") pod \"image-registry-759df6c9-tpdgh\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " pod="openshift-image-registry/image-registry-759df6c9-tpdgh" May 21 20:38:47.052721 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.052605 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-bound-sa-token\") pod \"image-registry-759df6c9-tpdgh\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " pod="openshift-image-registry/image-registry-759df6c9-tpdgh" May 21 20:38:47.052721 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.052631 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a2f603e-8e52-4c17-9f71-0518c657f864-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-hn2r7\" (UID: \"0a2f603e-8e52-4c17-9f71-0518c657f864\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-hn2r7" May 21 20:38:47.052721 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.052694 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-image-registry-private-configuration\") pod \"image-registry-759df6c9-tpdgh\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " pod="openshift-image-registry/image-registry-759df6c9-tpdgh" May 21 20:38:47.153562 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.153518 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-registry-certificates\") pod \"image-registry-759df6c9-tpdgh\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " pod="openshift-image-registry/image-registry-759df6c9-tpdgh" May 21 20:38:47.153562 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.153568 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-bound-sa-token\") pod \"image-registry-759df6c9-tpdgh\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " pod="openshift-image-registry/image-registry-759df6c9-tpdgh" May 21 20:38:47.153805 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.153597 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a2f603e-8e52-4c17-9f71-0518c657f864-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-hn2r7\" (UID: \"0a2f603e-8e52-4c17-9f71-0518c657f864\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-hn2r7" May 21 20:38:47.153805 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.153628 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ba567318-f7e8-435e-b1c6-152074615586-config-volume\") pod \"dns-default-z7tv2\" (UID: \"ba567318-f7e8-435e-b1c6-152074615586\") " pod="openshift-dns/dns-default-z7tv2" May 21 20:38:47.153805 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.153655 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba567318-f7e8-435e-b1c6-152074615586-metrics-tls\") pod \"dns-default-z7tv2\" (UID: \"ba567318-f7e8-435e-b1c6-152074615586\") " pod="openshift-dns/dns-default-z7tv2" May 21 20:38:47.153805 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.153703 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-image-registry-private-configuration\") pod \"image-registry-759df6c9-tpdgh\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " pod="openshift-image-registry/image-registry-759df6c9-tpdgh" May 21 20:38:47.153805 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.153727 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdvh8\" (UniqueName: \"kubernetes.io/projected/9b6798e3-449b-4f3b-900d-08e55e6acf43-kube-api-access-pdvh8\") pod \"ingress-canary-kql5p\" (UID: \"9b6798e3-449b-4f3b-900d-08e55e6acf43\") " pod="openshift-ingress-canary/ingress-canary-kql5p" May 21 20:38:47.154052 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:47.153890 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 20:38:47.154052 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:47.153959 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a2f603e-8e52-4c17-9f71-0518c657f864-networking-console-plugin-cert podName:0a2f603e-8e52-4c17-9f71-0518c657f864 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:47.653938853 +0000 UTC m=+35.584713917 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0a2f603e-8e52-4c17-9f71-0518c657f864-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-hn2r7" (UID: "0a2f603e-8e52-4c17-9f71-0518c657f864") : secret "networking-console-plugin-cert" not found May 21 20:38:47.154169 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.154099 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-trusted-ca\") pod \"image-registry-759df6c9-tpdgh\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " pod="openshift-image-registry/image-registry-759df6c9-tpdgh" May 21 20:38:47.154169 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.154122 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba567318-f7e8-435e-b1c6-152074615586-tmp-dir\") pod \"dns-default-z7tv2\" (UID: \"ba567318-f7e8-435e-b1c6-152074615586\") " pod="openshift-dns/dns-default-z7tv2" May 21 20:38:47.154169 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.154153 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b6798e3-449b-4f3b-900d-08e55e6acf43-cert\") pod \"ingress-canary-kql5p\" (UID: \"9b6798e3-449b-4f3b-900d-08e55e6acf43\") " pod="openshift-ingress-canary/ingress-canary-kql5p" May 21 20:38:47.154309 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.154186 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-registry-tls\") pod \"image-registry-759df6c9-tpdgh\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " pod="openshift-image-registry/image-registry-759df6c9-tpdgh" May 21 20:38:47.154309 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.154209 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-installation-pull-secrets\") pod \"image-registry-759df6c9-tpdgh\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " pod="openshift-image-registry/image-registry-759df6c9-tpdgh" May 21 20:38:47.154309 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.154230 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-registry-certificates\") pod \"image-registry-759df6c9-tpdgh\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " pod="openshift-image-registry/image-registry-759df6c9-tpdgh" May 21 20:38:47.154309 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.154242 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdnzj\" (UniqueName: \"kubernetes.io/projected/ba567318-f7e8-435e-b1c6-152074615586-kube-api-access-kdnzj\") pod \"dns-default-z7tv2\" (UID: \"ba567318-f7e8-435e-b1c6-152074615586\") " pod="openshift-dns/dns-default-z7tv2" May 21 20:38:47.154309 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:47.154300 2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 20:38:47.154511 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:47.154316 2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-759df6c9-tpdgh: secret "image-registry-tls" not found May 21 20:38:47.154511 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:47.154378 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-registry-tls podName:3b0dc320-bd9c-430a-bb6b-a38d2a5bb089 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:47.654343922 +0000 UTC m=+35.585118985 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-registry-tls") pod "image-registry-759df6c9-tpdgh" (UID: "3b0dc320-bd9c-430a-bb6b-a38d2a5bb089") : secret "image-registry-tls" not found May 21 20:38:47.154511 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.154443 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-ca-trust-extracted\") pod \"image-registry-759df6c9-tpdgh\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " pod="openshift-image-registry/image-registry-759df6c9-tpdgh" May 21 20:38:47.154511 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.154488 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hc66w\" (UniqueName: \"kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-kube-api-access-hc66w\") pod \"image-registry-759df6c9-tpdgh\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " pod="openshift-image-registry/image-registry-759df6c9-tpdgh" May 21 20:38:47.154698 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.154534 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0a2f603e-8e52-4c17-9f71-0518c657f864-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-hn2r7\" (UID: \"0a2f603e-8e52-4c17-9f71-0518c657f864\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-hn2r7" May 21 20:38:47.154795 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.154772 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-ca-trust-extracted\") pod \"image-registry-759df6c9-tpdgh\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " pod="openshift-image-registry/image-registry-759df6c9-tpdgh" May 21 20:38:47.154956 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.154934 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-trusted-ca\") pod \"image-registry-759df6c9-tpdgh\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " pod="openshift-image-registry/image-registry-759df6c9-tpdgh" May 21 20:38:47.155178 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.155157 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0a2f603e-8e52-4c17-9f71-0518c657f864-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-hn2r7\" (UID: \"0a2f603e-8e52-4c17-9f71-0518c657f864\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-hn2r7" May 21 20:38:47.158577 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.158553 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-installation-pull-secrets\") pod \"image-registry-759df6c9-tpdgh\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " pod="openshift-image-registry/image-registry-759df6c9-tpdgh" May 21 20:38:47.158665 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.158586 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-image-registry-private-configuration\") pod \"image-registry-759df6c9-tpdgh\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " pod="openshift-image-registry/image-registry-759df6c9-tpdgh" May 21 20:38:47.163013 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.162990 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc66w\" (UniqueName: \"kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-kube-api-access-hc66w\") pod \"image-registry-759df6c9-tpdgh\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " pod="openshift-image-registry/image-registry-759df6c9-tpdgh" May 21 20:38:47.163142 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.162994 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-bound-sa-token\") pod \"image-registry-759df6c9-tpdgh\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " pod="openshift-image-registry/image-registry-759df6c9-tpdgh" May 21 20:38:47.255379 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.255279 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ba567318-f7e8-435e-b1c6-152074615586-config-volume\") pod \"dns-default-z7tv2\" (UID: \"ba567318-f7e8-435e-b1c6-152074615586\") " pod="openshift-dns/dns-default-z7tv2" May 21 20:38:47.255379 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.255325 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba567318-f7e8-435e-b1c6-152074615586-metrics-tls\") pod \"dns-default-z7tv2\" (UID: \"ba567318-f7e8-435e-b1c6-152074615586\") " pod="openshift-dns/dns-default-z7tv2" May 21 20:38:47.255595 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:47.255450 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:38:47.255595 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.255452 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pdvh8\" (UniqueName: \"kubernetes.io/projected/9b6798e3-449b-4f3b-900d-08e55e6acf43-kube-api-access-pdvh8\") pod \"ingress-canary-kql5p\" (UID: \"9b6798e3-449b-4f3b-900d-08e55e6acf43\") " pod="openshift-ingress-canary/ingress-canary-kql5p" May 21 20:38:47.255595 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.255496 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba567318-f7e8-435e-b1c6-152074615586-tmp-dir\") pod \"dns-default-z7tv2\" (UID: \"ba567318-f7e8-435e-b1c6-152074615586\") " pod="openshift-dns/dns-default-z7tv2" May 21 20:38:47.255595 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:47.255516 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba567318-f7e8-435e-b1c6-152074615586-metrics-tls podName:ba567318-f7e8-435e-b1c6-152074615586 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:47.755502544 +0000 UTC m=+35.686277605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ba567318-f7e8-435e-b1c6-152074615586-metrics-tls") pod "dns-default-z7tv2" (UID: "ba567318-f7e8-435e-b1c6-152074615586") : secret "dns-default-metrics-tls" not found May 21 20:38:47.255595 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.255538 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b6798e3-449b-4f3b-900d-08e55e6acf43-cert\") pod \"ingress-canary-kql5p\" (UID: \"9b6798e3-449b-4f3b-900d-08e55e6acf43\") " pod="openshift-ingress-canary/ingress-canary-kql5p" May 21 20:38:47.255805 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.255597 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kdnzj\" (UniqueName: \"kubernetes.io/projected/ba567318-f7e8-435e-b1c6-152074615586-kube-api-access-kdnzj\") pod \"dns-default-z7tv2\" (UID: \"ba567318-f7e8-435e-b1c6-152074615586\") " pod="openshift-dns/dns-default-z7tv2" May 21 20:38:47.255805 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.255770 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba567318-f7e8-435e-b1c6-152074615586-tmp-dir\") pod \"dns-default-z7tv2\" (UID: \"ba567318-f7e8-435e-b1c6-152074615586\") " pod="openshift-dns/dns-default-z7tv2" May 21 20:38:47.255918 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.255872 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ba567318-f7e8-435e-b1c6-152074615586-config-volume\") pod \"dns-default-z7tv2\" (UID: \"ba567318-f7e8-435e-b1c6-152074615586\") " pod="openshift-dns/dns-default-z7tv2" May 21 20:38:47.255965 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:47.255950 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:38:47.256010 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:47.255995 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b6798e3-449b-4f3b-900d-08e55e6acf43-cert podName:9b6798e3-449b-4f3b-900d-08e55e6acf43 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:47.755980576 +0000 UTC m=+35.686755638 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9b6798e3-449b-4f3b-900d-08e55e6acf43-cert") pod "ingress-canary-kql5p" (UID: "9b6798e3-449b-4f3b-900d-08e55e6acf43") : secret "canary-serving-cert" not found May 21 20:38:47.264402 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.264355 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdnzj\" (UniqueName: \"kubernetes.io/projected/ba567318-f7e8-435e-b1c6-152074615586-kube-api-access-kdnzj\") pod \"dns-default-z7tv2\" (UID: \"ba567318-f7e8-435e-b1c6-152074615586\") " pod="openshift-dns/dns-default-z7tv2" May 21 20:38:47.264627 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.264594 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdvh8\" (UniqueName: \"kubernetes.io/projected/9b6798e3-449b-4f3b-900d-08e55e6acf43-kube-api-access-pdvh8\") pod \"ingress-canary-kql5p\" (UID: \"9b6798e3-449b-4f3b-900d-08e55e6acf43\") " pod="openshift-ingress-canary/ingress-canary-kql5p" May 21 20:38:47.660660 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.660632 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-registry-tls\") pod \"image-registry-759df6c9-tpdgh\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " pod="openshift-image-registry/image-registry-759df6c9-tpdgh" May 21 20:38:47.661288 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.660722 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a2f603e-8e52-4c17-9f71-0518c657f864-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-hn2r7\" (UID: \"0a2f603e-8e52-4c17-9f71-0518c657f864\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-hn2r7" May 21 20:38:47.661288 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:47.660782 2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 20:38:47.661288 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:47.660801 2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-759df6c9-tpdgh: secret "image-registry-tls" not found May 21 20:38:47.661288 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:47.660833 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 20:38:47.661288 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:47.660862 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-registry-tls podName:3b0dc320-bd9c-430a-bb6b-a38d2a5bb089 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:48.660847263 +0000 UTC m=+36.591622328 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-registry-tls") pod "image-registry-759df6c9-tpdgh" (UID: "3b0dc320-bd9c-430a-bb6b-a38d2a5bb089") : secret "image-registry-tls" not found May 21 20:38:47.661288 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:47.660888 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a2f603e-8e52-4c17-9f71-0518c657f864-networking-console-plugin-cert podName:0a2f603e-8e52-4c17-9f71-0518c657f864 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:48.660874671 +0000 UTC m=+36.591649750 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0a2f603e-8e52-4c17-9f71-0518c657f864-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-hn2r7" (UID: "0a2f603e-8e52-4c17-9f71-0518c657f864") : secret "networking-console-plugin-cert" not found May 21 20:38:47.761586 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.761551 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba567318-f7e8-435e-b1c6-152074615586-metrics-tls\") pod \"dns-default-z7tv2\" (UID: \"ba567318-f7e8-435e-b1c6-152074615586\") " pod="openshift-dns/dns-default-z7tv2" May 21 20:38:47.761756 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:47.761603 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b6798e3-449b-4f3b-900d-08e55e6acf43-cert\") pod \"ingress-canary-kql5p\" (UID: \"9b6798e3-449b-4f3b-900d-08e55e6acf43\") " pod="openshift-ingress-canary/ingress-canary-kql5p" May 21 20:38:47.761756 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:47.761708 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:38:47.761756 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:47.761717 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:38:47.761885 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:47.761769 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b6798e3-449b-4f3b-900d-08e55e6acf43-cert podName:9b6798e3-449b-4f3b-900d-08e55e6acf43 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:48.761755531 +0000 UTC m=+36.692530592 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9b6798e3-449b-4f3b-900d-08e55e6acf43-cert") pod "ingress-canary-kql5p" (UID: "9b6798e3-449b-4f3b-900d-08e55e6acf43") : secret "canary-serving-cert" not found May 21 20:38:47.761885 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:47.761782 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba567318-f7e8-435e-b1c6-152074615586-metrics-tls podName:ba567318-f7e8-435e-b1c6-152074615586 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:48.761776083 +0000 UTC m=+36.692551144 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ba567318-f7e8-435e-b1c6-152074615586-metrics-tls") pod "dns-default-z7tv2" (UID: "ba567318-f7e8-435e-b1c6-152074615586") : secret "dns-default-metrics-tls" not found May 21 20:38:48.667389 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:48.667328 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a2f603e-8e52-4c17-9f71-0518c657f864-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-hn2r7\" (UID: \"0a2f603e-8e52-4c17-9f71-0518c657f864\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-hn2r7" May 21 20:38:48.667977 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:48.667448 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-registry-tls\") pod \"image-registry-759df6c9-tpdgh\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " pod="openshift-image-registry/image-registry-759df6c9-tpdgh" May 21 20:38:48.667977 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:48.667509 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 20:38:48.667977 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:48.667599 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a2f603e-8e52-4c17-9f71-0518c657f864-networking-console-plugin-cert podName:0a2f603e-8e52-4c17-9f71-0518c657f864 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:50.667577048 +0000 UTC m=+38.598352109 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0a2f603e-8e52-4c17-9f71-0518c657f864-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-hn2r7" (UID: "0a2f603e-8e52-4c17-9f71-0518c657f864") : secret "networking-console-plugin-cert" not found May 21 20:38:48.667977 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:48.667597 2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 20:38:48.667977 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:48.667615 2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-759df6c9-tpdgh: secret "image-registry-tls" not found May 21 20:38:48.667977 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:48.667661 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-registry-tls podName:3b0dc320-bd9c-430a-bb6b-a38d2a5bb089 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:50.667645528 +0000 UTC m=+38.598420591 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-registry-tls") pod "image-registry-759df6c9-tpdgh" (UID: "3b0dc320-bd9c-430a-bb6b-a38d2a5bb089") : secret "image-registry-tls" not found May 21 20:38:48.687264 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:48.687232 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvzdl" May 21 20:38:48.687455 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:48.687232 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrfc" May 21 20:38:48.687527 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:48.687232 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr8nm" May 21 20:38:48.689093 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:48.689060 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 20:38:48.689224 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:48.689149 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cjf7l\"" May 21 20:38:48.689224 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:48.689194 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 20:38:48.689699 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:48.689678 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 20:38:48.689824 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:48.689703 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 20:38:48.689824 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:48.689726 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hrp5p\"" May 21 20:38:48.768338 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:48.768300 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba567318-f7e8-435e-b1c6-152074615586-metrics-tls\") pod \"dns-default-z7tv2\" (UID: \"ba567318-f7e8-435e-b1c6-152074615586\") " pod="openshift-dns/dns-default-z7tv2" May 21 20:38:48.768530 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:48.768358 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b6798e3-449b-4f3b-900d-08e55e6acf43-cert\") pod \"ingress-canary-kql5p\" (UID: \"9b6798e3-449b-4f3b-900d-08e55e6acf43\") " pod="openshift-ingress-canary/ingress-canary-kql5p" May 21 20:38:48.768530 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:48.768475 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:38:48.768530 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:48.768476 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:38:48.768630 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:48.768543 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba567318-f7e8-435e-b1c6-152074615586-metrics-tls podName:ba567318-f7e8-435e-b1c6-152074615586 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:50.768524727 +0000 UTC m=+38.699299788 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ba567318-f7e8-435e-b1c6-152074615586-metrics-tls") pod "dns-default-z7tv2" (UID: "ba567318-f7e8-435e-b1c6-152074615586") : secret "dns-default-metrics-tls" not found May 21 20:38:48.768630 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:48.768558 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b6798e3-449b-4f3b-900d-08e55e6acf43-cert podName:9b6798e3-449b-4f3b-900d-08e55e6acf43 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:50.768551112 +0000 UTC m=+38.699326173 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9b6798e3-449b-4f3b-900d-08e55e6acf43-cert") pod "ingress-canary-kql5p" (UID: "9b6798e3-449b-4f3b-900d-08e55e6acf43") : secret "canary-serving-cert" not found May 21 20:38:48.849069 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:48.849034 2556 generic.go:358] "Generic (PLEG): container finished" podID="0f3e31a1-421b-4147-8fe1-70facdf3c1b4" containerID="812d38b664a5eb5bd4a4c8cd54078e39c2e0fb6fc88e1989cb63a43e20a947a8" exitCode=0 May 21 20:38:48.849234 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:48.849098 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hlljl" event={"ID":"0f3e31a1-421b-4147-8fe1-70facdf3c1b4","Type":"ContainerDied","Data":"812d38b664a5eb5bd4a4c8cd54078e39c2e0fb6fc88e1989cb63a43e20a947a8"} May 21 20:38:49.853662 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:49.853629 2556 generic.go:358] "Generic (PLEG): container finished" podID="0f3e31a1-421b-4147-8fe1-70facdf3c1b4" containerID="5fd8ce89739471849d8206a701d96080b6062e106a9055fa1de55312c1a59259" exitCode=0 May 21 20:38:49.853662 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:49.853675 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hlljl" event={"ID":"0f3e31a1-421b-4147-8fe1-70facdf3c1b4","Type":"ContainerDied","Data":"5fd8ce89739471849d8206a701d96080b6062e106a9055fa1de55312c1a59259"} May 21 20:38:50.687731 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:50.687651 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a2f603e-8e52-4c17-9f71-0518c657f864-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-hn2r7\" (UID: \"0a2f603e-8e52-4c17-9f71-0518c657f864\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-hn2r7" May 21 20:38:50.687731 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:50.687720 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-registry-tls\") pod \"image-registry-759df6c9-tpdgh\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " pod="openshift-image-registry/image-registry-759df6c9-tpdgh" May 21 20:38:50.687947 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:50.687795 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 20:38:50.687947 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:50.687824 2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 20:38:50.687947 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:50.687841 2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-759df6c9-tpdgh: secret "image-registry-tls" not found May 21 20:38:50.687947 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:50.687855 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a2f603e-8e52-4c17-9f71-0518c657f864-networking-console-plugin-cert podName:0a2f603e-8e52-4c17-9f71-0518c657f864 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:54.687840075 +0000 UTC m=+42.618615136 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0a2f603e-8e52-4c17-9f71-0518c657f864-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-hn2r7" (UID: "0a2f603e-8e52-4c17-9f71-0518c657f864") : secret "networking-console-plugin-cert" not found May 21 20:38:50.687947 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:50.687887 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-registry-tls podName:3b0dc320-bd9c-430a-bb6b-a38d2a5bb089 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:54.687871868 +0000 UTC m=+42.618646929 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-registry-tls") pod "image-registry-759df6c9-tpdgh" (UID: "3b0dc320-bd9c-430a-bb6b-a38d2a5bb089") : secret "image-registry-tls" not found May 21 20:38:50.788477 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:50.788436 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba567318-f7e8-435e-b1c6-152074615586-metrics-tls\") pod \"dns-default-z7tv2\" (UID: \"ba567318-f7e8-435e-b1c6-152074615586\") " pod="openshift-dns/dns-default-z7tv2" May 21 20:38:50.788650 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:50.788496 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b6798e3-449b-4f3b-900d-08e55e6acf43-cert\") pod \"ingress-canary-kql5p\" (UID: \"9b6798e3-449b-4f3b-900d-08e55e6acf43\") " pod="openshift-ingress-canary/ingress-canary-kql5p" May 21 20:38:50.788906 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:50.788884 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:38:50.788961 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:50.788951 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba567318-f7e8-435e-b1c6-152074615586-metrics-tls podName:ba567318-f7e8-435e-b1c6-152074615586 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:54.788935134 +0000 UTC m=+42.719710197 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ba567318-f7e8-435e-b1c6-152074615586-metrics-tls") pod "dns-default-z7tv2" (UID: "ba567318-f7e8-435e-b1c6-152074615586") : secret "dns-default-metrics-tls" not found May 21 20:38:50.789012 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:50.788989 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:38:50.789048 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:50.789039 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b6798e3-449b-4f3b-900d-08e55e6acf43-cert podName:9b6798e3-449b-4f3b-900d-08e55e6acf43 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:54.789028041 +0000 UTC m=+42.719803101 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9b6798e3-449b-4f3b-900d-08e55e6acf43-cert") pod "ingress-canary-kql5p" (UID: "9b6798e3-449b-4f3b-900d-08e55e6acf43") : secret "canary-serving-cert" not found May 21 20:38:50.859023 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:50.858982 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hlljl" event={"ID":"0f3e31a1-421b-4147-8fe1-70facdf3c1b4","Type":"ContainerStarted","Data":"d08c8a3df2eb644ca139e168c729b8d9c073da148ebd1cd4b2059643247635e6"} May 21 20:38:50.883222 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:50.883168 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hlljl" podStartSLOduration=6.5006855009999995 podStartE2EDuration="38.883152543s" podCreationTimestamp="2026-05-21 20:38:12 +0000 UTC" firstStartedPulling="2026-05-21 20:38:15.47481168 +0000 UTC m=+3.405586743" lastFinishedPulling="2026-05-21 20:38:47.857278722 +0000 UTC m=+35.788053785" observedRunningTime="2026-05-21 20:38:50.880235695 +0000 UTC m=+38.811010782" watchObservedRunningTime="2026-05-21 20:38:50.883152543 +0000 UTC m=+38.813927626" May 21 20:38:52.300816 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:52.300777 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4615b277-5db1-4fdc-a5f8-42b00145b04c-original-pull-secret\") pod \"global-pull-secret-syncer-wvzdl\" (UID: \"4615b277-5db1-4fdc-a5f8-42b00145b04c\") " pod="kube-system/global-pull-secret-syncer-wvzdl" May 21 20:38:52.304557 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:52.304528 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4615b277-5db1-4fdc-a5f8-42b00145b04c-original-pull-secret\") pod \"global-pull-secret-syncer-wvzdl\" (UID: \"4615b277-5db1-4fdc-a5f8-42b00145b04c\") " pod="kube-system/global-pull-secret-syncer-wvzdl" May 21 20:38:52.597005 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:52.596966 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvzdl" May 21 20:38:52.736835 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:52.736801 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wvzdl"] May 21 20:38:52.740109 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:38:52.740073 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4615b277_5db1_4fdc_a5f8_42b00145b04c.slice/crio-b05531ea7906101c4720391f1ee97cff62d8ee450ae793fe4d56d04d79dad5b9 WatchSource:0}: Error finding container b05531ea7906101c4720391f1ee97cff62d8ee450ae793fe4d56d04d79dad5b9: Status 404 returned error can't find the container with id b05531ea7906101c4720391f1ee97cff62d8ee450ae793fe4d56d04d79dad5b9 May 21 20:38:52.864283 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:52.864191 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wvzdl" event={"ID":"4615b277-5db1-4fdc-a5f8-42b00145b04c","Type":"ContainerStarted","Data":"b05531ea7906101c4720391f1ee97cff62d8ee450ae793fe4d56d04d79dad5b9"} May 21 20:38:54.719175 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:54.719127 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a2f603e-8e52-4c17-9f71-0518c657f864-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-hn2r7\" (UID: \"0a2f603e-8e52-4c17-9f71-0518c657f864\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-hn2r7" May 21 20:38:54.719643 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:54.719233 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-registry-tls\") pod \"image-registry-759df6c9-tpdgh\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " pod="openshift-image-registry/image-registry-759df6c9-tpdgh" May 21 20:38:54.719643 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:54.719290 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 20:38:54.719643 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:54.719345 2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 20:38:54.719643 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:54.719357 2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-759df6c9-tpdgh: secret "image-registry-tls" not found May 21 20:38:54.719643 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:54.719362 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a2f603e-8e52-4c17-9f71-0518c657f864-networking-console-plugin-cert podName:0a2f603e-8e52-4c17-9f71-0518c657f864 nodeName:}" failed. No retries permitted until 2026-05-21 20:39:02.719343709 +0000 UTC m=+50.650118774 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0a2f603e-8e52-4c17-9f71-0518c657f864-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-hn2r7" (UID: "0a2f603e-8e52-4c17-9f71-0518c657f864") : secret "networking-console-plugin-cert" not found May 21 20:38:54.719643 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:54.719417 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-registry-tls podName:3b0dc320-bd9c-430a-bb6b-a38d2a5bb089 nodeName:}" failed. No retries permitted until 2026-05-21 20:39:02.719401463 +0000 UTC m=+50.650176542 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-registry-tls") pod "image-registry-759df6c9-tpdgh" (UID: "3b0dc320-bd9c-430a-bb6b-a38d2a5bb089") : secret "image-registry-tls" not found May 21 20:38:54.819954 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:54.819911 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba567318-f7e8-435e-b1c6-152074615586-metrics-tls\") pod \"dns-default-z7tv2\" (UID: \"ba567318-f7e8-435e-b1c6-152074615586\") " pod="openshift-dns/dns-default-z7tv2" May 21 20:38:54.820142 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:54.819971 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b6798e3-449b-4f3b-900d-08e55e6acf43-cert\") pod \"ingress-canary-kql5p\" (UID: \"9b6798e3-449b-4f3b-900d-08e55e6acf43\") " pod="openshift-ingress-canary/ingress-canary-kql5p" May 21 20:38:54.820142 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:54.820078 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:38:54.820142 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:54.820078 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:38:54.820142 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:54.820142 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba567318-f7e8-435e-b1c6-152074615586-metrics-tls podName:ba567318-f7e8-435e-b1c6-152074615586 nodeName:}" failed. No retries permitted until 2026-05-21 20:39:02.820121832 +0000 UTC m=+50.750896910 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ba567318-f7e8-435e-b1c6-152074615586-metrics-tls") pod "dns-default-z7tv2" (UID: "ba567318-f7e8-435e-b1c6-152074615586") : secret "dns-default-metrics-tls" not found May 21 20:38:54.820351 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:38:54.820159 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b6798e3-449b-4f3b-900d-08e55e6acf43-cert podName:9b6798e3-449b-4f3b-900d-08e55e6acf43 nodeName:}" failed. No retries permitted until 2026-05-21 20:39:02.820150238 +0000 UTC m=+50.750925298 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9b6798e3-449b-4f3b-900d-08e55e6acf43-cert") pod "ingress-canary-kql5p" (UID: "9b6798e3-449b-4f3b-900d-08e55e6acf43") : secret "canary-serving-cert" not found May 21 20:38:56.874847 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:56.874812 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wvzdl" event={"ID":"4615b277-5db1-4fdc-a5f8-42b00145b04c","Type":"ContainerStarted","Data":"2317b17405af5212676a8acf07c3364e5bbf37ec72319c6ab0f90df659934cdc"} May 21 20:38:56.889061 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:38:56.889000 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wvzdl" podStartSLOduration=33.15393074 podStartE2EDuration="36.888982724s" podCreationTimestamp="2026-05-21 20:38:20 +0000 UTC" firstStartedPulling="2026-05-21 20:38:52.74182455 +0000 UTC m=+40.672599613" lastFinishedPulling="2026-05-21 20:38:56.476876535 +0000 UTC m=+44.407651597" observedRunningTime="2026-05-21 20:38:56.888346865 +0000 UTC m=+44.819121949" watchObservedRunningTime="2026-05-21 20:38:56.888982724 +0000 UTC m=+44.819757808" May 21 20:39:02.779969 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:39:02.779924 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-registry-tls\") pod \"image-registry-759df6c9-tpdgh\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " pod="openshift-image-registry/image-registry-759df6c9-tpdgh" May 21 20:39:02.780534 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:39:02.780007 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a2f603e-8e52-4c17-9f71-0518c657f864-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-hn2r7\" (UID: \"0a2f603e-8e52-4c17-9f71-0518c657f864\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-hn2r7" May 21 20:39:02.780534 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:39:02.780121 2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 20:39:02.780534 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:39:02.780142 2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-759df6c9-tpdgh: secret "image-registry-tls" not found May 21 20:39:02.780534 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:39:02.780148 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 20:39:02.780534 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:39:02.780201 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-registry-tls podName:3b0dc320-bd9c-430a-bb6b-a38d2a5bb089 nodeName:}" failed. No retries permitted until 2026-05-21 20:39:18.780182285 +0000 UTC m=+66.710957350 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-registry-tls") pod "image-registry-759df6c9-tpdgh" (UID: "3b0dc320-bd9c-430a-bb6b-a38d2a5bb089") : secret "image-registry-tls" not found May 21 20:39:02.780534 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:39:02.780215 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a2f603e-8e52-4c17-9f71-0518c657f864-networking-console-plugin-cert podName:0a2f603e-8e52-4c17-9f71-0518c657f864 nodeName:}" failed. No retries permitted until 2026-05-21 20:39:18.780208182 +0000 UTC m=+66.710983242 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0a2f603e-8e52-4c17-9f71-0518c657f864-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-hn2r7" (UID: "0a2f603e-8e52-4c17-9f71-0518c657f864") : secret "networking-console-plugin-cert" not found May 21 20:39:02.880549 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:39:02.880509 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b6798e3-449b-4f3b-900d-08e55e6acf43-cert\") pod \"ingress-canary-kql5p\" (UID: \"9b6798e3-449b-4f3b-900d-08e55e6acf43\") " pod="openshift-ingress-canary/ingress-canary-kql5p" May 21 20:39:02.880707 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:39:02.880596 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba567318-f7e8-435e-b1c6-152074615586-metrics-tls\") pod \"dns-default-z7tv2\" (UID: \"ba567318-f7e8-435e-b1c6-152074615586\") " pod="openshift-dns/dns-default-z7tv2" May 21 20:39:02.880707 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:39:02.880676 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:39:02.880776 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:39:02.880727 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:39:02.880776 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:39:02.880749 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b6798e3-449b-4f3b-900d-08e55e6acf43-cert podName:9b6798e3-449b-4f3b-900d-08e55e6acf43 nodeName:}" failed. No retries permitted until 2026-05-21 20:39:18.880733695 +0000 UTC m=+66.811508755 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9b6798e3-449b-4f3b-900d-08e55e6acf43-cert") pod "ingress-canary-kql5p" (UID: "9b6798e3-449b-4f3b-900d-08e55e6acf43") : secret "canary-serving-cert" not found May 21 20:39:02.880866 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:39:02.880777 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba567318-f7e8-435e-b1c6-152074615586-metrics-tls podName:ba567318-f7e8-435e-b1c6-152074615586 nodeName:}" failed. No retries permitted until 2026-05-21 20:39:18.880757958 +0000 UTC m=+66.811533018 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ba567318-f7e8-435e-b1c6-152074615586-metrics-tls") pod "dns-default-z7tv2" (UID: "ba567318-f7e8-435e-b1c6-152074615586") : secret "dns-default-metrics-tls" not found May 21 20:39:11.845828 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:39:11.845798 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v7n7h" May 21 20:39:18.400012 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:39:18.399965 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3bdf9a6b-e989-4794-bbe7-3396ae7ddc07-metrics-certs\") pod \"network-metrics-daemon-dgrfc\" (UID: \"3bdf9a6b-e989-4794-bbe7-3396ae7ddc07\") " pod="openshift-multus/network-metrics-daemon-dgrfc" May 21 20:39:18.402358 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:39:18.402337 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 20:39:18.410634 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:39:18.410599 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 20:39:18.410737 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:39:18.410711 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bdf9a6b-e989-4794-bbe7-3396ae7ddc07-metrics-certs podName:3bdf9a6b-e989-4794-bbe7-3396ae7ddc07 nodeName:}" failed. No retries permitted until 2026-05-21 20:40:22.410684502 +0000 UTC m=+130.341459576 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3bdf9a6b-e989-4794-bbe7-3396ae7ddc07-metrics-certs") pod "network-metrics-daemon-dgrfc" (UID: "3bdf9a6b-e989-4794-bbe7-3396ae7ddc07") : secret "metrics-daemon-secret" not found May 21 20:39:18.500602 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:39:18.500569 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8m8t5\" (UniqueName: \"kubernetes.io/projected/fc75acb2-0d8e-462c-98b4-1e8f5a06054d-kube-api-access-8m8t5\") pod \"network-check-target-hr8nm\" (UID: \"fc75acb2-0d8e-462c-98b4-1e8f5a06054d\") " pod="openshift-network-diagnostics/network-check-target-hr8nm" May 21 20:39:18.503265 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:39:18.503240 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 20:39:18.513049 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:39:18.513022 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 20:39:18.523708 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:39:18.523683 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m8t5\" (UniqueName: \"kubernetes.io/projected/fc75acb2-0d8e-462c-98b4-1e8f5a06054d-kube-api-access-8m8t5\") pod \"network-check-target-hr8nm\" (UID: \"fc75acb2-0d8e-462c-98b4-1e8f5a06054d\") " pod="openshift-network-diagnostics/network-check-target-hr8nm" May 21 20:39:18.710078 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:39:18.709991 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hrp5p\"" May 21 20:39:18.718618 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:39:18.718588 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr8nm" May 21 20:39:18.802957 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:39:18.802921 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a2f603e-8e52-4c17-9f71-0518c657f864-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-hn2r7\" (UID: \"0a2f603e-8e52-4c17-9f71-0518c657f864\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-hn2r7" May 21 20:39:18.803128 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:39:18.803000 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-registry-tls\") pod \"image-registry-759df6c9-tpdgh\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " pod="openshift-image-registry/image-registry-759df6c9-tpdgh" May 21 20:39:18.803128 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:39:18.803072 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 20:39:18.803128 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:39:18.803117 2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 20:39:18.803128 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:39:18.803131 2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-759df6c9-tpdgh: secret "image-registry-tls" not found May 21 20:39:18.803303 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:39:18.803136 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a2f603e-8e52-4c17-9f71-0518c657f864-networking-console-plugin-cert podName:0a2f603e-8e52-4c17-9f71-0518c657f864 nodeName:}" failed. No retries permitted until 2026-05-21 20:39:50.80312109 +0000 UTC m=+98.733896155 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0a2f603e-8e52-4c17-9f71-0518c657f864-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-hn2r7" (UID: "0a2f603e-8e52-4c17-9f71-0518c657f864") : secret "networking-console-plugin-cert" not found May 21 20:39:18.803303 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:39:18.803181 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-registry-tls podName:3b0dc320-bd9c-430a-bb6b-a38d2a5bb089 nodeName:}" failed. No retries permitted until 2026-05-21 20:39:50.803163673 +0000 UTC m=+98.733938754 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-registry-tls") pod "image-registry-759df6c9-tpdgh" (UID: "3b0dc320-bd9c-430a-bb6b-a38d2a5bb089") : secret "image-registry-tls" not found May 21 20:39:18.842057 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:39:18.842025 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hr8nm"] May 21 20:39:18.845126 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:39:18.845088 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc75acb2_0d8e_462c_98b4_1e8f5a06054d.slice/crio-ad6066ef9c7f15db2836ed6f7fedef820831960027bb820162ade163103c0999 WatchSource:0}: Error finding container ad6066ef9c7f15db2836ed6f7fedef820831960027bb820162ade163103c0999: Status 404 returned error can't find the container with id ad6066ef9c7f15db2836ed6f7fedef820831960027bb820162ade163103c0999 May 21 20:39:18.903479 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:39:18.903442 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b6798e3-449b-4f3b-900d-08e55e6acf43-cert\") pod \"ingress-canary-kql5p\" (UID: \"9b6798e3-449b-4f3b-900d-08e55e6acf43\") " pod="openshift-ingress-canary/ingress-canary-kql5p" May 21 20:39:18.903650 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:39:18.903578 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba567318-f7e8-435e-b1c6-152074615586-metrics-tls\") pod \"dns-default-z7tv2\" (UID: \"ba567318-f7e8-435e-b1c6-152074615586\") " pod="openshift-dns/dns-default-z7tv2" May 21 20:39:18.903650 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:39:18.903614 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:39:18.903750 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:39:18.903666 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:39:18.903750 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:39:18.903690 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b6798e3-449b-4f3b-900d-08e55e6acf43-cert podName:9b6798e3-449b-4f3b-900d-08e55e6acf43 nodeName:}" failed. No retries permitted until 2026-05-21 20:39:50.903670499 +0000 UTC m=+98.834445578 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9b6798e3-449b-4f3b-900d-08e55e6acf43-cert") pod "ingress-canary-kql5p" (UID: "9b6798e3-449b-4f3b-900d-08e55e6acf43") : secret "canary-serving-cert" not found May 21 20:39:18.903750 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:39:18.903708 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba567318-f7e8-435e-b1c6-152074615586-metrics-tls podName:ba567318-f7e8-435e-b1c6-152074615586 nodeName:}" failed. No retries permitted until 2026-05-21 20:39:50.903699398 +0000 UTC m=+98.834474461 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ba567318-f7e8-435e-b1c6-152074615586-metrics-tls") pod "dns-default-z7tv2" (UID: "ba567318-f7e8-435e-b1c6-152074615586") : secret "dns-default-metrics-tls" not found May 21 20:39:18.921945 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:39:18.921906 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hr8nm" event={"ID":"fc75acb2-0d8e-462c-98b4-1e8f5a06054d","Type":"ContainerStarted","Data":"ad6066ef9c7f15db2836ed6f7fedef820831960027bb820162ade163103c0999"} May 21 20:39:21.929110 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:39:21.929017 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hr8nm" event={"ID":"fc75acb2-0d8e-462c-98b4-1e8f5a06054d","Type":"ContainerStarted","Data":"f948e1e50a7181bfac3b50fda96207adbdb8d18e822d5e25a7a2d198fb06470c"} May 21 20:39:21.929562 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:39:21.929158 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hr8nm" May 21 20:39:21.944105 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:39:21.944026 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hr8nm" podStartSLOduration=67.201592007 podStartE2EDuration="1m9.944009684s" podCreationTimestamp="2026-05-21 20:38:12 +0000 UTC" firstStartedPulling="2026-05-21 20:39:18.847128766 +0000 UTC m=+66.777903846" lastFinishedPulling="2026-05-21 20:39:21.589546463 +0000 UTC m=+69.520321523" observedRunningTime="2026-05-21 20:39:21.943705892 +0000 UTC m=+69.874480974" watchObservedRunningTime="2026-05-21 20:39:21.944009684 +0000 UTC m=+69.874784766" May 21 20:39:50.848965 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:39:50.848930 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a2f603e-8e52-4c17-9f71-0518c657f864-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-hn2r7\" (UID: \"0a2f603e-8e52-4c17-9f71-0518c657f864\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-hn2r7" May 21 20:39:50.849352 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:39:50.848989 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-registry-tls\") pod \"image-registry-759df6c9-tpdgh\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " pod="openshift-image-registry/image-registry-759df6c9-tpdgh" May 21 20:39:50.849352 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:39:50.849076 2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 20:39:50.849352 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:39:50.849078 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 20:39:50.849352 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:39:50.849145 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a2f603e-8e52-4c17-9f71-0518c657f864-networking-console-plugin-cert podName:0a2f603e-8e52-4c17-9f71-0518c657f864 nodeName:}" failed. No retries permitted until 2026-05-21 20:40:54.849130216 +0000 UTC m=+162.779905276 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0a2f603e-8e52-4c17-9f71-0518c657f864-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-hn2r7" (UID: "0a2f603e-8e52-4c17-9f71-0518c657f864") : secret "networking-console-plugin-cert" not found May 21 20:39:50.849352 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:39:50.849087 2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-759df6c9-tpdgh: secret "image-registry-tls" not found May 21 20:39:50.849352 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:39:50.849216 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-registry-tls podName:3b0dc320-bd9c-430a-bb6b-a38d2a5bb089 nodeName:}" failed. No retries permitted until 2026-05-21 20:40:54.849204941 +0000 UTC m=+162.779980002 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-registry-tls") pod "image-registry-759df6c9-tpdgh" (UID: "3b0dc320-bd9c-430a-bb6b-a38d2a5bb089") : secret "image-registry-tls" not found May 21 20:39:50.949912 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:39:50.949862 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba567318-f7e8-435e-b1c6-152074615586-metrics-tls\") pod \"dns-default-z7tv2\" (UID: \"ba567318-f7e8-435e-b1c6-152074615586\") " pod="openshift-dns/dns-default-z7tv2" May 21 20:39:50.950018 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:39:50.949923 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b6798e3-449b-4f3b-900d-08e55e6acf43-cert\") pod \"ingress-canary-kql5p\" (UID: \"9b6798e3-449b-4f3b-900d-08e55e6acf43\") " pod="openshift-ingress-canary/ingress-canary-kql5p" May 21 20:39:50.950051 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:39:50.950009 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:39:50.950051 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:39:50.950046 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:39:50.950112 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:39:50.950072 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba567318-f7e8-435e-b1c6-152074615586-metrics-tls podName:ba567318-f7e8-435e-b1c6-152074615586 nodeName:}" failed. No retries permitted until 2026-05-21 20:40:54.950057777 +0000 UTC m=+162.880832841 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ba567318-f7e8-435e-b1c6-152074615586-metrics-tls") pod "dns-default-z7tv2" (UID: "ba567318-f7e8-435e-b1c6-152074615586") : secret "dns-default-metrics-tls" not found May 21 20:39:50.950112 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:39:50.950092 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b6798e3-449b-4f3b-900d-08e55e6acf43-cert podName:9b6798e3-449b-4f3b-900d-08e55e6acf43 nodeName:}" failed. No retries permitted until 2026-05-21 20:40:54.95008055 +0000 UTC m=+162.880855616 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9b6798e3-449b-4f3b-900d-08e55e6acf43-cert") pod "ingress-canary-kql5p" (UID: "9b6798e3-449b-4f3b-900d-08e55e6acf43") : secret "canary-serving-cert" not found May 21 20:39:52.933567 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:39:52.933536 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hr8nm" May 21 20:40:22.482965 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:22.482924 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3bdf9a6b-e989-4794-bbe7-3396ae7ddc07-metrics-certs\") pod \"network-metrics-daemon-dgrfc\" (UID: \"3bdf9a6b-e989-4794-bbe7-3396ae7ddc07\") " pod="openshift-multus/network-metrics-daemon-dgrfc" May 21 20:40:22.483459 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:40:22.483075 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 20:40:22.483459 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:40:22.483153 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bdf9a6b-e989-4794-bbe7-3396ae7ddc07-metrics-certs podName:3bdf9a6b-e989-4794-bbe7-3396ae7ddc07 nodeName:}" failed. No retries permitted until 2026-05-21 20:42:24.483135912 +0000 UTC m=+252.413910973 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3bdf9a6b-e989-4794-bbe7-3396ae7ddc07-metrics-certs") pod "network-metrics-daemon-dgrfc" (UID: "3bdf9a6b-e989-4794-bbe7-3396ae7ddc07") : secret "metrics-daemon-secret" not found May 21 20:40:49.960593 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:40:49.960534 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-759df6c9-tpdgh" podUID="3b0dc320-bd9c-430a-bb6b-a38d2a5bb089" May 21 20:40:49.979906 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:40:49.979867 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-hn2r7" podUID="0a2f603e-8e52-4c17-9f71-0518c657f864" May 21 20:40:49.999134 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:40:49.999108 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-z7tv2" podUID="ba567318-f7e8-435e-b1c6-152074615586" May 21 20:40:50.021503 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:40:50.021468 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-kql5p" podUID="9b6798e3-449b-4f3b-900d-08e55e6acf43" May 21 20:40:50.089960 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:50.089935 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z7tv2" May 21 20:40:50.090122 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:50.089935 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-759df6c9-tpdgh" May 21 20:40:51.703107 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:40:51.703043 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-dgrfc" podUID="3bdf9a6b-e989-4794-bbe7-3396ae7ddc07" May 21 20:40:54.917709 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:54.917651 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-registry-tls\") pod \"image-registry-759df6c9-tpdgh\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " pod="openshift-image-registry/image-registry-759df6c9-tpdgh" May 21 20:40:54.918144 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:54.917743 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a2f603e-8e52-4c17-9f71-0518c657f864-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-hn2r7\" (UID: \"0a2f603e-8e52-4c17-9f71-0518c657f864\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-hn2r7" May 21 20:40:54.918144 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:40:54.917803 2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 20:40:54.918144 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:40:54.917824 2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-759df6c9-tpdgh: secret "image-registry-tls" not found May 21 20:40:54.918144 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:40:54.917828 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 20:40:54.918144 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:40:54.917878 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-registry-tls podName:3b0dc320-bd9c-430a-bb6b-a38d2a5bb089 nodeName:}" failed. No retries permitted until 2026-05-21 20:42:56.917863284 +0000 UTC m=+284.848638344 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-registry-tls") pod "image-registry-759df6c9-tpdgh" (UID: "3b0dc320-bd9c-430a-bb6b-a38d2a5bb089") : secret "image-registry-tls" not found May 21 20:40:54.918144 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:40:54.917891 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a2f603e-8e52-4c17-9f71-0518c657f864-networking-console-plugin-cert podName:0a2f603e-8e52-4c17-9f71-0518c657f864 nodeName:}" failed. No retries permitted until 2026-05-21 20:42:56.917885708 +0000 UTC m=+284.848660768 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0a2f603e-8e52-4c17-9f71-0518c657f864-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-hn2r7" (UID: "0a2f603e-8e52-4c17-9f71-0518c657f864") : secret "networking-console-plugin-cert" not found May 21 20:40:55.018437 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.018387 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba567318-f7e8-435e-b1c6-152074615586-metrics-tls\") pod \"dns-default-z7tv2\" (UID: \"ba567318-f7e8-435e-b1c6-152074615586\") " pod="openshift-dns/dns-default-z7tv2" May 21 20:40:55.018437 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.018444 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b6798e3-449b-4f3b-900d-08e55e6acf43-cert\") pod \"ingress-canary-kql5p\" (UID: \"9b6798e3-449b-4f3b-900d-08e55e6acf43\") " pod="openshift-ingress-canary/ingress-canary-kql5p" May 21 20:40:55.018606 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:40:55.018537 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:40:55.018606 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:40:55.018597 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba567318-f7e8-435e-b1c6-152074615586-metrics-tls podName:ba567318-f7e8-435e-b1c6-152074615586 nodeName:}" failed. No retries permitted until 2026-05-21 20:42:57.018582052 +0000 UTC m=+284.949357116 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ba567318-f7e8-435e-b1c6-152074615586-metrics-tls") pod "dns-default-z7tv2" (UID: "ba567318-f7e8-435e-b1c6-152074615586") : secret "dns-default-metrics-tls" not found May 21 20:40:55.018690 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:40:55.018537 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:40:55.018690 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:40:55.018668 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b6798e3-449b-4f3b-900d-08e55e6acf43-cert podName:9b6798e3-449b-4f3b-900d-08e55e6acf43 nodeName:}" failed. No retries permitted until 2026-05-21 20:42:57.018656221 +0000 UTC m=+284.949431281 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9b6798e3-449b-4f3b-900d-08e55e6acf43-cert") pod "ingress-canary-kql5p" (UID: "9b6798e3-449b-4f3b-900d-08e55e6acf43") : secret "canary-serving-cert" not found May 21 20:40:55.274854 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.274769 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nn778"] May 21 20:40:55.277601 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.277586 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nn778" May 21 20:40:55.279748 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.279721 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-9zx44\"" May 21 20:40:55.279748 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.279733 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 21 20:40:55.279955 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.279752 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 21 20:40:55.279955 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.279848 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 21 20:40:55.280106 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.280093 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 21 20:40:55.286917 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.286888 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nn778"] May 21 20:40:55.321226 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.321180 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e8d1d929-7502-4b6b-b5d4-a66201f06c8e-config\") pod \"kube-storage-version-migrator-operator-565644f49-nn778\" (UID: \"e8d1d929-7502-4b6b-b5d4-a66201f06c8e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nn778" May 21 20:40:55.321226 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.321227 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x27xj\" (UniqueName: \"kubernetes.io/projected/e8d1d929-7502-4b6b-b5d4-a66201f06c8e-kube-api-access-x27xj\") pod \"kube-storage-version-migrator-operator-565644f49-nn778\" (UID: \"e8d1d929-7502-4b6b-b5d4-a66201f06c8e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nn778" May 21 20:40:55.321586 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.321410 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e8d1d929-7502-4b6b-b5d4-a66201f06c8e-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-nn778\" (UID: \"e8d1d929-7502-4b6b-b5d4-a66201f06c8e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nn778" May 21 20:40:55.373064 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.373029 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-kwvc6"] May 21 20:40:55.376029 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.376006 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-kwvc6" May 21 20:40:55.377116 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.377089 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-lcsb7"] May 21 20:40:55.377917 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.377894 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 21 20:40:55.378186 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.378168 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 21 20:40:55.378445 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.378345 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 21 20:40:55.378445 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.378356 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 21 20:40:55.378578 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.378472 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-qq2fv\"" May 21 20:40:55.379923 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.379906 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lcsb7" May 21 20:40:55.381494 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.381477 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 21 20:40:55.382328 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.382311 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 21 20:40:55.382515 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.382475 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 21 20:40:55.382670 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.382652 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-dv462\"" May 21 20:40:55.384148 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.384131 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-kwvc6"] May 21 20:40:55.394244 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.394226 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-lcsb7"] May 21 20:40:55.422175 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.422145 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e8d1d929-7502-4b6b-b5d4-a66201f06c8e-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-nn778\" (UID: \"e8d1d929-7502-4b6b-b5d4-a66201f06c8e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nn778" May 21 20:40:55.422175 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.422178 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ea006f9a-fd3a-47a3-8edf-cae4c8b385fb-config\") pod \"service-ca-operator-57b5b68b8-kwvc6\" (UID: \"ea006f9a-fd3a-47a3-8edf-cae4c8b385fb\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-kwvc6" May 21 20:40:55.422418 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.422203 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnbvq\" (UniqueName: \"kubernetes.io/projected/96cb3215-4d33-4543-8305-7a5843062860-kube-api-access-cnbvq\") pod \"cluster-samples-operator-697587599-lcsb7\" (UID: \"96cb3215-4d33-4543-8305-7a5843062860\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lcsb7" May 21 20:40:55.422418 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.422349 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e8d1d929-7502-4b6b-b5d4-a66201f06c8e-config\") pod \"kube-storage-version-migrator-operator-565644f49-nn778\" (UID: \"e8d1d929-7502-4b6b-b5d4-a66201f06c8e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nn778" May 21 20:40:55.422539 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.422408 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/96cb3215-4d33-4543-8305-7a5843062860-samples-operator-tls\") pod \"cluster-samples-operator-697587599-lcsb7\" (UID: \"96cb3215-4d33-4543-8305-7a5843062860\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lcsb7" May 21 20:40:55.422539 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.422463 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ea006f9a-fd3a-47a3-8edf-cae4c8b385fb-serving-cert\") pod \"service-ca-operator-57b5b68b8-kwvc6\" (UID: \"ea006f9a-fd3a-47a3-8edf-cae4c8b385fb\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-kwvc6" May 21 20:40:55.422539 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.422486 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x27xj\" (UniqueName: \"kubernetes.io/projected/e8d1d929-7502-4b6b-b5d4-a66201f06c8e-kube-api-access-x27xj\") pod \"kube-storage-version-migrator-operator-565644f49-nn778\" (UID: \"e8d1d929-7502-4b6b-b5d4-a66201f06c8e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nn778" May 21 20:40:55.422539 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.422513 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nltfz\" (UniqueName: \"kubernetes.io/projected/ea006f9a-fd3a-47a3-8edf-cae4c8b385fb-kube-api-access-nltfz\") pod \"service-ca-operator-57b5b68b8-kwvc6\" (UID: \"ea006f9a-fd3a-47a3-8edf-cae4c8b385fb\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-kwvc6" May 21 20:40:55.422945 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.422918 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e8d1d929-7502-4b6b-b5d4-a66201f06c8e-config\") pod \"kube-storage-version-migrator-operator-565644f49-nn778\" (UID: \"e8d1d929-7502-4b6b-b5d4-a66201f06c8e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nn778" May 21 20:40:55.424635 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.424618 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e8d1d929-7502-4b6b-b5d4-a66201f06c8e-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-nn778\" (UID: \"e8d1d929-7502-4b6b-b5d4-a66201f06c8e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nn778" May 21 20:40:55.431211 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.431190 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x27xj\" (UniqueName: \"kubernetes.io/projected/e8d1d929-7502-4b6b-b5d4-a66201f06c8e-kube-api-access-x27xj\") pod \"kube-storage-version-migrator-operator-565644f49-nn778\" (UID: \"e8d1d929-7502-4b6b-b5d4-a66201f06c8e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nn778" May 21 20:40:55.485972 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.485938 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-786d87b5dd-59596"] May 21 20:40:55.489178 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.489156 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-786d87b5dd-59596" May 21 20:40:55.491210 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.491182 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 20:40:55.491399 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.491358 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 21 20:40:55.491488 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.491470 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 20:40:55.491545 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.491500 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 21 20:40:55.491545 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.491510 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 21 20:40:55.491936 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.491917 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 21 20:40:55.491936 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.491931 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ndzdr\"" May 21 20:40:55.502422 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.502361 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-786d87b5dd-59596"] May 21 20:40:55.523348 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.523313 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-metrics-certs\") pod \"router-default-786d87b5dd-59596\" (UID: \"53afa1f9-37ff-4f67-8a7d-4b28bcb756ab\") " pod="openshift-ingress/router-default-786d87b5dd-59596" May 21 20:40:55.523529 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.523363 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-default-certificate\") pod \"router-default-786d87b5dd-59596\" (UID: \"53afa1f9-37ff-4f67-8a7d-4b28bcb756ab\") " pod="openshift-ingress/router-default-786d87b5dd-59596" May 21 20:40:55.523529 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.523449 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cnbvq\" (UniqueName: \"kubernetes.io/projected/96cb3215-4d33-4543-8305-7a5843062860-kube-api-access-cnbvq\") pod \"cluster-samples-operator-697587599-lcsb7\" (UID: \"96cb3215-4d33-4543-8305-7a5843062860\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lcsb7" May 21 20:40:55.523529 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.523480 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-service-ca-bundle\") pod \"router-default-786d87b5dd-59596\" (UID: \"53afa1f9-37ff-4f67-8a7d-4b28bcb756ab\") " pod="openshift-ingress/router-default-786d87b5dd-59596" May 21 20:40:55.523529 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.523497 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pqss\" (UniqueName: \"kubernetes.io/projected/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-kube-api-access-6pqss\") pod \"router-default-786d87b5dd-59596\" (UID: \"53afa1f9-37ff-4f67-8a7d-4b28bcb756ab\") " pod="openshift-ingress/router-default-786d87b5dd-59596" May 21 20:40:55.523529 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.523518 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ea006f9a-fd3a-47a3-8edf-cae4c8b385fb-serving-cert\") pod \"service-ca-operator-57b5b68b8-kwvc6\" (UID: \"ea006f9a-fd3a-47a3-8edf-cae4c8b385fb\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-kwvc6" May 21 20:40:55.523728 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.523600 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ea006f9a-fd3a-47a3-8edf-cae4c8b385fb-config\") pod \"service-ca-operator-57b5b68b8-kwvc6\" (UID: \"ea006f9a-fd3a-47a3-8edf-cae4c8b385fb\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-kwvc6" May 21 20:40:55.523728 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.523616 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-stats-auth\") pod \"router-default-786d87b5dd-59596\" (UID: \"53afa1f9-37ff-4f67-8a7d-4b28bcb756ab\") " pod="openshift-ingress/router-default-786d87b5dd-59596" May 21 20:40:55.523728 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.523644 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/96cb3215-4d33-4543-8305-7a5843062860-samples-operator-tls\") pod \"cluster-samples-operator-697587599-lcsb7\" (UID: \"96cb3215-4d33-4543-8305-7a5843062860\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lcsb7" May 21 20:40:55.523728 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.523666 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nltfz\" (UniqueName: \"kubernetes.io/projected/ea006f9a-fd3a-47a3-8edf-cae4c8b385fb-kube-api-access-nltfz\") pod \"service-ca-operator-57b5b68b8-kwvc6\" (UID: \"ea006f9a-fd3a-47a3-8edf-cae4c8b385fb\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-kwvc6" May 21 20:40:55.524017 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:40:55.523753 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 20:40:55.524017 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:40:55.523816 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96cb3215-4d33-4543-8305-7a5843062860-samples-operator-tls podName:96cb3215-4d33-4543-8305-7a5843062860 nodeName:}" failed. No retries permitted until 2026-05-21 20:40:56.023797233 +0000 UTC m=+163.954572312 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/96cb3215-4d33-4543-8305-7a5843062860-samples-operator-tls") pod "cluster-samples-operator-697587599-lcsb7" (UID: "96cb3215-4d33-4543-8305-7a5843062860") : secret "samples-operator-tls" not found May 21 20:40:55.524250 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.524230 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ea006f9a-fd3a-47a3-8edf-cae4c8b385fb-config\") pod \"service-ca-operator-57b5b68b8-kwvc6\" (UID: \"ea006f9a-fd3a-47a3-8edf-cae4c8b385fb\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-kwvc6" May 21 20:40:55.525956 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.525916 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ea006f9a-fd3a-47a3-8edf-cae4c8b385fb-serving-cert\") pod \"service-ca-operator-57b5b68b8-kwvc6\" (UID: \"ea006f9a-fd3a-47a3-8edf-cae4c8b385fb\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-kwvc6" May 21 20:40:55.540257 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.540228 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nltfz\" (UniqueName: \"kubernetes.io/projected/ea006f9a-fd3a-47a3-8edf-cae4c8b385fb-kube-api-access-nltfz\") pod \"service-ca-operator-57b5b68b8-kwvc6\" (UID: \"ea006f9a-fd3a-47a3-8edf-cae4c8b385fb\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-kwvc6" May 21 20:40:55.540390 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.540312 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnbvq\" (UniqueName: \"kubernetes.io/projected/96cb3215-4d33-4543-8305-7a5843062860-kube-api-access-cnbvq\") pod \"cluster-samples-operator-697587599-lcsb7\" (UID: \"96cb3215-4d33-4543-8305-7a5843062860\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lcsb7" May 21 20:40:55.588352 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.588312 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nn778" May 21 20:40:55.624742 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.624709 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-stats-auth\") pod \"router-default-786d87b5dd-59596\" (UID: \"53afa1f9-37ff-4f67-8a7d-4b28bcb756ab\") " pod="openshift-ingress/router-default-786d87b5dd-59596" May 21 20:40:55.624907 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.624813 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-metrics-certs\") pod \"router-default-786d87b5dd-59596\" (UID: \"53afa1f9-37ff-4f67-8a7d-4b28bcb756ab\") " pod="openshift-ingress/router-default-786d87b5dd-59596" May 21 20:40:55.624907 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.624860 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-default-certificate\") pod \"router-default-786d87b5dd-59596\" (UID: \"53afa1f9-37ff-4f67-8a7d-4b28bcb756ab\") " pod="openshift-ingress/router-default-786d87b5dd-59596" May 21 20:40:55.624981 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:40:55.624959 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 20:40:55.625036 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:40:55.625025 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-metrics-certs podName:53afa1f9-37ff-4f67-8a7d-4b28bcb756ab nodeName:}" failed. No retries permitted until 2026-05-21 20:40:56.1250104 +0000 UTC m=+164.055785461 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-metrics-certs") pod "router-default-786d87b5dd-59596" (UID: "53afa1f9-37ff-4f67-8a7d-4b28bcb756ab") : secret "router-metrics-certs-default" not found May 21 20:40:55.625086 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.625048 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-service-ca-bundle\") pod \"router-default-786d87b5dd-59596\" (UID: \"53afa1f9-37ff-4f67-8a7d-4b28bcb756ab\") " pod="openshift-ingress/router-default-786d87b5dd-59596" May 21 20:40:55.625086 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.625075 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6pqss\" (UniqueName: \"kubernetes.io/projected/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-kube-api-access-6pqss\") pod \"router-default-786d87b5dd-59596\" (UID: \"53afa1f9-37ff-4f67-8a7d-4b28bcb756ab\") " pod="openshift-ingress/router-default-786d87b5dd-59596" May 21 20:40:55.625236 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:40:55.625216 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-service-ca-bundle podName:53afa1f9-37ff-4f67-8a7d-4b28bcb756ab nodeName:}" failed. No retries permitted until 2026-05-21 20:40:56.125197412 +0000 UTC m=+164.055972492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-service-ca-bundle") pod "router-default-786d87b5dd-59596" (UID: "53afa1f9-37ff-4f67-8a7d-4b28bcb756ab") : configmap references non-existent config key: service-ca.crt May 21 20:40:55.627379 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.627344 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-stats-auth\") pod \"router-default-786d87b5dd-59596\" (UID: \"53afa1f9-37ff-4f67-8a7d-4b28bcb756ab\") " pod="openshift-ingress/router-default-786d87b5dd-59596" May 21 20:40:55.627482 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.627383 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-default-certificate\") pod \"router-default-786d87b5dd-59596\" (UID: \"53afa1f9-37ff-4f67-8a7d-4b28bcb756ab\") " pod="openshift-ingress/router-default-786d87b5dd-59596" May 21 20:40:55.639277 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.639222 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pqss\" (UniqueName: \"kubernetes.io/projected/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-kube-api-access-6pqss\") pod \"router-default-786d87b5dd-59596\" (UID: \"53afa1f9-37ff-4f67-8a7d-4b28bcb756ab\") " pod="openshift-ingress/router-default-786d87b5dd-59596" May 21 20:40:55.686901 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.686857 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-kwvc6" May 21 20:40:55.712899 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.712871 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nn778"] May 21 20:40:55.715347 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:40:55.715310 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8d1d929_7502_4b6b_b5d4_a66201f06c8e.slice/crio-4aad9a0243247d3cc9fea477becdf3d9993647f255037ac191b200faedfa1567 WatchSource:0}: Error finding container 4aad9a0243247d3cc9fea477becdf3d9993647f255037ac191b200faedfa1567: Status 404 returned error can't find the container with id 4aad9a0243247d3cc9fea477becdf3d9993647f255037ac191b200faedfa1567 May 21 20:40:55.808358 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:55.808277 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-kwvc6"] May 21 20:40:55.813166 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:40:55.811796 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea006f9a_fd3a_47a3_8edf_cae4c8b385fb.slice/crio-8e5d29a97bbd56fa5ed03ff11241028e38d59f12575ed592f6b06a90d5bf4a07 WatchSource:0}: Error finding container 8e5d29a97bbd56fa5ed03ff11241028e38d59f12575ed592f6b06a90d5bf4a07: Status 404 returned error can't find the container with id 8e5d29a97bbd56fa5ed03ff11241028e38d59f12575ed592f6b06a90d5bf4a07 May 21 20:40:56.028543 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:56.028497 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/96cb3215-4d33-4543-8305-7a5843062860-samples-operator-tls\") pod \"cluster-samples-operator-697587599-lcsb7\" (UID: \"96cb3215-4d33-4543-8305-7a5843062860\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lcsb7" May 21 20:40:56.028976 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:40:56.028671 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 20:40:56.028976 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:40:56.028756 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96cb3215-4d33-4543-8305-7a5843062860-samples-operator-tls podName:96cb3215-4d33-4543-8305-7a5843062860 nodeName:}" failed. No retries permitted until 2026-05-21 20:40:57.028735633 +0000 UTC m=+164.959510712 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/96cb3215-4d33-4543-8305-7a5843062860-samples-operator-tls") pod "cluster-samples-operator-697587599-lcsb7" (UID: "96cb3215-4d33-4543-8305-7a5843062860") : secret "samples-operator-tls" not found May 21 20:40:56.101668 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:56.101640 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nn778" event={"ID":"e8d1d929-7502-4b6b-b5d4-a66201f06c8e","Type":"ContainerStarted","Data":"4aad9a0243247d3cc9fea477becdf3d9993647f255037ac191b200faedfa1567"} May 21 20:40:56.102560 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:56.102535 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-kwvc6" event={"ID":"ea006f9a-fd3a-47a3-8edf-cae4c8b385fb","Type":"ContainerStarted","Data":"8e5d29a97bbd56fa5ed03ff11241028e38d59f12575ed592f6b06a90d5bf4a07"} May 21 20:40:56.129660 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:56.129621 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-metrics-certs\") pod \"router-default-786d87b5dd-59596\" (UID: \"53afa1f9-37ff-4f67-8a7d-4b28bcb756ab\") " pod="openshift-ingress/router-default-786d87b5dd-59596" May 21 20:40:56.129797 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:56.129676 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-service-ca-bundle\") pod \"router-default-786d87b5dd-59596\" (UID: \"53afa1f9-37ff-4f67-8a7d-4b28bcb756ab\") " pod="openshift-ingress/router-default-786d87b5dd-59596" May 21 20:40:56.129797 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:40:56.129773 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 20:40:56.129861 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:40:56.129782 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-service-ca-bundle podName:53afa1f9-37ff-4f67-8a7d-4b28bcb756ab nodeName:}" failed. No retries permitted until 2026-05-21 20:40:57.129770437 +0000 UTC m=+165.060545497 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-service-ca-bundle") pod "router-default-786d87b5dd-59596" (UID: "53afa1f9-37ff-4f67-8a7d-4b28bcb756ab") : configmap references non-existent config key: service-ca.crt May 21 20:40:56.129861 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:40:56.129836 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-metrics-certs podName:53afa1f9-37ff-4f67-8a7d-4b28bcb756ab nodeName:}" failed. No retries permitted until 2026-05-21 20:40:57.129820866 +0000 UTC m=+165.060595926 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-metrics-certs") pod "router-default-786d87b5dd-59596" (UID: "53afa1f9-37ff-4f67-8a7d-4b28bcb756ab") : secret "router-metrics-certs-default" not found May 21 20:40:57.037076 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:57.037036 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/96cb3215-4d33-4543-8305-7a5843062860-samples-operator-tls\") pod \"cluster-samples-operator-697587599-lcsb7\" (UID: \"96cb3215-4d33-4543-8305-7a5843062860\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lcsb7" May 21 20:40:57.037461 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:40:57.037143 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 20:40:57.037461 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:40:57.037194 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96cb3215-4d33-4543-8305-7a5843062860-samples-operator-tls podName:96cb3215-4d33-4543-8305-7a5843062860 nodeName:}" failed. No retries permitted until 2026-05-21 20:40:59.037181154 +0000 UTC m=+166.967956220 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/96cb3215-4d33-4543-8305-7a5843062860-samples-operator-tls") pod "cluster-samples-operator-697587599-lcsb7" (UID: "96cb3215-4d33-4543-8305-7a5843062860") : secret "samples-operator-tls" not found May 21 20:40:57.137540 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:57.137506 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-metrics-certs\") pod \"router-default-786d87b5dd-59596\" (UID: \"53afa1f9-37ff-4f67-8a7d-4b28bcb756ab\") " pod="openshift-ingress/router-default-786d87b5dd-59596" May 21 20:40:57.137708 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:57.137587 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-service-ca-bundle\") pod \"router-default-786d87b5dd-59596\" (UID: \"53afa1f9-37ff-4f67-8a7d-4b28bcb756ab\") " pod="openshift-ingress/router-default-786d87b5dd-59596" May 21 20:40:57.137708 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:40:57.137673 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 20:40:57.137821 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:40:57.137749 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-metrics-certs podName:53afa1f9-37ff-4f67-8a7d-4b28bcb756ab nodeName:}" failed. No retries permitted until 2026-05-21 20:40:59.137729882 +0000 UTC m=+167.068504947 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-metrics-certs") pod "router-default-786d87b5dd-59596" (UID: "53afa1f9-37ff-4f67-8a7d-4b28bcb756ab") : secret "router-metrics-certs-default" not found May 21 20:40:57.137821 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:40:57.137769 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-service-ca-bundle podName:53afa1f9-37ff-4f67-8a7d-4b28bcb756ab nodeName:}" failed. No retries permitted until 2026-05-21 20:40:59.137759969 +0000 UTC m=+167.068535032 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-service-ca-bundle") pod "router-default-786d87b5dd-59596" (UID: "53afa1f9-37ff-4f67-8a7d-4b28bcb756ab") : configmap references non-existent config key: service-ca.crt May 21 20:40:59.055361 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:59.055311 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/96cb3215-4d33-4543-8305-7a5843062860-samples-operator-tls\") pod \"cluster-samples-operator-697587599-lcsb7\" (UID: \"96cb3215-4d33-4543-8305-7a5843062860\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lcsb7" May 21 20:40:59.055861 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:40:59.055500 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 20:40:59.055861 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:40:59.055588 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96cb3215-4d33-4543-8305-7a5843062860-samples-operator-tls podName:96cb3215-4d33-4543-8305-7a5843062860 nodeName:}" failed. No retries permitted until 2026-05-21 20:41:03.055564812 +0000 UTC m=+170.986339878 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/96cb3215-4d33-4543-8305-7a5843062860-samples-operator-tls") pod "cluster-samples-operator-697587599-lcsb7" (UID: "96cb3215-4d33-4543-8305-7a5843062860") : secret "samples-operator-tls" not found May 21 20:40:59.109802 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:59.109759 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-kwvc6" event={"ID":"ea006f9a-fd3a-47a3-8edf-cae4c8b385fb","Type":"ContainerStarted","Data":"df4d9a5b986131560d99662702f69bcaca3f638ad06ee835a5dcef7bc60a1f85"} May 21 20:40:59.111206 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:59.111172 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nn778" event={"ID":"e8d1d929-7502-4b6b-b5d4-a66201f06c8e","Type":"ContainerStarted","Data":"572b975343744e269d6239d46e52a2f4416c178f67129769b094cdab7888d559"} May 21 20:40:59.130512 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:59.130460 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-kwvc6" podStartSLOduration=1.86770807 podStartE2EDuration="4.130446127s" podCreationTimestamp="2026-05-21 20:40:55 +0000 UTC" firstStartedPulling="2026-05-21 20:40:55.814681154 +0000 UTC m=+163.745456215" lastFinishedPulling="2026-05-21 20:40:58.077419209 +0000 UTC m=+166.008194272" observedRunningTime="2026-05-21 20:40:59.129740073 +0000 UTC m=+167.060515155" watchObservedRunningTime="2026-05-21 20:40:59.130446127 +0000 UTC m=+167.061221203" May 21 20:40:59.147563 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:59.147503 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nn778" podStartSLOduration=1.789476377 podStartE2EDuration="4.147480873s" podCreationTimestamp="2026-05-21 20:40:55 +0000 UTC" firstStartedPulling="2026-05-21 20:40:55.717039672 +0000 UTC m=+163.647814733" lastFinishedPulling="2026-05-21 20:40:58.075044167 +0000 UTC m=+166.005819229" observedRunningTime="2026-05-21 20:40:59.146718102 +0000 UTC m=+167.077493186" watchObservedRunningTime="2026-05-21 20:40:59.147480873 +0000 UTC m=+167.078255955" May 21 20:40:59.156253 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:59.156122 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-metrics-certs\") pod \"router-default-786d87b5dd-59596\" (UID: \"53afa1f9-37ff-4f67-8a7d-4b28bcb756ab\") " pod="openshift-ingress/router-default-786d87b5dd-59596" May 21 20:40:59.156253 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:59.156226 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-service-ca-bundle\") pod \"router-default-786d87b5dd-59596\" (UID: \"53afa1f9-37ff-4f67-8a7d-4b28bcb756ab\") " pod="openshift-ingress/router-default-786d87b5dd-59596" May 21 20:40:59.156500 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:40:59.156327 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 20:40:59.156500 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:40:59.156430 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-metrics-certs podName:53afa1f9-37ff-4f67-8a7d-4b28bcb756ab nodeName:}" failed. No retries permitted until 2026-05-21 20:41:03.156409003 +0000 UTC m=+171.087184065 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-metrics-certs") pod "router-default-786d87b5dd-59596" (UID: "53afa1f9-37ff-4f67-8a7d-4b28bcb756ab") : secret "router-metrics-certs-default" not found May 21 20:40:59.156819 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:40:59.156801 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-service-ca-bundle podName:53afa1f9-37ff-4f67-8a7d-4b28bcb756ab nodeName:}" failed. No retries permitted until 2026-05-21 20:41:03.156785261 +0000 UTC m=+171.087560331 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-service-ca-bundle") pod "router-default-786d87b5dd-59596" (UID: "53afa1f9-37ff-4f67-8a7d-4b28bcb756ab") : configmap references non-existent config key: service-ca.crt May 21 20:40:59.667565 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:59.667534 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-vq4vs"] May 21 20:40:59.670570 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:59.670549 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-vq4vs" May 21 20:40:59.672622 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:59.672590 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 21 20:40:59.672622 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:59.672614 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 21 20:40:59.672785 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:59.672768 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-qsd45\"" May 21 20:40:59.677460 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:59.677435 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-vq4vs"] May 21 20:40:59.762413 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:59.762296 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk5s7\" (UniqueName: \"kubernetes.io/projected/c4a72146-e54f-4c90-99b5-a0096eb6deec-kube-api-access-hk5s7\") pod \"migrator-b985f5d89-vq4vs\" (UID: \"c4a72146-e54f-4c90-99b5-a0096eb6deec\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-vq4vs" May 21 20:40:59.863686 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:59.863638 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hk5s7\" (UniqueName: \"kubernetes.io/projected/c4a72146-e54f-4c90-99b5-a0096eb6deec-kube-api-access-hk5s7\") pod \"migrator-b985f5d89-vq4vs\" (UID: \"c4a72146-e54f-4c90-99b5-a0096eb6deec\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-vq4vs" May 21 20:40:59.871939 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:59.871905 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk5s7\" (UniqueName: \"kubernetes.io/projected/c4a72146-e54f-4c90-99b5-a0096eb6deec-kube-api-access-hk5s7\") pod \"migrator-b985f5d89-vq4vs\" (UID: \"c4a72146-e54f-4c90-99b5-a0096eb6deec\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-vq4vs" May 21 20:40:59.979278 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:40:59.979189 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-vq4vs" May 21 20:41:00.100478 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:00.100392 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-vq4vs"] May 21 20:41:00.102726 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:41:00.102699 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4a72146_e54f_4c90_99b5_a0096eb6deec.slice/crio-cbaa0f9ea5a4095f09f23c8df5d8af5d229dc86e9b1ec7850dc7810290035a31 WatchSource:0}: Error finding container cbaa0f9ea5a4095f09f23c8df5d8af5d229dc86e9b1ec7850dc7810290035a31: Status 404 returned error can't find the container with id cbaa0f9ea5a4095f09f23c8df5d8af5d229dc86e9b1ec7850dc7810290035a31 May 21 20:41:00.113721 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:00.113686 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-vq4vs" event={"ID":"c4a72146-e54f-4c90-99b5-a0096eb6deec","Type":"ContainerStarted","Data":"cbaa0f9ea5a4095f09f23c8df5d8af5d229dc86e9b1ec7850dc7810290035a31"} May 21 20:41:00.686998 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:00.686963 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-hn2r7" May 21 20:41:02.124186 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:02.124148 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-vq4vs" event={"ID":"c4a72146-e54f-4c90-99b5-a0096eb6deec","Type":"ContainerStarted","Data":"d376015fc4f391432f36960e41cf52a0df0e70ca565143acc6f999e299695fc9"} May 21 20:41:02.124186 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:02.124187 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-vq4vs" event={"ID":"c4a72146-e54f-4c90-99b5-a0096eb6deec","Type":"ContainerStarted","Data":"e6af945fbbb90f8f99e11dcda6b3343b74163e39c4fbde2421c9041dedfc6041"} May 21 20:41:02.137704 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:02.137654 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-vq4vs" podStartSLOduration=1.9986645859999999 podStartE2EDuration="3.137639309s" podCreationTimestamp="2026-05-21 20:40:59 +0000 UTC" firstStartedPulling="2026-05-21 20:41:00.104681145 +0000 UTC m=+168.035456206" lastFinishedPulling="2026-05-21 20:41:01.243655866 +0000 UTC m=+169.174430929" observedRunningTime="2026-05-21 20:41:02.137172403 +0000 UTC m=+170.067947497" watchObservedRunningTime="2026-05-21 20:41:02.137639309 +0000 UTC m=+170.068414390" May 21 20:41:02.685426 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:02.685393 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrfc" May 21 20:41:02.952513 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:02.952439 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6p4ps_84d7fb93-5212-4b3f-a963-296ed4cae5b0/dns-node-resolver/0.log" May 21 20:41:03.089139 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:03.089083 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/96cb3215-4d33-4543-8305-7a5843062860-samples-operator-tls\") pod \"cluster-samples-operator-697587599-lcsb7\" (UID: \"96cb3215-4d33-4543-8305-7a5843062860\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lcsb7" May 21 20:41:03.089319 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:41:03.089246 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 20:41:03.089319 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:41:03.089313 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96cb3215-4d33-4543-8305-7a5843062860-samples-operator-tls podName:96cb3215-4d33-4543-8305-7a5843062860 nodeName:}" failed. No retries permitted until 2026-05-21 20:41:11.089297725 +0000 UTC m=+179.020072785 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/96cb3215-4d33-4543-8305-7a5843062860-samples-operator-tls") pod "cluster-samples-operator-697587599-lcsb7" (UID: "96cb3215-4d33-4543-8305-7a5843062860") : secret "samples-operator-tls" not found May 21 20:41:03.190512 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:03.190467 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-metrics-certs\") pod \"router-default-786d87b5dd-59596\" (UID: \"53afa1f9-37ff-4f67-8a7d-4b28bcb756ab\") " pod="openshift-ingress/router-default-786d87b5dd-59596" May 21 20:41:03.190901 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:03.190545 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-service-ca-bundle\") pod \"router-default-786d87b5dd-59596\" (UID: \"53afa1f9-37ff-4f67-8a7d-4b28bcb756ab\") " pod="openshift-ingress/router-default-786d87b5dd-59596" May 21 20:41:03.190901 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:41:03.190596 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 20:41:03.190901 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:41:03.190668 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-metrics-certs podName:53afa1f9-37ff-4f67-8a7d-4b28bcb756ab nodeName:}" failed. No retries permitted until 2026-05-21 20:41:11.190648531 +0000 UTC m=+179.121423612 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-metrics-certs") pod "router-default-786d87b5dd-59596" (UID: "53afa1f9-37ff-4f67-8a7d-4b28bcb756ab") : secret "router-metrics-certs-default" not found May 21 20:41:03.190901 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:41:03.190702 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-service-ca-bundle podName:53afa1f9-37ff-4f67-8a7d-4b28bcb756ab nodeName:}" failed. No retries permitted until 2026-05-21 20:41:11.190693328 +0000 UTC m=+179.121468388 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-service-ca-bundle") pod "router-default-786d87b5dd-59596" (UID: "53afa1f9-37ff-4f67-8a7d-4b28bcb756ab") : configmap references non-existent config key: service-ca.crt May 21 20:41:03.683678 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:03.683638 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kql5p" May 21 20:41:03.952645 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:03.952575 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n8gtw_3cef130e-0ffb-400e-ba51-f4947d952456/node-ca/0.log" May 21 20:41:05.352619 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:05.352581 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-vq4vs_c4a72146-e54f-4c90-99b5-a0096eb6deec/migrator/0.log" May 21 20:41:05.551861 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:05.551826 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-vq4vs_c4a72146-e54f-4c90-99b5-a0096eb6deec/graceful-termination/0.log" May 21 20:41:05.753874 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:05.753793 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-nn778_e8d1d929-7502-4b6b-b5d4-a66201f06c8e/kube-storage-version-migrator-operator/0.log" May 21 20:41:11.160758 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:11.160721 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/96cb3215-4d33-4543-8305-7a5843062860-samples-operator-tls\") pod \"cluster-samples-operator-697587599-lcsb7\" (UID: \"96cb3215-4d33-4543-8305-7a5843062860\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lcsb7" May 21 20:41:11.163259 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:11.163228 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/96cb3215-4d33-4543-8305-7a5843062860-samples-operator-tls\") pod \"cluster-samples-operator-697587599-lcsb7\" (UID: \"96cb3215-4d33-4543-8305-7a5843062860\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lcsb7" May 21 20:41:11.261869 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:11.261826 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-metrics-certs\") pod \"router-default-786d87b5dd-59596\" (UID: \"53afa1f9-37ff-4f67-8a7d-4b28bcb756ab\") " pod="openshift-ingress/router-default-786d87b5dd-59596" May 21 20:41:11.262035 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:11.261881 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-service-ca-bundle\") pod \"router-default-786d87b5dd-59596\" (UID: \"53afa1f9-37ff-4f67-8a7d-4b28bcb756ab\") " pod="openshift-ingress/router-default-786d87b5dd-59596" May 21 20:41:11.262035 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:41:11.262012 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-service-ca-bundle podName:53afa1f9-37ff-4f67-8a7d-4b28bcb756ab nodeName:}" failed. No retries permitted until 2026-05-21 20:41:27.261997551 +0000 UTC m=+195.192772611 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-service-ca-bundle") pod "router-default-786d87b5dd-59596" (UID: "53afa1f9-37ff-4f67-8a7d-4b28bcb756ab") : configmap references non-existent config key: service-ca.crt May 21 20:41:11.264443 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:11.264416 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-metrics-certs\") pod \"router-default-786d87b5dd-59596\" (UID: \"53afa1f9-37ff-4f67-8a7d-4b28bcb756ab\") " pod="openshift-ingress/router-default-786d87b5dd-59596" May 21 20:41:11.292806 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:11.292769 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lcsb7" May 21 20:41:11.414033 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:11.413960 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-lcsb7"] May 21 20:41:12.151217 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:12.151176 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lcsb7" event={"ID":"96cb3215-4d33-4543-8305-7a5843062860","Type":"ContainerStarted","Data":"e794e60206956ea4968bef129a8c7ce63a55ec096102a58879491042cdeec9cb"} May 21 20:41:14.157414 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:14.157356 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lcsb7" event={"ID":"96cb3215-4d33-4543-8305-7a5843062860","Type":"ContainerStarted","Data":"4aea311f01903f2cd38138bd84c61b7560cc92ab79ebc8401509eb87ac090d89"} May 21 20:41:14.157414 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:14.157418 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lcsb7" event={"ID":"96cb3215-4d33-4543-8305-7a5843062860","Type":"ContainerStarted","Data":"e0bcb88b595e000a4445307189612733210880632f3d7557b278028ab3b13378"} May 21 20:41:14.171899 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:14.171849 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-lcsb7" podStartSLOduration=17.503641726 podStartE2EDuration="19.17183455s" podCreationTimestamp="2026-05-21 20:40:55 +0000 UTC" firstStartedPulling="2026-05-21 20:41:11.45968158 +0000 UTC m=+179.390456644" lastFinishedPulling="2026-05-21 20:41:13.127874405 +0000 UTC m=+181.058649468" observedRunningTime="2026-05-21 20:41:14.171427114 +0000 UTC m=+182.102202198" watchObservedRunningTime="2026-05-21 20:41:14.17183455 +0000 UTC m=+182.102609632" May 21 20:41:23.813531 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:23.813489 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8d4sk"] May 21 20:41:23.817871 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:23.817848 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8d4sk" May 21 20:41:23.820246 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:23.820221 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 20:41:23.821355 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:23.821337 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 20:41:23.821477 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:23.821457 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f9jgq\"" May 21 20:41:23.822267 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:23.822243 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 20:41:23.822537 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:23.822511 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 20:41:23.829285 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:23.829259 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8d4sk"] May 21 20:41:23.965966 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:23.965927 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b493e2e9-01d8-42dc-81a1-91af6d6d59a2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8d4sk\" (UID: \"b493e2e9-01d8-42dc-81a1-91af6d6d59a2\") " pod="openshift-insights/insights-runtime-extractor-8d4sk" May 21 20:41:23.965966 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:23.965968 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b493e2e9-01d8-42dc-81a1-91af6d6d59a2-crio-socket\") pod \"insights-runtime-extractor-8d4sk\" (UID: \"b493e2e9-01d8-42dc-81a1-91af6d6d59a2\") " pod="openshift-insights/insights-runtime-extractor-8d4sk" May 21 20:41:23.966167 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:23.965990 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b493e2e9-01d8-42dc-81a1-91af6d6d59a2-data-volume\") pod \"insights-runtime-extractor-8d4sk\" (UID: \"b493e2e9-01d8-42dc-81a1-91af6d6d59a2\") " pod="openshift-insights/insights-runtime-extractor-8d4sk" May 21 20:41:23.966167 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:23.966073 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b493e2e9-01d8-42dc-81a1-91af6d6d59a2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8d4sk\" (UID: \"b493e2e9-01d8-42dc-81a1-91af6d6d59a2\") " pod="openshift-insights/insights-runtime-extractor-8d4sk" May 21 20:41:23.966167 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:23.966123 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbs4b\" (UniqueName: \"kubernetes.io/projected/b493e2e9-01d8-42dc-81a1-91af6d6d59a2-kube-api-access-bbs4b\") pod \"insights-runtime-extractor-8d4sk\" (UID: \"b493e2e9-01d8-42dc-81a1-91af6d6d59a2\") " pod="openshift-insights/insights-runtime-extractor-8d4sk" May 21 20:41:24.067351 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:24.067245 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b493e2e9-01d8-42dc-81a1-91af6d6d59a2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8d4sk\" (UID: \"b493e2e9-01d8-42dc-81a1-91af6d6d59a2\") " pod="openshift-insights/insights-runtime-extractor-8d4sk" May 21 20:41:24.067351 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:24.067288 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b493e2e9-01d8-42dc-81a1-91af6d6d59a2-crio-socket\") pod \"insights-runtime-extractor-8d4sk\" (UID: \"b493e2e9-01d8-42dc-81a1-91af6d6d59a2\") " pod="openshift-insights/insights-runtime-extractor-8d4sk" May 21 20:41:24.067351 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:24.067314 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b493e2e9-01d8-42dc-81a1-91af6d6d59a2-data-volume\") pod \"insights-runtime-extractor-8d4sk\" (UID: \"b493e2e9-01d8-42dc-81a1-91af6d6d59a2\") " pod="openshift-insights/insights-runtime-extractor-8d4sk" May 21 20:41:24.067351 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:24.067352 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b493e2e9-01d8-42dc-81a1-91af6d6d59a2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8d4sk\" (UID: \"b493e2e9-01d8-42dc-81a1-91af6d6d59a2\") " pod="openshift-insights/insights-runtime-extractor-8d4sk" May 21 20:41:24.067711 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:24.067423 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bbs4b\" (UniqueName: \"kubernetes.io/projected/b493e2e9-01d8-42dc-81a1-91af6d6d59a2-kube-api-access-bbs4b\") pod \"insights-runtime-extractor-8d4sk\" (UID: \"b493e2e9-01d8-42dc-81a1-91af6d6d59a2\") " pod="openshift-insights/insights-runtime-extractor-8d4sk" May 21 20:41:24.067711 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:24.067424 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b493e2e9-01d8-42dc-81a1-91af6d6d59a2-crio-socket\") pod \"insights-runtime-extractor-8d4sk\" (UID: \"b493e2e9-01d8-42dc-81a1-91af6d6d59a2\") " pod="openshift-insights/insights-runtime-extractor-8d4sk" May 21 20:41:24.067807 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:24.067740 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b493e2e9-01d8-42dc-81a1-91af6d6d59a2-data-volume\") pod \"insights-runtime-extractor-8d4sk\" (UID: \"b493e2e9-01d8-42dc-81a1-91af6d6d59a2\") " pod="openshift-insights/insights-runtime-extractor-8d4sk" May 21 20:41:24.067958 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:24.067940 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b493e2e9-01d8-42dc-81a1-91af6d6d59a2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8d4sk\" (UID: \"b493e2e9-01d8-42dc-81a1-91af6d6d59a2\") " pod="openshift-insights/insights-runtime-extractor-8d4sk" May 21 20:41:24.069834 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:24.069814 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b493e2e9-01d8-42dc-81a1-91af6d6d59a2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8d4sk\" (UID: \"b493e2e9-01d8-42dc-81a1-91af6d6d59a2\") " pod="openshift-insights/insights-runtime-extractor-8d4sk" May 21 20:41:24.075878 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:24.075852 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbs4b\" (UniqueName: \"kubernetes.io/projected/b493e2e9-01d8-42dc-81a1-91af6d6d59a2-kube-api-access-bbs4b\") pod \"insights-runtime-extractor-8d4sk\" (UID: \"b493e2e9-01d8-42dc-81a1-91af6d6d59a2\") " pod="openshift-insights/insights-runtime-extractor-8d4sk" May 21 20:41:24.130317 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:24.130279 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8d4sk" May 21 20:41:24.252002 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:24.251918 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8d4sk"] May 21 20:41:24.254704 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:41:24.254665 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb493e2e9_01d8_42dc_81a1_91af6d6d59a2.slice/crio-c136baec25978885aea66670d31617f83f23b9e3a57a8202e84cbf32eec376ae WatchSource:0}: Error finding container c136baec25978885aea66670d31617f83f23b9e3a57a8202e84cbf32eec376ae: Status 404 returned error can't find the container with id c136baec25978885aea66670d31617f83f23b9e3a57a8202e84cbf32eec376ae May 21 20:41:25.189673 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:25.189640 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8d4sk" event={"ID":"b493e2e9-01d8-42dc-81a1-91af6d6d59a2","Type":"ContainerStarted","Data":"9e7e08438ab651de28c428ab2742bad0119d59af74ad70d2a78d02623a09dcfd"} May 21 20:41:25.189673 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:25.189678 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8d4sk" event={"ID":"b493e2e9-01d8-42dc-81a1-91af6d6d59a2","Type":"ContainerStarted","Data":"d8edc11abb4cc5aafc879032c45ddeab0aa9952fceccb1ec52ce8cb22cdc67ec"} May 21 20:41:25.190060 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:25.189688 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8d4sk" event={"ID":"b493e2e9-01d8-42dc-81a1-91af6d6d59a2","Type":"ContainerStarted","Data":"c136baec25978885aea66670d31617f83f23b9e3a57a8202e84cbf32eec376ae"} May 21 20:41:27.196389 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:27.196340 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8d4sk" event={"ID":"b493e2e9-01d8-42dc-81a1-91af6d6d59a2","Type":"ContainerStarted","Data":"9fb917ee43f57f5959a057f65ae5df69a564ade57b77316e4da896cf349f21b1"} May 21 20:41:27.215863 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:27.215809 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8d4sk" podStartSLOduration=1.761509292 podStartE2EDuration="4.215794629s" podCreationTimestamp="2026-05-21 20:41:23 +0000 UTC" firstStartedPulling="2026-05-21 20:41:24.309062273 +0000 UTC m=+192.239837337" lastFinishedPulling="2026-05-21 20:41:26.763347613 +0000 UTC m=+194.694122674" observedRunningTime="2026-05-21 20:41:27.21431846 +0000 UTC m=+195.145093542" watchObservedRunningTime="2026-05-21 20:41:27.215794629 +0000 UTC m=+195.146569943" May 21 20:41:27.293682 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:27.293648 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-service-ca-bundle\") pod \"router-default-786d87b5dd-59596\" (UID: \"53afa1f9-37ff-4f67-8a7d-4b28bcb756ab\") " pod="openshift-ingress/router-default-786d87b5dd-59596" May 21 20:41:27.294179 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:27.294157 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53afa1f9-37ff-4f67-8a7d-4b28bcb756ab-service-ca-bundle\") pod \"router-default-786d87b5dd-59596\" (UID: \"53afa1f9-37ff-4f67-8a7d-4b28bcb756ab\") " pod="openshift-ingress/router-default-786d87b5dd-59596" May 21 20:41:27.301641 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:27.301620 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ndzdr\"" May 21 20:41:27.310359 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:27.310333 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-786d87b5dd-59596" May 21 20:41:27.437176 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:27.437118 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-786d87b5dd-59596"] May 21 20:41:27.439529 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:41:27.439498 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53afa1f9_37ff_4f67_8a7d_4b28bcb756ab.slice/crio-9800cf48427078ea2cacc26b6c2d50f11c127b72e5db5d95c1c27a335bed0691 WatchSource:0}: Error finding container 9800cf48427078ea2cacc26b6c2d50f11c127b72e5db5d95c1c27a335bed0691: Status 404 returned error can't find the container with id 9800cf48427078ea2cacc26b6c2d50f11c127b72e5db5d95c1c27a335bed0691 May 21 20:41:28.200602 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:28.200564 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-786d87b5dd-59596" event={"ID":"53afa1f9-37ff-4f67-8a7d-4b28bcb756ab","Type":"ContainerStarted","Data":"9184c4977aa8cb62b04c93a739e96a37cbb0b95bb5eef3a876a7c1d9dcf37c33"} May 21 20:41:28.200602 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:28.200609 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-786d87b5dd-59596" event={"ID":"53afa1f9-37ff-4f67-8a7d-4b28bcb756ab","Type":"ContainerStarted","Data":"9800cf48427078ea2cacc26b6c2d50f11c127b72e5db5d95c1c27a335bed0691"} May 21 20:41:28.216718 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:28.216670 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-786d87b5dd-59596" podStartSLOduration=33.21665611 podStartE2EDuration="33.21665611s" podCreationTimestamp="2026-05-21 20:40:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 20:41:28.216541617 +0000 UTC m=+196.147316698" watchObservedRunningTime="2026-05-21 20:41:28.21665611 +0000 UTC m=+196.147431190" May 21 20:41:28.310711 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:28.310676 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-786d87b5dd-59596" May 21 20:41:28.313339 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:28.313289 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-786d87b5dd-59596" May 21 20:41:29.203362 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:29.203326 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-786d87b5dd-59596" May 21 20:41:29.204695 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:29.204673 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-786d87b5dd-59596" May 21 20:41:29.488384 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:29.488280 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f846dbbb8-8p6b7"] May 21 20:41:29.491131 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:29.491106 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f846dbbb8-8p6b7" May 21 20:41:29.493288 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:29.493237 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 21 20:41:29.493288 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:29.493277 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 21 20:41:29.493570 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:29.493515 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-q2hjx\"" May 21 20:41:29.493570 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:29.493561 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 21 20:41:29.493744 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:29.493579 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 21 20:41:29.493744 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:29.493590 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 21 20:41:29.493744 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:29.493579 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 21 20:41:29.493744 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:29.493716 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 21 20:41:29.501609 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:29.501581 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f846dbbb8-8p6b7"] May 21 20:41:29.611735 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:29.611700 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82d894fa-294f-4bcb-b5d6-2d86fd204805-console-config\") pod \"console-7f846dbbb8-8p6b7\" (UID: \"82d894fa-294f-4bcb-b5d6-2d86fd204805\") " pod="openshift-console/console-7f846dbbb8-8p6b7" May 21 20:41:29.611916 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:29.611746 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82d894fa-294f-4bcb-b5d6-2d86fd204805-oauth-serving-cert\") pod \"console-7f846dbbb8-8p6b7\" (UID: \"82d894fa-294f-4bcb-b5d6-2d86fd204805\") " pod="openshift-console/console-7f846dbbb8-8p6b7" May 21 20:41:29.611916 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:29.611857 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82d894fa-294f-4bcb-b5d6-2d86fd204805-console-serving-cert\") pod \"console-7f846dbbb8-8p6b7\" (UID: \"82d894fa-294f-4bcb-b5d6-2d86fd204805\") " pod="openshift-console/console-7f846dbbb8-8p6b7" May 21 20:41:29.611916 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:29.611887 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khn7n\" (UniqueName: \"kubernetes.io/projected/82d894fa-294f-4bcb-b5d6-2d86fd204805-kube-api-access-khn7n\") pod \"console-7f846dbbb8-8p6b7\" (UID: \"82d894fa-294f-4bcb-b5d6-2d86fd204805\") " pod="openshift-console/console-7f846dbbb8-8p6b7" May 21 20:41:29.612013 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:29.611925 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82d894fa-294f-4bcb-b5d6-2d86fd204805-service-ca\") pod \"console-7f846dbbb8-8p6b7\" (UID: \"82d894fa-294f-4bcb-b5d6-2d86fd204805\") " pod="openshift-console/console-7f846dbbb8-8p6b7" May 21 20:41:29.612013 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:29.611958 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82d894fa-294f-4bcb-b5d6-2d86fd204805-console-oauth-config\") pod \"console-7f846dbbb8-8p6b7\" (UID: \"82d894fa-294f-4bcb-b5d6-2d86fd204805\") " pod="openshift-console/console-7f846dbbb8-8p6b7" May 21 20:41:29.712538 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:29.712502 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82d894fa-294f-4bcb-b5d6-2d86fd204805-console-oauth-config\") pod \"console-7f846dbbb8-8p6b7\" (UID: \"82d894fa-294f-4bcb-b5d6-2d86fd204805\") " pod="openshift-console/console-7f846dbbb8-8p6b7" May 21 20:41:29.712721 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:29.712572 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82d894fa-294f-4bcb-b5d6-2d86fd204805-console-config\") pod \"console-7f846dbbb8-8p6b7\" (UID: \"82d894fa-294f-4bcb-b5d6-2d86fd204805\") " pod="openshift-console/console-7f846dbbb8-8p6b7" May 21 20:41:29.712721 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:29.712601 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82d894fa-294f-4bcb-b5d6-2d86fd204805-oauth-serving-cert\") pod \"console-7f846dbbb8-8p6b7\" (UID: \"82d894fa-294f-4bcb-b5d6-2d86fd204805\") " pod="openshift-console/console-7f846dbbb8-8p6b7" May 21 20:41:29.712721 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:29.712643 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82d894fa-294f-4bcb-b5d6-2d86fd204805-console-serving-cert\") pod \"console-7f846dbbb8-8p6b7\" (UID: \"82d894fa-294f-4bcb-b5d6-2d86fd204805\") " pod="openshift-console/console-7f846dbbb8-8p6b7" May 21 20:41:29.712721 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:29.712666 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-khn7n\" (UniqueName: \"kubernetes.io/projected/82d894fa-294f-4bcb-b5d6-2d86fd204805-kube-api-access-khn7n\") pod \"console-7f846dbbb8-8p6b7\" (UID: \"82d894fa-294f-4bcb-b5d6-2d86fd204805\") " pod="openshift-console/console-7f846dbbb8-8p6b7" May 21 20:41:29.712907 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:29.712834 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82d894fa-294f-4bcb-b5d6-2d86fd204805-service-ca\") pod \"console-7f846dbbb8-8p6b7\" (UID: \"82d894fa-294f-4bcb-b5d6-2d86fd204805\") " pod="openshift-console/console-7f846dbbb8-8p6b7" May 21 20:41:29.713330 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:29.713304 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82d894fa-294f-4bcb-b5d6-2d86fd204805-oauth-serving-cert\") pod \"console-7f846dbbb8-8p6b7\" (UID: \"82d894fa-294f-4bcb-b5d6-2d86fd204805\") " pod="openshift-console/console-7f846dbbb8-8p6b7" May 21 20:41:29.713330 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:29.713325 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82d894fa-294f-4bcb-b5d6-2d86fd204805-console-config\") pod \"console-7f846dbbb8-8p6b7\" (UID: \"82d894fa-294f-4bcb-b5d6-2d86fd204805\") " pod="openshift-console/console-7f846dbbb8-8p6b7" May 21 20:41:29.713767 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:29.713745 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82d894fa-294f-4bcb-b5d6-2d86fd204805-service-ca\") pod \"console-7f846dbbb8-8p6b7\" (UID: \"82d894fa-294f-4bcb-b5d6-2d86fd204805\") " pod="openshift-console/console-7f846dbbb8-8p6b7" May 21 20:41:29.715041 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:29.715017 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82d894fa-294f-4bcb-b5d6-2d86fd204805-console-oauth-config\") pod \"console-7f846dbbb8-8p6b7\" (UID: \"82d894fa-294f-4bcb-b5d6-2d86fd204805\") " pod="openshift-console/console-7f846dbbb8-8p6b7" May 21 20:41:29.715154 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:29.715133 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82d894fa-294f-4bcb-b5d6-2d86fd204805-console-serving-cert\") pod \"console-7f846dbbb8-8p6b7\" (UID: \"82d894fa-294f-4bcb-b5d6-2d86fd204805\") " pod="openshift-console/console-7f846dbbb8-8p6b7" May 21 20:41:29.721884 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:29.721863 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khn7n\" (UniqueName: \"kubernetes.io/projected/82d894fa-294f-4bcb-b5d6-2d86fd204805-kube-api-access-khn7n\") pod \"console-7f846dbbb8-8p6b7\" (UID: \"82d894fa-294f-4bcb-b5d6-2d86fd204805\") " pod="openshift-console/console-7f846dbbb8-8p6b7" May 21 20:41:29.800650 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:29.800536 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f846dbbb8-8p6b7" May 21 20:41:29.930417 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:29.930380 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f846dbbb8-8p6b7"] May 21 20:41:29.933353 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:41:29.933319 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82d894fa_294f_4bcb_b5d6_2d86fd204805.slice/crio-4e146bf7299e83b668a6b4c8f452c7bdf1f2e7903a95c9c7574521b72eea07ec WatchSource:0}: Error finding container 4e146bf7299e83b668a6b4c8f452c7bdf1f2e7903a95c9c7574521b72eea07ec: Status 404 returned error can't find the container with id 4e146bf7299e83b668a6b4c8f452c7bdf1f2e7903a95c9c7574521b72eea07ec May 21 20:41:30.206698 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:30.206657 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f846dbbb8-8p6b7" event={"ID":"82d894fa-294f-4bcb-b5d6-2d86fd204805","Type":"ContainerStarted","Data":"4e146bf7299e83b668a6b4c8f452c7bdf1f2e7903a95c9c7574521b72eea07ec"} May 21 20:41:33.020413 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:33.020377 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-lfnxt"] May 21 20:41:33.023464 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:33.023446 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-lfnxt" May 21 20:41:33.025661 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:33.025628 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 20:41:33.025661 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:33.025628 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-pf7h5\"" May 21 20:41:33.025844 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:33.025694 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 21 20:41:33.025844 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:33.025741 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 21 20:41:33.025844 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:33.025773 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 20:41:33.026036 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:33.026019 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 20:41:33.033176 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:33.033155 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-lfnxt"] May 21 20:41:33.141317 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:33.141271 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2983b7ae-d2d8-48eb-856b-65526d77c4cf-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-lfnxt\" (UID: \"2983b7ae-d2d8-48eb-856b-65526d77c4cf\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lfnxt" May 21 20:41:33.141557 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:33.141432 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2983b7ae-d2d8-48eb-856b-65526d77c4cf-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-lfnxt\" (UID: \"2983b7ae-d2d8-48eb-856b-65526d77c4cf\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lfnxt" May 21 20:41:33.141557 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:33.141484 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2983b7ae-d2d8-48eb-856b-65526d77c4cf-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-lfnxt\" (UID: \"2983b7ae-d2d8-48eb-856b-65526d77c4cf\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lfnxt" May 21 20:41:33.141557 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:33.141546 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjwns\" (UniqueName: \"kubernetes.io/projected/2983b7ae-d2d8-48eb-856b-65526d77c4cf-kube-api-access-xjwns\") pod \"prometheus-operator-7779bbdd78-lfnxt\" (UID: \"2983b7ae-d2d8-48eb-856b-65526d77c4cf\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lfnxt" May 21 20:41:33.215742 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:33.215708 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f846dbbb8-8p6b7" event={"ID":"82d894fa-294f-4bcb-b5d6-2d86fd204805","Type":"ContainerStarted","Data":"51ed57ff6df401c8465ee709b07007421bba3d0918b25b685d466405e0c4c902"} May 21 20:41:33.231728 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:33.231676 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7f846dbbb8-8p6b7" podStartSLOduration=1.367744901 podStartE2EDuration="4.231662835s" podCreationTimestamp="2026-05-21 20:41:29 +0000 UTC" firstStartedPulling="2026-05-21 20:41:29.935277881 +0000 UTC m=+197.866052942" lastFinishedPulling="2026-05-21 20:41:32.799195812 +0000 UTC m=+200.729970876" observedRunningTime="2026-05-21 20:41:33.230490129 +0000 UTC m=+201.161265211" watchObservedRunningTime="2026-05-21 20:41:33.231662835 +0000 UTC m=+201.162437917" May 21 20:41:33.242960 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:33.242925 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2983b7ae-d2d8-48eb-856b-65526d77c4cf-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-lfnxt\" (UID: \"2983b7ae-d2d8-48eb-856b-65526d77c4cf\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lfnxt" May 21 20:41:33.243120 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:33.243003 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2983b7ae-d2d8-48eb-856b-65526d77c4cf-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-lfnxt\" (UID: \"2983b7ae-d2d8-48eb-856b-65526d77c4cf\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lfnxt" May 21 20:41:33.243120 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:33.243023 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2983b7ae-d2d8-48eb-856b-65526d77c4cf-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-lfnxt\" (UID: \"2983b7ae-d2d8-48eb-856b-65526d77c4cf\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lfnxt" May 21 20:41:33.243120 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:33.243068 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xjwns\" (UniqueName: \"kubernetes.io/projected/2983b7ae-d2d8-48eb-856b-65526d77c4cf-kube-api-access-xjwns\") pod \"prometheus-operator-7779bbdd78-lfnxt\" (UID: \"2983b7ae-d2d8-48eb-856b-65526d77c4cf\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lfnxt" May 21 20:41:33.243245 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:41:33.243134 2556 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found May 21 20:41:33.243245 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:41:33.243217 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2983b7ae-d2d8-48eb-856b-65526d77c4cf-prometheus-operator-tls podName:2983b7ae-d2d8-48eb-856b-65526d77c4cf nodeName:}" failed. No retries permitted until 2026-05-21 20:41:33.743199141 +0000 UTC m=+201.673974204 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/2983b7ae-d2d8-48eb-856b-65526d77c4cf-prometheus-operator-tls") pod "prometheus-operator-7779bbdd78-lfnxt" (UID: "2983b7ae-d2d8-48eb-856b-65526d77c4cf") : secret "prometheus-operator-tls" not found May 21 20:41:33.243713 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:33.243681 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2983b7ae-d2d8-48eb-856b-65526d77c4cf-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-lfnxt\" (UID: \"2983b7ae-d2d8-48eb-856b-65526d77c4cf\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lfnxt" May 21 20:41:33.245510 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:33.245481 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2983b7ae-d2d8-48eb-856b-65526d77c4cf-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-lfnxt\" (UID: \"2983b7ae-d2d8-48eb-856b-65526d77c4cf\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lfnxt" May 21 20:41:33.251046 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:33.251027 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjwns\" (UniqueName: \"kubernetes.io/projected/2983b7ae-d2d8-48eb-856b-65526d77c4cf-kube-api-access-xjwns\") pod \"prometheus-operator-7779bbdd78-lfnxt\" (UID: \"2983b7ae-d2d8-48eb-856b-65526d77c4cf\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lfnxt" May 21 20:41:33.747214 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:33.747174 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2983b7ae-d2d8-48eb-856b-65526d77c4cf-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-lfnxt\" (UID: \"2983b7ae-d2d8-48eb-856b-65526d77c4cf\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lfnxt" May 21 20:41:33.747468 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:41:33.747334 2556 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found May 21 20:41:33.747468 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:41:33.747457 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2983b7ae-d2d8-48eb-856b-65526d77c4cf-prometheus-operator-tls podName:2983b7ae-d2d8-48eb-856b-65526d77c4cf nodeName:}" failed. No retries permitted until 2026-05-21 20:41:34.747437599 +0000 UTC m=+202.678212672 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/2983b7ae-d2d8-48eb-856b-65526d77c4cf-prometheus-operator-tls") pod "prometheus-operator-7779bbdd78-lfnxt" (UID: "2983b7ae-d2d8-48eb-856b-65526d77c4cf") : secret "prometheus-operator-tls" not found May 21 20:41:34.756983 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:34.756946 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2983b7ae-d2d8-48eb-856b-65526d77c4cf-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-lfnxt\" (UID: \"2983b7ae-d2d8-48eb-856b-65526d77c4cf\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lfnxt" May 21 20:41:34.759493 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:34.759464 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2983b7ae-d2d8-48eb-856b-65526d77c4cf-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-lfnxt\" (UID: \"2983b7ae-d2d8-48eb-856b-65526d77c4cf\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-lfnxt" May 21 20:41:34.832829 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:34.832789 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-lfnxt" May 21 20:41:34.960845 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:34.960700 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-lfnxt"] May 21 20:41:34.963425 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:41:34.963398 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2983b7ae_d2d8_48eb_856b_65526d77c4cf.slice/crio-eab4b668f8f8f063e9dcd33a21e3a9e8917bf5b1f1416471c88ea1fc08d2b2de WatchSource:0}: Error finding container eab4b668f8f8f063e9dcd33a21e3a9e8917bf5b1f1416471c88ea1fc08d2b2de: Status 404 returned error can't find the container with id eab4b668f8f8f063e9dcd33a21e3a9e8917bf5b1f1416471c88ea1fc08d2b2de May 21 20:41:35.222417 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:35.222359 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-lfnxt" event={"ID":"2983b7ae-d2d8-48eb-856b-65526d77c4cf","Type":"ContainerStarted","Data":"eab4b668f8f8f063e9dcd33a21e3a9e8917bf5b1f1416471c88ea1fc08d2b2de"} May 21 20:41:36.227054 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:36.227016 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-lfnxt" event={"ID":"2983b7ae-d2d8-48eb-856b-65526d77c4cf","Type":"ContainerStarted","Data":"ddb233d5aea421b68b0541e5cf2d25a2a0cc71622e26077724a60fea45715713"} May 21 20:41:37.231121 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:37.231078 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-lfnxt" event={"ID":"2983b7ae-d2d8-48eb-856b-65526d77c4cf","Type":"ContainerStarted","Data":"3031b0ab04113696fbb856eb35a32fade113f6dade701e042ac27e53ce3b8ec6"} May 21 20:41:37.247299 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:37.247243 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-lfnxt" podStartSLOduration=3.090984403 podStartE2EDuration="4.247230175s" podCreationTimestamp="2026-05-21 20:41:33 +0000 UTC" firstStartedPulling="2026-05-21 20:41:34.965641804 +0000 UTC m=+202.896416866" lastFinishedPulling="2026-05-21 20:41:36.121887565 +0000 UTC m=+204.052662638" observedRunningTime="2026-05-21 20:41:37.246733614 +0000 UTC m=+205.177508697" watchObservedRunningTime="2026-05-21 20:41:37.247230175 +0000 UTC m=+205.178005257" May 21 20:41:39.363632 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.363581 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xvvc2"] May 21 20:41:39.366965 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.366946 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xvvc2" May 21 20:41:39.368722 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.368695 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 20:41:39.368997 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.368979 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 20:41:39.369069 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.369052 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-p456j\"" May 21 20:41:39.369126 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.369082 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 20:41:39.397295 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.397265 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/49764fd0-a453-4e95-b0a9-64e02354891e-node-exporter-tls\") pod \"node-exporter-xvvc2\" (UID: \"49764fd0-a453-4e95-b0a9-64e02354891e\") " pod="openshift-monitoring/node-exporter-xvvc2" May 21 20:41:39.397295 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.397297 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49764fd0-a453-4e95-b0a9-64e02354891e-metrics-client-ca\") pod \"node-exporter-xvvc2\" (UID: \"49764fd0-a453-4e95-b0a9-64e02354891e\") " pod="openshift-monitoring/node-exporter-xvvc2" May 21 20:41:39.397522 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.397331 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/49764fd0-a453-4e95-b0a9-64e02354891e-root\") pod \"node-exporter-xvvc2\" (UID: \"49764fd0-a453-4e95-b0a9-64e02354891e\") " pod="openshift-monitoring/node-exporter-xvvc2" May 21 20:41:39.397522 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.397402 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/49764fd0-a453-4e95-b0a9-64e02354891e-node-exporter-wtmp\") pod \"node-exporter-xvvc2\" (UID: \"49764fd0-a453-4e95-b0a9-64e02354891e\") " pod="openshift-monitoring/node-exporter-xvvc2" May 21 20:41:39.397522 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.397439 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49764fd0-a453-4e95-b0a9-64e02354891e-sys\") pod \"node-exporter-xvvc2\" (UID: \"49764fd0-a453-4e95-b0a9-64e02354891e\") " pod="openshift-monitoring/node-exporter-xvvc2" May 21 20:41:39.397522 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.397476 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/49764fd0-a453-4e95-b0a9-64e02354891e-node-exporter-textfile\") pod \"node-exporter-xvvc2\" (UID: \"49764fd0-a453-4e95-b0a9-64e02354891e\") " pod="openshift-monitoring/node-exporter-xvvc2" May 21 20:41:39.397522 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.397503 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxbz8\" (UniqueName: \"kubernetes.io/projected/49764fd0-a453-4e95-b0a9-64e02354891e-kube-api-access-sxbz8\") pod \"node-exporter-xvvc2\" (UID: \"49764fd0-a453-4e95-b0a9-64e02354891e\") " pod="openshift-monitoring/node-exporter-xvvc2" May 21 20:41:39.397683 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.397568 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/49764fd0-a453-4e95-b0a9-64e02354891e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xvvc2\" (UID: \"49764fd0-a453-4e95-b0a9-64e02354891e\") " pod="openshift-monitoring/node-exporter-xvvc2" May 21 20:41:39.397683 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.397596 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/49764fd0-a453-4e95-b0a9-64e02354891e-node-exporter-accelerators-collector-config\") pod \"node-exporter-xvvc2\" (UID: \"49764fd0-a453-4e95-b0a9-64e02354891e\") " pod="openshift-monitoring/node-exporter-xvvc2" May 21 20:41:39.498217 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.498180 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/49764fd0-a453-4e95-b0a9-64e02354891e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xvvc2\" (UID: \"49764fd0-a453-4e95-b0a9-64e02354891e\") " pod="openshift-monitoring/node-exporter-xvvc2" May 21 20:41:39.498217 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.498234 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/49764fd0-a453-4e95-b0a9-64e02354891e-node-exporter-accelerators-collector-config\") pod \"node-exporter-xvvc2\" (UID: \"49764fd0-a453-4e95-b0a9-64e02354891e\") " pod="openshift-monitoring/node-exporter-xvvc2" May 21 20:41:39.498511 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.498411 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/49764fd0-a453-4e95-b0a9-64e02354891e-node-exporter-tls\") pod \"node-exporter-xvvc2\" (UID: \"49764fd0-a453-4e95-b0a9-64e02354891e\") " pod="openshift-monitoring/node-exporter-xvvc2" May 21 20:41:39.498511 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.498453 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49764fd0-a453-4e95-b0a9-64e02354891e-metrics-client-ca\") pod \"node-exporter-xvvc2\" (UID: \"49764fd0-a453-4e95-b0a9-64e02354891e\") " pod="openshift-monitoring/node-exporter-xvvc2" May 21 20:41:39.498594 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.498517 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/49764fd0-a453-4e95-b0a9-64e02354891e-root\") pod \"node-exporter-xvvc2\" (UID: \"49764fd0-a453-4e95-b0a9-64e02354891e\") " pod="openshift-monitoring/node-exporter-xvvc2" May 21 20:41:39.498594 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.498553 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/49764fd0-a453-4e95-b0a9-64e02354891e-node-exporter-wtmp\") pod \"node-exporter-xvvc2\" (UID: \"49764fd0-a453-4e95-b0a9-64e02354891e\") " pod="openshift-monitoring/node-exporter-xvvc2" May 21 20:41:39.498594 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.498587 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49764fd0-a453-4e95-b0a9-64e02354891e-sys\") pod \"node-exporter-xvvc2\" (UID: \"49764fd0-a453-4e95-b0a9-64e02354891e\") " pod="openshift-monitoring/node-exporter-xvvc2" May 21 20:41:39.498723 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.498641 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/49764fd0-a453-4e95-b0a9-64e02354891e-node-exporter-textfile\") pod \"node-exporter-xvvc2\" (UID: \"49764fd0-a453-4e95-b0a9-64e02354891e\") " pod="openshift-monitoring/node-exporter-xvvc2" May 21 20:41:39.498723 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.498646 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/49764fd0-a453-4e95-b0a9-64e02354891e-root\") pod \"node-exporter-xvvc2\" (UID: \"49764fd0-a453-4e95-b0a9-64e02354891e\") " pod="openshift-monitoring/node-exporter-xvvc2" May 21 20:41:39.498723 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.498690 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sxbz8\" (UniqueName: \"kubernetes.io/projected/49764fd0-a453-4e95-b0a9-64e02354891e-kube-api-access-sxbz8\") pod \"node-exporter-xvvc2\" (UID: \"49764fd0-a453-4e95-b0a9-64e02354891e\") " pod="openshift-monitoring/node-exporter-xvvc2" May 21 20:41:39.498723 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.498711 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49764fd0-a453-4e95-b0a9-64e02354891e-sys\") pod \"node-exporter-xvvc2\" (UID: \"49764fd0-a453-4e95-b0a9-64e02354891e\") " pod="openshift-monitoring/node-exporter-xvvc2" May 21 20:41:39.498915 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.498756 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/49764fd0-a453-4e95-b0a9-64e02354891e-node-exporter-wtmp\") pod \"node-exporter-xvvc2\" (UID: \"49764fd0-a453-4e95-b0a9-64e02354891e\") " pod="openshift-monitoring/node-exporter-xvvc2" May 21 20:41:39.498997 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.498976 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/49764fd0-a453-4e95-b0a9-64e02354891e-node-exporter-textfile\") pod \"node-exporter-xvvc2\" (UID: \"49764fd0-a453-4e95-b0a9-64e02354891e\") " pod="openshift-monitoring/node-exporter-xvvc2" May 21 20:41:39.499106 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.499066 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49764fd0-a453-4e95-b0a9-64e02354891e-metrics-client-ca\") pod \"node-exporter-xvvc2\" (UID: \"49764fd0-a453-4e95-b0a9-64e02354891e\") " pod="openshift-monitoring/node-exporter-xvvc2" May 21 20:41:39.499228 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.499176 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/49764fd0-a453-4e95-b0a9-64e02354891e-node-exporter-accelerators-collector-config\") pod \"node-exporter-xvvc2\" (UID: \"49764fd0-a453-4e95-b0a9-64e02354891e\") " pod="openshift-monitoring/node-exporter-xvvc2" May 21 20:41:39.501087 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.501061 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/49764fd0-a453-4e95-b0a9-64e02354891e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xvvc2\" (UID: \"49764fd0-a453-4e95-b0a9-64e02354891e\") " pod="openshift-monitoring/node-exporter-xvvc2" May 21 20:41:39.501220 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.501100 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/49764fd0-a453-4e95-b0a9-64e02354891e-node-exporter-tls\") pod \"node-exporter-xvvc2\" (UID: \"49764fd0-a453-4e95-b0a9-64e02354891e\") " pod="openshift-monitoring/node-exporter-xvvc2" May 21 20:41:39.506341 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.506316 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxbz8\" (UniqueName: \"kubernetes.io/projected/49764fd0-a453-4e95-b0a9-64e02354891e-kube-api-access-sxbz8\") pod \"node-exporter-xvvc2\" (UID: \"49764fd0-a453-4e95-b0a9-64e02354891e\") " pod="openshift-monitoring/node-exporter-xvvc2" May 21 20:41:39.676714 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.676629 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xvvc2" May 21 20:41:39.684672 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:41:39.684646 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49764fd0_a453_4e95_b0a9_64e02354891e.slice/crio-39665b6ee62d51c91b919dcacf34108889bf7b46fb87d31344b8c76a90362e83 WatchSource:0}: Error finding container 39665b6ee62d51c91b919dcacf34108889bf7b46fb87d31344b8c76a90362e83: Status 404 returned error can't find the container with id 39665b6ee62d51c91b919dcacf34108889bf7b46fb87d31344b8c76a90362e83 May 21 20:41:39.800815 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.800769 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f846dbbb8-8p6b7" May 21 20:41:39.801004 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.800828 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f846dbbb8-8p6b7" May 21 20:41:39.806352 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:39.806322 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f846dbbb8-8p6b7" May 21 20:41:40.241236 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:40.241199 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xvvc2" event={"ID":"49764fd0-a453-4e95-b0a9-64e02354891e","Type":"ContainerStarted","Data":"39665b6ee62d51c91b919dcacf34108889bf7b46fb87d31344b8c76a90362e83"} May 21 20:41:40.246189 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:40.246163 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f846dbbb8-8p6b7" May 21 20:41:41.245015 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:41.244974 2556 generic.go:358] "Generic (PLEG): container finished" podID="49764fd0-a453-4e95-b0a9-64e02354891e" containerID="1c9fc1e292cd50e5023f34ed60a0e0efc9885b02cc18f7f201a090aaf0294cec" exitCode=0 May 21 20:41:41.245473 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:41.245059 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xvvc2" event={"ID":"49764fd0-a453-4e95-b0a9-64e02354891e","Type":"ContainerDied","Data":"1c9fc1e292cd50e5023f34ed60a0e0efc9885b02cc18f7f201a090aaf0294cec"} May 21 20:41:42.249676 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:42.249638 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xvvc2" event={"ID":"49764fd0-a453-4e95-b0a9-64e02354891e","Type":"ContainerStarted","Data":"69a58475994331c470ac1fdc9de6dac5ce156132ec1cde3afb326ef2432d1354"} May 21 20:41:42.249676 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:42.249678 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xvvc2" event={"ID":"49764fd0-a453-4e95-b0a9-64e02354891e","Type":"ContainerStarted","Data":"27b2a43a817ce501a94d8d93e0345d7d2cb1e9cb522487b65428000e244ea771"} May 21 20:41:42.276617 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:42.276556 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xvvc2" podStartSLOduration=2.377916769 podStartE2EDuration="3.276542057s" podCreationTimestamp="2026-05-21 20:41:39 +0000 UTC" firstStartedPulling="2026-05-21 20:41:39.686439529 +0000 UTC m=+207.617214592" lastFinishedPulling="2026-05-21 20:41:40.585064816 +0000 UTC m=+208.515839880" observedRunningTime="2026-05-21 20:41:42.275455132 +0000 UTC m=+210.206230216" watchObservedRunningTime="2026-05-21 20:41:42.276542057 +0000 UTC m=+210.207317138" May 21 20:41:43.280339 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:43.280293 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f846dbbb8-8p6b7"] May 21 20:41:43.770242 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:43.770210 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-c459f6b9b-tgc65"] May 21 20:41:43.775663 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:43.775638 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-c459f6b9b-tgc65" May 21 20:41:43.777884 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:43.777863 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 21 20:41:43.778394 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:43.778360 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2qpcmr6ldpeqf\"" May 21 20:41:43.778548 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:43.778419 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 21 20:41:43.778548 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:43.778494 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 21 20:41:43.778701 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:43.778558 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 21 20:41:43.778701 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:43.778643 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-b9pzd\"" May 21 20:41:43.780284 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:43.780264 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-c459f6b9b-tgc65"] May 21 20:41:43.840938 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:43.840877 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4-metrics-server-audit-profiles\") pod \"metrics-server-c459f6b9b-tgc65\" (UID: \"5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4\") " pod="openshift-monitoring/metrics-server-c459f6b9b-tgc65" May 21 20:41:43.841112 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:43.840993 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4-secret-metrics-server-client-certs\") pod \"metrics-server-c459f6b9b-tgc65\" (UID: \"5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4\") " pod="openshift-monitoring/metrics-server-c459f6b9b-tgc65" May 21 20:41:43.841112 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:43.841031 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4-audit-log\") pod \"metrics-server-c459f6b9b-tgc65\" (UID: \"5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4\") " pod="openshift-monitoring/metrics-server-c459f6b9b-tgc65" May 21 20:41:43.841112 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:43.841076 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c459f6b9b-tgc65\" (UID: \"5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4\") " pod="openshift-monitoring/metrics-server-c459f6b9b-tgc65" May 21 20:41:43.841112 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:43.841100 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h76cg\" (UniqueName: \"kubernetes.io/projected/5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4-kube-api-access-h76cg\") pod \"metrics-server-c459f6b9b-tgc65\" (UID: \"5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4\") " pod="openshift-monitoring/metrics-server-c459f6b9b-tgc65" May 21 20:41:43.841250 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:43.841122 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4-secret-metrics-server-tls\") pod \"metrics-server-c459f6b9b-tgc65\" (UID: \"5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4\") " pod="openshift-monitoring/metrics-server-c459f6b9b-tgc65" May 21 20:41:43.841250 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:43.841182 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4-client-ca-bundle\") pod \"metrics-server-c459f6b9b-tgc65\" (UID: \"5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4\") " pod="openshift-monitoring/metrics-server-c459f6b9b-tgc65" May 21 20:41:43.942614 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:43.942577 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4-audit-log\") pod \"metrics-server-c459f6b9b-tgc65\" (UID: \"5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4\") " pod="openshift-monitoring/metrics-server-c459f6b9b-tgc65" May 21 20:41:43.942782 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:43.942636 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c459f6b9b-tgc65\" (UID: \"5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4\") " pod="openshift-monitoring/metrics-server-c459f6b9b-tgc65" May 21 20:41:43.942782 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:43.942676 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h76cg\" (UniqueName: \"kubernetes.io/projected/5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4-kube-api-access-h76cg\") pod \"metrics-server-c459f6b9b-tgc65\" (UID: \"5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4\") " pod="openshift-monitoring/metrics-server-c459f6b9b-tgc65" May 21 20:41:43.942782 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:43.942710 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4-secret-metrics-server-tls\") pod \"metrics-server-c459f6b9b-tgc65\" (UID: \"5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4\") " pod="openshift-monitoring/metrics-server-c459f6b9b-tgc65" May 21 20:41:43.942941 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:43.942916 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4-client-ca-bundle\") pod \"metrics-server-c459f6b9b-tgc65\" (UID: \"5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4\") " pod="openshift-monitoring/metrics-server-c459f6b9b-tgc65" May 21 20:41:43.943048 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:43.943028 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4-metrics-server-audit-profiles\") pod \"metrics-server-c459f6b9b-tgc65\" (UID: \"5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4\") " pod="openshift-monitoring/metrics-server-c459f6b9b-tgc65" May 21 20:41:43.943106 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:43.943035 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4-audit-log\") pod \"metrics-server-c459f6b9b-tgc65\" (UID: \"5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4\") " pod="openshift-monitoring/metrics-server-c459f6b9b-tgc65" May 21 20:41:43.943106 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:43.943096 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4-secret-metrics-server-client-certs\") pod \"metrics-server-c459f6b9b-tgc65\" (UID: \"5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4\") " pod="openshift-monitoring/metrics-server-c459f6b9b-tgc65" May 21 20:41:43.943469 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:43.943449 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c459f6b9b-tgc65\" (UID: \"5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4\") " pod="openshift-monitoring/metrics-server-c459f6b9b-tgc65" May 21 20:41:43.944230 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:43.944205 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4-metrics-server-audit-profiles\") pod \"metrics-server-c459f6b9b-tgc65\" (UID: \"5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4\") " pod="openshift-monitoring/metrics-server-c459f6b9b-tgc65" May 21 20:41:43.945647 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:43.945625 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4-secret-metrics-server-tls\") pod \"metrics-server-c459f6b9b-tgc65\" (UID: \"5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4\") " pod="openshift-monitoring/metrics-server-c459f6b9b-tgc65" May 21 20:41:43.945723 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:43.945675 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4-secret-metrics-server-client-certs\") pod \"metrics-server-c459f6b9b-tgc65\" (UID: \"5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4\") " pod="openshift-monitoring/metrics-server-c459f6b9b-tgc65" May 21 20:41:43.945766 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:43.945726 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4-client-ca-bundle\") pod \"metrics-server-c459f6b9b-tgc65\" (UID: \"5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4\") " pod="openshift-monitoring/metrics-server-c459f6b9b-tgc65" May 21 20:41:43.950419 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:43.950394 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h76cg\" (UniqueName: \"kubernetes.io/projected/5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4-kube-api-access-h76cg\") pod \"metrics-server-c459f6b9b-tgc65\" (UID: \"5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4\") " pod="openshift-monitoring/metrics-server-c459f6b9b-tgc65" May 21 20:41:44.085978 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:44.085947 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-c459f6b9b-tgc65" May 21 20:41:44.159875 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:44.159847 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-prtgn"] May 21 20:41:44.165362 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:44.165336 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-prtgn" May 21 20:41:44.167308 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:44.167284 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 21 20:41:44.167308 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:44.167304 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-pbf4j\"" May 21 20:41:44.172573 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:44.172356 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-prtgn"] May 21 20:41:44.228171 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:44.228138 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-c459f6b9b-tgc65"] May 21 20:41:44.236879 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:41:44.236853 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bcd6758_c7b5_4e1b_84f4_a22b382c2bf4.slice/crio-976dab0ecbcf4e0f7326125c0d211abe590840840a883ea51d7761c8746ce56d WatchSource:0}: Error finding container 976dab0ecbcf4e0f7326125c0d211abe590840840a883ea51d7761c8746ce56d: Status 404 returned error can't find the container with id 976dab0ecbcf4e0f7326125c0d211abe590840840a883ea51d7761c8746ce56d May 21 20:41:44.245154 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:44.245130 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0d9ae6c1-f713-4430-95da-b812c6c56222-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-prtgn\" (UID: \"0d9ae6c1-f713-4430-95da-b812c6c56222\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-prtgn" May 21 20:41:44.256163 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:44.256128 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-c459f6b9b-tgc65" event={"ID":"5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4","Type":"ContainerStarted","Data":"976dab0ecbcf4e0f7326125c0d211abe590840840a883ea51d7761c8746ce56d"} May 21 20:41:44.346208 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:44.346122 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0d9ae6c1-f713-4430-95da-b812c6c56222-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-prtgn\" (UID: \"0d9ae6c1-f713-4430-95da-b812c6c56222\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-prtgn" May 21 20:41:44.346633 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:41:44.346271 2556 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found May 21 20:41:44.346633 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:41:44.346352 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d9ae6c1-f713-4430-95da-b812c6c56222-monitoring-plugin-cert podName:0d9ae6c1-f713-4430-95da-b812c6c56222 nodeName:}" failed. No retries permitted until 2026-05-21 20:41:44.846333512 +0000 UTC m=+212.777108584 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/0d9ae6c1-f713-4430-95da-b812c6c56222-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-prtgn" (UID: "0d9ae6c1-f713-4430-95da-b812c6c56222") : secret "monitoring-plugin-cert" not found May 21 20:41:44.851251 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:44.851206 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0d9ae6c1-f713-4430-95da-b812c6c56222-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-prtgn\" (UID: \"0d9ae6c1-f713-4430-95da-b812c6c56222\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-prtgn" May 21 20:41:44.854128 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:44.854091 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0d9ae6c1-f713-4430-95da-b812c6c56222-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-prtgn\" (UID: \"0d9ae6c1-f713-4430-95da-b812c6c56222\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-prtgn" May 21 20:41:45.079154 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.079115 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-prtgn" May 21 20:41:45.214697 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.214652 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-prtgn"] May 21 20:41:45.537872 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:41:45.537794 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d9ae6c1_f713_4430_95da_b812c6c56222.slice/crio-c9540b4f0782b1a76331b3f35933a71c23ced1df7cd39fbab29d337824681a43 WatchSource:0}: Error finding container c9540b4f0782b1a76331b3f35933a71c23ced1df7cd39fbab29d337824681a43: Status 404 returned error can't find the container with id c9540b4f0782b1a76331b3f35933a71c23ced1df7cd39fbab29d337824681a43 May 21 20:41:45.662019 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.661988 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 20:41:45.666506 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.666481 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.668618 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.668589 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 21 20:41:45.669487 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.668855 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 21 20:41:45.669487 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.669084 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4dptj\"" May 21 20:41:45.669487 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.669135 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 21 20:41:45.669487 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.669188 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 21 20:41:45.669487 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.669239 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 21 20:41:45.669487 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.669085 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 21 20:41:45.669487 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.669415 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 21 20:41:45.669903 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.669597 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 21 20:41:45.669903 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.669842 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fkfbq82i4m8ds\"" May 21 20:41:45.670090 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.670064 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 21 20:41:45.670323 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.670069 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 21 20:41:45.670323 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.670268 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 21 20:41:45.672549 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.672532 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 21 20:41:45.678677 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.677964 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 20:41:45.759954 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.759921 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38af7c9b-9881-457e-9a7c-1432813f63a1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.759954 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.759960 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/38af7c9b-9881-457e-9a7c-1432813f63a1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.760221 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.759978 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/38af7c9b-9881-457e-9a7c-1432813f63a1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.760221 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.760028 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/38af7c9b-9881-457e-9a7c-1432813f63a1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.760221 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.760073 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/38af7c9b-9881-457e-9a7c-1432813f63a1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.760221 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.760092 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncrc9\" (UniqueName: \"kubernetes.io/projected/38af7c9b-9881-457e-9a7c-1432813f63a1-kube-api-access-ncrc9\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.760221 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.760111 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38af7c9b-9881-457e-9a7c-1432813f63a1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.760221 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.760133 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/38af7c9b-9881-457e-9a7c-1432813f63a1-config\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.760221 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.760150 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/38af7c9b-9881-457e-9a7c-1432813f63a1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.760221 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.760207 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38af7c9b-9881-457e-9a7c-1432813f63a1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.760624 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.760232 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38af7c9b-9881-457e-9a7c-1432813f63a1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.760624 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.760267 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38af7c9b-9881-457e-9a7c-1432813f63a1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.760624 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.760286 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38af7c9b-9881-457e-9a7c-1432813f63a1-web-config\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.760624 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.760307 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/38af7c9b-9881-457e-9a7c-1432813f63a1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.760624 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.760343 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38af7c9b-9881-457e-9a7c-1432813f63a1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.760624 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.760402 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38af7c9b-9881-457e-9a7c-1432813f63a1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.760624 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.760427 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/38af7c9b-9881-457e-9a7c-1432813f63a1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.760624 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.760460 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38af7c9b-9881-457e-9a7c-1432813f63a1-config-out\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.851301 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.851259 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-759df6c9-tpdgh"] May 21 20:41:45.851655 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:41:45.851626 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-759df6c9-tpdgh" podUID="3b0dc320-bd9c-430a-bb6b-a38d2a5bb089" May 21 20:41:45.861507 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.861467 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/38af7c9b-9881-457e-9a7c-1432813f63a1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.861670 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.861520 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38af7c9b-9881-457e-9a7c-1432813f63a1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.861670 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.861560 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38af7c9b-9881-457e-9a7c-1432813f63a1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.861670 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.861596 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/38af7c9b-9881-457e-9a7c-1432813f63a1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.861670 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.861650 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38af7c9b-9881-457e-9a7c-1432813f63a1-config-out\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.862012 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.861975 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38af7c9b-9881-457e-9a7c-1432813f63a1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.862153 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.862135 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/38af7c9b-9881-457e-9a7c-1432813f63a1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.862356 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.862251 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/38af7c9b-9881-457e-9a7c-1432813f63a1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.862606 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.862588 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/38af7c9b-9881-457e-9a7c-1432813f63a1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.862755 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.862721 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/38af7c9b-9881-457e-9a7c-1432813f63a1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.862887 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.862758 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ncrc9\" (UniqueName: \"kubernetes.io/projected/38af7c9b-9881-457e-9a7c-1432813f63a1-kube-api-access-ncrc9\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.862887 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.862790 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38af7c9b-9881-457e-9a7c-1432813f63a1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.862887 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.862831 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/38af7c9b-9881-457e-9a7c-1432813f63a1-config\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.862887 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.862860 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/38af7c9b-9881-457e-9a7c-1432813f63a1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.863354 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.862897 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38af7c9b-9881-457e-9a7c-1432813f63a1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.863354 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.862925 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38af7c9b-9881-457e-9a7c-1432813f63a1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.863354 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.862970 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38af7c9b-9881-457e-9a7c-1432813f63a1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.863354 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.862999 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38af7c9b-9881-457e-9a7c-1432813f63a1-web-config\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.865797 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.862964 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38af7c9b-9881-457e-9a7c-1432813f63a1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.865990 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.865839 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/38af7c9b-9881-457e-9a7c-1432813f63a1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.866726 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.866689 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38af7c9b-9881-457e-9a7c-1432813f63a1-config-out\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.866934 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.866834 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/38af7c9b-9881-457e-9a7c-1432813f63a1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.866934 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.866876 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38af7c9b-9881-457e-9a7c-1432813f63a1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.866934 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.862441 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38af7c9b-9881-457e-9a7c-1432813f63a1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.867127 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.867062 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/38af7c9b-9881-457e-9a7c-1432813f63a1-config\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.867832 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.867805 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/38af7c9b-9881-457e-9a7c-1432813f63a1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.867983 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.867928 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38af7c9b-9881-457e-9a7c-1432813f63a1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.869691 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.869646 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38af7c9b-9881-457e-9a7c-1432813f63a1-web-config\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.870448 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.869991 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38af7c9b-9881-457e-9a7c-1432813f63a1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.870448 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.870417 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/38af7c9b-9881-457e-9a7c-1432813f63a1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.870616 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.870419 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38af7c9b-9881-457e-9a7c-1432813f63a1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.870900 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.870849 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/38af7c9b-9881-457e-9a7c-1432813f63a1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.871046 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.871020 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/38af7c9b-9881-457e-9a7c-1432813f63a1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.871109 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.871065 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/38af7c9b-9881-457e-9a7c-1432813f63a1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.871623 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.871602 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38af7c9b-9881-457e-9a7c-1432813f63a1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.874158 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.874137 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncrc9\" (UniqueName: \"kubernetes.io/projected/38af7c9b-9881-457e-9a7c-1432813f63a1-kube-api-access-ncrc9\") pod \"prometheus-k8s-0\" (UID: \"38af7c9b-9881-457e-9a7c-1432813f63a1\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:45.982596 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:45.982548 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 20:41:46.152394 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:46.152187 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 20:41:46.263306 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:46.263242 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-c459f6b9b-tgc65" event={"ID":"5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4","Type":"ContainerStarted","Data":"8517658bbc358f10588f8b9957c7840ae44a405b54402397dca5475f2e7e8e90"} May 21 20:41:46.264565 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:46.264530 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38af7c9b-9881-457e-9a7c-1432813f63a1","Type":"ContainerStarted","Data":"4bf12de39aa54e2ae6fb62163da247b43f29fe4ce291750be624c3597e3441d6"} May 21 20:41:46.265716 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:46.265689 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-prtgn" event={"ID":"0d9ae6c1-f713-4430-95da-b812c6c56222","Type":"ContainerStarted","Data":"c9540b4f0782b1a76331b3f35933a71c23ced1df7cd39fbab29d337824681a43"} May 21 20:41:46.265834 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:46.265729 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-759df6c9-tpdgh" May 21 20:41:46.271555 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:46.271532 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-759df6c9-tpdgh" May 21 20:41:46.279704 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:46.279608 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-c459f6b9b-tgc65" podStartSLOduration=1.921018522 podStartE2EDuration="3.279594018s" podCreationTimestamp="2026-05-21 20:41:43 +0000 UTC" firstStartedPulling="2026-05-21 20:41:44.238333334 +0000 UTC m=+212.169108395" lastFinishedPulling="2026-05-21 20:41:45.596908831 +0000 UTC m=+213.527683891" observedRunningTime="2026-05-21 20:41:46.278993565 +0000 UTC m=+214.209768649" watchObservedRunningTime="2026-05-21 20:41:46.279594018 +0000 UTC m=+214.210369101" May 21 20:41:46.368157 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:46.368122 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-trusted-ca\") pod \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " May 21 20:41:46.368351 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:46.368180 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-bound-sa-token\") pod \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " May 21 20:41:46.368351 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:46.368239 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-image-registry-private-configuration\") pod \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " May 21 20:41:46.368351 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:46.368266 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-registry-certificates\") pod \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " May 21 20:41:46.368351 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:46.368316 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-ca-trust-extracted\") pod \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " May 21 20:41:46.368587 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:46.368432 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-installation-pull-secrets\") pod \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " May 21 20:41:46.368587 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:46.368459 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hc66w\" (UniqueName: \"kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-kube-api-access-hc66w\") pod \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\" (UID: \"3b0dc320-bd9c-430a-bb6b-a38d2a5bb089\") " May 21 20:41:46.368976 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:46.368674 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "3b0dc320-bd9c-430a-bb6b-a38d2a5bb089" (UID: "3b0dc320-bd9c-430a-bb6b-a38d2a5bb089"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:41:46.368976 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:46.368698 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "3b0dc320-bd9c-430a-bb6b-a38d2a5bb089" (UID: "3b0dc320-bd9c-430a-bb6b-a38d2a5bb089"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:41:46.368976 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:46.368835 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "3b0dc320-bd9c-430a-bb6b-a38d2a5bb089" (UID: "3b0dc320-bd9c-430a-bb6b-a38d2a5bb089"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:41:46.369176 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:46.369068 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-trusted-ca\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\"" May 21 20:41:46.369313 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:46.369258 2556 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-registry-certificates\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\"" May 21 20:41:46.369313 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:46.369287 2556 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-ca-trust-extracted\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\"" May 21 20:41:46.371793 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:46.371755 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "3b0dc320-bd9c-430a-bb6b-a38d2a5bb089" (UID: "3b0dc320-bd9c-430a-bb6b-a38d2a5bb089"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 20:41:46.371950 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:46.371928 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-kube-api-access-hc66w" (OuterVolumeSpecName: "kube-api-access-hc66w") pod "3b0dc320-bd9c-430a-bb6b-a38d2a5bb089" (UID: "3b0dc320-bd9c-430a-bb6b-a38d2a5bb089"). InnerVolumeSpecName "kube-api-access-hc66w". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:41:46.372047 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:46.372020 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "3b0dc320-bd9c-430a-bb6b-a38d2a5bb089" (UID: "3b0dc320-bd9c-430a-bb6b-a38d2a5bb089"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:41:46.372242 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:46.372220 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "3b0dc320-bd9c-430a-bb6b-a38d2a5bb089" (UID: "3b0dc320-bd9c-430a-bb6b-a38d2a5bb089"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 20:41:46.470833 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:46.470750 2556 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-bound-sa-token\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\"" May 21 20:41:46.470833 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:46.470785 2556 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-image-registry-private-configuration\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\"" May 21 20:41:46.470833 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:46.470805 2556 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-installation-pull-secrets\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\"" May 21 20:41:46.470833 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:46.470822 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hc66w\" (UniqueName: \"kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-kube-api-access-hc66w\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\"" May 21 20:41:47.270770 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:47.270663 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-prtgn" event={"ID":"0d9ae6c1-f713-4430-95da-b812c6c56222","Type":"ContainerStarted","Data":"3bf24f23b529043c5d09963dfd45b69312dbd690e722d7404130f13461d11b62"} May 21 20:41:47.271219 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:47.270926 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-759df6c9-tpdgh" May 21 20:41:47.271219 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:47.271142 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-prtgn" May 21 20:41:47.276822 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:47.276799 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-prtgn" May 21 20:41:47.289649 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:47.289594 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-prtgn" podStartSLOduration=1.994775136 podStartE2EDuration="3.289579443s" podCreationTimestamp="2026-05-21 20:41:44 +0000 UTC" firstStartedPulling="2026-05-21 20:41:45.540240649 +0000 UTC m=+213.471015714" lastFinishedPulling="2026-05-21 20:41:46.835044955 +0000 UTC m=+214.765820021" observedRunningTime="2026-05-21 20:41:47.288843213 +0000 UTC m=+215.219618305" watchObservedRunningTime="2026-05-21 20:41:47.289579443 +0000 UTC m=+215.220354525" May 21 20:41:47.333280 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:47.333246 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-759df6c9-tpdgh"] May 21 20:41:47.334685 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:47.334658 2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-759df6c9-tpdgh"] May 21 20:41:47.382695 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:47.382543 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089-registry-tls\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\"" May 21 20:41:48.277962 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:48.277926 2556 generic.go:358] "Generic (PLEG): container finished" podID="38af7c9b-9881-457e-9a7c-1432813f63a1" containerID="120f16c19cb5a7144aafd666d655dbf16093b7c062a60ce18bf046c53eda36a1" exitCode=0 May 21 20:41:48.278296 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:48.278013 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38af7c9b-9881-457e-9a7c-1432813f63a1","Type":"ContainerDied","Data":"120f16c19cb5a7144aafd666d655dbf16093b7c062a60ce18bf046c53eda36a1"} May 21 20:41:48.687168 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:48.687136 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b0dc320-bd9c-430a-bb6b-a38d2a5bb089" path="/var/lib/kubelet/pods/3b0dc320-bd9c-430a-bb6b-a38d2a5bb089/volumes" May 21 20:41:51.073086 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:51.073066 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d74df5579-6zgdv"] May 21 20:41:51.077756 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:51.077737 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d74df5579-6zgdv" May 21 20:41:51.085481 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:51.085205 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 21 20:41:51.085481 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:51.085233 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d74df5579-6zgdv"] May 21 20:41:51.223111 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:51.222582 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2123a08c-c8d4-43df-a050-b5784387ac49-trusted-ca-bundle\") pod \"console-7d74df5579-6zgdv\" (UID: \"2123a08c-c8d4-43df-a050-b5784387ac49\") " pod="openshift-console/console-7d74df5579-6zgdv" May 21 20:41:51.223111 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:51.222691 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2123a08c-c8d4-43df-a050-b5784387ac49-oauth-serving-cert\") pod \"console-7d74df5579-6zgdv\" (UID: \"2123a08c-c8d4-43df-a050-b5784387ac49\") " pod="openshift-console/console-7d74df5579-6zgdv" May 21 20:41:51.223111 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:51.222746 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2123a08c-c8d4-43df-a050-b5784387ac49-service-ca\") pod \"console-7d74df5579-6zgdv\" (UID: \"2123a08c-c8d4-43df-a050-b5784387ac49\") " pod="openshift-console/console-7d74df5579-6zgdv" May 21 20:41:51.223111 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:51.222786 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2123a08c-c8d4-43df-a050-b5784387ac49-console-oauth-config\") pod \"console-7d74df5579-6zgdv\" (UID: \"2123a08c-c8d4-43df-a050-b5784387ac49\") " pod="openshift-console/console-7d74df5579-6zgdv" May 21 20:41:51.223111 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:51.222844 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2123a08c-c8d4-43df-a050-b5784387ac49-console-serving-cert\") pod \"console-7d74df5579-6zgdv\" (UID: \"2123a08c-c8d4-43df-a050-b5784387ac49\") " pod="openshift-console/console-7d74df5579-6zgdv" May 21 20:41:51.223111 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:51.222878 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2123a08c-c8d4-43df-a050-b5784387ac49-console-config\") pod \"console-7d74df5579-6zgdv\" (UID: \"2123a08c-c8d4-43df-a050-b5784387ac49\") " pod="openshift-console/console-7d74df5579-6zgdv" May 21 20:41:51.223111 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:51.222965 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgtlt\" (UniqueName: \"kubernetes.io/projected/2123a08c-c8d4-43df-a050-b5784387ac49-kube-api-access-zgtlt\") pod \"console-7d74df5579-6zgdv\" (UID: \"2123a08c-c8d4-43df-a050-b5784387ac49\") " pod="openshift-console/console-7d74df5579-6zgdv" May 21 20:41:51.289894 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:51.289817 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38af7c9b-9881-457e-9a7c-1432813f63a1","Type":"ContainerStarted","Data":"26d686b8abea132661c087ecd040b5e870e0f26c3618e0cb13b981c8f437f077"} May 21 20:41:51.289894 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:51.289849 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38af7c9b-9881-457e-9a7c-1432813f63a1","Type":"ContainerStarted","Data":"7f1c2084de08e7efa7a3f4fbf97a8cafda803a7a2fc8f4e22bde8533755826c7"} May 21 20:41:51.324240 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:51.324199 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zgtlt\" (UniqueName: \"kubernetes.io/projected/2123a08c-c8d4-43df-a050-b5784387ac49-kube-api-access-zgtlt\") pod \"console-7d74df5579-6zgdv\" (UID: \"2123a08c-c8d4-43df-a050-b5784387ac49\") " pod="openshift-console/console-7d74df5579-6zgdv" May 21 20:41:51.324240 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:51.324244 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2123a08c-c8d4-43df-a050-b5784387ac49-trusted-ca-bundle\") pod \"console-7d74df5579-6zgdv\" (UID: \"2123a08c-c8d4-43df-a050-b5784387ac49\") " pod="openshift-console/console-7d74df5579-6zgdv" May 21 20:41:51.324514 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:51.324296 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2123a08c-c8d4-43df-a050-b5784387ac49-oauth-serving-cert\") pod \"console-7d74df5579-6zgdv\" (UID: \"2123a08c-c8d4-43df-a050-b5784387ac49\") " pod="openshift-console/console-7d74df5579-6zgdv" May 21 20:41:51.324514 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:51.324321 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2123a08c-c8d4-43df-a050-b5784387ac49-service-ca\") pod \"console-7d74df5579-6zgdv\" (UID: \"2123a08c-c8d4-43df-a050-b5784387ac49\") " pod="openshift-console/console-7d74df5579-6zgdv" May 21 20:41:51.324514 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:51.324341 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2123a08c-c8d4-43df-a050-b5784387ac49-console-oauth-config\") pod \"console-7d74df5579-6zgdv\" (UID: \"2123a08c-c8d4-43df-a050-b5784387ac49\") " pod="openshift-console/console-7d74df5579-6zgdv" May 21 20:41:51.324514 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:51.324404 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2123a08c-c8d4-43df-a050-b5784387ac49-console-serving-cert\") pod \"console-7d74df5579-6zgdv\" (UID: \"2123a08c-c8d4-43df-a050-b5784387ac49\") " pod="openshift-console/console-7d74df5579-6zgdv" May 21 20:41:51.324514 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:51.324426 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2123a08c-c8d4-43df-a050-b5784387ac49-console-config\") pod \"console-7d74df5579-6zgdv\" (UID: \"2123a08c-c8d4-43df-a050-b5784387ac49\") " pod="openshift-console/console-7d74df5579-6zgdv" May 21 20:41:51.325085 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:51.325060 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2123a08c-c8d4-43df-a050-b5784387ac49-service-ca\") pod \"console-7d74df5579-6zgdv\" (UID: \"2123a08c-c8d4-43df-a050-b5784387ac49\") " pod="openshift-console/console-7d74df5579-6zgdv" May 21 20:41:51.325443 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:51.325195 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2123a08c-c8d4-43df-a050-b5784387ac49-oauth-serving-cert\") pod \"console-7d74df5579-6zgdv\" (UID: \"2123a08c-c8d4-43df-a050-b5784387ac49\") " pod="openshift-console/console-7d74df5579-6zgdv" May 21 20:41:51.325967 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:51.325945 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2123a08c-c8d4-43df-a050-b5784387ac49-console-config\") pod \"console-7d74df5579-6zgdv\" (UID: \"2123a08c-c8d4-43df-a050-b5784387ac49\") " pod="openshift-console/console-7d74df5579-6zgdv" May 21 20:41:51.326067 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:51.326011 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2123a08c-c8d4-43df-a050-b5784387ac49-trusted-ca-bundle\") pod \"console-7d74df5579-6zgdv\" (UID: \"2123a08c-c8d4-43df-a050-b5784387ac49\") " pod="openshift-console/console-7d74df5579-6zgdv" May 21 20:41:51.327350 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:51.327318 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2123a08c-c8d4-43df-a050-b5784387ac49-console-oauth-config\") pod \"console-7d74df5579-6zgdv\" (UID: \"2123a08c-c8d4-43df-a050-b5784387ac49\") " pod="openshift-console/console-7d74df5579-6zgdv" May 21 20:41:51.327475 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:51.327321 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2123a08c-c8d4-43df-a050-b5784387ac49-console-serving-cert\") pod \"console-7d74df5579-6zgdv\" (UID: \"2123a08c-c8d4-43df-a050-b5784387ac49\") " pod="openshift-console/console-7d74df5579-6zgdv" May 21 20:41:51.332049 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:51.332022 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgtlt\" (UniqueName: \"kubernetes.io/projected/2123a08c-c8d4-43df-a050-b5784387ac49-kube-api-access-zgtlt\") pod \"console-7d74df5579-6zgdv\" (UID: \"2123a08c-c8d4-43df-a050-b5784387ac49\") " pod="openshift-console/console-7d74df5579-6zgdv" May 21 20:41:51.388055 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:51.388016 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d74df5579-6zgdv" May 21 20:41:51.514302 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:51.514270 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d74df5579-6zgdv"] May 21 20:41:51.517164 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:41:51.517132 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2123a08c_c8d4_43df_a050_b5784387ac49.slice/crio-2f9157b52393d62a1eea5443e75f52c88f7031b21de40ef639d9ecff4c3333d7 WatchSource:0}: Error finding container 2f9157b52393d62a1eea5443e75f52c88f7031b21de40ef639d9ecff4c3333d7: Status 404 returned error can't find the container with id 2f9157b52393d62a1eea5443e75f52c88f7031b21de40ef639d9ecff4c3333d7 May 21 20:41:52.294768 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:52.294724 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d74df5579-6zgdv" event={"ID":"2123a08c-c8d4-43df-a050-b5784387ac49","Type":"ContainerStarted","Data":"00023fff65a193dc19b6be4a91913066f62b794c1f284b8f8f3660b24398f06a"} May 21 20:41:52.294768 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:52.294773 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d74df5579-6zgdv" event={"ID":"2123a08c-c8d4-43df-a050-b5784387ac49","Type":"ContainerStarted","Data":"2f9157b52393d62a1eea5443e75f52c88f7031b21de40ef639d9ecff4c3333d7"} May 21 20:41:52.313189 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:52.313125 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7d74df5579-6zgdv" podStartSLOduration=1.313109998 podStartE2EDuration="1.313109998s" podCreationTimestamp="2026-05-21 20:41:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 20:41:52.311867411 +0000 UTC m=+220.242642515" watchObservedRunningTime="2026-05-21 20:41:52.313109998 +0000 UTC m=+220.243885078" May 21 20:41:53.300106 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:53.300070 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38af7c9b-9881-457e-9a7c-1432813f63a1","Type":"ContainerStarted","Data":"d209b0628442e92eaba97d66bbf17fb6df85ec42933b4c7d04aeb41141bacb0b"} May 21 20:41:53.300106 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:53.300113 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38af7c9b-9881-457e-9a7c-1432813f63a1","Type":"ContainerStarted","Data":"f70e9cfc0c8b4ed00f7a5dca243d6e4b714fef779ee918f016c79051b952efd1"} May 21 20:41:53.300524 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:53.300123 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38af7c9b-9881-457e-9a7c-1432813f63a1","Type":"ContainerStarted","Data":"59364b334d7bad491aa5b0b45d29cfff87e4a7a84de134a41172c923709b8f42"} May 21 20:41:53.300524 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:53.300132 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38af7c9b-9881-457e-9a7c-1432813f63a1","Type":"ContainerStarted","Data":"7bdab2728f2289846c326868b23e6cc33db9b389971d7a2d51cf5c17bcfdc649"} May 21 20:41:53.327007 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:53.326947 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.692403587 podStartE2EDuration="8.326926553s" podCreationTimestamp="2026-05-21 20:41:45 +0000 UTC" firstStartedPulling="2026-05-21 20:41:46.16390698 +0000 UTC m=+214.094682047" lastFinishedPulling="2026-05-21 20:41:52.798429953 +0000 UTC m=+220.729205013" observedRunningTime="2026-05-21 20:41:53.325536024 +0000 UTC m=+221.256311110" watchObservedRunningTime="2026-05-21 20:41:53.326926553 +0000 UTC m=+221.257701638" May 21 20:41:55.983107 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:41:55.983069 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 20:42:01.388380 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:01.388337 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d74df5579-6zgdv" May 21 20:42:01.388882 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:01.388402 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d74df5579-6zgdv" May 21 20:42:01.393025 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:01.392995 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d74df5579-6zgdv" May 21 20:42:02.327041 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:02.327012 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d74df5579-6zgdv" May 21 20:42:04.086755 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:04.086707 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-c459f6b9b-tgc65" May 21 20:42:04.086755 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:04.086755 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-c459f6b9b-tgc65" May 21 20:42:04.330360 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:04.330273 2556 generic.go:358] "Generic (PLEG): container finished" podID="ea006f9a-fd3a-47a3-8edf-cae4c8b385fb" containerID="df4d9a5b986131560d99662702f69bcaca3f638ad06ee835a5dcef7bc60a1f85" exitCode=0 May 21 20:42:04.330360 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:04.330323 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-kwvc6" event={"ID":"ea006f9a-fd3a-47a3-8edf-cae4c8b385fb","Type":"ContainerDied","Data":"df4d9a5b986131560d99662702f69bcaca3f638ad06ee835a5dcef7bc60a1f85"} May 21 20:42:04.330666 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:04.330652 2556 scope.go:117] "RemoveContainer" containerID="df4d9a5b986131560d99662702f69bcaca3f638ad06ee835a5dcef7bc60a1f85" May 21 20:42:05.334290 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:05.334249 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-kwvc6" event={"ID":"ea006f9a-fd3a-47a3-8edf-cae4c8b385fb","Type":"ContainerStarted","Data":"3377a8bbb98b17c86764157fe840e5bace40173c7082142bdae7acda646b0137"} May 21 20:42:08.299900 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:08.299862 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7f846dbbb8-8p6b7" podUID="82d894fa-294f-4bcb-b5d6-2d86fd204805" containerName="console" containerID="cri-o://51ed57ff6df401c8465ee709b07007421bba3d0918b25b685d466405e0c4c902" gracePeriod=15 May 21 20:42:08.547656 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:08.547634 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f846dbbb8-8p6b7_82d894fa-294f-4bcb-b5d6-2d86fd204805/console/0.log" May 21 20:42:08.547775 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:08.547693 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f846dbbb8-8p6b7" May 21 20:42:08.589565 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:08.589529 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82d894fa-294f-4bcb-b5d6-2d86fd204805-console-serving-cert\") pod \"82d894fa-294f-4bcb-b5d6-2d86fd204805\" (UID: \"82d894fa-294f-4bcb-b5d6-2d86fd204805\") " May 21 20:42:08.589760 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:08.589578 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82d894fa-294f-4bcb-b5d6-2d86fd204805-console-config\") pod \"82d894fa-294f-4bcb-b5d6-2d86fd204805\" (UID: \"82d894fa-294f-4bcb-b5d6-2d86fd204805\") " May 21 20:42:08.589760 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:08.589597 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82d894fa-294f-4bcb-b5d6-2d86fd204805-console-oauth-config\") pod \"82d894fa-294f-4bcb-b5d6-2d86fd204805\" (UID: \"82d894fa-294f-4bcb-b5d6-2d86fd204805\") " May 21 20:42:08.589760 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:08.589630 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82d894fa-294f-4bcb-b5d6-2d86fd204805-oauth-serving-cert\") pod \"82d894fa-294f-4bcb-b5d6-2d86fd204805\" (UID: \"82d894fa-294f-4bcb-b5d6-2d86fd204805\") " May 21 20:42:08.589760 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:08.589672 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khn7n\" (UniqueName: \"kubernetes.io/projected/82d894fa-294f-4bcb-b5d6-2d86fd204805-kube-api-access-khn7n\") pod \"82d894fa-294f-4bcb-b5d6-2d86fd204805\" (UID: \"82d894fa-294f-4bcb-b5d6-2d86fd204805\") " May 21 20:42:08.589760 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:08.589706 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82d894fa-294f-4bcb-b5d6-2d86fd204805-service-ca\") pod \"82d894fa-294f-4bcb-b5d6-2d86fd204805\" (UID: \"82d894fa-294f-4bcb-b5d6-2d86fd204805\") " May 21 20:42:08.590114 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:08.590082 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82d894fa-294f-4bcb-b5d6-2d86fd204805-console-config" (OuterVolumeSpecName: "console-config") pod "82d894fa-294f-4bcb-b5d6-2d86fd204805" (UID: "82d894fa-294f-4bcb-b5d6-2d86fd204805"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:42:08.590203 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:08.590169 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82d894fa-294f-4bcb-b5d6-2d86fd204805-service-ca" (OuterVolumeSpecName: "service-ca") pod "82d894fa-294f-4bcb-b5d6-2d86fd204805" (UID: "82d894fa-294f-4bcb-b5d6-2d86fd204805"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:42:08.590203 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:08.590172 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82d894fa-294f-4bcb-b5d6-2d86fd204805-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "82d894fa-294f-4bcb-b5d6-2d86fd204805" (UID: "82d894fa-294f-4bcb-b5d6-2d86fd204805"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:42:08.592126 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:08.592102 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82d894fa-294f-4bcb-b5d6-2d86fd204805-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "82d894fa-294f-4bcb-b5d6-2d86fd204805" (UID: "82d894fa-294f-4bcb-b5d6-2d86fd204805"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 20:42:08.592214 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:08.592107 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82d894fa-294f-4bcb-b5d6-2d86fd204805-kube-api-access-khn7n" (OuterVolumeSpecName: "kube-api-access-khn7n") pod "82d894fa-294f-4bcb-b5d6-2d86fd204805" (UID: "82d894fa-294f-4bcb-b5d6-2d86fd204805"). InnerVolumeSpecName "kube-api-access-khn7n". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:42:08.592214 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:08.592126 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82d894fa-294f-4bcb-b5d6-2d86fd204805-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "82d894fa-294f-4bcb-b5d6-2d86fd204805" (UID: "82d894fa-294f-4bcb-b5d6-2d86fd204805"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 20:42:08.690396 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:08.690331 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82d894fa-294f-4bcb-b5d6-2d86fd204805-console-serving-cert\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\"" May 21 20:42:08.690396 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:08.690361 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82d894fa-294f-4bcb-b5d6-2d86fd204805-console-config\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\"" May 21 20:42:08.690396 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:08.690395 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82d894fa-294f-4bcb-b5d6-2d86fd204805-console-oauth-config\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\"" May 21 20:42:08.690396 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:08.690406 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82d894fa-294f-4bcb-b5d6-2d86fd204805-oauth-serving-cert\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\"" May 21 20:42:08.690769 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:08.690416 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khn7n\" (UniqueName: \"kubernetes.io/projected/82d894fa-294f-4bcb-b5d6-2d86fd204805-kube-api-access-khn7n\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\"" May 21 20:42:08.690769 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:08.690425 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82d894fa-294f-4bcb-b5d6-2d86fd204805-service-ca\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\"" May 21 20:42:09.348073 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:09.348046 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f846dbbb8-8p6b7_82d894fa-294f-4bcb-b5d6-2d86fd204805/console/0.log" May 21 20:42:09.348440 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:09.348086 2556 generic.go:358] "Generic (PLEG): container finished" podID="82d894fa-294f-4bcb-b5d6-2d86fd204805" containerID="51ed57ff6df401c8465ee709b07007421bba3d0918b25b685d466405e0c4c902" exitCode=2 May 21 20:42:09.348440 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:09.348160 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f846dbbb8-8p6b7" May 21 20:42:09.348440 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:09.348168 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f846dbbb8-8p6b7" event={"ID":"82d894fa-294f-4bcb-b5d6-2d86fd204805","Type":"ContainerDied","Data":"51ed57ff6df401c8465ee709b07007421bba3d0918b25b685d466405e0c4c902"} May 21 20:42:09.348440 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:09.348199 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f846dbbb8-8p6b7" event={"ID":"82d894fa-294f-4bcb-b5d6-2d86fd204805","Type":"ContainerDied","Data":"4e146bf7299e83b668a6b4c8f452c7bdf1f2e7903a95c9c7574521b72eea07ec"} May 21 20:42:09.348440 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:09.348218 2556 scope.go:117] "RemoveContainer" containerID="51ed57ff6df401c8465ee709b07007421bba3d0918b25b685d466405e0c4c902" May 21 20:42:09.356190 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:09.356169 2556 scope.go:117] "RemoveContainer" containerID="51ed57ff6df401c8465ee709b07007421bba3d0918b25b685d466405e0c4c902" May 21 20:42:09.356497 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:42:09.356473 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51ed57ff6df401c8465ee709b07007421bba3d0918b25b685d466405e0c4c902\": container with ID starting with 51ed57ff6df401c8465ee709b07007421bba3d0918b25b685d466405e0c4c902 not found: ID does not exist" containerID="51ed57ff6df401c8465ee709b07007421bba3d0918b25b685d466405e0c4c902" May 21 20:42:09.356573 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:09.356508 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51ed57ff6df401c8465ee709b07007421bba3d0918b25b685d466405e0c4c902"} err="failed to get container status \"51ed57ff6df401c8465ee709b07007421bba3d0918b25b685d466405e0c4c902\": rpc error: code = NotFound desc = could not find container \"51ed57ff6df401c8465ee709b07007421bba3d0918b25b685d466405e0c4c902\": container with ID starting with 51ed57ff6df401c8465ee709b07007421bba3d0918b25b685d466405e0c4c902 not found: ID does not exist" May 21 20:42:09.361837 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:09.361812 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f846dbbb8-8p6b7"] May 21 20:42:09.365317 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:09.365294 2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f846dbbb8-8p6b7"] May 21 20:42:10.687212 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:10.687177 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82d894fa-294f-4bcb-b5d6-2d86fd204805" path="/var/lib/kubelet/pods/82d894fa-294f-4bcb-b5d6-2d86fd204805/volumes" May 21 20:42:24.092139 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:24.092108 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-c459f6b9b-tgc65" May 21 20:42:24.096668 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:24.096642 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-c459f6b9b-tgc65" May 21 20:42:24.541682 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:24.541594 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3bdf9a6b-e989-4794-bbe7-3396ae7ddc07-metrics-certs\") pod \"network-metrics-daemon-dgrfc\" (UID: \"3bdf9a6b-e989-4794-bbe7-3396ae7ddc07\") " pod="openshift-multus/network-metrics-daemon-dgrfc" May 21 20:42:24.544012 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:24.543989 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3bdf9a6b-e989-4794-bbe7-3396ae7ddc07-metrics-certs\") pod \"network-metrics-daemon-dgrfc\" (UID: \"3bdf9a6b-e989-4794-bbe7-3396ae7ddc07\") " pod="openshift-multus/network-metrics-daemon-dgrfc" May 21 20:42:24.588063 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:24.588027 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cjf7l\"" May 21 20:42:24.596681 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:24.596640 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dgrfc" May 21 20:42:24.725852 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:24.725816 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dgrfc"] May 21 20:42:24.729573 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:42:24.729539 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bdf9a6b_e989_4794_bbe7_3396ae7ddc07.slice/crio-3623a3d29cab166e56ddf64ee0551d9c23c541ef589a0412d473bbf0d2070678 WatchSource:0}: Error finding container 3623a3d29cab166e56ddf64ee0551d9c23c541ef589a0412d473bbf0d2070678: Status 404 returned error can't find the container with id 3623a3d29cab166e56ddf64ee0551d9c23c541ef589a0412d473bbf0d2070678 May 21 20:42:25.394230 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:25.394193 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dgrfc" event={"ID":"3bdf9a6b-e989-4794-bbe7-3396ae7ddc07","Type":"ContainerStarted","Data":"3623a3d29cab166e56ddf64ee0551d9c23c541ef589a0412d473bbf0d2070678"} May 21 20:42:26.234229 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:26.234192 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6p4ps_84d7fb93-5212-4b3f-a963-296ed4cae5b0/dns-node-resolver/0.log" May 21 20:42:26.398198 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:26.398162 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dgrfc" event={"ID":"3bdf9a6b-e989-4794-bbe7-3396ae7ddc07","Type":"ContainerStarted","Data":"3d2aea43b3441d992f105441e76d8a953f768a37c29171c512c618adb6b37334"} May 21 20:42:26.398198 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:26.398199 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dgrfc" event={"ID":"3bdf9a6b-e989-4794-bbe7-3396ae7ddc07","Type":"ContainerStarted","Data":"322ebbf4874518348f28c91b71b8bd2067252e24fcdb57e980ba35315644d558"} May 21 20:42:26.412786 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:26.412728 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dgrfc" podStartSLOduration=253.540316239 podStartE2EDuration="4m14.412714307s" podCreationTimestamp="2026-05-21 20:38:12 +0000 UTC" firstStartedPulling="2026-05-21 20:42:24.731347925 +0000 UTC m=+252.662122987" lastFinishedPulling="2026-05-21 20:42:25.603745989 +0000 UTC m=+253.534521055" observedRunningTime="2026-05-21 20:42:26.41167717 +0000 UTC m=+254.342452299" watchObservedRunningTime="2026-05-21 20:42:26.412714307 +0000 UTC m=+254.343489389" May 21 20:42:29.407593 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:29.407497 2556 generic.go:358] "Generic (PLEG): container finished" podID="e8d1d929-7502-4b6b-b5d4-a66201f06c8e" containerID="572b975343744e269d6239d46e52a2f4416c178f67129769b094cdab7888d559" exitCode=0 May 21 20:42:29.407593 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:29.407561 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nn778" event={"ID":"e8d1d929-7502-4b6b-b5d4-a66201f06c8e","Type":"ContainerDied","Data":"572b975343744e269d6239d46e52a2f4416c178f67129769b094cdab7888d559"} May 21 20:42:29.408066 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:29.407865 2556 scope.go:117] "RemoveContainer" containerID="572b975343744e269d6239d46e52a2f4416c178f67129769b094cdab7888d559" May 21 20:42:30.411991 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:30.411955 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nn778" event={"ID":"e8d1d929-7502-4b6b-b5d4-a66201f06c8e","Type":"ContainerStarted","Data":"61c53cb0ce4de31bb0cb4e5035b03c89def1b98735551ce72245cca28e5cb5bc"} May 21 20:42:45.983352 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:45.983303 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 21 20:42:45.999697 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:45.999664 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 21 20:42:46.473729 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:46.473701 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 20:42:53.091168 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:42:53.091122 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-z7tv2" podUID="ba567318-f7e8-435e-b1c6-152074615586" May 21 20:42:53.479064 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:53.478986 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z7tv2" May 21 20:42:56.941630 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:56.941585 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a2f603e-8e52-4c17-9f71-0518c657f864-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-hn2r7\" (UID: \"0a2f603e-8e52-4c17-9f71-0518c657f864\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-hn2r7" May 21 20:42:56.944287 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:56.944258 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a2f603e-8e52-4c17-9f71-0518c657f864-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-hn2r7\" (UID: \"0a2f603e-8e52-4c17-9f71-0518c657f864\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-hn2r7" May 21 20:42:57.042681 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:57.042633 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba567318-f7e8-435e-b1c6-152074615586-metrics-tls\") pod \"dns-default-z7tv2\" (UID: \"ba567318-f7e8-435e-b1c6-152074615586\") " pod="openshift-dns/dns-default-z7tv2" May 21 20:42:57.042892 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:57.042694 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b6798e3-449b-4f3b-900d-08e55e6acf43-cert\") pod \"ingress-canary-kql5p\" (UID: \"9b6798e3-449b-4f3b-900d-08e55e6acf43\") " pod="openshift-ingress-canary/ingress-canary-kql5p" May 21 20:42:57.045723 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:57.045684 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba567318-f7e8-435e-b1c6-152074615586-metrics-tls\") pod \"dns-default-z7tv2\" (UID: \"ba567318-f7e8-435e-b1c6-152074615586\") " pod="openshift-dns/dns-default-z7tv2" May 21 20:42:57.045853 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:57.045749 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b6798e3-449b-4f3b-900d-08e55e6acf43-cert\") pod \"ingress-canary-kql5p\" (UID: \"9b6798e3-449b-4f3b-900d-08e55e6acf43\") " pod="openshift-ingress-canary/ingress-canary-kql5p" May 21 20:42:57.081732 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:57.081698 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-25972\"" May 21 20:42:57.085586 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:57.085567 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-f4n69\"" May 21 20:42:57.089428 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:57.089410 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-56rzl\"" May 21 20:42:57.090429 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:57.090412 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z7tv2" May 21 20:42:57.095153 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:57.095129 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kql5p" May 21 20:42:57.098772 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:57.098754 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-hn2r7" May 21 20:42:57.239744 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:57.239702 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z7tv2"] May 21 20:42:57.243184 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:42:57.243134 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba567318_f7e8_435e_b1c6_152074615586.slice/crio-7ce372853363f8fb1af5d9cefd99586f75fb7713a84a7780abac21aca5cf4667 WatchSource:0}: Error finding container 7ce372853363f8fb1af5d9cefd99586f75fb7713a84a7780abac21aca5cf4667: Status 404 returned error can't find the container with id 7ce372853363f8fb1af5d9cefd99586f75fb7713a84a7780abac21aca5cf4667 May 21 20:42:57.262925 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:57.262893 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kql5p"] May 21 20:42:57.265542 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:42:57.265506 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b6798e3_449b_4f3b_900d_08e55e6acf43.slice/crio-fc9fd28c9ecac0e08140b1fddeb903ecbe873128ffda5cf18aab7a2f68b00f32 WatchSource:0}: Error finding container fc9fd28c9ecac0e08140b1fddeb903ecbe873128ffda5cf18aab7a2f68b00f32: Status 404 returned error can't find the container with id fc9fd28c9ecac0e08140b1fddeb903ecbe873128ffda5cf18aab7a2f68b00f32 May 21 20:42:57.281909 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:57.281889 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-hn2r7"] May 21 20:42:57.283879 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:42:57.283857 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a2f603e_8e52_4c17_9f71_0518c657f864.slice/crio-1670fddbf55feff81fc988661fb0db0a301d5a9e882c9a8c503cafc84bb8295f WatchSource:0}: Error finding container 1670fddbf55feff81fc988661fb0db0a301d5a9e882c9a8c503cafc84bb8295f: Status 404 returned error can't find the container with id 1670fddbf55feff81fc988661fb0db0a301d5a9e882c9a8c503cafc84bb8295f May 21 20:42:57.490832 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:57.490739 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-hn2r7" event={"ID":"0a2f603e-8e52-4c17-9f71-0518c657f864","Type":"ContainerStarted","Data":"1670fddbf55feff81fc988661fb0db0a301d5a9e882c9a8c503cafc84bb8295f"} May 21 20:42:57.491660 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:57.491634 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z7tv2" event={"ID":"ba567318-f7e8-435e-b1c6-152074615586","Type":"ContainerStarted","Data":"7ce372853363f8fb1af5d9cefd99586f75fb7713a84a7780abac21aca5cf4667"} May 21 20:42:57.492499 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:42:57.492476 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kql5p" event={"ID":"9b6798e3-449b-4f3b-900d-08e55e6acf43","Type":"ContainerStarted","Data":"fc9fd28c9ecac0e08140b1fddeb903ecbe873128ffda5cf18aab7a2f68b00f32"} May 21 20:43:00.503847 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:00.503811 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z7tv2" event={"ID":"ba567318-f7e8-435e-b1c6-152074615586","Type":"ContainerStarted","Data":"5f09629e248e0493c020fae8712fee8e00c04df77ed2fc0a7be2763fa48b0e5c"} May 21 20:43:00.503847 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:00.503847 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z7tv2" event={"ID":"ba567318-f7e8-435e-b1c6-152074615586","Type":"ContainerStarted","Data":"af0eb011e4783b1ef033dbf9d984af4c498277b46bb258cd33173978f0887402"} May 21 20:43:00.504312 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:00.503911 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-z7tv2" May 21 20:43:00.505270 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:00.505249 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kql5p" event={"ID":"9b6798e3-449b-4f3b-900d-08e55e6acf43","Type":"ContainerStarted","Data":"e071f26e81a1ec8a0d3771c44a06927bc0860e7644d98d6aa4a39714e6226107"} May 21 20:43:00.506436 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:00.506415 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-hn2r7" event={"ID":"0a2f603e-8e52-4c17-9f71-0518c657f864","Type":"ContainerStarted","Data":"5a70874d9da6d568b131a0796f0b906a08d86e6b02cf5a4cdbe8a2bb8c45ec74"} May 21 20:43:00.522356 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:00.522314 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-z7tv2" podStartSLOduration=252.251711961 podStartE2EDuration="4m14.52230062s" podCreationTimestamp="2026-05-21 20:38:46 +0000 UTC" firstStartedPulling="2026-05-21 20:42:57.245595462 +0000 UTC m=+285.176370525" lastFinishedPulling="2026-05-21 20:42:59.516184111 +0000 UTC m=+287.446959184" observedRunningTime="2026-05-21 20:43:00.52116385 +0000 UTC m=+288.451938933" watchObservedRunningTime="2026-05-21 20:43:00.52230062 +0000 UTC m=+288.453075709" May 21 20:43:00.535901 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:00.535851 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-hn2r7" podStartSLOduration=273.305422896 podStartE2EDuration="4m35.535837664s" podCreationTimestamp="2026-05-21 20:38:25 +0000 UTC" firstStartedPulling="2026-05-21 20:42:57.285704313 +0000 UTC m=+285.216479375" lastFinishedPulling="2026-05-21 20:42:59.516119082 +0000 UTC m=+287.446894143" observedRunningTime="2026-05-21 20:43:00.535394065 +0000 UTC m=+288.466169141" watchObservedRunningTime="2026-05-21 20:43:00.535837664 +0000 UTC m=+288.466612746" May 21 20:43:00.549574 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:00.549523 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kql5p" podStartSLOduration=252.295177377 podStartE2EDuration="4m14.549505388s" podCreationTimestamp="2026-05-21 20:38:46 +0000 UTC" firstStartedPulling="2026-05-21 20:42:57.267475828 +0000 UTC m=+285.198250890" lastFinishedPulling="2026-05-21 20:42:59.521803833 +0000 UTC m=+287.452578901" observedRunningTime="2026-05-21 20:43:00.549200567 +0000 UTC m=+288.479975673" watchObservedRunningTime="2026-05-21 20:43:00.549505388 +0000 UTC m=+288.480280468" May 21 20:43:07.587711 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:07.587679 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d74df5579-6zgdv"] May 21 20:43:10.512287 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:10.512254 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-z7tv2" May 21 20:43:12.592939 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:12.592910 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7n7h_2b22953d-24b1-4a5a-9ad2-870f2414a537/ovn-acl-logging/0.log" May 21 20:43:12.594691 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:12.594663 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7n7h_2b22953d-24b1-4a5a-9ad2-870f2414a537/ovn-acl-logging/0.log" May 21 20:43:12.597217 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:12.597188 2556 kubelet.go:1628] "Image garbage collection succeeded" May 21 20:43:32.607074 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:32.607011 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7d74df5579-6zgdv" podUID="2123a08c-c8d4-43df-a050-b5784387ac49" containerName="console" containerID="cri-o://00023fff65a193dc19b6be4a91913066f62b794c1f284b8f8f3660b24398f06a" gracePeriod=15 May 21 20:43:32.855326 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:32.855300 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7d74df5579-6zgdv_2123a08c-c8d4-43df-a050-b5784387ac49/console/0.log" May 21 20:43:32.855490 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:32.855407 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d74df5579-6zgdv" May 21 20:43:32.944043 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:32.943954 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2123a08c-c8d4-43df-a050-b5784387ac49-oauth-serving-cert\") pod \"2123a08c-c8d4-43df-a050-b5784387ac49\" (UID: \"2123a08c-c8d4-43df-a050-b5784387ac49\") " May 21 20:43:32.944043 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:32.943988 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2123a08c-c8d4-43df-a050-b5784387ac49-service-ca\") pod \"2123a08c-c8d4-43df-a050-b5784387ac49\" (UID: \"2123a08c-c8d4-43df-a050-b5784387ac49\") " May 21 20:43:32.944261 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:32.944126 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2123a08c-c8d4-43df-a050-b5784387ac49-console-config\") pod \"2123a08c-c8d4-43df-a050-b5784387ac49\" (UID: \"2123a08c-c8d4-43df-a050-b5784387ac49\") " May 21 20:43:32.944261 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:32.944162 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2123a08c-c8d4-43df-a050-b5784387ac49-console-oauth-config\") pod \"2123a08c-c8d4-43df-a050-b5784387ac49\" (UID: \"2123a08c-c8d4-43df-a050-b5784387ac49\") " May 21 20:43:32.944261 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:32.944191 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2123a08c-c8d4-43df-a050-b5784387ac49-trusted-ca-bundle\") pod \"2123a08c-c8d4-43df-a050-b5784387ac49\" (UID: \"2123a08c-c8d4-43df-a050-b5784387ac49\") " May 21 20:43:32.944261 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:32.944217 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgtlt\" (UniqueName: \"kubernetes.io/projected/2123a08c-c8d4-43df-a050-b5784387ac49-kube-api-access-zgtlt\") pod \"2123a08c-c8d4-43df-a050-b5784387ac49\" (UID: \"2123a08c-c8d4-43df-a050-b5784387ac49\") " May 21 20:43:32.944261 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:32.944253 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2123a08c-c8d4-43df-a050-b5784387ac49-console-serving-cert\") pod \"2123a08c-c8d4-43df-a050-b5784387ac49\" (UID: \"2123a08c-c8d4-43df-a050-b5784387ac49\") " May 21 20:43:32.944545 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:32.944503 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2123a08c-c8d4-43df-a050-b5784387ac49-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2123a08c-c8d4-43df-a050-b5784387ac49" (UID: "2123a08c-c8d4-43df-a050-b5784387ac49"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:43:32.944545 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:32.944532 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2123a08c-c8d4-43df-a050-b5784387ac49-service-ca" (OuterVolumeSpecName: "service-ca") pod "2123a08c-c8d4-43df-a050-b5784387ac49" (UID: "2123a08c-c8d4-43df-a050-b5784387ac49"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:43:32.944627 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:32.944549 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2123a08c-c8d4-43df-a050-b5784387ac49-console-config" (OuterVolumeSpecName: "console-config") pod "2123a08c-c8d4-43df-a050-b5784387ac49" (UID: "2123a08c-c8d4-43df-a050-b5784387ac49"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:43:32.944678 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:32.944653 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2123a08c-c8d4-43df-a050-b5784387ac49-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2123a08c-c8d4-43df-a050-b5784387ac49" (UID: "2123a08c-c8d4-43df-a050-b5784387ac49"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:43:32.946482 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:32.946450 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2123a08c-c8d4-43df-a050-b5784387ac49-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2123a08c-c8d4-43df-a050-b5784387ac49" (UID: "2123a08c-c8d4-43df-a050-b5784387ac49"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 20:43:32.946585 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:32.946522 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2123a08c-c8d4-43df-a050-b5784387ac49-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2123a08c-c8d4-43df-a050-b5784387ac49" (UID: "2123a08c-c8d4-43df-a050-b5784387ac49"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 20:43:32.946641 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:32.946577 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2123a08c-c8d4-43df-a050-b5784387ac49-kube-api-access-zgtlt" (OuterVolumeSpecName: "kube-api-access-zgtlt") pod "2123a08c-c8d4-43df-a050-b5784387ac49" (UID: "2123a08c-c8d4-43df-a050-b5784387ac49"). InnerVolumeSpecName "kube-api-access-zgtlt". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:43:33.045481 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:33.045424 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2123a08c-c8d4-43df-a050-b5784387ac49-oauth-serving-cert\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\"" May 21 20:43:33.045481 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:33.045475 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2123a08c-c8d4-43df-a050-b5784387ac49-service-ca\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\"" May 21 20:43:33.045481 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:33.045488 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2123a08c-c8d4-43df-a050-b5784387ac49-console-config\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\"" May 21 20:43:33.045729 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:33.045500 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2123a08c-c8d4-43df-a050-b5784387ac49-console-oauth-config\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\"" May 21 20:43:33.045729 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:33.045513 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2123a08c-c8d4-43df-a050-b5784387ac49-trusted-ca-bundle\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\"" May 21 20:43:33.045729 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:33.045525 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgtlt\" (UniqueName: \"kubernetes.io/projected/2123a08c-c8d4-43df-a050-b5784387ac49-kube-api-access-zgtlt\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\"" May 21 20:43:33.045729 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:33.045537 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2123a08c-c8d4-43df-a050-b5784387ac49-console-serving-cert\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\"" May 21 20:43:33.600272 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:33.600244 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7d74df5579-6zgdv_2123a08c-c8d4-43df-a050-b5784387ac49/console/0.log" May 21 20:43:33.600476 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:33.600282 2556 generic.go:358] "Generic (PLEG): container finished" podID="2123a08c-c8d4-43df-a050-b5784387ac49" containerID="00023fff65a193dc19b6be4a91913066f62b794c1f284b8f8f3660b24398f06a" exitCode=2 May 21 20:43:33.600476 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:33.600333 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d74df5579-6zgdv" event={"ID":"2123a08c-c8d4-43df-a050-b5784387ac49","Type":"ContainerDied","Data":"00023fff65a193dc19b6be4a91913066f62b794c1f284b8f8f3660b24398f06a"} May 21 20:43:33.600476 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:33.600403 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d74df5579-6zgdv" event={"ID":"2123a08c-c8d4-43df-a050-b5784387ac49","Type":"ContainerDied","Data":"2f9157b52393d62a1eea5443e75f52c88f7031b21de40ef639d9ecff4c3333d7"} May 21 20:43:33.600476 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:33.600420 2556 scope.go:117] "RemoveContainer" containerID="00023fff65a193dc19b6be4a91913066f62b794c1f284b8f8f3660b24398f06a" May 21 20:43:33.600672 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:33.600350 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d74df5579-6zgdv" May 21 20:43:33.609044 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:33.609027 2556 scope.go:117] "RemoveContainer" containerID="00023fff65a193dc19b6be4a91913066f62b794c1f284b8f8f3660b24398f06a" May 21 20:43:33.609311 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:43:33.609249 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00023fff65a193dc19b6be4a91913066f62b794c1f284b8f8f3660b24398f06a\": container with ID starting with 00023fff65a193dc19b6be4a91913066f62b794c1f284b8f8f3660b24398f06a not found: ID does not exist" containerID="00023fff65a193dc19b6be4a91913066f62b794c1f284b8f8f3660b24398f06a" May 21 20:43:33.609311 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:33.609275 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00023fff65a193dc19b6be4a91913066f62b794c1f284b8f8f3660b24398f06a"} err="failed to get container status \"00023fff65a193dc19b6be4a91913066f62b794c1f284b8f8f3660b24398f06a\": rpc error: code = NotFound desc = could not find container \"00023fff65a193dc19b6be4a91913066f62b794c1f284b8f8f3660b24398f06a\": container with ID starting with 00023fff65a193dc19b6be4a91913066f62b794c1f284b8f8f3660b24398f06a not found: ID does not exist" May 21 20:43:33.619526 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:33.619498 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d74df5579-6zgdv"] May 21 20:43:33.622871 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:33.622845 2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d74df5579-6zgdv"] May 21 20:43:34.688136 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:43:34.688106 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2123a08c-c8d4-43df-a050-b5784387ac49" path="/var/lib/kubelet/pods/2123a08c-c8d4-43df-a050-b5784387ac49/volumes" May 21 20:48:12.614140 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:48:12.614112 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7n7h_2b22953d-24b1-4a5a-9ad2-870f2414a537/ovn-acl-logging/0.log" May 21 20:48:12.615034 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:48:12.615013 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7n7h_2b22953d-24b1-4a5a-9ad2-870f2414a537/ovn-acl-logging/0.log" May 21 20:48:52.037595 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:48:52.037527 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-s9gq5"] May 21 20:48:52.038096 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:48:52.037855 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82d894fa-294f-4bcb-b5d6-2d86fd204805" containerName="console" May 21 20:48:52.038096 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:48:52.037873 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="82d894fa-294f-4bcb-b5d6-2d86fd204805" containerName="console" May 21 20:48:52.038096 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:48:52.037895 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2123a08c-c8d4-43df-a050-b5784387ac49" containerName="console" May 21 20:48:52.038096 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:48:52.037900 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2123a08c-c8d4-43df-a050-b5784387ac49" containerName="console" May 21 20:48:52.038096 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:48:52.037953 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="82d894fa-294f-4bcb-b5d6-2d86fd204805" containerName="console" May 21 20:48:52.038096 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:48:52.037966 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="2123a08c-c8d4-43df-a050-b5784387ac49" containerName="console" May 21 20:48:52.040856 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:48:52.040840 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-s9gq5" May 21 20:48:52.042893 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:48:52.042872 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 21 20:48:52.043272 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:48:52.043252 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 21 20:48:52.043386 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:48:52.043254 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-mz4vc\"" May 21 20:48:52.049409 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:48:52.049387 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-s9gq5"] May 21 20:48:52.076644 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:48:52.076600 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgxnk\" (UniqueName: \"kubernetes.io/projected/50d60ac3-9e9b-47b2-9278-5c10337a3090-kube-api-access-wgxnk\") pod \"cert-manager-79c8d999ff-s9gq5\" (UID: \"50d60ac3-9e9b-47b2-9278-5c10337a3090\") " pod="cert-manager/cert-manager-79c8d999ff-s9gq5" May 21 20:48:52.076644 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:48:52.076644 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/50d60ac3-9e9b-47b2-9278-5c10337a3090-bound-sa-token\") pod \"cert-manager-79c8d999ff-s9gq5\" (UID: \"50d60ac3-9e9b-47b2-9278-5c10337a3090\") " pod="cert-manager/cert-manager-79c8d999ff-s9gq5" May 21 20:48:52.177889 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:48:52.177851 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wgxnk\" (UniqueName: \"kubernetes.io/projected/50d60ac3-9e9b-47b2-9278-5c10337a3090-kube-api-access-wgxnk\") pod \"cert-manager-79c8d999ff-s9gq5\" (UID: \"50d60ac3-9e9b-47b2-9278-5c10337a3090\") " pod="cert-manager/cert-manager-79c8d999ff-s9gq5" May 21 20:48:52.177889 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:48:52.177889 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/50d60ac3-9e9b-47b2-9278-5c10337a3090-bound-sa-token\") pod \"cert-manager-79c8d999ff-s9gq5\" (UID: \"50d60ac3-9e9b-47b2-9278-5c10337a3090\") " pod="cert-manager/cert-manager-79c8d999ff-s9gq5" May 21 20:48:52.186317 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:48:52.186285 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/50d60ac3-9e9b-47b2-9278-5c10337a3090-bound-sa-token\") pod \"cert-manager-79c8d999ff-s9gq5\" (UID: \"50d60ac3-9e9b-47b2-9278-5c10337a3090\") " pod="cert-manager/cert-manager-79c8d999ff-s9gq5" May 21 20:48:52.186490 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:48:52.186352 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgxnk\" (UniqueName: \"kubernetes.io/projected/50d60ac3-9e9b-47b2-9278-5c10337a3090-kube-api-access-wgxnk\") pod \"cert-manager-79c8d999ff-s9gq5\" (UID: \"50d60ac3-9e9b-47b2-9278-5c10337a3090\") " pod="cert-manager/cert-manager-79c8d999ff-s9gq5" May 21 20:48:52.360043 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:48:52.359992 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-s9gq5" May 21 20:48:52.491239 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:48:52.491208 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-s9gq5"] May 21 20:48:52.494823 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:48:52.494793 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod50d60ac3_9e9b_47b2_9278_5c10337a3090.slice/crio-1ea570e22c96a4b3077606916b212e115cf4ae13c73ea6ad5f798ff156668922 WatchSource:0}: Error finding container 1ea570e22c96a4b3077606916b212e115cf4ae13c73ea6ad5f798ff156668922: Status 404 returned error can't find the container with id 1ea570e22c96a4b3077606916b212e115cf4ae13c73ea6ad5f798ff156668922 May 21 20:48:52.496616 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:48:52.496597 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 20:48:52.500264 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:48:52.500211 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-s9gq5" event={"ID":"50d60ac3-9e9b-47b2-9278-5c10337a3090","Type":"ContainerStarted","Data":"1ea570e22c96a4b3077606916b212e115cf4ae13c73ea6ad5f798ff156668922"} May 21 20:48:56.514108 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:48:56.514064 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-s9gq5" event={"ID":"50d60ac3-9e9b-47b2-9278-5c10337a3090","Type":"ContainerStarted","Data":"e858404068744944e28861d7037e77599d1ca26ce3a5d55fe71cf903142114f1"} May 21 20:48:56.528554 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:48:56.528499 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-s9gq5" podStartSLOduration=1.307485034 podStartE2EDuration="4.52848412s" podCreationTimestamp="2026-05-21 20:48:52 +0000 UTC" firstStartedPulling="2026-05-21 20:48:52.496782668 +0000 UTC m=+640.427557730" lastFinishedPulling="2026-05-21 20:48:55.717781751 +0000 UTC m=+643.648556816" observedRunningTime="2026-05-21 20:48:56.526530824 +0000 UTC m=+644.457305906" watchObservedRunningTime="2026-05-21 20:48:56.52848412 +0000 UTC m=+644.459259202" May 21 20:49:16.881513 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:16.881446 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bb9zg"] May 21 20:49:16.885760 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:16.885740 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bb9zg" May 21 20:49:16.887788 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:16.887759 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 20:49:16.888105 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:16.888084 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 20:49:16.888198 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:16.888103 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8hv5g\"" May 21 20:49:16.888198 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:16.888120 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 20:49:16.888198 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:16.888179 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 20:49:16.901163 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:16.901141 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bb9zg"] May 21 20:49:16.993443 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:16.993398 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-872mm\" (UniqueName: \"kubernetes.io/projected/1d2d37ec-1406-4b83-a0e5-54a892ed6773-kube-api-access-872mm\") pod \"opendatahub-operator-controller-manager-76cc84b65c-bb9zg\" (UID: \"1d2d37ec-1406-4b83-a0e5-54a892ed6773\") " pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bb9zg" May 21 20:49:16.993594 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:16.993522 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d2d37ec-1406-4b83-a0e5-54a892ed6773-webhook-cert\") pod \"opendatahub-operator-controller-manager-76cc84b65c-bb9zg\" (UID: \"1d2d37ec-1406-4b83-a0e5-54a892ed6773\") " pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bb9zg" May 21 20:49:16.993594 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:16.993581 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1d2d37ec-1406-4b83-a0e5-54a892ed6773-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76cc84b65c-bb9zg\" (UID: \"1d2d37ec-1406-4b83-a0e5-54a892ed6773\") " pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bb9zg" May 21 20:49:17.094653 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:17.094620 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d2d37ec-1406-4b83-a0e5-54a892ed6773-webhook-cert\") pod \"opendatahub-operator-controller-manager-76cc84b65c-bb9zg\" (UID: \"1d2d37ec-1406-4b83-a0e5-54a892ed6773\") " pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bb9zg" May 21 20:49:17.094801 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:17.094666 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1d2d37ec-1406-4b83-a0e5-54a892ed6773-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76cc84b65c-bb9zg\" (UID: \"1d2d37ec-1406-4b83-a0e5-54a892ed6773\") " pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bb9zg" May 21 20:49:17.094801 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:17.094703 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-872mm\" (UniqueName: \"kubernetes.io/projected/1d2d37ec-1406-4b83-a0e5-54a892ed6773-kube-api-access-872mm\") pod \"opendatahub-operator-controller-manager-76cc84b65c-bb9zg\" (UID: \"1d2d37ec-1406-4b83-a0e5-54a892ed6773\") " pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bb9zg" May 21 20:49:17.097348 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:17.097320 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d2d37ec-1406-4b83-a0e5-54a892ed6773-webhook-cert\") pod \"opendatahub-operator-controller-manager-76cc84b65c-bb9zg\" (UID: \"1d2d37ec-1406-4b83-a0e5-54a892ed6773\") " pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bb9zg" May 21 20:49:17.097348 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:17.097339 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1d2d37ec-1406-4b83-a0e5-54a892ed6773-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76cc84b65c-bb9zg\" (UID: \"1d2d37ec-1406-4b83-a0e5-54a892ed6773\") " pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bb9zg" May 21 20:49:17.107844 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:17.107817 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-872mm\" (UniqueName: \"kubernetes.io/projected/1d2d37ec-1406-4b83-a0e5-54a892ed6773-kube-api-access-872mm\") pod \"opendatahub-operator-controller-manager-76cc84b65c-bb9zg\" (UID: \"1d2d37ec-1406-4b83-a0e5-54a892ed6773\") " pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bb9zg" May 21 20:49:17.195725 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:17.195635 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bb9zg" May 21 20:49:17.331642 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:17.331610 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bb9zg"] May 21 20:49:17.335316 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:49:17.335287 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d2d37ec_1406_4b83_a0e5_54a892ed6773.slice/crio-cb165cd5119383179eec0c845be62b0f7860d381893e5f3e7c7ea3f3c1d99745 WatchSource:0}: Error finding container cb165cd5119383179eec0c845be62b0f7860d381893e5f3e7c7ea3f3c1d99745: Status 404 returned error can't find the container with id cb165cd5119383179eec0c845be62b0f7860d381893e5f3e7c7ea3f3c1d99745 May 21 20:49:17.574246 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:17.574165 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bb9zg" event={"ID":"1d2d37ec-1406-4b83-a0e5-54a892ed6773","Type":"ContainerStarted","Data":"cb165cd5119383179eec0c845be62b0f7860d381893e5f3e7c7ea3f3c1d99745"} May 21 20:49:20.587923 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:20.587880 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bb9zg" event={"ID":"1d2d37ec-1406-4b83-a0e5-54a892ed6773","Type":"ContainerStarted","Data":"57bcf132506ac2f99a39f03659d0e58a5af1765d6fd62f855cf1d4030c58dbef"} May 21 20:49:20.588268 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:20.588024 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bb9zg" May 21 20:49:20.610452 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:20.610351 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bb9zg" podStartSLOduration=2.138899006 podStartE2EDuration="4.610338426s" podCreationTimestamp="2026-05-21 20:49:16 +0000 UTC" firstStartedPulling="2026-05-21 20:49:17.337029091 +0000 UTC m=+665.267804153" lastFinishedPulling="2026-05-21 20:49:19.80846851 +0000 UTC m=+667.739243573" observedRunningTime="2026-05-21 20:49:20.609195012 +0000 UTC m=+668.539970093" watchObservedRunningTime="2026-05-21 20:49:20.610338426 +0000 UTC m=+668.541113507" May 21 20:49:31.593033 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:31.593004 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-bb9zg" May 21 20:49:38.521096 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:38.521057 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-4sp7r"] May 21 20:49:38.524179 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:38.524163 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-4sp7r" May 21 20:49:38.525951 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:38.525925 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-6xjpl\"" May 21 20:49:38.526077 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:38.526030 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" May 21 20:49:38.530600 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:38.530574 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-4sp7r"] May 21 20:49:38.573794 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:38.573749 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxfdv\" (UniqueName: \"kubernetes.io/projected/86bcf399-8d3a-4705-a9d0-b644ed132749-kube-api-access-kxfdv\") pod \"odh-model-controller-858dbf95b8-4sp7r\" (UID: \"86bcf399-8d3a-4705-a9d0-b644ed132749\") " pod="opendatahub/odh-model-controller-858dbf95b8-4sp7r" May 21 20:49:38.573998 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:38.573827 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86bcf399-8d3a-4705-a9d0-b644ed132749-cert\") pod \"odh-model-controller-858dbf95b8-4sp7r\" (UID: \"86bcf399-8d3a-4705-a9d0-b644ed132749\") " pod="opendatahub/odh-model-controller-858dbf95b8-4sp7r" May 21 20:49:38.675229 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:38.675191 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86bcf399-8d3a-4705-a9d0-b644ed132749-cert\") pod \"odh-model-controller-858dbf95b8-4sp7r\" (UID: \"86bcf399-8d3a-4705-a9d0-b644ed132749\") " pod="opendatahub/odh-model-controller-858dbf95b8-4sp7r" May 21 20:49:38.675460 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:38.675259 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kxfdv\" (UniqueName: \"kubernetes.io/projected/86bcf399-8d3a-4705-a9d0-b644ed132749-kube-api-access-kxfdv\") pod \"odh-model-controller-858dbf95b8-4sp7r\" (UID: \"86bcf399-8d3a-4705-a9d0-b644ed132749\") " pod="opendatahub/odh-model-controller-858dbf95b8-4sp7r" May 21 20:49:38.675460 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:49:38.675344 2556 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 21 20:49:38.675460 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:49:38.675433 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86bcf399-8d3a-4705-a9d0-b644ed132749-cert podName:86bcf399-8d3a-4705-a9d0-b644ed132749 nodeName:}" failed. No retries permitted until 2026-05-21 20:49:39.175416688 +0000 UTC m=+687.106191749 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/86bcf399-8d3a-4705-a9d0-b644ed132749-cert") pod "odh-model-controller-858dbf95b8-4sp7r" (UID: "86bcf399-8d3a-4705-a9d0-b644ed132749") : secret "odh-model-controller-webhook-cert" not found May 21 20:49:38.683054 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:38.683026 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxfdv\" (UniqueName: \"kubernetes.io/projected/86bcf399-8d3a-4705-a9d0-b644ed132749-kube-api-access-kxfdv\") pod \"odh-model-controller-858dbf95b8-4sp7r\" (UID: \"86bcf399-8d3a-4705-a9d0-b644ed132749\") " pod="opendatahub/odh-model-controller-858dbf95b8-4sp7r" May 21 20:49:39.180692 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:39.180644 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86bcf399-8d3a-4705-a9d0-b644ed132749-cert\") pod \"odh-model-controller-858dbf95b8-4sp7r\" (UID: \"86bcf399-8d3a-4705-a9d0-b644ed132749\") " pod="opendatahub/odh-model-controller-858dbf95b8-4sp7r" May 21 20:49:39.180878 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:49:39.180797 2556 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 21 20:49:39.180878 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:49:39.180867 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86bcf399-8d3a-4705-a9d0-b644ed132749-cert podName:86bcf399-8d3a-4705-a9d0-b644ed132749 nodeName:}" failed. No retries permitted until 2026-05-21 20:49:40.180846421 +0000 UTC m=+688.111621482 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/86bcf399-8d3a-4705-a9d0-b644ed132749-cert") pod "odh-model-controller-858dbf95b8-4sp7r" (UID: "86bcf399-8d3a-4705-a9d0-b644ed132749") : secret "odh-model-controller-webhook-cert" not found May 21 20:49:40.189877 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:40.189842 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86bcf399-8d3a-4705-a9d0-b644ed132749-cert\") pod \"odh-model-controller-858dbf95b8-4sp7r\" (UID: \"86bcf399-8d3a-4705-a9d0-b644ed132749\") " pod="opendatahub/odh-model-controller-858dbf95b8-4sp7r" May 21 20:49:40.192765 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:40.192709 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86bcf399-8d3a-4705-a9d0-b644ed132749-cert\") pod \"odh-model-controller-858dbf95b8-4sp7r\" (UID: \"86bcf399-8d3a-4705-a9d0-b644ed132749\") " pod="opendatahub/odh-model-controller-858dbf95b8-4sp7r" May 21 20:49:40.334678 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:40.334644 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-4sp7r" May 21 20:49:40.466232 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:40.466200 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-4sp7r"] May 21 20:49:40.468673 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:49:40.468643 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86bcf399_8d3a_4705_a9d0_b644ed132749.slice/crio-1c1611e4ab7435d146086ef9c4341818e5d17c748e774c756f400532bea9023f WatchSource:0}: Error finding container 1c1611e4ab7435d146086ef9c4341818e5d17c748e774c756f400532bea9023f: Status 404 returned error can't find the container with id 1c1611e4ab7435d146086ef9c4341818e5d17c748e774c756f400532bea9023f May 21 20:49:40.656741 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:40.656705 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-4sp7r" event={"ID":"86bcf399-8d3a-4705-a9d0-b644ed132749","Type":"ContainerStarted","Data":"1c1611e4ab7435d146086ef9c4341818e5d17c748e774c756f400532bea9023f"} May 21 20:49:43.627997 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:43.627954 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-tvfpp"] May 21 20:49:43.631350 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:43.631330 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-tvfpp" May 21 20:49:43.633182 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:43.633159 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" May 21 20:49:43.633297 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:43.633218 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-w5sft\"" May 21 20:49:43.638833 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:43.638810 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-tvfpp"] May 21 20:49:43.668994 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:43.668960 2556 generic.go:358] "Generic (PLEG): container finished" podID="86bcf399-8d3a-4705-a9d0-b644ed132749" containerID="3c029378e156b03c990f5a15d7fe8f375989cfdf6e13765c6edfe022bfb8f031" exitCode=1 May 21 20:49:43.669181 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:43.669047 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-4sp7r" event={"ID":"86bcf399-8d3a-4705-a9d0-b644ed132749","Type":"ContainerDied","Data":"3c029378e156b03c990f5a15d7fe8f375989cfdf6e13765c6edfe022bfb8f031"} May 21 20:49:43.669253 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:43.669233 2556 scope.go:117] "RemoveContainer" containerID="3c029378e156b03c990f5a15d7fe8f375989cfdf6e13765c6edfe022bfb8f031" May 21 20:49:43.724250 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:43.724205 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b076cf0-4b0d-4a61-b0e4-173e4f004496-cert\") pod \"kserve-controller-manager-856948b99f-tvfpp\" (UID: \"2b076cf0-4b0d-4a61-b0e4-173e4f004496\") " pod="opendatahub/kserve-controller-manager-856948b99f-tvfpp" May 21 20:49:43.724250 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:43.724246 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnh2d\" (UniqueName: \"kubernetes.io/projected/2b076cf0-4b0d-4a61-b0e4-173e4f004496-kube-api-access-jnh2d\") pod \"kserve-controller-manager-856948b99f-tvfpp\" (UID: \"2b076cf0-4b0d-4a61-b0e4-173e4f004496\") " pod="opendatahub/kserve-controller-manager-856948b99f-tvfpp" May 21 20:49:43.825285 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:43.825243 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b076cf0-4b0d-4a61-b0e4-173e4f004496-cert\") pod \"kserve-controller-manager-856948b99f-tvfpp\" (UID: \"2b076cf0-4b0d-4a61-b0e4-173e4f004496\") " pod="opendatahub/kserve-controller-manager-856948b99f-tvfpp" May 21 20:49:43.825285 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:43.825284 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jnh2d\" (UniqueName: \"kubernetes.io/projected/2b076cf0-4b0d-4a61-b0e4-173e4f004496-kube-api-access-jnh2d\") pod \"kserve-controller-manager-856948b99f-tvfpp\" (UID: \"2b076cf0-4b0d-4a61-b0e4-173e4f004496\") " pod="opendatahub/kserve-controller-manager-856948b99f-tvfpp" May 21 20:49:43.825528 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:49:43.825414 2556 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found May 21 20:49:43.825528 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:49:43.825484 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b076cf0-4b0d-4a61-b0e4-173e4f004496-cert podName:2b076cf0-4b0d-4a61-b0e4-173e4f004496 nodeName:}" failed. No retries permitted until 2026-05-21 20:49:44.325464809 +0000 UTC m=+692.256239874 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2b076cf0-4b0d-4a61-b0e4-173e4f004496-cert") pod "kserve-controller-manager-856948b99f-tvfpp" (UID: "2b076cf0-4b0d-4a61-b0e4-173e4f004496") : secret "kserve-webhook-server-cert" not found May 21 20:49:43.846264 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:43.846222 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnh2d\" (UniqueName: \"kubernetes.io/projected/2b076cf0-4b0d-4a61-b0e4-173e4f004496-kube-api-access-jnh2d\") pod \"kserve-controller-manager-856948b99f-tvfpp\" (UID: \"2b076cf0-4b0d-4a61-b0e4-173e4f004496\") " pod="opendatahub/kserve-controller-manager-856948b99f-tvfpp" May 21 20:49:44.331009 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:44.330922 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b076cf0-4b0d-4a61-b0e4-173e4f004496-cert\") pod \"kserve-controller-manager-856948b99f-tvfpp\" (UID: \"2b076cf0-4b0d-4a61-b0e4-173e4f004496\") " pod="opendatahub/kserve-controller-manager-856948b99f-tvfpp" May 21 20:49:44.333759 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:44.333728 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b076cf0-4b0d-4a61-b0e4-173e4f004496-cert\") pod \"kserve-controller-manager-856948b99f-tvfpp\" (UID: \"2b076cf0-4b0d-4a61-b0e4-173e4f004496\") " pod="opendatahub/kserve-controller-manager-856948b99f-tvfpp" May 21 20:49:44.542687 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:44.542643 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-tvfpp" May 21 20:49:44.674902 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:44.674861 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-4sp7r" event={"ID":"86bcf399-8d3a-4705-a9d0-b644ed132749","Type":"ContainerStarted","Data":"9c229bc21bbf9c837fe443be47b3729c16b4345e759167c58e4e768ea24f4ea5"} May 21 20:49:44.675348 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:44.674996 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-4sp7r" May 21 20:49:44.682781 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:44.682654 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-tvfpp"] May 21 20:49:44.685175 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:49:44.685147 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b076cf0_4b0d_4a61_b0e4_173e4f004496.slice/crio-2998a7548fda96d84e96667e68be1ad794c52e15992f7294a13d02443f55a7ac WatchSource:0}: Error finding container 2998a7548fda96d84e96667e68be1ad794c52e15992f7294a13d02443f55a7ac: Status 404 returned error can't find the container with id 2998a7548fda96d84e96667e68be1ad794c52e15992f7294a13d02443f55a7ac May 21 20:49:44.690388 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:44.690268 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-4sp7r" podStartSLOduration=3.227615943 podStartE2EDuration="6.690253317s" podCreationTimestamp="2026-05-21 20:49:38 +0000 UTC" firstStartedPulling="2026-05-21 20:49:40.46993925 +0000 UTC m=+688.400714311" lastFinishedPulling="2026-05-21 20:49:43.932576625 +0000 UTC m=+691.863351685" observedRunningTime="2026-05-21 20:49:44.689818799 +0000 UTC m=+692.620593884" watchObservedRunningTime="2026-05-21 20:49:44.690253317 +0000 UTC m=+692.621028399" May 21 20:49:45.679906 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:45.679861 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-tvfpp" event={"ID":"2b076cf0-4b0d-4a61-b0e4-173e4f004496","Type":"ContainerStarted","Data":"2998a7548fda96d84e96667e68be1ad794c52e15992f7294a13d02443f55a7ac"} May 21 20:49:46.596855 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:46.596812 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-c9f76b4c5-8tg4g"] May 21 20:49:46.600637 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:46.600611 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-c9f76b4c5-8tg4g" May 21 20:49:46.602480 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:46.602453 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 21 20:49:46.602597 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:46.602485 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 21 20:49:46.610258 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:46.610226 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-c9f76b4c5-8tg4g"] May 21 20:49:46.651767 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:46.651722 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq4bf\" (UniqueName: \"kubernetes.io/projected/b2dcd1ab-8a2d-469b-bf00-9769f5e23700-kube-api-access-nq4bf\") pod \"kube-auth-proxy-c9f76b4c5-8tg4g\" (UID: \"b2dcd1ab-8a2d-469b-bf00-9769f5e23700\") " pod="openshift-ingress/kube-auth-proxy-c9f76b4c5-8tg4g" May 21 20:49:46.651952 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:46.651771 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2dcd1ab-8a2d-469b-bf00-9769f5e23700-tls-certs\") pod \"kube-auth-proxy-c9f76b4c5-8tg4g\" (UID: \"b2dcd1ab-8a2d-469b-bf00-9769f5e23700\") " pod="openshift-ingress/kube-auth-proxy-c9f76b4c5-8tg4g" May 21 20:49:46.651952 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:46.651854 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2dcd1ab-8a2d-469b-bf00-9769f5e23700-tmp\") pod \"kube-auth-proxy-c9f76b4c5-8tg4g\" (UID: \"b2dcd1ab-8a2d-469b-bf00-9769f5e23700\") " pod="openshift-ingress/kube-auth-proxy-c9f76b4c5-8tg4g" May 21 20:49:46.753274 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:46.753237 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2dcd1ab-8a2d-469b-bf00-9769f5e23700-tmp\") pod \"kube-auth-proxy-c9f76b4c5-8tg4g\" (UID: \"b2dcd1ab-8a2d-469b-bf00-9769f5e23700\") " pod="openshift-ingress/kube-auth-proxy-c9f76b4c5-8tg4g" May 21 20:49:46.753673 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:46.753295 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nq4bf\" (UniqueName: \"kubernetes.io/projected/b2dcd1ab-8a2d-469b-bf00-9769f5e23700-kube-api-access-nq4bf\") pod \"kube-auth-proxy-c9f76b4c5-8tg4g\" (UID: \"b2dcd1ab-8a2d-469b-bf00-9769f5e23700\") " pod="openshift-ingress/kube-auth-proxy-c9f76b4c5-8tg4g" May 21 20:49:46.753673 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:46.753317 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2dcd1ab-8a2d-469b-bf00-9769f5e23700-tls-certs\") pod \"kube-auth-proxy-c9f76b4c5-8tg4g\" (UID: \"b2dcd1ab-8a2d-469b-bf00-9769f5e23700\") " pod="openshift-ingress/kube-auth-proxy-c9f76b4c5-8tg4g" May 21 20:49:46.753673 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:49:46.753458 2556 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found May 21 20:49:46.753673 ip-10-0-132-7 kubenswrapper[2556]: E0521 20:49:46.753534 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2dcd1ab-8a2d-469b-bf00-9769f5e23700-tls-certs podName:b2dcd1ab-8a2d-469b-bf00-9769f5e23700 nodeName:}" failed. No retries permitted until 2026-05-21 20:49:47.253518108 +0000 UTC m=+695.184293169 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/b2dcd1ab-8a2d-469b-bf00-9769f5e23700-tls-certs") pod "kube-auth-proxy-c9f76b4c5-8tg4g" (UID: "b2dcd1ab-8a2d-469b-bf00-9769f5e23700") : secret "kube-auth-proxy-tls" not found May 21 20:49:46.755711 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:46.755686 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2dcd1ab-8a2d-469b-bf00-9769f5e23700-tmp\") pod \"kube-auth-proxy-c9f76b4c5-8tg4g\" (UID: \"b2dcd1ab-8a2d-469b-bf00-9769f5e23700\") " pod="openshift-ingress/kube-auth-proxy-c9f76b4c5-8tg4g" May 21 20:49:46.761711 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:46.761681 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq4bf\" (UniqueName: \"kubernetes.io/projected/b2dcd1ab-8a2d-469b-bf00-9769f5e23700-kube-api-access-nq4bf\") pod \"kube-auth-proxy-c9f76b4c5-8tg4g\" (UID: \"b2dcd1ab-8a2d-469b-bf00-9769f5e23700\") " pod="openshift-ingress/kube-auth-proxy-c9f76b4c5-8tg4g" May 21 20:49:47.258189 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:47.258144 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2dcd1ab-8a2d-469b-bf00-9769f5e23700-tls-certs\") pod \"kube-auth-proxy-c9f76b4c5-8tg4g\" (UID: \"b2dcd1ab-8a2d-469b-bf00-9769f5e23700\") " pod="openshift-ingress/kube-auth-proxy-c9f76b4c5-8tg4g" May 21 20:49:47.260830 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:47.260803 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2dcd1ab-8a2d-469b-bf00-9769f5e23700-tls-certs\") pod \"kube-auth-proxy-c9f76b4c5-8tg4g\" (UID: \"b2dcd1ab-8a2d-469b-bf00-9769f5e23700\") " pod="openshift-ingress/kube-auth-proxy-c9f76b4c5-8tg4g" May 21 20:49:47.512399 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:47.512275 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-c9f76b4c5-8tg4g" May 21 20:49:47.651577 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:47.651447 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-c9f76b4c5-8tg4g"] May 21 20:49:47.654296 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:49:47.654264 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2dcd1ab_8a2d_469b_bf00_9769f5e23700.slice/crio-16fdb4bed23b54f2dc71f07cb8c91f6e59c23eb4010d265a50fc57d38bb58584 WatchSource:0}: Error finding container 16fdb4bed23b54f2dc71f07cb8c91f6e59c23eb4010d265a50fc57d38bb58584: Status 404 returned error can't find the container with id 16fdb4bed23b54f2dc71f07cb8c91f6e59c23eb4010d265a50fc57d38bb58584 May 21 20:49:47.687760 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:47.687723 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-c9f76b4c5-8tg4g" event={"ID":"b2dcd1ab-8a2d-469b-bf00-9769f5e23700","Type":"ContainerStarted","Data":"16fdb4bed23b54f2dc71f07cb8c91f6e59c23eb4010d265a50fc57d38bb58584"} May 21 20:49:48.695080 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:48.694086 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-tvfpp" event={"ID":"2b076cf0-4b0d-4a61-b0e4-173e4f004496","Type":"ContainerStarted","Data":"072ea2d2ccb53c61e379014e5e025c281ac2209083a06b3d65a21444627eb4f0"} May 21 20:49:48.695080 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:48.694983 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-tvfpp" May 21 20:49:48.708703 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:48.708577 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-tvfpp" podStartSLOduration=2.000527809 podStartE2EDuration="5.708554663s" podCreationTimestamp="2026-05-21 20:49:43 +0000 UTC" firstStartedPulling="2026-05-21 20:49:44.687037345 +0000 UTC m=+692.617812424" lastFinishedPulling="2026-05-21 20:49:48.395064212 +0000 UTC m=+696.325839278" observedRunningTime="2026-05-21 20:49:48.707874159 +0000 UTC m=+696.638649243" watchObservedRunningTime="2026-05-21 20:49:48.708554663 +0000 UTC m=+696.639329748" May 21 20:49:51.706558 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:51.706525 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-c9f76b4c5-8tg4g" event={"ID":"b2dcd1ab-8a2d-469b-bf00-9769f5e23700","Type":"ContainerStarted","Data":"7c71f647621a9817f35f671e34728b058af1e985a0ae268e0feff6f40fabf850"} May 21 20:49:51.723116 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:51.723062 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-c9f76b4c5-8tg4g" podStartSLOduration=2.56035146 podStartE2EDuration="5.72304576s" podCreationTimestamp="2026-05-21 20:49:46 +0000 UTC" firstStartedPulling="2026-05-21 20:49:47.656095159 +0000 UTC m=+695.586870220" lastFinishedPulling="2026-05-21 20:49:50.818789452 +0000 UTC m=+698.749564520" observedRunningTime="2026-05-21 20:49:51.721183666 +0000 UTC m=+699.651958774" watchObservedRunningTime="2026-05-21 20:49:51.72304576 +0000 UTC m=+699.653820842" May 21 20:49:55.682245 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:49:55.682214 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-4sp7r" May 21 20:50:01.931712 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:01.931609 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-dwkkh"] May 21 20:50:01.940758 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:01.940726 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-dwkkh" May 21 20:50:01.943318 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:01.943264 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-hbd5m\"" May 21 20:50:01.943318 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:01.943294 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" May 21 20:50:01.943620 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:01.943317 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" May 21 20:50:01.946446 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:01.946423 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-dwkkh"] May 21 20:50:01.992699 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:01.992650 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/5698d387-d695-405e-98ef-0e4fed8b1f62-operator-config\") pod \"servicemesh-operator3-55f49c5f94-dwkkh\" (UID: \"5698d387-d695-405e-98ef-0e4fed8b1f62\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-dwkkh" May 21 20:50:01.992879 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:01.992770 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwp25\" (UniqueName: \"kubernetes.io/projected/5698d387-d695-405e-98ef-0e4fed8b1f62-kube-api-access-cwp25\") pod \"servicemesh-operator3-55f49c5f94-dwkkh\" (UID: \"5698d387-d695-405e-98ef-0e4fed8b1f62\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-dwkkh" May 21 20:50:02.093741 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:02.093702 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/5698d387-d695-405e-98ef-0e4fed8b1f62-operator-config\") pod \"servicemesh-operator3-55f49c5f94-dwkkh\" (UID: \"5698d387-d695-405e-98ef-0e4fed8b1f62\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-dwkkh" May 21 20:50:02.093926 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:02.093788 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cwp25\" (UniqueName: \"kubernetes.io/projected/5698d387-d695-405e-98ef-0e4fed8b1f62-kube-api-access-cwp25\") pod \"servicemesh-operator3-55f49c5f94-dwkkh\" (UID: \"5698d387-d695-405e-98ef-0e4fed8b1f62\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-dwkkh" May 21 20:50:02.096449 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:02.096421 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/5698d387-d695-405e-98ef-0e4fed8b1f62-operator-config\") pod \"servicemesh-operator3-55f49c5f94-dwkkh\" (UID: \"5698d387-d695-405e-98ef-0e4fed8b1f62\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-dwkkh" May 21 20:50:02.101683 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:02.101657 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwp25\" (UniqueName: \"kubernetes.io/projected/5698d387-d695-405e-98ef-0e4fed8b1f62-kube-api-access-cwp25\") pod \"servicemesh-operator3-55f49c5f94-dwkkh\" (UID: \"5698d387-d695-405e-98ef-0e4fed8b1f62\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-dwkkh" May 21 20:50:02.252066 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:02.251972 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-dwkkh" May 21 20:50:02.391781 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:02.391752 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-dwkkh"] May 21 20:50:02.395601 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:50:02.395566 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5698d387_d695_405e_98ef_0e4fed8b1f62.slice/crio-7a9c96948f92ad45ae436c99fc00808e2265f7ce0dee3e4dc07518b137e9c215 WatchSource:0}: Error finding container 7a9c96948f92ad45ae436c99fc00808e2265f7ce0dee3e4dc07518b137e9c215: Status 404 returned error can't find the container with id 7a9c96948f92ad45ae436c99fc00808e2265f7ce0dee3e4dc07518b137e9c215 May 21 20:50:02.745361 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:02.745324 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-dwkkh" event={"ID":"5698d387-d695-405e-98ef-0e4fed8b1f62","Type":"ContainerStarted","Data":"7a9c96948f92ad45ae436c99fc00808e2265f7ce0dee3e4dc07518b137e9c215"} May 21 20:50:05.763156 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:05.763116 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-dwkkh" event={"ID":"5698d387-d695-405e-98ef-0e4fed8b1f62","Type":"ContainerStarted","Data":"9a52e94e4b180889e1001fab31b5e1abd60d794180cdc8d642f552dca92d2ae8"} May 21 20:50:05.763603 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:05.763250 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-dwkkh" May 21 20:50:05.781761 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:05.781606 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-dwkkh" podStartSLOduration=2.005122126 podStartE2EDuration="4.781591765s" podCreationTimestamp="2026-05-21 20:50:01 +0000 UTC" firstStartedPulling="2026-05-21 20:50:02.398005606 +0000 UTC m=+710.328780667" lastFinishedPulling="2026-05-21 20:50:05.174475244 +0000 UTC m=+713.105250306" observedRunningTime="2026-05-21 20:50:05.780883992 +0000 UTC m=+713.711659129" watchObservedRunningTime="2026-05-21 20:50:05.781591765 +0000 UTC m=+713.712366849" May 21 20:50:16.768826 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:16.768797 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-dwkkh" May 21 20:50:17.598023 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:17.597985 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-b294r"] May 21 20:50:17.603296 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:17.603274 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b294r" May 21 20:50:17.605775 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:17.605752 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" May 21 20:50:17.605913 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:17.605795 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" May 21 20:50:17.605913 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:17.605858 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" May 21 20:50:17.605913 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:17.605893 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-c2q8x\"" May 21 20:50:17.608380 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:17.608347 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 21 20:50:17.619757 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:17.619689 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-b294r"] May 21 20:50:17.640472 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:17.640427 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c0d9466d-d063-4e82-ac2f-aac41a26a7b5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-b294r\" (UID: \"c0d9466d-d063-4e82-ac2f-aac41a26a7b5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b294r" May 21 20:50:17.640669 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:17.640493 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c0d9466d-d063-4e82-ac2f-aac41a26a7b5-cacerts\") pod \"istiod-openshift-gateway-798958bb55-b294r\" (UID: \"c0d9466d-d063-4e82-ac2f-aac41a26a7b5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b294r" May 21 20:50:17.640669 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:17.640541 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c0d9466d-d063-4e82-ac2f-aac41a26a7b5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-b294r\" (UID: \"c0d9466d-d063-4e82-ac2f-aac41a26a7b5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b294r" May 21 20:50:17.640669 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:17.640588 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dj79\" (UniqueName: \"kubernetes.io/projected/c0d9466d-d063-4e82-ac2f-aac41a26a7b5-kube-api-access-7dj79\") pod \"istiod-openshift-gateway-798958bb55-b294r\" (UID: \"c0d9466d-d063-4e82-ac2f-aac41a26a7b5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b294r" May 21 20:50:17.640669 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:17.640624 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0d9466d-d063-4e82-ac2f-aac41a26a7b5-local-certs\") pod \"istiod-openshift-gateway-798958bb55-b294r\" (UID: \"c0d9466d-d063-4e82-ac2f-aac41a26a7b5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b294r" May 21 20:50:17.640669 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:17.640656 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0d9466d-d063-4e82-ac2f-aac41a26a7b5-istio-token\") pod \"istiod-openshift-gateway-798958bb55-b294r\" (UID: \"c0d9466d-d063-4e82-ac2f-aac41a26a7b5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b294r" May 21 20:50:17.640921 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:17.640682 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c0d9466d-d063-4e82-ac2f-aac41a26a7b5-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-b294r\" (UID: \"c0d9466d-d063-4e82-ac2f-aac41a26a7b5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b294r" May 21 20:50:17.741496 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:17.741459 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7dj79\" (UniqueName: \"kubernetes.io/projected/c0d9466d-d063-4e82-ac2f-aac41a26a7b5-kube-api-access-7dj79\") pod \"istiod-openshift-gateway-798958bb55-b294r\" (UID: \"c0d9466d-d063-4e82-ac2f-aac41a26a7b5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b294r" May 21 20:50:17.741699 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:17.741502 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0d9466d-d063-4e82-ac2f-aac41a26a7b5-local-certs\") pod \"istiod-openshift-gateway-798958bb55-b294r\" (UID: \"c0d9466d-d063-4e82-ac2f-aac41a26a7b5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b294r" May 21 20:50:17.741699 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:17.741634 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0d9466d-d063-4e82-ac2f-aac41a26a7b5-istio-token\") pod \"istiod-openshift-gateway-798958bb55-b294r\" (UID: \"c0d9466d-d063-4e82-ac2f-aac41a26a7b5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b294r" May 21 20:50:17.741699 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:17.741682 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c0d9466d-d063-4e82-ac2f-aac41a26a7b5-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-b294r\" (UID: \"c0d9466d-d063-4e82-ac2f-aac41a26a7b5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b294r" May 21 20:50:17.741870 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:17.741757 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c0d9466d-d063-4e82-ac2f-aac41a26a7b5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-b294r\" (UID: \"c0d9466d-d063-4e82-ac2f-aac41a26a7b5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b294r" May 21 20:50:17.741870 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:17.741806 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c0d9466d-d063-4e82-ac2f-aac41a26a7b5-cacerts\") pod \"istiod-openshift-gateway-798958bb55-b294r\" (UID: \"c0d9466d-d063-4e82-ac2f-aac41a26a7b5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b294r" May 21 20:50:17.741870 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:17.741864 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c0d9466d-d063-4e82-ac2f-aac41a26a7b5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-b294r\" (UID: \"c0d9466d-d063-4e82-ac2f-aac41a26a7b5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b294r" May 21 20:50:17.742602 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:17.742571 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c0d9466d-d063-4e82-ac2f-aac41a26a7b5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-b294r\" (UID: \"c0d9466d-d063-4e82-ac2f-aac41a26a7b5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b294r" May 21 20:50:17.744088 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:17.744065 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0d9466d-d063-4e82-ac2f-aac41a26a7b5-local-certs\") pod \"istiod-openshift-gateway-798958bb55-b294r\" (UID: \"c0d9466d-d063-4e82-ac2f-aac41a26a7b5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b294r" May 21 20:50:17.744539 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:17.744517 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c0d9466d-d063-4e82-ac2f-aac41a26a7b5-cacerts\") pod \"istiod-openshift-gateway-798958bb55-b294r\" (UID: \"c0d9466d-d063-4e82-ac2f-aac41a26a7b5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b294r" May 21 20:50:17.744827 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:17.744808 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c0d9466d-d063-4e82-ac2f-aac41a26a7b5-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-b294r\" (UID: \"c0d9466d-d063-4e82-ac2f-aac41a26a7b5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b294r" May 21 20:50:17.744899 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:17.744839 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c0d9466d-d063-4e82-ac2f-aac41a26a7b5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-b294r\" (UID: \"c0d9466d-d063-4e82-ac2f-aac41a26a7b5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b294r" May 21 20:50:17.752940 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:17.752911 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dj79\" (UniqueName: \"kubernetes.io/projected/c0d9466d-d063-4e82-ac2f-aac41a26a7b5-kube-api-access-7dj79\") pod \"istiod-openshift-gateway-798958bb55-b294r\" (UID: \"c0d9466d-d063-4e82-ac2f-aac41a26a7b5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b294r" May 21 20:50:17.753767 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:17.753729 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0d9466d-d063-4e82-ac2f-aac41a26a7b5-istio-token\") pod \"istiod-openshift-gateway-798958bb55-b294r\" (UID: \"c0d9466d-d063-4e82-ac2f-aac41a26a7b5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b294r" May 21 20:50:17.913305 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:17.913200 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b294r" May 21 20:50:18.075038 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:18.074976 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-b294r"] May 21 20:50:18.079639 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:50:18.079589 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0d9466d_d063_4e82_ac2f_aac41a26a7b5.slice/crio-2189d889961ae6915753757ed6ef3dd8dad22f475c3bb95bfd5c766878e2eb0e WatchSource:0}: Error finding container 2189d889961ae6915753757ed6ef3dd8dad22f475c3bb95bfd5c766878e2eb0e: Status 404 returned error can't find the container with id 2189d889961ae6915753757ed6ef3dd8dad22f475c3bb95bfd5c766878e2eb0e May 21 20:50:18.815453 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:18.815354 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b294r" event={"ID":"c0d9466d-d063-4e82-ac2f-aac41a26a7b5","Type":"ContainerStarted","Data":"2189d889961ae6915753757ed6ef3dd8dad22f475c3bb95bfd5c766878e2eb0e"} May 21 20:50:20.707430 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:20.707395 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-tvfpp" May 21 20:50:26.600140 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:26.600099 2556 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} May 21 20:50:26.600456 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:26.600171 2556 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} May 21 20:50:26.844304 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:26.844269 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b294r" event={"ID":"c0d9466d-d063-4e82-ac2f-aac41a26a7b5","Type":"ContainerStarted","Data":"0e6818fee9455680d86ef5475aaad49f82695bfed178ef4039af959ae21daee4"} May 21 20:50:26.844529 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:26.844508 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b294r" May 21 20:50:26.863444 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:26.863307 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b294r" podStartSLOduration=1.34542311 podStartE2EDuration="9.863286701s" podCreationTimestamp="2026-05-21 20:50:17 +0000 UTC" firstStartedPulling="2026-05-21 20:50:18.081992128 +0000 UTC m=+726.012767194" lastFinishedPulling="2026-05-21 20:50:26.599855721 +0000 UTC m=+734.530630785" observedRunningTime="2026-05-21 20:50:26.861571755 +0000 UTC m=+734.792346840" watchObservedRunningTime="2026-05-21 20:50:26.863286701 +0000 UTC m=+734.794061784" May 21 20:50:27.849914 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:27.849873 2556 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-b294r container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= May 21 20:50:27.850361 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:27.849950 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b294r" podUID="c0d9466d-d063-4e82-ac2f-aac41a26a7b5" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 21 20:50:30.849697 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:50:30.849662 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b294r" May 21 20:51:18.975092 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:18.975053 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-mpx6q"] May 21 20:51:18.978480 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:18.978454 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-mpx6q" May 21 20:51:18.981765 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:18.981743 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 20:51:18.983891 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:18.983862 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-rnhff\"" May 21 20:51:18.983891 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:18.983880 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 20:51:18.989140 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:18.989118 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-mpx6q"] May 21 20:51:19.078006 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:19.077969 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqwp6\" (UniqueName: \"kubernetes.io/projected/758ff596-55a1-43d7-991e-82aef23c5312-kube-api-access-kqwp6\") pod \"authorino-operator-657f44b778-mpx6q\" (UID: \"758ff596-55a1-43d7-991e-82aef23c5312\") " pod="kuadrant-system/authorino-operator-657f44b778-mpx6q" May 21 20:51:19.178595 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:19.178529 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kqwp6\" (UniqueName: \"kubernetes.io/projected/758ff596-55a1-43d7-991e-82aef23c5312-kube-api-access-kqwp6\") pod \"authorino-operator-657f44b778-mpx6q\" (UID: \"758ff596-55a1-43d7-991e-82aef23c5312\") " pod="kuadrant-system/authorino-operator-657f44b778-mpx6q" May 21 20:51:19.186505 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:19.186477 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqwp6\" (UniqueName: \"kubernetes.io/projected/758ff596-55a1-43d7-991e-82aef23c5312-kube-api-access-kqwp6\") pod \"authorino-operator-657f44b778-mpx6q\" (UID: \"758ff596-55a1-43d7-991e-82aef23c5312\") " pod="kuadrant-system/authorino-operator-657f44b778-mpx6q" May 21 20:51:19.289742 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:19.289627 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-mpx6q" May 21 20:51:19.446158 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:19.446129 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-mpx6q"] May 21 20:51:19.449252 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:51:19.449222 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod758ff596_55a1_43d7_991e_82aef23c5312.slice/crio-eb523e4cec6f600439f3daceaa655baba5d7065bdc69c4d2fca943bbfc672721 WatchSource:0}: Error finding container eb523e4cec6f600439f3daceaa655baba5d7065bdc69c4d2fca943bbfc672721: Status 404 returned error can't find the container with id eb523e4cec6f600439f3daceaa655baba5d7065bdc69c4d2fca943bbfc672721 May 21 20:51:20.026861 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:20.026824 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-mpx6q" event={"ID":"758ff596-55a1-43d7-991e-82aef23c5312","Type":"ContainerStarted","Data":"eb523e4cec6f600439f3daceaa655baba5d7065bdc69c4d2fca943bbfc672721"} May 21 20:51:22.035815 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:22.035756 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-mpx6q" event={"ID":"758ff596-55a1-43d7-991e-82aef23c5312","Type":"ContainerStarted","Data":"7344ebecf1314c979acf0fd1ac60ec321ae00b4a455972e87bca4dec261d5651"} May 21 20:51:22.039389 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:22.036358 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-mpx6q" May 21 20:51:22.074541 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:22.074481 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-mpx6q" podStartSLOduration=2.248168577 podStartE2EDuration="4.074466445s" podCreationTimestamp="2026-05-21 20:51:18 +0000 UTC" firstStartedPulling="2026-05-21 20:51:19.451159429 +0000 UTC m=+787.381934490" lastFinishedPulling="2026-05-21 20:51:21.277457297 +0000 UTC m=+789.208232358" observedRunningTime="2026-05-21 20:51:22.073277252 +0000 UTC m=+790.004052335" watchObservedRunningTime="2026-05-21 20:51:22.074466445 +0000 UTC m=+790.005241527" May 21 20:51:22.255457 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:22.255424 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-7cm42"] May 21 20:51:22.258831 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:22.258812 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-7cm42" May 21 20:51:22.268144 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:22.268105 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-kdmtx\"" May 21 20:51:22.269049 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:22.269017 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-7cm42"] May 21 20:51:22.307921 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:22.307821 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8frr\" (UniqueName: \"kubernetes.io/projected/a7ab6c02-71ef-49cd-852f-f00ecf7b88fa-kube-api-access-z8frr\") pod \"limitador-operator-controller-manager-85c4996f8c-7cm42\" (UID: \"a7ab6c02-71ef-49cd-852f-f00ecf7b88fa\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-7cm42" May 21 20:51:22.409247 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:22.409204 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z8frr\" (UniqueName: \"kubernetes.io/projected/a7ab6c02-71ef-49cd-852f-f00ecf7b88fa-kube-api-access-z8frr\") pod \"limitador-operator-controller-manager-85c4996f8c-7cm42\" (UID: \"a7ab6c02-71ef-49cd-852f-f00ecf7b88fa\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-7cm42" May 21 20:51:22.424247 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:22.424203 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8frr\" (UniqueName: \"kubernetes.io/projected/a7ab6c02-71ef-49cd-852f-f00ecf7b88fa-kube-api-access-z8frr\") pod \"limitador-operator-controller-manager-85c4996f8c-7cm42\" (UID: \"a7ab6c02-71ef-49cd-852f-f00ecf7b88fa\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-7cm42" May 21 20:51:22.569954 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:22.569855 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-7cm42" May 21 20:51:22.714473 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:22.714324 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-7cm42"] May 21 20:51:22.717657 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:51:22.717620 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7ab6c02_71ef_49cd_852f_f00ecf7b88fa.slice/crio-ffc5bcfb187b0a8cc7183adf97774db6dc52004f2b3c6c0973b6f56554be001f WatchSource:0}: Error finding container ffc5bcfb187b0a8cc7183adf97774db6dc52004f2b3c6c0973b6f56554be001f: Status 404 returned error can't find the container with id ffc5bcfb187b0a8cc7183adf97774db6dc52004f2b3c6c0973b6f56554be001f May 21 20:51:23.040011 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:23.039972 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-7cm42" event={"ID":"a7ab6c02-71ef-49cd-852f-f00ecf7b88fa","Type":"ContainerStarted","Data":"ffc5bcfb187b0a8cc7183adf97774db6dc52004f2b3c6c0973b6f56554be001f"} May 21 20:51:25.048741 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:25.048652 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-7cm42" event={"ID":"a7ab6c02-71ef-49cd-852f-f00ecf7b88fa","Type":"ContainerStarted","Data":"dd188861d64c03448807b504aad61da23478b324552ea19826b5cd34b2eebfb2"} May 21 20:51:25.049142 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:25.048796 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-7cm42" May 21 20:51:25.066992 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:25.066922 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-7cm42" podStartSLOduration=1.044175077 podStartE2EDuration="3.066900204s" podCreationTimestamp="2026-05-21 20:51:22 +0000 UTC" firstStartedPulling="2026-05-21 20:51:22.719622618 +0000 UTC m=+790.650397680" lastFinishedPulling="2026-05-21 20:51:24.742347746 +0000 UTC m=+792.673122807" observedRunningTime="2026-05-21 20:51:25.065637099 +0000 UTC m=+792.996412199" watchObservedRunningTime="2026-05-21 20:51:25.066900204 +0000 UTC m=+792.997675288" May 21 20:51:33.043043 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:33.042955 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-mpx6q" May 21 20:51:33.949261 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:33.949199 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-7cm42"] May 21 20:51:33.949678 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:33.949644 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-7cm42" podUID="a7ab6c02-71ef-49cd-852f-f00ecf7b88fa" containerName="manager" containerID="cri-o://dd188861d64c03448807b504aad61da23478b324552ea19826b5cd34b2eebfb2" gracePeriod=2 May 21 20:51:33.951622 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:33.951589 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-7cm42" May 21 20:51:33.954191 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:33.954136 2556 status_manager.go:895] "Failed to get status for pod" podUID="a7ab6c02-71ef-49cd-852f-f00ecf7b88fa" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-7cm42" err="pods \"limitador-operator-controller-manager-85c4996f8c-7cm42\" is forbidden: User \"system:node:ip-10-0-132-7.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-7.ec2.internal' and this object" May 21 20:51:33.955125 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:33.955099 2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-7cm42"] May 21 20:51:33.957889 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:33.957865 2556 status_manager.go:895] "Failed to get status for pod" podUID="a7ab6c02-71ef-49cd-852f-f00ecf7b88fa" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-7cm42" err="pods \"limitador-operator-controller-manager-85c4996f8c-7cm42\" is forbidden: User \"system:node:ip-10-0-132-7.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-7.ec2.internal' and this object" May 21 20:51:34.081059 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:34.081030 2556 generic.go:358] "Generic (PLEG): container finished" podID="a7ab6c02-71ef-49cd-852f-f00ecf7b88fa" containerID="dd188861d64c03448807b504aad61da23478b324552ea19826b5cd34b2eebfb2" exitCode=0 May 21 20:51:34.186083 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:34.186057 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-7cm42" May 21 20:51:34.190424 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:34.190356 2556 status_manager.go:895] "Failed to get status for pod" podUID="a7ab6c02-71ef-49cd-852f-f00ecf7b88fa" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-7cm42" err="pods \"limitador-operator-controller-manager-85c4996f8c-7cm42\" is forbidden: User \"system:node:ip-10-0-132-7.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-7.ec2.internal' and this object" May 21 20:51:34.321231 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:34.321143 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8frr\" (UniqueName: \"kubernetes.io/projected/a7ab6c02-71ef-49cd-852f-f00ecf7b88fa-kube-api-access-z8frr\") pod \"a7ab6c02-71ef-49cd-852f-f00ecf7b88fa\" (UID: \"a7ab6c02-71ef-49cd-852f-f00ecf7b88fa\") " May 21 20:51:34.323661 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:34.323628 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7ab6c02-71ef-49cd-852f-f00ecf7b88fa-kube-api-access-z8frr" (OuterVolumeSpecName: "kube-api-access-z8frr") pod "a7ab6c02-71ef-49cd-852f-f00ecf7b88fa" (UID: "a7ab6c02-71ef-49cd-852f-f00ecf7b88fa"). InnerVolumeSpecName "kube-api-access-z8frr". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:51:34.422114 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:34.422074 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8frr\" (UniqueName: \"kubernetes.io/projected/a7ab6c02-71ef-49cd-852f-f00ecf7b88fa-kube-api-access-z8frr\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\"" May 21 20:51:34.688245 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:34.688211 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7ab6c02-71ef-49cd-852f-f00ecf7b88fa" path="/var/lib/kubelet/pods/a7ab6c02-71ef-49cd-852f-f00ecf7b88fa/volumes" May 21 20:51:34.904610 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:34.904579 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j6n9l"] May 21 20:51:34.904973 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:34.904957 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7ab6c02-71ef-49cd-852f-f00ecf7b88fa" containerName="manager" May 21 20:51:34.905012 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:34.904976 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7ab6c02-71ef-49cd-852f-f00ecf7b88fa" containerName="manager" May 21 20:51:34.905051 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:34.905043 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="a7ab6c02-71ef-49cd-852f-f00ecf7b88fa" containerName="manager" May 21 20:51:34.908208 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:34.908186 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j6n9l" May 21 20:51:34.914075 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:34.914052 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-j22bm\"" May 21 20:51:34.926168 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:34.926138 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j6n9l"] May 21 20:51:35.027647 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:35.027553 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9a66b4b-8692-49bf-ab36-53cc4a433741-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-j6n9l\" (UID: \"f9a66b4b-8692-49bf-ab36-53cc4a433741\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j6n9l" May 21 20:51:35.027647 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:35.027635 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nsxn\" (UniqueName: \"kubernetes.io/projected/f9a66b4b-8692-49bf-ab36-53cc4a433741-kube-api-access-5nsxn\") pod \"kuadrant-operator-controller-manager-55c7f4c975-j6n9l\" (UID: \"f9a66b4b-8692-49bf-ab36-53cc4a433741\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j6n9l" May 21 20:51:35.085321 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:35.085287 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-7cm42" May 21 20:51:35.085774 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:35.085334 2556 scope.go:117] "RemoveContainer" containerID="dd188861d64c03448807b504aad61da23478b324552ea19826b5cd34b2eebfb2" May 21 20:51:35.128994 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:35.128955 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9a66b4b-8692-49bf-ab36-53cc4a433741-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-j6n9l\" (UID: \"f9a66b4b-8692-49bf-ab36-53cc4a433741\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j6n9l" May 21 20:51:35.129162 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:35.129031 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5nsxn\" (UniqueName: \"kubernetes.io/projected/f9a66b4b-8692-49bf-ab36-53cc4a433741-kube-api-access-5nsxn\") pod \"kuadrant-operator-controller-manager-55c7f4c975-j6n9l\" (UID: \"f9a66b4b-8692-49bf-ab36-53cc4a433741\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j6n9l" May 21 20:51:35.129327 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:35.129306 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9a66b4b-8692-49bf-ab36-53cc4a433741-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-j6n9l\" (UID: \"f9a66b4b-8692-49bf-ab36-53cc4a433741\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j6n9l" May 21 20:51:35.141017 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:35.140979 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nsxn\" (UniqueName: \"kubernetes.io/projected/f9a66b4b-8692-49bf-ab36-53cc4a433741-kube-api-access-5nsxn\") pod \"kuadrant-operator-controller-manager-55c7f4c975-j6n9l\" (UID: \"f9a66b4b-8692-49bf-ab36-53cc4a433741\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j6n9l" May 21 20:51:35.218784 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:35.218741 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j6n9l" May 21 20:51:35.357325 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:35.357213 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j6n9l"] May 21 20:51:35.360639 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:51:35.360611 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9a66b4b_8692_49bf_ab36_53cc4a433741.slice/crio-b5ade58c9ecf5906c401f2bb11f8efce7bb14ec786dae541a0346ea835123ff4 WatchSource:0}: Error finding container b5ade58c9ecf5906c401f2bb11f8efce7bb14ec786dae541a0346ea835123ff4: Status 404 returned error can't find the container with id b5ade58c9ecf5906c401f2bb11f8efce7bb14ec786dae541a0346ea835123ff4 May 21 20:51:36.091455 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:36.091419 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j6n9l" event={"ID":"f9a66b4b-8692-49bf-ab36-53cc4a433741","Type":"ContainerStarted","Data":"b5ade58c9ecf5906c401f2bb11f8efce7bb14ec786dae541a0346ea835123ff4"} May 21 20:51:40.106801 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:40.106759 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j6n9l" event={"ID":"f9a66b4b-8692-49bf-ab36-53cc4a433741","Type":"ContainerStarted","Data":"5f6d07928fb68dffe210a477902379b2c20dce169f1108ed9fd37cf9cd37aafa"} May 21 20:51:40.107187 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:40.106826 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j6n9l" May 21 20:51:40.142403 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:40.142331 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j6n9l" podStartSLOduration=2.380844836 podStartE2EDuration="6.142311798s" podCreationTimestamp="2026-05-21 20:51:34 +0000 UTC" firstStartedPulling="2026-05-21 20:51:35.363204053 +0000 UTC m=+803.293979117" lastFinishedPulling="2026-05-21 20:51:39.124671014 +0000 UTC m=+807.055446079" observedRunningTime="2026-05-21 20:51:40.135357057 +0000 UTC m=+808.066132142" watchObservedRunningTime="2026-05-21 20:51:40.142311798 +0000 UTC m=+808.073086881" May 21 20:51:51.113487 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:51:51.113456 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j6n9l" May 21 20:52:12.107992 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:52:12.107957 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 20:52:12.110854 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:52:12.110834 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-fspjz" May 21 20:52:12.117071 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:52:12.117039 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 20:52:12.119383 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:52:12.119342 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 21 20:52:12.122792 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:52:12.122763 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2zgxl\"" May 21 20:52:12.136846 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:52:12.136812 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 20:52:12.154536 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:52:12.154487 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhnp6\" (UniqueName: \"kubernetes.io/projected/e4546ec8-7bf9-4d68-b315-f807c8880b8f-kube-api-access-dhnp6\") pod \"limitador-limitador-78c99df468-fspjz\" (UID: \"e4546ec8-7bf9-4d68-b315-f807c8880b8f\") " pod="kuadrant-system/limitador-limitador-78c99df468-fspjz" May 21 20:52:12.154739 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:52:12.154558 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e4546ec8-7bf9-4d68-b315-f807c8880b8f-config-file\") pod \"limitador-limitador-78c99df468-fspjz\" (UID: \"e4546ec8-7bf9-4d68-b315-f807c8880b8f\") " pod="kuadrant-system/limitador-limitador-78c99df468-fspjz" May 21 20:52:12.255849 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:52:12.255812 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dhnp6\" (UniqueName: \"kubernetes.io/projected/e4546ec8-7bf9-4d68-b315-f807c8880b8f-kube-api-access-dhnp6\") pod \"limitador-limitador-78c99df468-fspjz\" (UID: \"e4546ec8-7bf9-4d68-b315-f807c8880b8f\") " pod="kuadrant-system/limitador-limitador-78c99df468-fspjz" May 21 20:52:12.255849 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:52:12.255852 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e4546ec8-7bf9-4d68-b315-f807c8880b8f-config-file\") pod \"limitador-limitador-78c99df468-fspjz\" (UID: \"e4546ec8-7bf9-4d68-b315-f807c8880b8f\") " pod="kuadrant-system/limitador-limitador-78c99df468-fspjz" May 21 20:52:12.256460 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:52:12.256431 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e4546ec8-7bf9-4d68-b315-f807c8880b8f-config-file\") pod \"limitador-limitador-78c99df468-fspjz\" (UID: \"e4546ec8-7bf9-4d68-b315-f807c8880b8f\") " pod="kuadrant-system/limitador-limitador-78c99df468-fspjz" May 21 20:52:12.271125 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:52:12.271099 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhnp6\" (UniqueName: \"kubernetes.io/projected/e4546ec8-7bf9-4d68-b315-f807c8880b8f-kube-api-access-dhnp6\") pod \"limitador-limitador-78c99df468-fspjz\" (UID: \"e4546ec8-7bf9-4d68-b315-f807c8880b8f\") " pod="kuadrant-system/limitador-limitador-78c99df468-fspjz" May 21 20:52:12.422865 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:52:12.422764 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-fspjz" May 21 20:52:12.559245 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:52:12.559163 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 20:52:12.562611 ip-10-0-132-7 kubenswrapper[2556]: W0521 20:52:12.562580 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4546ec8_7bf9_4d68_b315_f807c8880b8f.slice/crio-29a68454aaee72576d340de132a6f62c278e068ae8eb6cfbcf97964952eb3c9f WatchSource:0}: Error finding container 29a68454aaee72576d340de132a6f62c278e068ae8eb6cfbcf97964952eb3c9f: Status 404 returned error can't find the container with id 29a68454aaee72576d340de132a6f62c278e068ae8eb6cfbcf97964952eb3c9f May 21 20:52:13.229357 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:52:13.229312 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-fspjz" event={"ID":"e4546ec8-7bf9-4d68-b315-f807c8880b8f","Type":"ContainerStarted","Data":"29a68454aaee72576d340de132a6f62c278e068ae8eb6cfbcf97964952eb3c9f"} May 21 20:52:15.239902 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:52:15.239868 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-fspjz" event={"ID":"e4546ec8-7bf9-4d68-b315-f807c8880b8f","Type":"ContainerStarted","Data":"30ea942a99bafa98103df7ded2d941a93663992741d5e1f494295f710b50f448"} May 21 20:52:15.240299 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:52:15.240023 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-fspjz" May 21 20:52:15.265789 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:52:15.265732 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-fspjz" podStartSLOduration=0.722640653 podStartE2EDuration="3.265718466s" podCreationTimestamp="2026-05-21 20:52:12 +0000 UTC" firstStartedPulling="2026-05-21 20:52:12.564336488 +0000 UTC m=+840.495111548" lastFinishedPulling="2026-05-21 20:52:15.107414289 +0000 UTC m=+843.038189361" observedRunningTime="2026-05-21 20:52:15.264644627 +0000 UTC m=+843.195419707" watchObservedRunningTime="2026-05-21 20:52:15.265718466 +0000 UTC m=+843.196493547" May 21 20:52:26.247637 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:52:26.247606 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-fspjz" May 21 20:53:12.645877 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:53:12.645789 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7n7h_2b22953d-24b1-4a5a-9ad2-870f2414a537/ovn-acl-logging/0.log" May 21 20:53:12.646487 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:53:12.645952 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7n7h_2b22953d-24b1-4a5a-9ad2-870f2414a537/ovn-acl-logging/0.log" May 21 20:53:37.285865 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:53:37.285825 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 20:53:52.228015 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:53:52.227972 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 20:54:06.934992 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:54:06.934949 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 20:54:32.024823 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:54:32.024737 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 20:54:35.027406 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:54:35.027353 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 20:54:39.631862 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:54:39.631820 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 20:55:19.920731 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:55:19.920688 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 20:55:25.425735 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:55:25.425695 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 20:55:31.929303 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:55:31.929264 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 20:55:41.928434 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:55:41.928397 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 20:55:51.029472 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:55:51.029431 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 20:56:01.828956 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:56:01.828856 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 20:56:10.030432 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:56:10.030381 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 20:56:20.521491 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:56:20.521454 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 20:57:33.334987 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:57:33.334891 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 20:57:49.327029 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:57:49.326986 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 20:58:12.668647 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:58:12.668614 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7n7h_2b22953d-24b1-4a5a-9ad2-870f2414a537/ovn-acl-logging/0.log" May 21 20:58:12.671224 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:58:12.671202 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7n7h_2b22953d-24b1-4a5a-9ad2-870f2414a537/ovn-acl-logging/0.log" May 21 20:58:27.126575 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:58:27.126531 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 20:58:44.416984 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:58:44.416945 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 20:58:58.622819 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:58:58.622782 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 20:59:13.221182 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:59:13.221099 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 20:59:17.827615 ip-10-0-132-7 kubenswrapper[2556]: I0521 20:59:17.827578 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:00:00.139342 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:00:00.139299 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29656620-gjm9d"] May 21 21:00:00.142246 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:00:00.142228 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656620-gjm9d" May 21 21:00:00.144362 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:00:00.144308 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-q858m\"" May 21 21:00:00.154355 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:00:00.154328 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656620-gjm9d"] May 21 21:00:00.169540 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:00:00.169508 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zlcv\" (UniqueName: \"kubernetes.io/projected/ff974162-5ce1-4218-b14c-05e67dbecbfc-kube-api-access-4zlcv\") pod \"maas-api-key-cleanup-29656620-gjm9d\" (UID: \"ff974162-5ce1-4218-b14c-05e67dbecbfc\") " pod="opendatahub/maas-api-key-cleanup-29656620-gjm9d" May 21 21:00:00.270834 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:00:00.270793 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zlcv\" (UniqueName: \"kubernetes.io/projected/ff974162-5ce1-4218-b14c-05e67dbecbfc-kube-api-access-4zlcv\") pod \"maas-api-key-cleanup-29656620-gjm9d\" (UID: \"ff974162-5ce1-4218-b14c-05e67dbecbfc\") " pod="opendatahub/maas-api-key-cleanup-29656620-gjm9d" May 21 21:00:00.278602 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:00:00.278572 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zlcv\" (UniqueName: \"kubernetes.io/projected/ff974162-5ce1-4218-b14c-05e67dbecbfc-kube-api-access-4zlcv\") pod \"maas-api-key-cleanup-29656620-gjm9d\" (UID: \"ff974162-5ce1-4218-b14c-05e67dbecbfc\") " pod="opendatahub/maas-api-key-cleanup-29656620-gjm9d" May 21 21:00:00.453084 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:00:00.452997 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656620-gjm9d" May 21 21:00:00.584624 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:00:00.584598 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656620-gjm9d"] May 21 21:00:00.587167 ip-10-0-132-7 kubenswrapper[2556]: W0521 21:00:00.587124 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff974162_5ce1_4218_b14c_05e67dbecbfc.slice/crio-8d47e134998b140fe07a229457297922530e0fb36e9e5d5236e59e9c374d748f WatchSource:0}: Error finding container 8d47e134998b140fe07a229457297922530e0fb36e9e5d5236e59e9c374d748f: Status 404 returned error can't find the container with id 8d47e134998b140fe07a229457297922530e0fb36e9e5d5236e59e9c374d748f May 21 21:00:00.588852 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:00:00.588835 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 21:00:00.881299 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:00:00.881264 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656620-gjm9d" event={"ID":"ff974162-5ce1-4218-b14c-05e67dbecbfc","Type":"ContainerStarted","Data":"8d47e134998b140fe07a229457297922530e0fb36e9e5d5236e59e9c374d748f"} May 21 21:00:08.324218 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:00:08.324176 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:00:16.724014 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:00:16.723976 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:00:24.966959 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:00:24.966917 2556 generic.go:358] "Generic (PLEG): container finished" podID="ff974162-5ce1-4218-b14c-05e67dbecbfc" containerID="f9c13dcea8158b02f445fd4bc8b65f0612f1b14de2398d310ccb8857780a1d41" exitCode=0 May 21 21:00:24.967324 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:00:24.966972 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656620-gjm9d" event={"ID":"ff974162-5ce1-4218-b14c-05e67dbecbfc","Type":"ContainerDied","Data":"f9c13dcea8158b02f445fd4bc8b65f0612f1b14de2398d310ccb8857780a1d41"} May 21 21:00:26.099245 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:00:26.099215 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656620-gjm9d" May 21 21:00:26.204465 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:00:26.204426 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zlcv\" (UniqueName: \"kubernetes.io/projected/ff974162-5ce1-4218-b14c-05e67dbecbfc-kube-api-access-4zlcv\") pod \"ff974162-5ce1-4218-b14c-05e67dbecbfc\" (UID: \"ff974162-5ce1-4218-b14c-05e67dbecbfc\") " May 21 21:00:26.206820 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:00:26.206792 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff974162-5ce1-4218-b14c-05e67dbecbfc-kube-api-access-4zlcv" (OuterVolumeSpecName: "kube-api-access-4zlcv") pod "ff974162-5ce1-4218-b14c-05e67dbecbfc" (UID: "ff974162-5ce1-4218-b14c-05e67dbecbfc"). InnerVolumeSpecName "kube-api-access-4zlcv". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 21:00:26.306084 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:00:26.306005 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zlcv\" (UniqueName: \"kubernetes.io/projected/ff974162-5ce1-4218-b14c-05e67dbecbfc-kube-api-access-4zlcv\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\"" May 21 21:00:26.974430 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:00:26.974309 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656620-gjm9d" event={"ID":"ff974162-5ce1-4218-b14c-05e67dbecbfc","Type":"ContainerDied","Data":"8d47e134998b140fe07a229457297922530e0fb36e9e5d5236e59e9c374d748f"} May 21 21:00:26.974430 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:00:26.974337 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656620-gjm9d" May 21 21:00:26.974430 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:00:26.974342 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8d47e134998b140fe07a229457297922530e0fb36e9e5d5236e59e9c374d748f" May 21 21:00:33.425838 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:00:33.425751 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:00:43.130581 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:00:43.130544 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:00:59.527138 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:00:59.527102 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:01:07.527005 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:01:07.526964 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:01:40.731970 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:01:40.731929 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:01:48.433039 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:01:48.432995 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:01:57.521498 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:01:57.521464 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:02:05.837141 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:02:05.837062 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:02:14.132616 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:02:14.132580 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:02:31.423698 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:02:31.423650 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:02:41.529244 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:02:41.529206 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:03:12.700271 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:03:12.700244 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7n7h_2b22953d-24b1-4a5a-9ad2-870f2414a537/ovn-acl-logging/0.log" May 21 21:03:12.704295 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:03:12.704276 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7n7h_2b22953d-24b1-4a5a-9ad2-870f2414a537/ovn-acl-logging/0.log" May 21 21:03:28.222741 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:03:28.222704 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:03:33.526412 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:03:33.526288 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:03:40.125776 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:03:40.125734 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:03:48.133966 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:03:48.133924 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:03:57.337243 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:03:57.337201 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:04:05.528472 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:04:05.528430 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:04:14.628349 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:04:14.628302 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:04:23.024581 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:04:23.024541 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:04:32.126315 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:04:32.126275 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:04:41.028529 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:04:41.028492 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:04:49.927720 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:04:49.927683 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:04:58.525961 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:04:58.525924 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:05:07.232431 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:05:07.232341 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:05:15.438160 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:05:15.438109 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:05:24.923425 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:05:24.923383 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:05:32.526317 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:05:32.526276 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:05:41.631499 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:05:41.631356 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:05:50.038317 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:05:50.038260 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:06:41.883236 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:06:41.883149 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j6n9l"] May 21 21:06:41.883909 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:06:41.883497 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j6n9l" podUID="f9a66b4b-8692-49bf-ab36-53cc4a433741" containerName="manager" containerID="cri-o://5f6d07928fb68dffe210a477902379b2c20dce169f1108ed9fd37cf9cd37aafa" gracePeriod=10 May 21 21:06:42.311058 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:06:42.311014 2556 generic.go:358] "Generic (PLEG): container finished" podID="f9a66b4b-8692-49bf-ab36-53cc4a433741" containerID="5f6d07928fb68dffe210a477902379b2c20dce169f1108ed9fd37cf9cd37aafa" exitCode=0 May 21 21:06:42.311212 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:06:42.311080 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j6n9l" event={"ID":"f9a66b4b-8692-49bf-ab36-53cc4a433741","Type":"ContainerDied","Data":"5f6d07928fb68dffe210a477902379b2c20dce169f1108ed9fd37cf9cd37aafa"} May 21 21:06:42.444360 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:06:42.444329 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j6n9l" May 21 21:06:42.579663 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:06:42.579575 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9a66b4b-8692-49bf-ab36-53cc4a433741-extensions-socket-volume\") pod \"f9a66b4b-8692-49bf-ab36-53cc4a433741\" (UID: \"f9a66b4b-8692-49bf-ab36-53cc4a433741\") " May 21 21:06:42.579818 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:06:42.579674 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5nsxn\" (UniqueName: \"kubernetes.io/projected/f9a66b4b-8692-49bf-ab36-53cc4a433741-kube-api-access-5nsxn\") pod \"f9a66b4b-8692-49bf-ab36-53cc4a433741\" (UID: \"f9a66b4b-8692-49bf-ab36-53cc4a433741\") " May 21 21:06:42.580022 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:06:42.579992 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9a66b4b-8692-49bf-ab36-53cc4a433741-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f9a66b4b-8692-49bf-ab36-53cc4a433741" (UID: "f9a66b4b-8692-49bf-ab36-53cc4a433741"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 21:06:42.581906 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:06:42.581886 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9a66b4b-8692-49bf-ab36-53cc4a433741-kube-api-access-5nsxn" (OuterVolumeSpecName: "kube-api-access-5nsxn") pod "f9a66b4b-8692-49bf-ab36-53cc4a433741" (UID: "f9a66b4b-8692-49bf-ab36-53cc4a433741"). InnerVolumeSpecName "kube-api-access-5nsxn". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 21:06:42.680453 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:06:42.680412 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5nsxn\" (UniqueName: \"kubernetes.io/projected/f9a66b4b-8692-49bf-ab36-53cc4a433741-kube-api-access-5nsxn\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\"" May 21 21:06:42.680453 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:06:42.680445 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9a66b4b-8692-49bf-ab36-53cc4a433741-extensions-socket-volume\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\"" May 21 21:06:43.318919 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:06:43.318881 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j6n9l" event={"ID":"f9a66b4b-8692-49bf-ab36-53cc4a433741","Type":"ContainerDied","Data":"b5ade58c9ecf5906c401f2bb11f8efce7bb14ec786dae541a0346ea835123ff4"} May 21 21:06:43.318919 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:06:43.318905 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j6n9l" May 21 21:06:43.319408 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:06:43.318930 2556 scope.go:117] "RemoveContainer" containerID="5f6d07928fb68dffe210a477902379b2c20dce169f1108ed9fd37cf9cd37aafa" May 21 21:06:43.333875 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:06:43.333848 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j6n9l"] May 21 21:06:43.338490 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:06:43.338463 2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j6n9l"] May 21 21:06:44.688114 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:06:44.688079 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9a66b4b-8692-49bf-ab36-53cc4a433741" path="/var/lib/kubelet/pods/f9a66b4b-8692-49bf-ab36-53cc4a433741/volumes" May 21 21:07:47.946226 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:07:47.946185 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2x8j4"] May 21 21:07:47.946769 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:07:47.946672 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff974162-5ce1-4218-b14c-05e67dbecbfc" containerName="cleanup" May 21 21:07:47.946769 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:07:47.946693 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff974162-5ce1-4218-b14c-05e67dbecbfc" containerName="cleanup" May 21 21:07:47.946769 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:07:47.946722 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9a66b4b-8692-49bf-ab36-53cc4a433741" containerName="manager" May 21 21:07:47.946769 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:07:47.946730 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9a66b4b-8692-49bf-ab36-53cc4a433741" containerName="manager" May 21 21:07:47.946900 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:07:47.946809 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="ff974162-5ce1-4218-b14c-05e67dbecbfc" containerName="cleanup" May 21 21:07:47.946900 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:07:47.946821 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="f9a66b4b-8692-49bf-ab36-53cc4a433741" containerName="manager" May 21 21:07:47.950082 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:07:47.950064 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2x8j4" May 21 21:07:47.952023 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:07:47.952000 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-j22bm\"" May 21 21:07:47.957808 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:07:47.957778 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4156e402-8c0a-4a1b-8fa7-fdd820babdb8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-2x8j4\" (UID: \"4156e402-8c0a-4a1b-8fa7-fdd820babdb8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2x8j4" May 21 21:07:47.957964 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:07:47.957941 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th8rb\" (UniqueName: \"kubernetes.io/projected/4156e402-8c0a-4a1b-8fa7-fdd820babdb8-kube-api-access-th8rb\") pod \"kuadrant-operator-controller-manager-55c7f4c975-2x8j4\" (UID: \"4156e402-8c0a-4a1b-8fa7-fdd820babdb8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2x8j4" May 21 21:07:47.959118 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:07:47.959095 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2x8j4"] May 21 21:07:48.059337 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:07:48.059291 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-th8rb\" (UniqueName: \"kubernetes.io/projected/4156e402-8c0a-4a1b-8fa7-fdd820babdb8-kube-api-access-th8rb\") pod \"kuadrant-operator-controller-manager-55c7f4c975-2x8j4\" (UID: \"4156e402-8c0a-4a1b-8fa7-fdd820babdb8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2x8j4" May 21 21:07:48.059550 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:07:48.059403 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4156e402-8c0a-4a1b-8fa7-fdd820babdb8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-2x8j4\" (UID: \"4156e402-8c0a-4a1b-8fa7-fdd820babdb8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2x8j4" May 21 21:07:48.059760 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:07:48.059743 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4156e402-8c0a-4a1b-8fa7-fdd820babdb8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-2x8j4\" (UID: \"4156e402-8c0a-4a1b-8fa7-fdd820babdb8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2x8j4" May 21 21:07:48.067980 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:07:48.067951 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-th8rb\" (UniqueName: \"kubernetes.io/projected/4156e402-8c0a-4a1b-8fa7-fdd820babdb8-kube-api-access-th8rb\") pod \"kuadrant-operator-controller-manager-55c7f4c975-2x8j4\" (UID: \"4156e402-8c0a-4a1b-8fa7-fdd820babdb8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2x8j4" May 21 21:07:48.260648 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:07:48.260546 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2x8j4" May 21 21:07:48.398174 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:07:48.398137 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2x8j4"] May 21 21:07:48.401756 ip-10-0-132-7 kubenswrapper[2556]: W0521 21:07:48.401720 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4156e402_8c0a_4a1b_8fa7_fdd820babdb8.slice/crio-1d90fc32cf821b0d3dae3fb067f997a501ab6e1d9a96f1c3b342a7d8f83f7977 WatchSource:0}: Error finding container 1d90fc32cf821b0d3dae3fb067f997a501ab6e1d9a96f1c3b342a7d8f83f7977: Status 404 returned error can't find the container with id 1d90fc32cf821b0d3dae3fb067f997a501ab6e1d9a96f1c3b342a7d8f83f7977 May 21 21:07:48.404111 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:07:48.404095 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 21:07:48.542785 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:07:48.542693 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2x8j4" event={"ID":"4156e402-8c0a-4a1b-8fa7-fdd820babdb8","Type":"ContainerStarted","Data":"53296e282f4cc806bcdda07ab8260d7662e9c01bbd2c1c3b7cf5b7e8f280391b"} May 21 21:07:48.542785 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:07:48.542729 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2x8j4" event={"ID":"4156e402-8c0a-4a1b-8fa7-fdd820babdb8","Type":"ContainerStarted","Data":"1d90fc32cf821b0d3dae3fb067f997a501ab6e1d9a96f1c3b342a7d8f83f7977"} May 21 21:07:48.542785 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:07:48.542753 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2x8j4" May 21 21:07:48.562095 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:07:48.562010 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2x8j4" podStartSLOduration=1.5619935649999999 podStartE2EDuration="1.561993565s" podCreationTimestamp="2026-05-21 21:07:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 21:07:48.561197283 +0000 UTC m=+1776.491972400" watchObservedRunningTime="2026-05-21 21:07:48.561993565 +0000 UTC m=+1776.492768649" May 21 21:07:59.548885 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:07:59.548850 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2x8j4" May 21 21:08:09.431610 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:08:09.431573 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:08:12.729325 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:08:12.729296 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7n7h_2b22953d-24b1-4a5a-9ad2-870f2414a537/ovn-acl-logging/0.log" May 21 21:08:12.734869 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:08:12.734845 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7n7h_2b22953d-24b1-4a5a-9ad2-870f2414a537/ovn-acl-logging/0.log" May 21 21:08:14.325616 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:08:14.325576 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:08:39.525528 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:08:39.525486 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:08:44.324378 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:08:44.324334 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:08:54.632799 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:08:54.632761 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:09:05.721830 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:09:05.721790 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:09:13.532158 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:09:13.532118 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:09:24.332630 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:09:24.332590 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:09:33.423130 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:09:33.423041 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:09:44.429883 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:09:44.429843 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:09:52.330696 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:09:52.330651 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:10:03.226503 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:10:03.226457 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:10:12.626685 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:10:12.626648 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:10:45.328988 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:10:45.328947 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:11:27.724751 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:11:27.724711 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:11:35.923671 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:11:35.923633 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:11:45.028168 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:11:45.028129 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:11:53.825544 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:11:53.825499 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:12:02.233108 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:12:02.233068 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:12:15.829484 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:12:15.829445 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:12:23.626737 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:12:23.626695 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:12:32.030473 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:12:32.030351 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:12:39.732780 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:12:39.732742 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:12:48.126165 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:12:48.126119 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:12:57.424204 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:12:57.424163 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:13:09.130576 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:13:09.130541 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:13:12.752735 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:13:12.752706 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7n7h_2b22953d-24b1-4a5a-9ad2-870f2414a537/ovn-acl-logging/0.log" May 21 21:13:12.760266 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:13:12.760242 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7n7h_2b22953d-24b1-4a5a-9ad2-870f2414a537/ovn-acl-logging/0.log" May 21 21:13:27.026614 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:13:27.026583 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:13:35.425286 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:13:35.425248 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:13:44.329625 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:13:44.329588 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:13:52.929261 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:13:52.929223 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:14:09.528104 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:14:09.528063 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:14:17.426557 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:14:17.426513 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:14:26.834104 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:14:26.834064 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:14:35.219421 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:14:35.219385 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:14:44.426346 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:14:44.426301 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:14:52.931431 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:14:52.931393 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:15:00.132604 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:15:00.132565 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29656635-82cfx"] May 21 21:15:00.136310 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:15:00.136290 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656635-82cfx" May 21 21:15:00.138116 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:15:00.138094 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-q858m\"" May 21 21:15:00.152377 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:15:00.152340 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656635-82cfx"] May 21 21:15:00.210888 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:15:00.210838 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h948\" (UniqueName: \"kubernetes.io/projected/6b7b659c-22a0-47d0-a3ad-493daa1aa3b2-kube-api-access-9h948\") pod \"maas-api-key-cleanup-29656635-82cfx\" (UID: \"6b7b659c-22a0-47d0-a3ad-493daa1aa3b2\") " pod="opendatahub/maas-api-key-cleanup-29656635-82cfx" May 21 21:15:00.312033 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:15:00.311995 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9h948\" (UniqueName: \"kubernetes.io/projected/6b7b659c-22a0-47d0-a3ad-493daa1aa3b2-kube-api-access-9h948\") pod \"maas-api-key-cleanup-29656635-82cfx\" (UID: \"6b7b659c-22a0-47d0-a3ad-493daa1aa3b2\") " pod="opendatahub/maas-api-key-cleanup-29656635-82cfx" May 21 21:15:00.319822 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:15:00.319785 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h948\" (UniqueName: \"kubernetes.io/projected/6b7b659c-22a0-47d0-a3ad-493daa1aa3b2-kube-api-access-9h948\") pod \"maas-api-key-cleanup-29656635-82cfx\" (UID: \"6b7b659c-22a0-47d0-a3ad-493daa1aa3b2\") " pod="opendatahub/maas-api-key-cleanup-29656635-82cfx" May 21 21:15:00.446077 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:15:00.445992 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656635-82cfx" May 21 21:15:00.574572 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:15:00.574436 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656635-82cfx"] May 21 21:15:00.580868 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:15:00.580832 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 21:15:01.045987 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:15:01.045892 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656635-82cfx" event={"ID":"6b7b659c-22a0-47d0-a3ad-493daa1aa3b2","Type":"ContainerStarted","Data":"5aa90af44fe464537a317920d65b687ac8c01c4cafe4cb1c064d5ba2a58fbf5c"} May 21 21:15:01.045987 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:15:01.045931 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656635-82cfx" event={"ID":"6b7b659c-22a0-47d0-a3ad-493daa1aa3b2","Type":"ContainerStarted","Data":"e8a609e642d20482a0de66b04d179e819de8a1cc7787c9541a2a8ea944579f7a"} May 21 21:15:01.059792 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:15:01.059739 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29656635-82cfx" podStartSLOduration=1.059724928 podStartE2EDuration="1.059724928s" podCreationTimestamp="2026-05-21 21:15:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 21:15:01.058117446 +0000 UTC m=+2208.988892529" watchObservedRunningTime="2026-05-21 21:15:01.059724928 +0000 UTC m=+2208.990500010" May 21 21:15:02.050037 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:15:02.050000 2556 generic.go:358] "Generic (PLEG): container finished" podID="6b7b659c-22a0-47d0-a3ad-493daa1aa3b2" containerID="5aa90af44fe464537a317920d65b687ac8c01c4cafe4cb1c064d5ba2a58fbf5c" exitCode=0 May 21 21:15:02.050465 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:15:02.050092 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656635-82cfx" event={"ID":"6b7b659c-22a0-47d0-a3ad-493daa1aa3b2","Type":"ContainerDied","Data":"5aa90af44fe464537a317920d65b687ac8c01c4cafe4cb1c064d5ba2a58fbf5c"} May 21 21:15:02.821218 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:15:02.821183 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:15:03.195477 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:15:03.195451 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656635-82cfx" May 21 21:15:03.239315 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:15:03.239277 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9h948\" (UniqueName: \"kubernetes.io/projected/6b7b659c-22a0-47d0-a3ad-493daa1aa3b2-kube-api-access-9h948\") pod \"6b7b659c-22a0-47d0-a3ad-493daa1aa3b2\" (UID: \"6b7b659c-22a0-47d0-a3ad-493daa1aa3b2\") " May 21 21:15:03.241533 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:15:03.241499 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b7b659c-22a0-47d0-a3ad-493daa1aa3b2-kube-api-access-9h948" (OuterVolumeSpecName: "kube-api-access-9h948") pod "6b7b659c-22a0-47d0-a3ad-493daa1aa3b2" (UID: "6b7b659c-22a0-47d0-a3ad-493daa1aa3b2"). InnerVolumeSpecName "kube-api-access-9h948". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 21:15:03.340400 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:15:03.340316 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9h948\" (UniqueName: \"kubernetes.io/projected/6b7b659c-22a0-47d0-a3ad-493daa1aa3b2-kube-api-access-9h948\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\"" May 21 21:15:04.058175 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:15:04.058140 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656635-82cfx" event={"ID":"6b7b659c-22a0-47d0-a3ad-493daa1aa3b2","Type":"ContainerDied","Data":"e8a609e642d20482a0de66b04d179e819de8a1cc7787c9541a2a8ea944579f7a"} May 21 21:15:04.058175 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:15:04.058174 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8a609e642d20482a0de66b04d179e819de8a1cc7787c9541a2a8ea944579f7a" May 21 21:15:04.058405 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:15:04.058181 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656635-82cfx" May 21 21:15:13.325805 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:15:13.325766 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:15:23.224205 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:15:23.224156 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:15:32.724825 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:15:32.724736 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:15:41.928485 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:15:41.928446 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:15:50.227654 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:15:50.227615 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:15:58.430444 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:15:58.430394 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:16:06.630427 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:16:06.630390 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:16:24.046176 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:16:24.046133 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:16:32.933458 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:16:32.933422 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:16:41.331101 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:16:41.331061 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:16:50.226087 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:16:50.226053 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:17:13.723672 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:13.723582 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:17:26.523983 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:26.523945 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:17:30.525825 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:30.525790 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-fspjz"] May 21 21:17:33.569909 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:33.569869 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-tvfpp_2b076cf0-4b0d-4a61-b0e4-173e4f004496/manager/0.log" May 21 21:17:33.802383 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:33.802335 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29656620-gjm9d_ff974162-5ce1-4218-b14c-05e67dbecbfc/cleanup/0.log" May 21 21:17:33.908310 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:33.908274 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29656635-82cfx_6b7b659c-22a0-47d0-a3ad-493daa1aa3b2/cleanup/0.log" May 21 21:17:34.142472 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:34.142430 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-4sp7r_86bcf399-8d3a-4705-a9d0-b644ed132749/manager/1.log" May 21 21:17:34.260430 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:34.260316 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76cc84b65c-bb9zg_1d2d37ec-1406-4b83-a0e5-54a892ed6773/manager/0.log" May 21 21:17:35.927786 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:35.927763 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-mpx6q_758ff596-55a1-43d7-991e-82aef23c5312/manager/0.log" May 21 21:17:36.368875 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:36.368832 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-2x8j4_4156e402-8c0a-4a1b-8fa7-fdd820babdb8/manager/0.log" May 21 21:17:36.473969 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:36.473935 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-fspjz_e4546ec8-7bf9-4d68-b315-f807c8880b8f/limitador/0.log" May 21 21:17:37.037930 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:37.037895 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-b294r_c0d9466d-d063-4e82-ac2f-aac41a26a7b5/discovery/0.log" May 21 21:17:37.149119 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:37.149086 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-c9f76b4c5-8tg4g_b2dcd1ab-8a2d-469b-bf00-9769f5e23700/kube-auth-proxy/0.log" May 21 21:17:37.591006 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:37.590977 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-786d87b5dd-59596_53afa1f9-37ff-4f67-8a7d-4b28bcb756ab/router/0.log" May 21 21:17:45.276642 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:45.276601 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wvzdl_4615b277-5db1-4fdc-a5f8-42b00145b04c/global-pull-secret-syncer/0.log" May 21 21:17:45.373647 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:45.373609 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nbcfl_1ae06c65-3e3e-4c07-a621-b12942dd11bf/konnectivity-agent/0.log" May 21 21:17:45.461495 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:45.461463 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-7.ec2.internal_0d4dbf022829d1830e4448f0950dd717/haproxy/0.log" May 21 21:17:49.648353 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:49.648315 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-mpx6q_758ff596-55a1-43d7-991e-82aef23c5312/manager/0.log" May 21 21:17:49.849137 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:49.849104 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-2x8j4_4156e402-8c0a-4a1b-8fa7-fdd820babdb8/manager/0.log" May 21 21:17:49.867196 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:49.867162 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-fspjz_e4546ec8-7bf9-4d68-b315-f807c8880b8f/limitador/0.log" May 21 21:17:51.550154 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:51.550119 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-c459f6b9b-tgc65_5bcd6758-c7b5-4e1b-84f4-a22b382c2bf4/metrics-server/0.log" May 21 21:17:51.576407 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:51.576362 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-prtgn_0d9ae6c1-f713-4430-95da-b812c6c56222/monitoring-plugin/0.log" May 21 21:17:51.758942 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:51.758846 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xvvc2_49764fd0-a453-4e95-b0a9-64e02354891e/node-exporter/0.log" May 21 21:17:51.777396 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:51.777341 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xvvc2_49764fd0-a453-4e95-b0a9-64e02354891e/kube-rbac-proxy/0.log" May 21 21:17:51.799809 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:51.799785 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xvvc2_49764fd0-a453-4e95-b0a9-64e02354891e/init-textfile/0.log" May 21 21:17:51.936740 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:51.936700 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_38af7c9b-9881-457e-9a7c-1432813f63a1/prometheus/0.log" May 21 21:17:51.954383 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:51.954336 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_38af7c9b-9881-457e-9a7c-1432813f63a1/config-reloader/0.log" May 21 21:17:51.974880 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:51.974847 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_38af7c9b-9881-457e-9a7c-1432813f63a1/thanos-sidecar/0.log" May 21 21:17:51.995167 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:51.995131 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_38af7c9b-9881-457e-9a7c-1432813f63a1/kube-rbac-proxy-web/0.log" May 21 21:17:52.014706 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:52.014604 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_38af7c9b-9881-457e-9a7c-1432813f63a1/kube-rbac-proxy/0.log" May 21 21:17:52.037305 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:52.037276 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_38af7c9b-9881-457e-9a7c-1432813f63a1/kube-rbac-proxy-thanos/0.log" May 21 21:17:52.057837 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:52.057817 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_38af7c9b-9881-457e-9a7c-1432813f63a1/init-config-reloader/0.log" May 21 21:17:52.087548 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:52.087514 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-lfnxt_2983b7ae-d2d8-48eb-856b-65526d77c4cf/prometheus-operator/0.log" May 21 21:17:52.107445 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:52.107422 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-lfnxt_2983b7ae-d2d8-48eb-856b-65526d77c4cf/kube-rbac-proxy/0.log" May 21 21:17:53.454203 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:53.454174 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-hn2r7_0a2f603e-8e52-4c17-9f71-0518c657f864/networking-console-plugin/0.log" May 21 21:17:54.058727 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:54.058694 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-866q5/perf-node-gather-daemonset-z6cwg"] May 21 21:17:54.059087 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:54.059074 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b7b659c-22a0-47d0-a3ad-493daa1aa3b2" containerName="cleanup" May 21 21:17:54.059130 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:54.059090 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b7b659c-22a0-47d0-a3ad-493daa1aa3b2" containerName="cleanup" May 21 21:17:54.059163 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:54.059154 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="6b7b659c-22a0-47d0-a3ad-493daa1aa3b2" containerName="cleanup" May 21 21:17:54.062191 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:54.062175 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-866q5/perf-node-gather-daemonset-z6cwg" May 21 21:17:54.064592 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:54.064569 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-866q5\"/\"default-dockercfg-phbdl\"" May 21 21:17:54.064785 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:54.064662 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-866q5\"/\"openshift-service-ca.crt\"" May 21 21:17:54.064916 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:54.064683 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-866q5\"/\"kube-root-ca.crt\"" May 21 21:17:54.071575 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:54.071549 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-866q5/perf-node-gather-daemonset-z6cwg"] May 21 21:17:54.095449 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:54.095420 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lt88\" (UniqueName: \"kubernetes.io/projected/dec8803f-6ecb-4c1c-9626-b3d085dc7f6a-kube-api-access-4lt88\") pod \"perf-node-gather-daemonset-z6cwg\" (UID: \"dec8803f-6ecb-4c1c-9626-b3d085dc7f6a\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-z6cwg" May 21 21:17:54.095612 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:54.095475 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dec8803f-6ecb-4c1c-9626-b3d085dc7f6a-proc\") pod \"perf-node-gather-daemonset-z6cwg\" (UID: \"dec8803f-6ecb-4c1c-9626-b3d085dc7f6a\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-z6cwg" May 21 21:17:54.095612 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:54.095537 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dec8803f-6ecb-4c1c-9626-b3d085dc7f6a-lib-modules\") pod \"perf-node-gather-daemonset-z6cwg\" (UID: \"dec8803f-6ecb-4c1c-9626-b3d085dc7f6a\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-z6cwg" May 21 21:17:54.095612 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:54.095563 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dec8803f-6ecb-4c1c-9626-b3d085dc7f6a-podres\") pod \"perf-node-gather-daemonset-z6cwg\" (UID: \"dec8803f-6ecb-4c1c-9626-b3d085dc7f6a\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-z6cwg" May 21 21:17:54.095726 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:54.095644 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dec8803f-6ecb-4c1c-9626-b3d085dc7f6a-sys\") pod \"perf-node-gather-daemonset-z6cwg\" (UID: \"dec8803f-6ecb-4c1c-9626-b3d085dc7f6a\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-z6cwg" May 21 21:17:54.196583 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:54.196543 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4lt88\" (UniqueName: \"kubernetes.io/projected/dec8803f-6ecb-4c1c-9626-b3d085dc7f6a-kube-api-access-4lt88\") pod \"perf-node-gather-daemonset-z6cwg\" (UID: \"dec8803f-6ecb-4c1c-9626-b3d085dc7f6a\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-z6cwg" May 21 21:17:54.196778 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:54.196604 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dec8803f-6ecb-4c1c-9626-b3d085dc7f6a-proc\") pod \"perf-node-gather-daemonset-z6cwg\" (UID: \"dec8803f-6ecb-4c1c-9626-b3d085dc7f6a\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-z6cwg" May 21 21:17:54.196778 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:54.196629 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dec8803f-6ecb-4c1c-9626-b3d085dc7f6a-lib-modules\") pod \"perf-node-gather-daemonset-z6cwg\" (UID: \"dec8803f-6ecb-4c1c-9626-b3d085dc7f6a\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-z6cwg" May 21 21:17:54.196778 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:54.196647 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dec8803f-6ecb-4c1c-9626-b3d085dc7f6a-podres\") pod \"perf-node-gather-daemonset-z6cwg\" (UID: \"dec8803f-6ecb-4c1c-9626-b3d085dc7f6a\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-z6cwg" May 21 21:17:54.196778 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:54.196695 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dec8803f-6ecb-4c1c-9626-b3d085dc7f6a-sys\") pod \"perf-node-gather-daemonset-z6cwg\" (UID: \"dec8803f-6ecb-4c1c-9626-b3d085dc7f6a\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-z6cwg" May 21 21:17:54.196778 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:54.196716 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dec8803f-6ecb-4c1c-9626-b3d085dc7f6a-proc\") pod \"perf-node-gather-daemonset-z6cwg\" (UID: \"dec8803f-6ecb-4c1c-9626-b3d085dc7f6a\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-z6cwg" May 21 21:17:54.196778 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:54.196766 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dec8803f-6ecb-4c1c-9626-b3d085dc7f6a-sys\") pod \"perf-node-gather-daemonset-z6cwg\" (UID: \"dec8803f-6ecb-4c1c-9626-b3d085dc7f6a\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-z6cwg" May 21 21:17:54.197125 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:54.196790 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dec8803f-6ecb-4c1c-9626-b3d085dc7f6a-lib-modules\") pod \"perf-node-gather-daemonset-z6cwg\" (UID: \"dec8803f-6ecb-4c1c-9626-b3d085dc7f6a\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-z6cwg" May 21 21:17:54.197125 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:54.196848 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dec8803f-6ecb-4c1c-9626-b3d085dc7f6a-podres\") pod \"perf-node-gather-daemonset-z6cwg\" (UID: \"dec8803f-6ecb-4c1c-9626-b3d085dc7f6a\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-z6cwg" May 21 21:17:54.203564 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:54.203538 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lt88\" (UniqueName: \"kubernetes.io/projected/dec8803f-6ecb-4c1c-9626-b3d085dc7f6a-kube-api-access-4lt88\") pod \"perf-node-gather-daemonset-z6cwg\" (UID: \"dec8803f-6ecb-4c1c-9626-b3d085dc7f6a\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-z6cwg" May 21 21:17:54.373672 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:54.373624 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-866q5/perf-node-gather-daemonset-z6cwg" May 21 21:17:54.505286 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:54.505227 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-866q5/perf-node-gather-daemonset-z6cwg"] May 21 21:17:54.509319 ip-10-0-132-7 kubenswrapper[2556]: W0521 21:17:54.509260 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddec8803f_6ecb_4c1c_9626_b3d085dc7f6a.slice/crio-3c47a2f935809d5cb51d2cf563203c93c6d9a721dcb1027074307e9e8d75bfb5 WatchSource:0}: Error finding container 3c47a2f935809d5cb51d2cf563203c93c6d9a721dcb1027074307e9e8d75bfb5: Status 404 returned error can't find the container with id 3c47a2f935809d5cb51d2cf563203c93c6d9a721dcb1027074307e9e8d75bfb5 May 21 21:17:54.661337 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:54.661245 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-866q5/perf-node-gather-daemonset-z6cwg" event={"ID":"dec8803f-6ecb-4c1c-9626-b3d085dc7f6a","Type":"ContainerStarted","Data":"972b9044b33f9b19207dcba4e6ebefb60445bf1a0cc80408b6b3e31a7689cb65"} May 21 21:17:54.661337 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:54.661291 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-866q5/perf-node-gather-daemonset-z6cwg" event={"ID":"dec8803f-6ecb-4c1c-9626-b3d085dc7f6a","Type":"ContainerStarted","Data":"3c47a2f935809d5cb51d2cf563203c93c6d9a721dcb1027074307e9e8d75bfb5"} May 21 21:17:54.661550 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:54.661510 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-866q5/perf-node-gather-daemonset-z6cwg" May 21 21:17:54.678962 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:54.678890 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-866q5/perf-node-gather-daemonset-z6cwg" podStartSLOduration=0.678868645 podStartE2EDuration="678.868645ms" podCreationTimestamp="2026-05-21 21:17:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 21:17:54.67549869 +0000 UTC m=+2382.606273773" watchObservedRunningTime="2026-05-21 21:17:54.678868645 +0000 UTC m=+2382.609643730" May 21 21:17:55.997741 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:55.997699 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z7tv2_ba567318-f7e8-435e-b1c6-152074615586/dns/0.log" May 21 21:17:56.035718 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:56.035685 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z7tv2_ba567318-f7e8-435e-b1c6-152074615586/kube-rbac-proxy/0.log" May 21 21:17:56.065300 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:56.065272 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6p4ps_84d7fb93-5212-4b3f-a963-296ed4cae5b0/dns-node-resolver/0.log" May 21 21:17:56.647972 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:56.647940 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n8gtw_3cef130e-0ffb-400e-ba51-f4947d952456/node-ca/0.log" May 21 21:17:57.701203 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:57.701170 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-b294r_c0d9466d-d063-4e82-ac2f-aac41a26a7b5/discovery/0.log" May 21 21:17:57.719997 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:57.719959 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-c9f76b4c5-8tg4g_b2dcd1ab-8a2d-469b-bf00-9769f5e23700/kube-auth-proxy/0.log" May 21 21:17:57.886970 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:57.886938 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-786d87b5dd-59596_53afa1f9-37ff-4f67-8a7d-4b28bcb756ab/router/0.log" May 21 21:17:58.415614 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:58.415568 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kql5p_9b6798e3-449b-4f3b-900d-08e55e6acf43/serve-healthcheck-canary/0.log" May 21 21:17:58.866787 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:58.866747 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8d4sk_b493e2e9-01d8-42dc-81a1-91af6d6d59a2/kube-rbac-proxy/0.log" May 21 21:17:58.885826 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:58.885794 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8d4sk_b493e2e9-01d8-42dc-81a1-91af6d6d59a2/exporter/0.log" May 21 21:17:58.906844 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:17:58.906810 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8d4sk_b493e2e9-01d8-42dc-81a1-91af6d6d59a2/extractor/0.log" May 21 21:18:00.675562 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:18:00.675534 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-866q5/perf-node-gather-daemonset-z6cwg" May 21 21:18:00.909208 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:18:00.909178 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-tvfpp_2b076cf0-4b0d-4a61-b0e4-173e4f004496/manager/0.log" May 21 21:18:00.962996 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:18:00.962908 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29656620-gjm9d_ff974162-5ce1-4218-b14c-05e67dbecbfc/cleanup/0.log" May 21 21:18:00.983502 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:18:00.983469 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29656635-82cfx_6b7b659c-22a0-47d0-a3ad-493daa1aa3b2/cleanup/0.log" May 21 21:18:01.079905 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:18:01.079853 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-4sp7r_86bcf399-8d3a-4705-a9d0-b644ed132749/manager/0.log" May 21 21:18:01.102994 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:18:01.102960 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-4sp7r_86bcf399-8d3a-4705-a9d0-b644ed132749/manager/1.log" May 21 21:18:01.154273 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:18:01.154240 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76cc84b65c-bb9zg_1d2d37ec-1406-4b83-a0e5-54a892ed6773/manager/0.log" May 21 21:18:06.684025 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:18:06.683997 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-vq4vs_c4a72146-e54f-4c90-99b5-a0096eb6deec/migrator/0.log" May 21 21:18:06.702739 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:18:06.702701 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-vq4vs_c4a72146-e54f-4c90-99b5-a0096eb6deec/graceful-termination/0.log" May 21 21:18:07.065986 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:18:07.065898 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-nn778_e8d1d929-7502-4b6b-b5d4-a66201f06c8e/kube-storage-version-migrator-operator/1.log" May 21 21:18:07.067800 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:18:07.067773 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-nn778_e8d1d929-7502-4b6b-b5d4-a66201f06c8e/kube-storage-version-migrator-operator/0.log" May 21 21:18:08.130582 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:18:08.130548 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6ldcp_233b9c5d-8fb6-4d7f-a394-6f35c388074e/kube-multus/0.log" May 21 21:18:08.303927 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:18:08.303895 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hlljl_0f3e31a1-421b-4147-8fe1-70facdf3c1b4/kube-multus-additional-cni-plugins/0.log" May 21 21:18:08.325106 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:18:08.325081 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hlljl_0f3e31a1-421b-4147-8fe1-70facdf3c1b4/egress-router-binary-copy/0.log" May 21 21:18:08.346806 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:18:08.346777 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hlljl_0f3e31a1-421b-4147-8fe1-70facdf3c1b4/cni-plugins/0.log" May 21 21:18:08.367603 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:18:08.367558 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hlljl_0f3e31a1-421b-4147-8fe1-70facdf3c1b4/bond-cni-plugin/0.log" May 21 21:18:08.393428 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:18:08.393319 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hlljl_0f3e31a1-421b-4147-8fe1-70facdf3c1b4/routeoverride-cni/0.log" May 21 21:18:08.417536 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:18:08.417503 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hlljl_0f3e31a1-421b-4147-8fe1-70facdf3c1b4/whereabouts-cni-bincopy/0.log" May 21 21:18:08.443061 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:18:08.443034 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hlljl_0f3e31a1-421b-4147-8fe1-70facdf3c1b4/whereabouts-cni/0.log" May 21 21:18:08.857085 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:18:08.857047 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dgrfc_3bdf9a6b-e989-4794-bbe7-3396ae7ddc07/network-metrics-daemon/0.log" May 21 21:18:08.881257 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:18:08.881236 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dgrfc_3bdf9a6b-e989-4794-bbe7-3396ae7ddc07/kube-rbac-proxy/0.log" May 21 21:18:10.405879 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:18:10.405836 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7n7h_2b22953d-24b1-4a5a-9ad2-870f2414a537/ovn-controller/0.log" May 21 21:18:10.422252 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:18:10.422220 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7n7h_2b22953d-24b1-4a5a-9ad2-870f2414a537/ovn-acl-logging/0.log" May 21 21:18:10.444882 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:18:10.444843 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7n7h_2b22953d-24b1-4a5a-9ad2-870f2414a537/ovn-acl-logging/1.log" May 21 21:18:10.468928 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:18:10.468894 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7n7h_2b22953d-24b1-4a5a-9ad2-870f2414a537/kube-rbac-proxy-node/0.log" May 21 21:18:10.491129 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:18:10.491092 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7n7h_2b22953d-24b1-4a5a-9ad2-870f2414a537/kube-rbac-proxy-ovn-metrics/0.log" May 21 21:18:10.508206 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:18:10.508174 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7n7h_2b22953d-24b1-4a5a-9ad2-870f2414a537/northd/0.log" May 21 21:18:10.530614 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:18:10.530579 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7n7h_2b22953d-24b1-4a5a-9ad2-870f2414a537/nbdb/0.log" May 21 21:18:10.549898 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:18:10.549871 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7n7h_2b22953d-24b1-4a5a-9ad2-870f2414a537/sbdb/0.log" May 21 21:18:10.717768 ip-10-0-132-7 kubenswrapper[2556]: I0521 21:18:10.717679 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7n7h_2b22953d-24b1-4a5a-9ad2-870f2414a537/ovnkube-controller/0.log"