May 22 10:32:30.349814 ip-10-0-138-186 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 22 10:32:30.349825 ip-10-0-138-186 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 22 10:32:30.349833 ip-10-0-138-186 systemd[1]: kubelet.service: Failed with result 'resources'. May 22 10:32:30.350087 ip-10-0-138-186 systemd[1]: Failed to start Kubernetes Kubelet. May 22 10:32:40.401896 ip-10-0-138-186 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 22 10:32:40.401913 ip-10-0-138-186 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 452075816fbf46e2abe7f2aecaeb3aa4 -- May 22 10:35:08.573671 ip-10-0-138-186 systemd[1]: Starting Kubernetes Kubelet... May 22 10:35:09.006595 ip-10-0-138-186 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 22 10:35:09.006595 ip-10-0-138-186 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 22 10:35:09.006595 ip-10-0-138-186 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 22 10:35:09.006595 ip-10-0-138-186 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 22 10:35:09.006595 ip-10-0-138-186 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 22 10:35:09.008385 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.008279 2558 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 22 10:35:09.011440 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011426 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 22 10:35:09.011470 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011442 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 22 10:35:09.011470 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011445 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 22 10:35:09.011470 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011449 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 22 10:35:09.011470 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011452 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 22 10:35:09.011470 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011455 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 22 10:35:09.011470 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011458 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 22 10:35:09.011470 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011461 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 22 10:35:09.011470 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011464 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 22 10:35:09.011470 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011467 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 22 10:35:09.011470 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011470 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 22 10:35:09.011470 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011474 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 22 10:35:09.011772 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011478 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 22 10:35:09.011772 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011481 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 22 10:35:09.011772 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011484 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 22 10:35:09.011772 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011492 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 22 10:35:09.011772 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011494 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 22 10:35:09.011772 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011498 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 22 10:35:09.011772 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011500 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 22 10:35:09.011772 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011503 2558 feature_gate.go:328] unrecognized feature gate: Example May 22 10:35:09.011772 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011505 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 22 10:35:09.011772 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011508 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 22 10:35:09.011772 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011511 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 22 10:35:09.011772 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011513 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 22 10:35:09.011772 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011516 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 22 10:35:09.011772 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011519 2558 feature_gate.go:328] unrecognized feature gate: Example2 May 22 10:35:09.011772 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011521 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 22 10:35:09.011772 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011524 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores May 22 10:35:09.011772 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011526 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 22 10:35:09.011772 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011529 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 22 10:35:09.011772 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011531 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 22 10:35:09.011772 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011533 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 22 10:35:09.012497 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011536 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 22 10:35:09.012497 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011538 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 22 10:35:09.012497 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011540 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 22 10:35:09.012497 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011543 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages May 22 10:35:09.012497 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011546 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 22 10:35:09.012497 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011548 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 22 10:35:09.012497 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011551 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 22 10:35:09.012497 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011553 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 22 10:35:09.012497 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011557 2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 22 10:35:09.012497 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011559 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 22 10:35:09.012497 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011562 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 22 10:35:09.012497 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011564 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 22 10:35:09.012497 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011567 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 22 10:35:09.012497 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011571 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 22 10:35:09.012497 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011573 2558 feature_gate.go:328] unrecognized feature gate: DualReplica May 22 10:35:09.012497 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011576 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 22 10:35:09.012497 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011578 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 22 10:35:09.012497 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011581 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 22 10:35:09.012497 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011584 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 22 10:35:09.012497 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011586 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 22 10:35:09.013101 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011589 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 22 10:35:09.013101 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011591 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 22 10:35:09.013101 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011594 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 22 10:35:09.013101 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011596 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 22 10:35:09.013101 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011599 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 22 10:35:09.013101 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011601 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability May 22 10:35:09.013101 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011604 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 22 10:35:09.013101 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011606 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 22 10:35:09.013101 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011608 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 22 10:35:09.013101 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011612 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 22 10:35:09.013101 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011616 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 22 10:35:09.013101 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011618 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 22 10:35:09.013101 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011621 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 22 10:35:09.013101 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011623 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 22 10:35:09.013101 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011626 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 22 10:35:09.013101 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011628 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 22 10:35:09.013101 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011631 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 22 10:35:09.013101 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011633 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 22 10:35:09.013101 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011636 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 22 10:35:09.013584 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011639 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 22 10:35:09.013584 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011641 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 22 10:35:09.013584 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011644 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 22 10:35:09.013584 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011647 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 22 10:35:09.013584 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011649 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 22 10:35:09.013584 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011652 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 22 10:35:09.013584 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011655 2558 feature_gate.go:328] unrecognized feature gate: NewOLM May 22 10:35:09.013584 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011657 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 22 10:35:09.013584 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011659 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 22 10:35:09.013584 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011663 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 22 10:35:09.013584 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011666 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 22 10:35:09.013584 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011668 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 22 10:35:09.013584 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011671 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 22 10:35:09.013584 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011673 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 22 10:35:09.013584 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.011676 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 22 10:35:09.013584 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.012933 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 22 10:35:09.013584 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.012944 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 22 10:35:09.013584 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.012947 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 22 10:35:09.013584 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.012951 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 22 10:35:09.014042 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.012954 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 22 10:35:09.014042 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.012959 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 22 10:35:09.014042 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.012962 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 22 10:35:09.014042 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.012964 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 22 10:35:09.014042 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.012967 2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 22 10:35:09.014042 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.012970 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 22 10:35:09.014042 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.012973 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 22 10:35:09.014042 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.012976 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 22 10:35:09.014042 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.012980 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 22 10:35:09.014042 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.012984 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 22 10:35:09.014042 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.012987 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 22 10:35:09.014042 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.012989 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 22 10:35:09.014042 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.012992 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 22 10:35:09.014042 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.012994 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 22 10:35:09.014042 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.012997 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 22 10:35:09.014042 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.012999 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 22 10:35:09.014042 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013002 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 22 10:35:09.014042 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013005 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 22 10:35:09.014042 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013007 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 22 10:35:09.014042 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013010 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores May 22 10:35:09.014534 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013012 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 22 10:35:09.014534 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013015 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 22 10:35:09.014534 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013018 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 22 10:35:09.014534 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013020 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 22 10:35:09.014534 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013024 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 22 10:35:09.014534 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013026 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 22 10:35:09.014534 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013029 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 22 10:35:09.014534 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013031 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 22 10:35:09.014534 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013037 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 22 10:35:09.014534 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013043 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 22 10:35:09.014534 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013046 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 22 10:35:09.014534 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013048 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 22 10:35:09.014534 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013052 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 22 10:35:09.014534 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013057 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 22 10:35:09.014534 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013059 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 22 10:35:09.014534 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013062 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 22 10:35:09.014534 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013064 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 22 10:35:09.014534 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013067 2558 feature_gate.go:328] unrecognized feature gate: DualReplica May 22 10:35:09.014534 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013070 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 22 10:35:09.014534 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013072 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability May 22 10:35:09.015033 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013074 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 22 10:35:09.015033 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013077 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 22 10:35:09.015033 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013079 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 22 10:35:09.015033 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013081 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 22 10:35:09.015033 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013085 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 22 10:35:09.015033 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013089 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages May 22 10:35:09.015033 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013091 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 22 10:35:09.015033 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013094 2558 feature_gate.go:328] unrecognized feature gate: Example May 22 10:35:09.015033 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013097 2558 feature_gate.go:328] unrecognized feature gate: Example2 May 22 10:35:09.015033 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013099 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 22 10:35:09.015033 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013101 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 22 10:35:09.015033 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013104 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 22 10:35:09.015033 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013106 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 22 10:35:09.015033 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013110 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 22 10:35:09.015033 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013113 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 22 10:35:09.015033 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013116 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 22 10:35:09.015033 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013118 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 22 10:35:09.015033 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013121 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 22 10:35:09.015033 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013123 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 22 10:35:09.015511 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013126 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 22 10:35:09.015511 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013128 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 22 10:35:09.015511 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013131 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 22 10:35:09.015511 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013133 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 22 10:35:09.015511 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013136 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 22 10:35:09.015511 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013138 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 22 10:35:09.015511 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013141 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 22 10:35:09.015511 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013143 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 22 10:35:09.015511 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013145 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 22 10:35:09.015511 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013148 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 22 10:35:09.015511 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013151 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 22 10:35:09.015511 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013153 2558 feature_gate.go:328] unrecognized feature gate: NewOLM May 22 10:35:09.015511 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013156 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 22 10:35:09.015511 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013158 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 22 10:35:09.015511 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013162 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 22 10:35:09.015511 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013164 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 22 10:35:09.015511 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013167 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 22 10:35:09.015511 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013169 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 22 10:35:09.015511 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013172 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 22 10:35:09.015511 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013174 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 22 10:35:09.016013 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013176 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 22 10:35:09.016013 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013179 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 22 10:35:09.016013 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.013181 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 22 10:35:09.016013 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014017 2558 flags.go:64] FLAG: --address="0.0.0.0" May 22 10:35:09.016013 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014026 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 22 10:35:09.016013 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014034 2558 flags.go:64] FLAG: --anonymous-auth="true" May 22 10:35:09.016013 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014040 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" May 22 10:35:09.016013 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014044 2558 flags.go:64] FLAG: --authentication-token-webhook="false" May 22 10:35:09.016013 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014048 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 22 10:35:09.016013 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014052 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 22 10:35:09.016013 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014057 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 22 10:35:09.016013 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014060 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 22 10:35:09.016013 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014063 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 22 10:35:09.016013 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014067 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 22 10:35:09.016013 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014074 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 22 10:35:09.016013 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014077 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 22 10:35:09.016013 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014080 2558 flags.go:64] FLAG: --cgroup-root="" May 22 10:35:09.016013 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014083 2558 flags.go:64] FLAG: --cgroups-per-qos="true" May 22 10:35:09.016013 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014086 2558 flags.go:64] FLAG: --client-ca-file="" May 22 10:35:09.016013 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014089 2558 flags.go:64] FLAG: --cloud-config="" May 22 10:35:09.016013 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014091 2558 flags.go:64] FLAG: --cloud-provider="external" May 22 10:35:09.016013 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014094 2558 flags.go:64] FLAG: --cluster-dns="[]" May 22 10:35:09.016013 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014099 2558 flags.go:64] FLAG: --cluster-domain="" May 22 10:35:09.016013 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014102 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 22 10:35:09.016608 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014105 2558 flags.go:64] FLAG: --config-dir="" May 22 10:35:09.016608 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014108 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 22 10:35:09.016608 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014111 2558 flags.go:64] FLAG: --container-log-max-files="5" May 22 10:35:09.016608 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014116 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" May 22 10:35:09.016608 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014119 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 22 10:35:09.016608 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014122 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 22 10:35:09.016608 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014126 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 22 10:35:09.016608 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014129 2558 flags.go:64] FLAG: --contention-profiling="false" May 22 10:35:09.016608 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014132 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" May 22 10:35:09.016608 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014134 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 22 10:35:09.016608 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014137 2558 flags.go:64] FLAG: --cpu-manager-policy="none" May 22 10:35:09.016608 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014140 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" May 22 10:35:09.016608 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014144 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 22 10:35:09.016608 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014147 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 22 10:35:09.016608 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014150 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" May 22 10:35:09.016608 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014153 2558 flags.go:64] FLAG: --enable-load-reader="false" May 22 10:35:09.016608 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014156 2558 flags.go:64] FLAG: --enable-server="true" May 22 10:35:09.016608 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014158 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 22 10:35:09.016608 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014163 2558 flags.go:64] FLAG: --event-burst="100" May 22 10:35:09.016608 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014166 2558 flags.go:64] FLAG: --event-qps="50" May 22 10:35:09.016608 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014169 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 22 10:35:09.016608 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014172 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 22 10:35:09.016608 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014176 2558 flags.go:64] FLAG: --eviction-hard="" May 22 10:35:09.016608 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014180 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 22 10:35:09.016608 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014183 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 22 10:35:09.017240 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014186 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 22 10:35:09.017240 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014189 2558 flags.go:64] FLAG: --eviction-soft="" May 22 10:35:09.017240 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014192 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" May 22 10:35:09.017240 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014194 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" May 22 10:35:09.017240 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014197 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 22 10:35:09.017240 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014200 2558 flags.go:64] FLAG: --experimental-mounter-path="" May 22 10:35:09.017240 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014203 2558 flags.go:64] FLAG: --fail-cgroupv1="false" May 22 10:35:09.017240 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014206 2558 flags.go:64] FLAG: --fail-swap-on="true" May 22 10:35:09.017240 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014209 2558 flags.go:64] FLAG: --feature-gates="" May 22 10:35:09.017240 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014213 2558 flags.go:64] FLAG: --file-check-frequency="20s" May 22 10:35:09.017240 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014216 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 22 10:35:09.017240 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014219 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 22 10:35:09.017240 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014222 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 22 10:35:09.017240 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014225 2558 flags.go:64] FLAG: --healthz-port="10248" May 22 10:35:09.017240 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014228 2558 flags.go:64] FLAG: --help="false" May 22 10:35:09.017240 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014231 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-138-186.ec2.internal" May 22 10:35:09.017240 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014234 2558 flags.go:64] FLAG: --housekeeping-interval="10s" May 22 10:35:09.017240 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014237 2558 flags.go:64] FLAG: --http-check-frequency="20s" May 22 10:35:09.017240 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014239 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 22 10:35:09.017240 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014242 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 22 10:35:09.017240 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014245 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" May 22 10:35:09.017240 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014248 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" May 22 10:35:09.017240 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014251 2558 flags.go:64] FLAG: --image-service-endpoint="" May 22 10:35:09.017806 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014254 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" May 22 10:35:09.017806 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014256 2558 flags.go:64] FLAG: --kube-api-burst="100" May 22 10:35:09.017806 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014259 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 22 10:35:09.017806 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014262 2558 flags.go:64] FLAG: --kube-api-qps="50" May 22 10:35:09.017806 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014265 2558 flags.go:64] FLAG: --kube-reserved="" May 22 10:35:09.017806 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014267 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" May 22 10:35:09.017806 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014271 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 22 10:35:09.017806 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014274 2558 flags.go:64] FLAG: --kubelet-cgroups="" May 22 10:35:09.017806 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014277 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 22 10:35:09.017806 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014281 2558 flags.go:64] FLAG: --lock-file="" May 22 10:35:09.017806 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014283 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" May 22 10:35:09.017806 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014286 2558 flags.go:64] FLAG: --log-flush-frequency="5s" May 22 10:35:09.017806 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014289 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 22 10:35:09.017806 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014299 2558 flags.go:64] FLAG: --log-json-split-stream="false" May 22 10:35:09.017806 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014302 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 22 10:35:09.017806 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014305 2558 flags.go:64] FLAG: --log-text-split-stream="false" May 22 10:35:09.017806 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014308 2558 flags.go:64] FLAG: --logging-format="text" May 22 10:35:09.017806 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014310 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 22 10:35:09.017806 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014314 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" May 22 10:35:09.017806 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014317 2558 flags.go:64] FLAG: --manifest-url="" May 22 10:35:09.017806 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014319 2558 flags.go:64] FLAG: --manifest-url-header="" May 22 10:35:09.017806 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014324 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 22 10:35:09.017806 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014327 2558 flags.go:64] FLAG: --max-open-files="1000000" May 22 10:35:09.017806 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014331 2558 flags.go:64] FLAG: --max-pods="110" May 22 10:35:09.017806 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014347 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" May 22 10:35:09.018442 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014350 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 22 10:35:09.018442 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014353 2558 flags.go:64] FLAG: --memory-manager-policy="None" May 22 10:35:09.018442 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014356 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 22 10:35:09.018442 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014359 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 22 10:35:09.018442 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014361 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" May 22 10:35:09.018442 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014364 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 22 10:35:09.018442 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014373 2558 flags.go:64] FLAG: --node-status-max-images="50" May 22 10:35:09.018442 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014376 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" May 22 10:35:09.018442 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014379 2558 flags.go:64] FLAG: --oom-score-adj="-999" May 22 10:35:09.018442 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014382 2558 flags.go:64] FLAG: --pod-cidr="" May 22 10:35:09.018442 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014385 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 22 10:35:09.018442 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014391 2558 flags.go:64] FLAG: --pod-manifest-path="" May 22 10:35:09.018442 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014394 2558 flags.go:64] FLAG: --pod-max-pids="-1" May 22 10:35:09.018442 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014397 2558 flags.go:64] FLAG: --pods-per-core="0" May 22 10:35:09.018442 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014401 2558 flags.go:64] FLAG: --port="10250" May 22 10:35:09.018442 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014404 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" May 22 10:35:09.018442 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014407 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0705dcf14871c2b56" May 22 10:35:09.018442 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014410 2558 flags.go:64] FLAG: --qos-reserved="" May 22 10:35:09.018442 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014412 2558 flags.go:64] FLAG: --read-only-port="10255" May 22 10:35:09.018442 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014415 2558 flags.go:64] FLAG: --register-node="true" May 22 10:35:09.018442 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014418 2558 flags.go:64] FLAG: --register-schedulable="true" May 22 10:35:09.018442 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014421 2558 flags.go:64] FLAG: --register-with-taints="" May 22 10:35:09.018442 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014428 2558 flags.go:64] FLAG: --registry-burst="10" May 22 10:35:09.018442 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014431 2558 flags.go:64] FLAG: --registry-qps="5" May 22 10:35:09.019025 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014434 2558 flags.go:64] FLAG: --reserved-cpus="" May 22 10:35:09.019025 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014436 2558 flags.go:64] FLAG: --reserved-memory="" May 22 10:35:09.019025 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014441 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 22 10:35:09.019025 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014444 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 22 10:35:09.019025 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014447 2558 flags.go:64] FLAG: --rotate-certificates="false" May 22 10:35:09.019025 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014450 2558 flags.go:64] FLAG: --rotate-server-certificates="false" May 22 10:35:09.019025 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014453 2558 flags.go:64] FLAG: --runonce="false" May 22 10:35:09.019025 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014456 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 22 10:35:09.019025 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014459 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 22 10:35:09.019025 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014461 2558 flags.go:64] FLAG: --seccomp-default="false" May 22 10:35:09.019025 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014464 2558 flags.go:64] FLAG: --serialize-image-pulls="true" May 22 10:35:09.019025 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014467 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 22 10:35:09.019025 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014470 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 22 10:35:09.019025 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014472 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 22 10:35:09.019025 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014476 2558 flags.go:64] FLAG: --storage-driver-password="root" May 22 10:35:09.019025 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014479 2558 flags.go:64] FLAG: --storage-driver-secure="false" May 22 10:35:09.019025 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014481 2558 flags.go:64] FLAG: --storage-driver-table="stats" May 22 10:35:09.019025 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014484 2558 flags.go:64] FLAG: --storage-driver-user="root" May 22 10:35:09.019025 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014487 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 22 10:35:09.019025 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014490 2558 flags.go:64] FLAG: --sync-frequency="1m0s" May 22 10:35:09.019025 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014492 2558 flags.go:64] FLAG: --system-cgroups="" May 22 10:35:09.019025 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014495 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 22 10:35:09.019025 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014503 2558 flags.go:64] FLAG: --system-reserved-cgroup="" May 22 10:35:09.019025 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014505 2558 flags.go:64] FLAG: --tls-cert-file="" May 22 10:35:09.019025 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014508 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" May 22 10:35:09.019623 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014512 2558 flags.go:64] FLAG: --tls-min-version="" May 22 10:35:09.019623 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014515 2558 flags.go:64] FLAG: --tls-private-key-file="" May 22 10:35:09.019623 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014518 2558 flags.go:64] FLAG: --topology-manager-policy="none" May 22 10:35:09.019623 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014520 2558 flags.go:64] FLAG: --topology-manager-policy-options="" May 22 10:35:09.019623 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014525 2558 flags.go:64] FLAG: --topology-manager-scope="container" May 22 10:35:09.019623 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014528 2558 flags.go:64] FLAG: --v="2" May 22 10:35:09.019623 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014532 2558 flags.go:64] FLAG: --version="false" May 22 10:35:09.019623 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014537 2558 flags.go:64] FLAG: --vmodule="" May 22 10:35:09.019623 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014541 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 22 10:35:09.019623 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.014544 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 22 10:35:09.019623 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014645 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 22 10:35:09.019623 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014650 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 22 10:35:09.019623 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014653 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 22 10:35:09.019623 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014656 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 22 10:35:09.019623 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014659 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 22 10:35:09.019623 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014662 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 22 10:35:09.019623 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014665 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 22 10:35:09.019623 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014668 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 22 10:35:09.019623 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014671 2558 feature_gate.go:328] unrecognized feature gate: Example2 May 22 10:35:09.019623 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014673 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 22 10:35:09.019623 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014676 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 22 10:35:09.019623 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014678 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 22 10:35:09.020202 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014681 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 22 10:35:09.020202 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014683 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 22 10:35:09.020202 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014685 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 22 10:35:09.020202 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014689 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 22 10:35:09.020202 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014692 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 22 10:35:09.020202 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014695 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 22 10:35:09.020202 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014697 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 22 10:35:09.020202 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014700 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores May 22 10:35:09.020202 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014703 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 22 10:35:09.020202 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014706 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 22 10:35:09.020202 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014708 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 22 10:35:09.020202 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014711 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 22 10:35:09.020202 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014713 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 22 10:35:09.020202 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014715 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 22 10:35:09.020202 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014719 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages May 22 10:35:09.020202 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014721 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 22 10:35:09.020202 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014724 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 22 10:35:09.020202 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014726 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 22 10:35:09.020202 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014728 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 22 10:35:09.020718 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014731 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 22 10:35:09.020718 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014733 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 22 10:35:09.020718 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014736 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability May 22 10:35:09.020718 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014738 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 22 10:35:09.020718 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014740 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 22 10:35:09.020718 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014743 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 22 10:35:09.020718 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014746 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 22 10:35:09.020718 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014748 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 22 10:35:09.020718 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014750 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 22 10:35:09.020718 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014752 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 22 10:35:09.020718 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014755 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 22 10:35:09.020718 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014757 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 22 10:35:09.020718 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014760 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 22 10:35:09.020718 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014762 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 22 10:35:09.020718 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014764 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 22 10:35:09.020718 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014767 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 22 10:35:09.020718 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014769 2558 feature_gate.go:328] unrecognized feature gate: DualReplica May 22 10:35:09.020718 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014772 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 22 10:35:09.020718 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014775 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 22 10:35:09.021175 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014778 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 22 10:35:09.021175 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014782 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 22 10:35:09.021175 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014784 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 22 10:35:09.021175 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014801 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 22 10:35:09.021175 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014804 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 22 10:35:09.021175 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014807 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 22 10:35:09.021175 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014810 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 22 10:35:09.021175 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014812 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 22 10:35:09.021175 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014817 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 22 10:35:09.021175 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014820 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 22 10:35:09.021175 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014822 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 22 10:35:09.021175 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014825 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 22 10:35:09.021175 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014828 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 22 10:35:09.021175 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014830 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 22 10:35:09.021175 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014833 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 22 10:35:09.021175 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014835 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 22 10:35:09.021175 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014838 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 22 10:35:09.021175 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014840 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 22 10:35:09.021175 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014842 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 22 10:35:09.021175 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014845 2558 feature_gate.go:328] unrecognized feature gate: NewOLM May 22 10:35:09.021696 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014848 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 22 10:35:09.021696 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014850 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 22 10:35:09.021696 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014853 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 22 10:35:09.021696 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014855 2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 22 10:35:09.021696 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014857 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 22 10:35:09.021696 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014860 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 22 10:35:09.021696 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014862 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 22 10:35:09.021696 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014864 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 22 10:35:09.021696 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014867 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 22 10:35:09.021696 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014869 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 22 10:35:09.021696 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014872 2558 feature_gate.go:328] unrecognized feature gate: Example May 22 10:35:09.021696 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014874 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 22 10:35:09.021696 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014876 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 22 10:35:09.021696 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014879 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 22 10:35:09.021696 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014882 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 22 10:35:09.021696 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.014884 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 22 10:35:09.022125 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.015432 2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 22 10:35:09.022815 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.022796 2558 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 22 10:35:09.022851 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.022816 2558 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 22 10:35:09.022879 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022864 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 22 10:35:09.022879 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022870 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 22 10:35:09.022879 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022873 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 22 10:35:09.022879 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022876 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 22 10:35:09.022879 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022879 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 22 10:35:09.022879 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022881 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 22 10:35:09.023024 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022884 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 22 10:35:09.023024 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022887 2558 feature_gate.go:328] unrecognized feature gate: Example2 May 22 10:35:09.023024 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022890 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 22 10:35:09.023024 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022892 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 22 10:35:09.023024 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022895 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 22 10:35:09.023024 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022897 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 22 10:35:09.023024 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022900 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 22 10:35:09.023024 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022903 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 22 10:35:09.023024 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022905 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 22 10:35:09.023024 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022908 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 22 10:35:09.023024 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022911 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 22 10:35:09.023024 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022913 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 22 10:35:09.023024 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022916 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 22 10:35:09.023024 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022918 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 22 10:35:09.023024 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022921 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 22 10:35:09.023024 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022923 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 22 10:35:09.023024 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022926 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 22 10:35:09.023024 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022929 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 22 10:35:09.023024 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022931 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 22 10:35:09.023024 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022934 2558 feature_gate.go:328] unrecognized feature gate: Example May 22 10:35:09.023524 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022936 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 22 10:35:09.023524 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022938 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 22 10:35:09.023524 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022941 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 22 10:35:09.023524 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022943 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 22 10:35:09.023524 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022946 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 22 10:35:09.023524 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022950 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 22 10:35:09.023524 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022955 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages May 22 10:35:09.023524 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022958 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 22 10:35:09.023524 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022961 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 22 10:35:09.023524 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022963 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 22 10:35:09.023524 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022966 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores May 22 10:35:09.023524 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022969 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 22 10:35:09.023524 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022971 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 22 10:35:09.023524 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022975 2558 feature_gate.go:328] unrecognized feature gate: DualReplica May 22 10:35:09.023524 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022978 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 22 10:35:09.023524 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022981 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 22 10:35:09.023524 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022983 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 22 10:35:09.023524 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022986 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 22 10:35:09.023524 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022989 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 22 10:35:09.023992 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022991 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 22 10:35:09.023992 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022994 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 22 10:35:09.023992 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022996 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 22 10:35:09.023992 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.022999 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 22 10:35:09.023992 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023001 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 22 10:35:09.023992 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023004 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 22 10:35:09.023992 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023006 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 22 10:35:09.023992 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023009 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 22 10:35:09.023992 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023011 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 22 10:35:09.023992 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023014 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 22 10:35:09.023992 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023016 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 22 10:35:09.023992 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023019 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 22 10:35:09.023992 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023021 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 22 10:35:09.023992 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023023 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 22 10:35:09.023992 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023026 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 22 10:35:09.023992 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023029 2558 feature_gate.go:328] unrecognized feature gate: NewOLM May 22 10:35:09.023992 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023032 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 22 10:35:09.023992 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023035 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 22 10:35:09.023992 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023037 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 22 10:35:09.023992 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023040 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 22 10:35:09.024506 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023043 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 22 10:35:09.024506 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023046 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 22 10:35:09.024506 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023048 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 22 10:35:09.024506 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023052 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 22 10:35:09.024506 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023056 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 22 10:35:09.024506 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023059 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 22 10:35:09.024506 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023062 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 22 10:35:09.024506 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023065 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 22 10:35:09.024506 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023067 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability May 22 10:35:09.024506 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023070 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 22 10:35:09.024506 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023073 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 22 10:35:09.024506 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023075 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 22 10:35:09.024506 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023078 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 22 10:35:09.024506 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023080 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 22 10:35:09.024506 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023082 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 22 10:35:09.024506 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023085 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 22 10:35:09.024506 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023087 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 22 10:35:09.024506 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023090 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 22 10:35:09.024506 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023092 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 22 10:35:09.024967 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023095 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 22 10:35:09.024967 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023097 2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 22 10:35:09.024967 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.023102 2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 22 10:35:09.024967 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023199 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 22 10:35:09.024967 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023204 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 22 10:35:09.024967 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023207 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 22 10:35:09.024967 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023210 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 22 10:35:09.024967 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023213 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 22 10:35:09.024967 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023216 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 22 10:35:09.024967 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023218 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 22 10:35:09.024967 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023220 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 22 10:35:09.024967 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023223 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 22 10:35:09.024967 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023226 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 22 10:35:09.024967 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023229 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 22 10:35:09.024967 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023232 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 22 10:35:09.025360 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023234 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 22 10:35:09.025360 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023236 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 22 10:35:09.025360 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023239 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 22 10:35:09.025360 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023241 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 22 10:35:09.025360 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023244 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 22 10:35:09.025360 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023247 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 22 10:35:09.025360 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023250 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 22 10:35:09.025360 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023252 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 22 10:35:09.025360 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023255 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 22 10:35:09.025360 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023257 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 22 10:35:09.025360 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023259 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 22 10:35:09.025360 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023262 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 22 10:35:09.025360 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023264 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 22 10:35:09.025360 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023267 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 22 10:35:09.025360 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023269 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 22 10:35:09.025360 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023272 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 22 10:35:09.025360 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023274 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 22 10:35:09.025360 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023277 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 22 10:35:09.025360 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023279 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 22 10:35:09.025360 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023281 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 22 10:35:09.025844 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023284 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 22 10:35:09.025844 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023286 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 22 10:35:09.025844 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023288 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 22 10:35:09.025844 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023291 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages May 22 10:35:09.025844 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023293 2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 22 10:35:09.025844 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023296 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 22 10:35:09.025844 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023298 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 22 10:35:09.025844 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023300 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 22 10:35:09.025844 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023303 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 22 10:35:09.025844 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023307 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 22 10:35:09.025844 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023310 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 22 10:35:09.025844 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023313 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability May 22 10:35:09.025844 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023315 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 22 10:35:09.025844 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023318 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 22 10:35:09.025844 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023321 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 22 10:35:09.025844 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023325 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 22 10:35:09.025844 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023328 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 22 10:35:09.025844 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023330 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 22 10:35:09.025844 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023347 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 22 10:35:09.026332 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023352 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 22 10:35:09.026332 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023354 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 22 10:35:09.026332 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023357 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 22 10:35:09.026332 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023359 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 22 10:35:09.026332 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023362 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 22 10:35:09.026332 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023365 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 22 10:35:09.026332 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023367 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 22 10:35:09.026332 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023369 2558 feature_gate.go:328] unrecognized feature gate: Example May 22 10:35:09.026332 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023372 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 22 10:35:09.026332 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023374 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 22 10:35:09.026332 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023377 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 22 10:35:09.026332 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023379 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 22 10:35:09.026332 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023382 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 22 10:35:09.026332 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023384 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 22 10:35:09.026332 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023387 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 22 10:35:09.026332 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023389 2558 feature_gate.go:328] unrecognized feature gate: DualReplica May 22 10:35:09.026332 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023391 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 22 10:35:09.026332 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023394 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 22 10:35:09.026332 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023396 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 22 10:35:09.026332 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023398 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 22 10:35:09.026829 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023400 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 22 10:35:09.026829 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023403 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 22 10:35:09.026829 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023406 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 22 10:35:09.026829 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023408 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores May 22 10:35:09.026829 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023411 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 22 10:35:09.026829 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023414 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 22 10:35:09.026829 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023417 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 22 10:35:09.026829 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023419 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 22 10:35:09.026829 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023422 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 22 10:35:09.026829 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023424 2558 feature_gate.go:328] unrecognized feature gate: Example2 May 22 10:35:09.026829 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023427 2558 feature_gate.go:328] unrecognized feature gate: NewOLM May 22 10:35:09.026829 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023430 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 22 10:35:09.026829 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023432 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 22 10:35:09.026829 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023435 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 22 10:35:09.026829 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:09.023437 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 22 10:35:09.026829 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.023442 2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 22 10:35:09.027225 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.024075 2558 server.go:962] "Client rotation is on, will bootstrap in background" May 22 10:35:09.029283 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.029268 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 22 10:35:09.030288 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.030276 2558 server.go:1019] "Starting client certificate rotation" May 22 10:35:09.030406 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.030388 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 22 10:35:09.030444 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.030431 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 22 10:35:09.052308 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.052290 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 22 10:35:09.054122 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.054103 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 22 10:35:09.067548 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.066280 2558 log.go:25] "Validated CRI v1 runtime API" May 22 10:35:09.072354 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.072322 2558 log.go:25] "Validated CRI v1 image API" May 22 10:35:09.073562 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.073547 2558 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 22 10:35:09.077423 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.077404 2558 fs.go:135] Filesystem UUIDs: map[6832c4f6-5e35-4a9b-9319-93649761db08:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 97c60dfb-21a7-4301-b979-9360c5207807:/dev/nvme0n1p3] May 22 10:35:09.077499 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.077422 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 22 10:35:09.081977 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.081877 2558 manager.go:217] Machine: {Timestamp:2026-05-22 10:35:09.081306226 +0000 UTC m=+0.388565963 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099972 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ad66cc59e5f37284a12a485f846cb SystemUUID:ec2ad66c-c59e-5f37-284a-12a485f846cb BootID:45207581-6fbf-46e2-abe7-f2aecaeb3aa4 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:87:c1:2c:e0:ff Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:87:c1:2c:e0:ff Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:2e:6e:71:85:d4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 22 10:35:09.082639 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.082628 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 22 10:35:09.082725 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.082712 2558 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 22 10:35:09.082761 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.082749 2558 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 22 10:35:09.085954 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.085916 2558 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 22 10:35:09.086096 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.085957 2558 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-186.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 22 10:35:09.086138 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.086105 2558 topology_manager.go:138] "Creating topology manager with none policy" May 22 10:35:09.086138 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.086115 2558 container_manager_linux.go:306] "Creating device plugin manager" May 22 10:35:09.086138 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.086122 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 22 10:35:09.086809 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.086799 2558 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 22 10:35:09.087961 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.087951 2558 state_mem.go:36] "Initialized new in-memory state store" May 22 10:35:09.088274 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.088263 2558 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 22 10:35:09.090636 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.090627 2558 kubelet.go:491] "Attempting to sync node with API server" May 22 10:35:09.090685 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.090640 2558 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 22 10:35:09.090685 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.090652 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 22 10:35:09.090685 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.090661 2558 kubelet.go:397] "Adding apiserver pod source" May 22 10:35:09.090685 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.090669 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 22 10:35:09.091769 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.091757 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 22 10:35:09.091810 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.091776 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 22 10:35:09.094962 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.094936 2558 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 22 10:35:09.096572 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.096558 2558 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 22 10:35:09.098112 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.098101 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 22 10:35:09.098158 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.098117 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 22 10:35:09.098158 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.098124 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 22 10:35:09.098158 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.098129 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 22 10:35:09.098158 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.098137 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 22 10:35:09.098158 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.098142 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 22 10:35:09.098158 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.098148 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 22 10:35:09.098158 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.098153 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 22 10:35:09.098158 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.098160 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 22 10:35:09.098384 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.098166 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 22 10:35:09.098384 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.098180 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 22 10:35:09.098384 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.098185 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 22 10:35:09.099015 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.099004 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 22 10:35:09.099015 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.099017 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 22 10:35:09.102472 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.102457 2558 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 22 10:35:09.102548 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.102494 2558 server.go:1295] "Started kubelet" May 22 10:35:09.102610 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.102551 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 22 10:35:09.102677 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.102638 2558 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 22 10:35:09.102723 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.102699 2558 server_v1.go:47] "podresources" method="list" useActivePods=true May 22 10:35:09.103259 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.103241 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k2scj" May 22 10:35:09.103358 ip-10-0-138-186 systemd[1]: Started Kubernetes Kubelet. May 22 10:35:09.103925 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.103845 2558 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 22 10:35:09.104958 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:09.104936 2558 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-186.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 22 10:35:09.105033 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:09.104994 2558 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 22 10:35:09.105104 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.105087 2558 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-186.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 22 10:35:09.105485 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.105472 2558 server.go:317] "Adding debug handlers to kubelet server" May 22 10:35:09.110742 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.110721 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k2scj" May 22 10:35:09.111027 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.110999 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 22 10:35:09.111598 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.111583 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 22 10:35:09.111687 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.111670 2558 volume_manager.go:295] "The desired_state_of_world populator starts" May 22 10:35:09.111687 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.111681 2558 volume_manager.go:297] "Starting Kubelet Volume Manager" May 22 10:35:09.111866 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.111848 2558 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 22 10:35:09.111942 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.111910 2558 reconstruct.go:97] "Volume reconstruction finished" May 22 10:35:09.111942 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.111923 2558 reconciler.go:26] "Reconciler: start to sync state" May 22 10:35:09.112812 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.112793 2558 factory.go:55] Registering systemd factory May 22 10:35:09.112915 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.112817 2558 factory.go:223] Registration of the systemd container factory successfully May 22 10:35:09.113235 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:09.109854 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-186.ec2.internal.18b1dcceee00f37b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-186.ec2.internal,UID:ip-10-0-138-186.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-186.ec2.internal,},FirstTimestamp:2026-05-22 10:35:09.102470011 +0000 UTC m=+0.409729748,LastTimestamp:2026-05-22 10:35:09.102470011 +0000 UTC m=+0.409729748,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-186.ec2.internal,}" May 22 10:35:09.113353 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.113242 2558 factory.go:153] Registering CRI-O factory May 22 10:35:09.113353 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.113261 2558 factory.go:223] Registration of the crio container factory successfully May 22 10:35:09.113353 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:09.113272 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-186.ec2.internal\" not found" May 22 10:35:09.113353 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.113323 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 22 10:35:09.113563 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.113372 2558 factory.go:103] Registering Raw factory May 22 10:35:09.113563 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.113393 2558 manager.go:1196] Started watching for new ooms in manager May 22 10:35:09.114022 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.114007 2558 manager.go:319] Starting recovery of all containers May 22 10:35:09.116025 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:09.115998 2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-186.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 22 10:35:09.116133 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:09.116059 2558 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 22 10:35:09.116133 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:09.116088 2558 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 22 10:35:09.125600 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.125444 2558 manager.go:324] Recovery completed May 22 10:35:09.126935 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:09.126909 2558 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory May 22 10:35:09.129786 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.129774 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 22 10:35:09.131726 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.131710 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasSufficientMemory" May 22 10:35:09.131806 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.131745 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasNoDiskPressure" May 22 10:35:09.131806 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.131759 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasSufficientPID" May 22 10:35:09.132238 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.132226 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" May 22 10:35:09.132283 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.132239 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 22 10:35:09.132283 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.132254 2558 state_mem.go:36] "Initialized new in-memory state store" May 22 10:35:09.134468 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.134457 2558 policy_none.go:49] "None policy: Start" May 22 10:35:09.134503 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.134472 2558 memory_manager.go:186] "Starting memorymanager" policy="None" May 22 10:35:09.134503 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.134481 2558 state_mem.go:35] "Initializing new in-memory state store" May 22 10:35:09.169140 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.169122 2558 manager.go:341] "Starting Device Plugin manager" May 22 10:35:09.169243 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:09.169160 2558 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 22 10:35:09.169243 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.169174 2558 server.go:85] "Starting device plugin registration server" May 22 10:35:09.169540 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.169520 2558 eviction_manager.go:189] "Eviction manager: starting control loop" May 22 10:35:09.193539 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.169541 2558 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 22 10:35:09.193539 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.169678 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 22 10:35:09.193539 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.169821 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 22 10:35:09.193539 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.169832 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 22 10:35:09.193539 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:09.170201 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 22 10:35:09.193539 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:09.170229 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-186.ec2.internal\" not found" May 22 10:35:09.247798 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.247765 2558 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 22 10:35:09.249069 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.249049 2558 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 22 10:35:09.249162 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.249074 2558 status_manager.go:230] "Starting to sync pod status with apiserver" May 22 10:35:09.249162 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.249091 2558 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 22 10:35:09.249162 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.249097 2558 kubelet.go:2451] "Starting kubelet main sync loop" May 22 10:35:09.249162 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:09.249135 2558 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 22 10:35:09.251460 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.251444 2558 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 22 10:35:09.270429 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.270378 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 22 10:35:09.271457 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.271442 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasSufficientMemory" May 22 10:35:09.271530 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.271472 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasNoDiskPressure" May 22 10:35:09.271530 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.271485 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasSufficientPID" May 22 10:35:09.271530 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.271511 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-186.ec2.internal" May 22 10:35:09.281717 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.281700 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-186.ec2.internal" May 22 10:35:09.281828 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:09.281726 2558 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-186.ec2.internal\": node \"ip-10-0-138-186.ec2.internal\" not found" May 22 10:35:09.305516 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:09.305486 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-186.ec2.internal\" not found" May 22 10:35:09.349994 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.349946 2558 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-186.ec2.internal"] May 22 10:35:09.350135 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.350036 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 22 10:35:09.354533 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.354516 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasSufficientMemory" May 22 10:35:09.354619 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.354550 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasNoDiskPressure" May 22 10:35:09.354619 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.354561 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasSufficientPID" May 22 10:35:09.356847 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.356835 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 22 10:35:09.357001 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.356977 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal" May 22 10:35:09.357056 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.357017 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 22 10:35:09.357811 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.357795 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasSufficientMemory" May 22 10:35:09.357896 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.357821 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasNoDiskPressure" May 22 10:35:09.357896 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.357826 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasSufficientMemory" May 22 10:35:09.357896 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.357834 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasSufficientPID" May 22 10:35:09.357896 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.357847 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasNoDiskPressure" May 22 10:35:09.357896 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.357857 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasSufficientPID" May 22 10:35:09.360289 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.360273 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-186.ec2.internal" May 22 10:35:09.360381 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.360304 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 22 10:35:09.361043 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.361027 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasSufficientMemory" May 22 10:35:09.361110 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.361091 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasNoDiskPressure" May 22 10:35:09.361110 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.361106 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeHasSufficientPID" May 22 10:35:09.387012 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:09.386990 2558 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-186.ec2.internal\" not found" node="ip-10-0-138-186.ec2.internal" May 22 10:35:09.391519 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:09.391505 2558 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-186.ec2.internal\" not found" node="ip-10-0-138-186.ec2.internal" May 22 10:35:09.406399 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:09.406382 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-186.ec2.internal\" not found" May 22 10:35:09.414740 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.414723 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fad8f2e01fa8e9d10bf87b1689efd852-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal\" (UID: \"fad8f2e01fa8e9d10bf87b1689efd852\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal" May 22 10:35:09.414835 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.414749 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fad8f2e01fa8e9d10bf87b1689efd852-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal\" (UID: \"fad8f2e01fa8e9d10bf87b1689efd852\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal" May 22 10:35:09.414835 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.414768 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b95c5d1fb0379c406cc76e5fce61434d-config\") pod \"kube-apiserver-proxy-ip-10-0-138-186.ec2.internal\" (UID: \"b95c5d1fb0379c406cc76e5fce61434d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-186.ec2.internal" May 22 10:35:09.506697 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:09.506649 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-186.ec2.internal\" not found" May 22 10:35:09.515045 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.515012 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b95c5d1fb0379c406cc76e5fce61434d-config\") pod \"kube-apiserver-proxy-ip-10-0-138-186.ec2.internal\" (UID: \"b95c5d1fb0379c406cc76e5fce61434d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-186.ec2.internal" May 22 10:35:09.515045 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.515044 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b95c5d1fb0379c406cc76e5fce61434d-config\") pod \"kube-apiserver-proxy-ip-10-0-138-186.ec2.internal\" (UID: \"b95c5d1fb0379c406cc76e5fce61434d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-186.ec2.internal" May 22 10:35:09.515218 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.515062 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fad8f2e01fa8e9d10bf87b1689efd852-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal\" (UID: \"fad8f2e01fa8e9d10bf87b1689efd852\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal" May 22 10:35:09.515218 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.515103 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fad8f2e01fa8e9d10bf87b1689efd852-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal\" (UID: \"fad8f2e01fa8e9d10bf87b1689efd852\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal" May 22 10:35:09.515218 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.515106 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fad8f2e01fa8e9d10bf87b1689efd852-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal\" (UID: \"fad8f2e01fa8e9d10bf87b1689efd852\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal" May 22 10:35:09.515218 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.515141 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fad8f2e01fa8e9d10bf87b1689efd852-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal\" (UID: \"fad8f2e01fa8e9d10bf87b1689efd852\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal" May 22 10:35:09.607539 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:09.607448 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-186.ec2.internal\" not found" May 22 10:35:09.689934 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.689905 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal" May 22 10:35:09.694474 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.694455 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-186.ec2.internal" May 22 10:35:09.707999 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:09.707972 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-186.ec2.internal\" not found" May 22 10:35:09.809020 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:09.808976 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-186.ec2.internal\" not found" May 22 10:35:09.909553 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:09.909485 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-186.ec2.internal\" not found" May 22 10:35:09.998608 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:09.998583 2558 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 22 10:35:10.009810 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:10.009782 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-186.ec2.internal\" not found" May 22 10:35:10.030179 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:10.030153 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 22 10:35:10.030352 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:10.030319 2558 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 22 10:35:10.030396 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:10.030379 2558 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 22 10:35:10.110347 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:10.110309 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-186.ec2.internal\" not found" May 22 10:35:10.111411 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:10.111395 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 22 10:35:10.114461 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:10.114429 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-21 10:30:09 +0000 UTC" deadline="2027-12-22 02:45:50.514871188 +0000 UTC" May 22 10:35:10.114461 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:10.114456 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13888h10m40.400417938s" May 22 10:35:10.125710 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:10.125679 2558 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 22 10:35:10.147885 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:10.147864 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7mzks" May 22 10:35:10.154349 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:10.154316 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7mzks" May 22 10:35:10.211324 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:10.211253 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-186.ec2.internal\" not found" May 22 10:35:10.264975 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:10.264945 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb95c5d1fb0379c406cc76e5fce61434d.slice/crio-b593de8c59bee94a9e8a7032386c5d016527c809318efe590b4983010c64d54f WatchSource:0}: Error finding container b593de8c59bee94a9e8a7032386c5d016527c809318efe590b4983010c64d54f: Status 404 returned error can't find the container with id b593de8c59bee94a9e8a7032386c5d016527c809318efe590b4983010c64d54f May 22 10:35:10.265257 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:10.265238 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfad8f2e01fa8e9d10bf87b1689efd852.slice/crio-f8170458a86c20b1d7337ce7bd7b34afbd4261a3e9b0fc91d1d7e9da762f91f3 WatchSource:0}: Error finding container f8170458a86c20b1d7337ce7bd7b34afbd4261a3e9b0fc91d1d7e9da762f91f3: Status 404 returned error can't find the container with id f8170458a86c20b1d7337ce7bd7b34afbd4261a3e9b0fc91d1d7e9da762f91f3 May 22 10:35:10.268403 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:10.268387 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 22 10:35:10.312291 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:10.312253 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-186.ec2.internal\" not found" May 22 10:35:10.401556 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:10.401529 2558 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 22 10:35:10.412802 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:10.412776 2558 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal" May 22 10:35:10.422672 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:10.422649 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 22 10:35:10.423568 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:10.423556 2558 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-186.ec2.internal" May 22 10:35:10.430238 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:10.430227 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 22 10:35:10.631739 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:10.631650 2558 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 22 10:35:11.092001 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.091915 2558 apiserver.go:52] "Watching apiserver" May 22 10:35:11.097683 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.097657 2558 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 22 10:35:11.099548 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.099523 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5trjw","openshift-cluster-node-tuning-operator/tuned-zgshg","openshift-image-registry/node-ca-cxx7z","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal","openshift-network-diagnostics/network-check-target-ncpgn","openshift-network-operator/iptables-alerter-84gt5","kube-system/kube-apiserver-proxy-ip-10-0-138-186.ec2.internal","openshift-dns/node-resolver-7mj84","openshift-multus/multus-6j2d5","openshift-multus/multus-additional-cni-plugins-r5lqn","openshift-multus/network-metrics-daemon-4t6q7","openshift-ovn-kubernetes/ovnkube-node-jzgxh","kube-system/konnectivity-agent-6f7c6"] May 22 10:35:11.102408 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.102386 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.105316 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.105212 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 22 10:35:11.105316 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.105219 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 22 10:35:11.105316 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.105275 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 22 10:35:11.105537 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.105326 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.105537 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.105377 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c9dgw\"" May 22 10:35:11.105637 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.105555 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 22 10:35:11.105731 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.105715 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 22 10:35:11.105867 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.105845 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 22 10:35:11.107324 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.107288 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 22 10:35:11.107565 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.107532 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 22 10:35:11.107709 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.107533 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-g4k7z\"" May 22 10:35:11.107981 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.107961 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cxx7z" May 22 10:35:11.109703 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.109329 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 22 10:35:11.109703 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.109558 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 22 10:35:11.109703 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.109595 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 22 10:35:11.109892 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.109797 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-k9x27\"" May 22 10:35:11.110459 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.110439 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5trjw" May 22 10:35:11.112295 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.112094 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 22 10:35:11.112295 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.112106 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 22 10:35:11.112295 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.112140 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 22 10:35:11.112295 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.112101 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sdbcq\"" May 22 10:35:11.114985 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.114965 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:35:11.115060 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:11.115034 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncpgn" podUID="63a0f782-b151-4b2a-be81-d0025df9fb35" May 22 10:35:11.117461 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.117440 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-84gt5" May 22 10:35:11.117555 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.117509 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6f7c6" May 22 10:35:11.119539 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.119502 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 22 10:35:11.119730 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.119712 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 22 10:35:11.119826 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.119752 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 22 10:35:11.119942 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.119924 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vfnzx\"" May 22 10:35:11.120044 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.119953 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 22 10:35:11.120105 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.120050 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-htgtl\"" May 22 10:35:11.120241 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.120224 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 22 10:35:11.122021 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.121999 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7mj84" May 22 10:35:11.122103 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.122014 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-host-kubelet\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.122103 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.122048 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-run-openvswitch\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.122103 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.122072 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-lib-modules\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.122103 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.122091 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6j2d5" May 22 10:35:11.122242 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.122097 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-var-lib-kubelet\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.122242 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.122165 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzrwf\" (UniqueName: \"kubernetes.io/projected/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-kube-api-access-qzrwf\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.122242 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.122188 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-run-ovn\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.122242 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.122214 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-log-socket\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.122242 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.122236 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-host-run-ovn-kubernetes\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.122421 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.122264 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-etc-sysctl-d\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.122421 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.122288 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-etc-sysctl-conf\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.122421 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.122309 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-etc-systemd\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.122421 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.122355 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.122421 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.122384 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-run\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.122421 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.122405 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-host\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.122636 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.122427 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5a26bab0-ee1f-4322-9413-91c337de805a-serviceca\") pod \"node-ca-cxx7z\" (UID: \"5a26bab0-ee1f-4322-9413-91c337de805a\") " pod="openshift-image-registry/node-ca-cxx7z" May 22 10:35:11.122636 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.122454 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f0208365-c78b-4378-bb0a-ccc84a1b726b-etc-selinux\") pod \"aws-ebs-csi-driver-node-5trjw\" (UID: \"f0208365-c78b-4378-bb0a-ccc84a1b726b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5trjw" May 22 10:35:11.122636 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.122494 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-systemd-units\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.122636 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.122568 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-host-slash\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.122636 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.122599 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-host-run-netns\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.122851 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.122639 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-etc-tuned\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.122851 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.122664 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5a26bab0-ee1f-4322-9413-91c337de805a-host\") pod \"node-ca-cxx7z\" (UID: \"5a26bab0-ee1f-4322-9413-91c337de805a\") " pod="openshift-image-registry/node-ca-cxx7z" May 22 10:35:11.122851 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.122717 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-etc-openvswitch\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.122851 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.122762 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-node-log\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.122851 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.122790 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-host-cni-netd\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.122851 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.122835 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0265449b-fdb7-4537-a446-8d97653b2097-env-overrides\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.123078 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.122869 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-etc-modprobe-d\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.123078 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.122898 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-run-systemd\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.123078 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.122925 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-var-lib-openvswitch\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.123078 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.122951 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-etc-kubernetes\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.123078 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.122974 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-sys\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.123078 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.123000 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f0208365-c78b-4378-bb0a-ccc84a1b726b-socket-dir\") pod \"aws-ebs-csi-driver-node-5trjw\" (UID: \"f0208365-c78b-4378-bb0a-ccc84a1b726b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5trjw" May 22 10:35:11.123078 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.123031 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f0208365-c78b-4378-bb0a-ccc84a1b726b-sys-fs\") pod \"aws-ebs-csi-driver-node-5trjw\" (UID: \"f0208365-c78b-4378-bb0a-ccc84a1b726b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5trjw" May 22 10:35:11.123078 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.123056 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6vp5\" (UniqueName: \"kubernetes.io/projected/f0208365-c78b-4378-bb0a-ccc84a1b726b-kube-api-access-k6vp5\") pod \"aws-ebs-csi-driver-node-5trjw\" (UID: \"f0208365-c78b-4378-bb0a-ccc84a1b726b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5trjw" May 22 10:35:11.123465 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.123081 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bkfv\" (UniqueName: \"kubernetes.io/projected/63a0f782-b151-4b2a-be81-d0025df9fb35-kube-api-access-2bkfv\") pod \"network-check-target-ncpgn\" (UID: \"63a0f782-b151-4b2a-be81-d0025df9fb35\") " pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:35:11.123465 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.123100 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-host-cni-bin\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.123465 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.123118 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0265449b-fdb7-4537-a446-8d97653b2097-ovn-node-metrics-cert\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.123465 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.123159 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0265449b-fdb7-4537-a446-8d97653b2097-ovnkube-script-lib\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.123465 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.123188 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-etc-sysconfig\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.123465 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.123220 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f0208365-c78b-4378-bb0a-ccc84a1b726b-registration-dir\") pod \"aws-ebs-csi-driver-node-5trjw\" (UID: \"f0208365-c78b-4378-bb0a-ccc84a1b726b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5trjw" May 22 10:35:11.123465 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.123252 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0265449b-fdb7-4537-a446-8d97653b2097-ovnkube-config\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.123465 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.123303 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl4pp\" (UniqueName: \"kubernetes.io/projected/0265449b-fdb7-4537-a446-8d97653b2097-kube-api-access-dl4pp\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.123465 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.123328 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-tmp\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.123465 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.123410 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 22 10:35:11.123465 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.123432 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48nrl\" (UniqueName: \"kubernetes.io/projected/5a26bab0-ee1f-4322-9413-91c337de805a-kube-api-access-48nrl\") pod \"node-ca-cxx7z\" (UID: \"5a26bab0-ee1f-4322-9413-91c337de805a\") " pod="openshift-image-registry/node-ca-cxx7z" May 22 10:35:11.124069 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.123456 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f0208365-c78b-4378-bb0a-ccc84a1b726b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5trjw\" (UID: \"f0208365-c78b-4378-bb0a-ccc84a1b726b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5trjw" May 22 10:35:11.124069 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.123521 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f0208365-c78b-4378-bb0a-ccc84a1b726b-device-dir\") pod \"aws-ebs-csi-driver-node-5trjw\" (UID: \"f0208365-c78b-4378-bb0a-ccc84a1b726b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5trjw" May 22 10:35:11.124069 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.123661 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 22 10:35:11.124069 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.123756 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5rhtw\"" May 22 10:35:11.124069 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.123960 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 22 10:35:11.124069 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.124048 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 22 10:35:11.124377 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.124113 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 22 10:35:11.124377 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.124161 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sg6xt\"" May 22 10:35:11.124377 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.124218 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 22 10:35:11.124629 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.124610 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r5lqn" May 22 10:35:11.126131 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.125979 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 22 10:35:11.126555 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.126428 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-shddp\"" May 22 10:35:11.126759 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.126728 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 22 10:35:11.126983 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.126969 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:11.127052 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:11.127028 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t6q7" podUID="d7db0942-cfd5-4727-b490-62198c86d1e6" May 22 10:35:11.155276 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.155244 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-21 10:30:10 +0000 UTC" deadline="2027-12-15 15:09:26.115125967 +0000 UTC" May 22 10:35:11.155276 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.155276 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13732h34m14.959853238s" May 22 10:35:11.189025 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.189003 2558 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 22 10:35:11.213391 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.213368 2558 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 22 10:35:11.224152 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224127 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-host-var-lib-kubelet\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.224299 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224171 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-host-cni-netd\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.224299 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224206 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0265449b-fdb7-4537-a446-8d97653b2097-env-overrides\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.224299 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224220 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-host-cni-netd\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.224299 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224228 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-host-var-lib-cni-multus\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.224299 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224245 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-multus-conf-dir\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.224299 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224263 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-host-run-multus-certs\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.224299 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224288 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dj79\" (UniqueName: \"kubernetes.io/projected/206f863a-6549-4ed7-9b1c-3a20fd243d51-kube-api-access-4dj79\") pod \"node-resolver-7mj84\" (UID: \"206f863a-6549-4ed7-9b1c-3a20fd243d51\") " pod="openshift-dns/node-resolver-7mj84" May 22 10:35:11.224632 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224312 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cb2a30bd-3761-45fe-80d6-b247b6ef6a31-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r5lqn\" (UID: \"cb2a30bd-3761-45fe-80d6-b247b6ef6a31\") " pod="openshift-multus/multus-additional-cni-plugins-r5lqn" May 22 10:35:11.224632 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224353 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-run-systemd\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.224632 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224372 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-var-lib-openvswitch\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.224632 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224396 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-etc-kubernetes\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.224632 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224420 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-sys\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.224632 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224434 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-var-lib-openvswitch\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.224632 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224439 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-run-systemd\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.224632 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224440 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-tmp\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.224632 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224481 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-etc-kubernetes\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.224632 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224488 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-system-cni-dir\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.224632 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224510 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-sys\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.224632 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224517 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f0208365-c78b-4378-bb0a-ccc84a1b726b-socket-dir\") pod \"aws-ebs-csi-driver-node-5trjw\" (UID: \"f0208365-c78b-4378-bb0a-ccc84a1b726b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5trjw" May 22 10:35:11.224632 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224539 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k6vp5\" (UniqueName: \"kubernetes.io/projected/f0208365-c78b-4378-bb0a-ccc84a1b726b-kube-api-access-k6vp5\") pod \"aws-ebs-csi-driver-node-5trjw\" (UID: \"f0208365-c78b-4378-bb0a-ccc84a1b726b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5trjw" May 22 10:35:11.224632 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224560 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2bkfv\" (UniqueName: \"kubernetes.io/projected/63a0f782-b151-4b2a-be81-d0025df9fb35-kube-api-access-2bkfv\") pod \"network-check-target-ncpgn\" (UID: \"63a0f782-b151-4b2a-be81-d0025df9fb35\") " pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:35:11.224632 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224582 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0265449b-fdb7-4537-a446-8d97653b2097-ovn-node-metrics-cert\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.224632 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224603 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f0208365-c78b-4378-bb0a-ccc84a1b726b-registration-dir\") pod \"aws-ebs-csi-driver-node-5trjw\" (UID: \"f0208365-c78b-4378-bb0a-ccc84a1b726b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5trjw" May 22 10:35:11.224632 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224625 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0265449b-fdb7-4537-a446-8d97653b2097-ovnkube-config\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.225391 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224647 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dl4pp\" (UniqueName: \"kubernetes.io/projected/0265449b-fdb7-4537-a446-8d97653b2097-kube-api-access-dl4pp\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.225391 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224669 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-48nrl\" (UniqueName: \"kubernetes.io/projected/5a26bab0-ee1f-4322-9413-91c337de805a-kube-api-access-48nrl\") pod \"node-ca-cxx7z\" (UID: \"5a26bab0-ee1f-4322-9413-91c337de805a\") " pod="openshift-image-registry/node-ca-cxx7z" May 22 10:35:11.225391 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224722 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0265449b-fdb7-4537-a446-8d97653b2097-env-overrides\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.225391 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224748 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 22 10:35:11.225391 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224785 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f0208365-c78b-4378-bb0a-ccc84a1b726b-registration-dir\") pod \"aws-ebs-csi-driver-node-5trjw\" (UID: \"f0208365-c78b-4378-bb0a-ccc84a1b726b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5trjw" May 22 10:35:11.225391 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224822 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f0208365-c78b-4378-bb0a-ccc84a1b726b-device-dir\") pod \"aws-ebs-csi-driver-node-5trjw\" (UID: \"f0208365-c78b-4378-bb0a-ccc84a1b726b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5trjw" May 22 10:35:11.225391 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224848 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-host-kubelet\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.225391 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224870 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-lib-modules\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.225391 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224896 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-host-var-lib-cni-bin\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.225391 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224918 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb2a30bd-3761-45fe-80d6-b247b6ef6a31-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r5lqn\" (UID: \"cb2a30bd-3761-45fe-80d6-b247b6ef6a31\") " pod="openshift-multus/multus-additional-cni-plugins-r5lqn" May 22 10:35:11.225391 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224942 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-run-ovn\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.225391 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224969 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-log-socket\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.225391 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.224993 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-host-run-ovn-kubernetes\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.225391 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225015 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-etc-systemd\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.225391 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225039 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-cnibin\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.225391 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225073 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-run\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.225391 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225097 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5a26bab0-ee1f-4322-9413-91c337de805a-serviceca\") pod \"node-ca-cxx7z\" (UID: \"5a26bab0-ee1f-4322-9413-91c337de805a\") " pod="openshift-image-registry/node-ca-cxx7z" May 22 10:35:11.225391 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225107 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-lib-modules\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.226133 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225120 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f0208365-c78b-4378-bb0a-ccc84a1b726b-device-dir\") pod \"aws-ebs-csi-driver-node-5trjw\" (UID: \"f0208365-c78b-4378-bb0a-ccc84a1b726b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5trjw" May 22 10:35:11.226133 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225128 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-hostroot\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.226133 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225166 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-host-kubelet\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.226133 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225174 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cb2a30bd-3761-45fe-80d6-b247b6ef6a31-os-release\") pod \"multus-additional-cni-plugins-r5lqn\" (UID: \"cb2a30bd-3761-45fe-80d6-b247b6ef6a31\") " pod="openshift-multus/multus-additional-cni-plugins-r5lqn" May 22 10:35:11.226133 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225198 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0265449b-fdb7-4537-a446-8d97653b2097-ovnkube-config\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.226133 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225207 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-host-run-ovn-kubernetes\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.226133 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225219 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-run-ovn\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.226133 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225223 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-etc-systemd\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.226133 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225259 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-systemd-units\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.226133 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225262 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-run\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.226133 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225316 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-systemd-units\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.226133 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225360 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f0208365-c78b-4378-bb0a-ccc84a1b726b-socket-dir\") pod \"aws-ebs-csi-driver-node-5trjw\" (UID: \"f0208365-c78b-4378-bb0a-ccc84a1b726b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5trjw" May 22 10:35:11.226133 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225317 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-log-socket\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.226133 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225381 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-host-slash\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.226133 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225404 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-host-slash\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.226133 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225408 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-host-run-netns\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.226133 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225429 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-host-run-netns\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.226133 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225432 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-etc-tuned\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.226924 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225461 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-multus-cni-dir\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.226924 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225487 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/206f863a-6549-4ed7-9b1c-3a20fd243d51-hosts-file\") pod \"node-resolver-7mj84\" (UID: \"206f863a-6549-4ed7-9b1c-3a20fd243d51\") " pod="openshift-dns/node-resolver-7mj84" May 22 10:35:11.226924 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225515 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-etc-openvswitch\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.226924 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225540 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-node-log\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.226924 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225580 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-etc-openvswitch\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.226924 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225584 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-node-log\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.226924 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225603 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-etc-modprobe-d\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.226924 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225634 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjfx8\" (UniqueName: \"kubernetes.io/projected/cb2a30bd-3761-45fe-80d6-b247b6ef6a31-kube-api-access-cjfx8\") pod \"multus-additional-cni-plugins-r5lqn\" (UID: \"cb2a30bd-3761-45fe-80d6-b247b6ef6a31\") " pod="openshift-multus/multus-additional-cni-plugins-r5lqn" May 22 10:35:11.226924 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225662 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7db0942-cfd5-4727-b490-62198c86d1e6-metrics-certs\") pod \"network-metrics-daemon-4t6q7\" (UID: \"d7db0942-cfd5-4727-b490-62198c86d1e6\") " pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:11.226924 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225605 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5a26bab0-ee1f-4322-9413-91c337de805a-serviceca\") pod \"node-ca-cxx7z\" (UID: \"5a26bab0-ee1f-4322-9413-91c337de805a\") " pod="openshift-image-registry/node-ca-cxx7z" May 22 10:35:11.226924 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225674 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-etc-modprobe-d\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.226924 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225687 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9qsq\" (UniqueName: \"kubernetes.io/projected/d7db0942-cfd5-4727-b490-62198c86d1e6-kube-api-access-z9qsq\") pod \"network-metrics-daemon-4t6q7\" (UID: \"d7db0942-cfd5-4727-b490-62198c86d1e6\") " pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:11.226924 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225720 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-os-release\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.226924 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225739 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-multus-socket-dir-parent\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.226924 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225758 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-host-run-netns\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.226924 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225781 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c90a0bcb-768c-44de-a10f-52e897159e53-iptables-alerter-script\") pod \"iptables-alerter-84gt5\" (UID: \"c90a0bcb-768c-44de-a10f-52e897159e53\") " pod="openshift-network-operator/iptables-alerter-84gt5" May 22 10:35:11.226924 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225797 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb2a30bd-3761-45fe-80d6-b247b6ef6a31-cnibin\") pod \"multus-additional-cni-plugins-r5lqn\" (UID: \"cb2a30bd-3761-45fe-80d6-b247b6ef6a31\") " pod="openshift-multus/multus-additional-cni-plugins-r5lqn" May 22 10:35:11.227471 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225812 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb2a30bd-3761-45fe-80d6-b247b6ef6a31-cni-binary-copy\") pod \"multus-additional-cni-plugins-r5lqn\" (UID: \"cb2a30bd-3761-45fe-80d6-b247b6ef6a31\") " pod="openshift-multus/multus-additional-cni-plugins-r5lqn" May 22 10:35:11.227471 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225849 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f0208365-c78b-4378-bb0a-ccc84a1b726b-sys-fs\") pod \"aws-ebs-csi-driver-node-5trjw\" (UID: \"f0208365-c78b-4378-bb0a-ccc84a1b726b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5trjw" May 22 10:35:11.227471 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225878 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-host-cni-bin\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.227471 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225901 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0265449b-fdb7-4537-a446-8d97653b2097-ovnkube-script-lib\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.227471 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225921 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-etc-sysconfig\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.227471 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225944 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f0208365-c78b-4378-bb0a-ccc84a1b726b-sys-fs\") pod \"aws-ebs-csi-driver-node-5trjw\" (UID: \"f0208365-c78b-4378-bb0a-ccc84a1b726b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5trjw" May 22 10:35:11.227471 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225947 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgzzg\" (UniqueName: \"kubernetes.io/projected/c90a0bcb-768c-44de-a10f-52e897159e53-kube-api-access-zgzzg\") pod \"iptables-alerter-84gt5\" (UID: \"c90a0bcb-768c-44de-a10f-52e897159e53\") " pod="openshift-network-operator/iptables-alerter-84gt5" May 22 10:35:11.227471 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225980 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb2a30bd-3761-45fe-80d6-b247b6ef6a31-system-cni-dir\") pod \"multus-additional-cni-plugins-r5lqn\" (UID: \"cb2a30bd-3761-45fe-80d6-b247b6ef6a31\") " pod="openshift-multus/multus-additional-cni-plugins-r5lqn" May 22 10:35:11.227471 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.226003 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-etc-sysconfig\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.227471 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.226008 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f78a7232-2308-46d7-b2c5-73e50d71fd25-konnectivity-ca\") pod \"konnectivity-agent-6f7c6\" (UID: \"f78a7232-2308-46d7-b2c5-73e50d71fd25\") " pod="kube-system/konnectivity-agent-6f7c6" May 22 10:35:11.227471 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.225946 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-host-cni-bin\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.227471 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.226047 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-multus-daemon-config\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.227471 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.226082 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-etc-kubernetes\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.227471 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.226109 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/206f863a-6549-4ed7-9b1c-3a20fd243d51-tmp-dir\") pod \"node-resolver-7mj84\" (UID: \"206f863a-6549-4ed7-9b1c-3a20fd243d51\") " pod="openshift-dns/node-resolver-7mj84" May 22 10:35:11.227471 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.226137 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f0208365-c78b-4378-bb0a-ccc84a1b726b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5trjw\" (UID: \"f0208365-c78b-4378-bb0a-ccc84a1b726b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5trjw" May 22 10:35:11.227471 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.226175 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-run-openvswitch\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.227471 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.226219 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f0208365-c78b-4378-bb0a-ccc84a1b726b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5trjw\" (UID: \"f0208365-c78b-4378-bb0a-ccc84a1b726b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5trjw" May 22 10:35:11.228133 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.226256 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-var-lib-kubelet\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.228133 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.226281 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-run-openvswitch\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.228133 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.226325 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qzrwf\" (UniqueName: \"kubernetes.io/projected/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-kube-api-access-qzrwf\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.228133 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.226377 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-host-run-k8s-cni-cncf-io\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.228133 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.226405 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-etc-sysctl-d\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.228133 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.226443 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-etc-sysctl-conf\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.228133 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.226413 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-var-lib-kubelet\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.228133 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.226524 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0265449b-fdb7-4537-a446-8d97653b2097-ovnkube-script-lib\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.228133 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.226534 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-etc-sysctl-d\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.228133 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.226579 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbrsk\" (UniqueName: \"kubernetes.io/projected/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-kube-api-access-vbrsk\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.228133 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.226618 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.228133 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.226645 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-host\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.228133 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.226658 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0265449b-fdb7-4537-a446-8d97653b2097-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.228133 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.226670 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-cni-binary-copy\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.228133 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.226661 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-etc-sysctl-conf\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.228133 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.226680 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-host\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.228133 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.226694 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c90a0bcb-768c-44de-a10f-52e897159e53-host-slash\") pod \"iptables-alerter-84gt5\" (UID: \"c90a0bcb-768c-44de-a10f-52e897159e53\") " pod="openshift-network-operator/iptables-alerter-84gt5" May 22 10:35:11.228658 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.226725 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cb2a30bd-3761-45fe-80d6-b247b6ef6a31-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r5lqn\" (UID: \"cb2a30bd-3761-45fe-80d6-b247b6ef6a31\") " pod="openshift-multus/multus-additional-cni-plugins-r5lqn" May 22 10:35:11.228658 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.226754 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f0208365-c78b-4378-bb0a-ccc84a1b726b-etc-selinux\") pod \"aws-ebs-csi-driver-node-5trjw\" (UID: \"f0208365-c78b-4378-bb0a-ccc84a1b726b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5trjw" May 22 10:35:11.228658 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.226786 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5a26bab0-ee1f-4322-9413-91c337de805a-host\") pod \"node-ca-cxx7z\" (UID: \"5a26bab0-ee1f-4322-9413-91c337de805a\") " pod="openshift-image-registry/node-ca-cxx7z" May 22 10:35:11.228658 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.226816 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f78a7232-2308-46d7-b2c5-73e50d71fd25-agent-certs\") pod \"konnectivity-agent-6f7c6\" (UID: \"f78a7232-2308-46d7-b2c5-73e50d71fd25\") " pod="kube-system/konnectivity-agent-6f7c6" May 22 10:35:11.228658 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.226865 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5a26bab0-ee1f-4322-9413-91c337de805a-host\") pod \"node-ca-cxx7z\" (UID: \"5a26bab0-ee1f-4322-9413-91c337de805a\") " pod="openshift-image-registry/node-ca-cxx7z" May 22 10:35:11.228658 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.226864 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f0208365-c78b-4378-bb0a-ccc84a1b726b-etc-selinux\") pod \"aws-ebs-csi-driver-node-5trjw\" (UID: \"f0208365-c78b-4378-bb0a-ccc84a1b726b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5trjw" May 22 10:35:11.228658 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.228163 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-etc-tuned\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.229231 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.229216 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-tmp\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.230890 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.230872 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0265449b-fdb7-4537-a446-8d97653b2097-ovn-node-metrics-cert\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.234167 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:11.234141 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 22 10:35:11.234261 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:11.234173 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 22 10:35:11.234261 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:11.234194 2558 projected.go:194] Error preparing data for projected volume kube-api-access-2bkfv for pod openshift-network-diagnostics/network-check-target-ncpgn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 22 10:35:11.234400 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:11.234263 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/63a0f782-b151-4b2a-be81-d0025df9fb35-kube-api-access-2bkfv podName:63a0f782-b151-4b2a-be81-d0025df9fb35 nodeName:}" failed. No retries permitted until 2026-05-22 10:35:11.734237227 +0000 UTC m=+3.041496965 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2bkfv" (UniqueName: "kubernetes.io/projected/63a0f782-b151-4b2a-be81-d0025df9fb35-kube-api-access-2bkfv") pod "network-check-target-ncpgn" (UID: "63a0f782-b151-4b2a-be81-d0025df9fb35") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 22 10:35:11.236785 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.236761 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzrwf\" (UniqueName: \"kubernetes.io/projected/e5fa7e55-73a3-4cec-bb73-fd75f35e3962-kube-api-access-qzrwf\") pod \"tuned-zgshg\" (UID: \"e5fa7e55-73a3-4cec-bb73-fd75f35e3962\") " pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.236785 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.236777 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6vp5\" (UniqueName: \"kubernetes.io/projected/f0208365-c78b-4378-bb0a-ccc84a1b726b-kube-api-access-k6vp5\") pod \"aws-ebs-csi-driver-node-5trjw\" (UID: \"f0208365-c78b-4378-bb0a-ccc84a1b726b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5trjw" May 22 10:35:11.237101 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.237083 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl4pp\" (UniqueName: \"kubernetes.io/projected/0265449b-fdb7-4537-a446-8d97653b2097-kube-api-access-dl4pp\") pod \"ovnkube-node-jzgxh\" (UID: \"0265449b-fdb7-4537-a446-8d97653b2097\") " pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.237163 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.237085 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48nrl\" (UniqueName: \"kubernetes.io/projected/5a26bab0-ee1f-4322-9413-91c337de805a-kube-api-access-48nrl\") pod \"node-ca-cxx7z\" (UID: \"5a26bab0-ee1f-4322-9413-91c337de805a\") " pod="openshift-image-registry/node-ca-cxx7z" May 22 10:35:11.254897 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.254852 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-186.ec2.internal" event={"ID":"b95c5d1fb0379c406cc76e5fce61434d","Type":"ContainerStarted","Data":"b593de8c59bee94a9e8a7032386c5d016527c809318efe590b4983010c64d54f"} May 22 10:35:11.256020 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.255978 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal" event={"ID":"fad8f2e01fa8e9d10bf87b1689efd852","Type":"ContainerStarted","Data":"f8170458a86c20b1d7337ce7bd7b34afbd4261a3e9b0fc91d1d7e9da762f91f3"} May 22 10:35:11.327119 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327081 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-system-cni-dir\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.327283 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327155 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-host-var-lib-cni-bin\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.327283 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327180 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb2a30bd-3761-45fe-80d6-b247b6ef6a31-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r5lqn\" (UID: \"cb2a30bd-3761-45fe-80d6-b247b6ef6a31\") " pod="openshift-multus/multus-additional-cni-plugins-r5lqn" May 22 10:35:11.327283 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327184 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-system-cni-dir\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.327283 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327199 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-cnibin\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.327283 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327243 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-hostroot\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.327283 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327254 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-cnibin\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.327283 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327265 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cb2a30bd-3761-45fe-80d6-b247b6ef6a31-os-release\") pod \"multus-additional-cni-plugins-r5lqn\" (UID: \"cb2a30bd-3761-45fe-80d6-b247b6ef6a31\") " pod="openshift-multus/multus-additional-cni-plugins-r5lqn" May 22 10:35:11.327639 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327280 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-host-var-lib-cni-bin\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.327639 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327303 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-hostroot\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.327639 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327296 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-multus-cni-dir\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.327639 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327360 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/206f863a-6549-4ed7-9b1c-3a20fd243d51-hosts-file\") pod \"node-resolver-7mj84\" (UID: \"206f863a-6549-4ed7-9b1c-3a20fd243d51\") " pod="openshift-dns/node-resolver-7mj84" May 22 10:35:11.327639 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327378 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-multus-cni-dir\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.327639 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327378 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cb2a30bd-3761-45fe-80d6-b247b6ef6a31-os-release\") pod \"multus-additional-cni-plugins-r5lqn\" (UID: \"cb2a30bd-3761-45fe-80d6-b247b6ef6a31\") " pod="openshift-multus/multus-additional-cni-plugins-r5lqn" May 22 10:35:11.327639 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327391 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cjfx8\" (UniqueName: \"kubernetes.io/projected/cb2a30bd-3761-45fe-80d6-b247b6ef6a31-kube-api-access-cjfx8\") pod \"multus-additional-cni-plugins-r5lqn\" (UID: \"cb2a30bd-3761-45fe-80d6-b247b6ef6a31\") " pod="openshift-multus/multus-additional-cni-plugins-r5lqn" May 22 10:35:11.327639 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327410 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7db0942-cfd5-4727-b490-62198c86d1e6-metrics-certs\") pod \"network-metrics-daemon-4t6q7\" (UID: \"d7db0942-cfd5-4727-b490-62198c86d1e6\") " pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:11.327639 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327429 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z9qsq\" (UniqueName: \"kubernetes.io/projected/d7db0942-cfd5-4727-b490-62198c86d1e6-kube-api-access-z9qsq\") pod \"network-metrics-daemon-4t6q7\" (UID: \"d7db0942-cfd5-4727-b490-62198c86d1e6\") " pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:11.327639 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327446 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-os-release\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.327639 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327446 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb2a30bd-3761-45fe-80d6-b247b6ef6a31-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r5lqn\" (UID: \"cb2a30bd-3761-45fe-80d6-b247b6ef6a31\") " pod="openshift-multus/multus-additional-cni-plugins-r5lqn" May 22 10:35:11.327639 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327469 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-multus-socket-dir-parent\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.327639 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327477 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/206f863a-6549-4ed7-9b1c-3a20fd243d51-hosts-file\") pod \"node-resolver-7mj84\" (UID: \"206f863a-6549-4ed7-9b1c-3a20fd243d51\") " pod="openshift-dns/node-resolver-7mj84" May 22 10:35:11.327639 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327484 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-host-run-netns\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.327639 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327513 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-host-run-netns\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.327639 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327512 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c90a0bcb-768c-44de-a10f-52e897159e53-iptables-alerter-script\") pod \"iptables-alerter-84gt5\" (UID: \"c90a0bcb-768c-44de-a10f-52e897159e53\") " pod="openshift-network-operator/iptables-alerter-84gt5" May 22 10:35:11.327639 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:11.327530 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 22 10:35:11.327639 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327558 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-multus-socket-dir-parent\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.328556 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:11.327590 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7db0942-cfd5-4727-b490-62198c86d1e6-metrics-certs podName:d7db0942-cfd5-4727-b490-62198c86d1e6 nodeName:}" failed. No retries permitted until 2026-05-22 10:35:11.827574918 +0000 UTC m=+3.134834675 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d7db0942-cfd5-4727-b490-62198c86d1e6-metrics-certs") pod "network-metrics-daemon-4t6q7" (UID: "d7db0942-cfd5-4727-b490-62198c86d1e6") : object "openshift-multus"/"metrics-daemon-secret" not registered May 22 10:35:11.328556 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327597 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-os-release\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.328556 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327633 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb2a30bd-3761-45fe-80d6-b247b6ef6a31-cnibin\") pod \"multus-additional-cni-plugins-r5lqn\" (UID: \"cb2a30bd-3761-45fe-80d6-b247b6ef6a31\") " pod="openshift-multus/multus-additional-cni-plugins-r5lqn" May 22 10:35:11.328556 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327649 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb2a30bd-3761-45fe-80d6-b247b6ef6a31-cni-binary-copy\") pod \"multus-additional-cni-plugins-r5lqn\" (UID: \"cb2a30bd-3761-45fe-80d6-b247b6ef6a31\") " pod="openshift-multus/multus-additional-cni-plugins-r5lqn" May 22 10:35:11.328556 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327666 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zgzzg\" (UniqueName: \"kubernetes.io/projected/c90a0bcb-768c-44de-a10f-52e897159e53-kube-api-access-zgzzg\") pod \"iptables-alerter-84gt5\" (UID: \"c90a0bcb-768c-44de-a10f-52e897159e53\") " pod="openshift-network-operator/iptables-alerter-84gt5" May 22 10:35:11.328556 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327667 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb2a30bd-3761-45fe-80d6-b247b6ef6a31-cnibin\") pod \"multus-additional-cni-plugins-r5lqn\" (UID: \"cb2a30bd-3761-45fe-80d6-b247b6ef6a31\") " pod="openshift-multus/multus-additional-cni-plugins-r5lqn" May 22 10:35:11.328556 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327682 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb2a30bd-3761-45fe-80d6-b247b6ef6a31-system-cni-dir\") pod \"multus-additional-cni-plugins-r5lqn\" (UID: \"cb2a30bd-3761-45fe-80d6-b247b6ef6a31\") " pod="openshift-multus/multus-additional-cni-plugins-r5lqn" May 22 10:35:11.328556 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327701 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f78a7232-2308-46d7-b2c5-73e50d71fd25-konnectivity-ca\") pod \"konnectivity-agent-6f7c6\" (UID: \"f78a7232-2308-46d7-b2c5-73e50d71fd25\") " pod="kube-system/konnectivity-agent-6f7c6" May 22 10:35:11.328556 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327727 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-multus-daemon-config\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.328556 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327744 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-etc-kubernetes\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.328556 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327758 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb2a30bd-3761-45fe-80d6-b247b6ef6a31-system-cni-dir\") pod \"multus-additional-cni-plugins-r5lqn\" (UID: \"cb2a30bd-3761-45fe-80d6-b247b6ef6a31\") " pod="openshift-multus/multus-additional-cni-plugins-r5lqn" May 22 10:35:11.328556 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327763 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/206f863a-6549-4ed7-9b1c-3a20fd243d51-tmp-dir\") pod \"node-resolver-7mj84\" (UID: \"206f863a-6549-4ed7-9b1c-3a20fd243d51\") " pod="openshift-dns/node-resolver-7mj84" May 22 10:35:11.328556 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327809 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-host-run-k8s-cni-cncf-io\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.328556 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327837 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vbrsk\" (UniqueName: \"kubernetes.io/projected/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-kube-api-access-vbrsk\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.328556 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327864 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-cni-binary-copy\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.328556 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327888 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c90a0bcb-768c-44de-a10f-52e897159e53-host-slash\") pod \"iptables-alerter-84gt5\" (UID: \"c90a0bcb-768c-44de-a10f-52e897159e53\") " pod="openshift-network-operator/iptables-alerter-84gt5" May 22 10:35:11.329250 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327906 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cb2a30bd-3761-45fe-80d6-b247b6ef6a31-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r5lqn\" (UID: \"cb2a30bd-3761-45fe-80d6-b247b6ef6a31\") " pod="openshift-multus/multus-additional-cni-plugins-r5lqn" May 22 10:35:11.329250 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327925 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f78a7232-2308-46d7-b2c5-73e50d71fd25-agent-certs\") pod \"konnectivity-agent-6f7c6\" (UID: \"f78a7232-2308-46d7-b2c5-73e50d71fd25\") " pod="kube-system/konnectivity-agent-6f7c6" May 22 10:35:11.329250 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327941 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-host-var-lib-kubelet\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.329250 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327959 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-host-var-lib-cni-multus\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.329250 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327974 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-multus-conf-dir\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.329250 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.327988 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-host-run-multus-certs\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.329250 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.328011 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4dj79\" (UniqueName: \"kubernetes.io/projected/206f863a-6549-4ed7-9b1c-3a20fd243d51-kube-api-access-4dj79\") pod \"node-resolver-7mj84\" (UID: \"206f863a-6549-4ed7-9b1c-3a20fd243d51\") " pod="openshift-dns/node-resolver-7mj84" May 22 10:35:11.329250 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.328028 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cb2a30bd-3761-45fe-80d6-b247b6ef6a31-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r5lqn\" (UID: \"cb2a30bd-3761-45fe-80d6-b247b6ef6a31\") " pod="openshift-multus/multus-additional-cni-plugins-r5lqn" May 22 10:35:11.329250 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.328029 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/206f863a-6549-4ed7-9b1c-3a20fd243d51-tmp-dir\") pod \"node-resolver-7mj84\" (UID: \"206f863a-6549-4ed7-9b1c-3a20fd243d51\") " pod="openshift-dns/node-resolver-7mj84" May 22 10:35:11.329250 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.328041 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c90a0bcb-768c-44de-a10f-52e897159e53-iptables-alerter-script\") pod \"iptables-alerter-84gt5\" (UID: \"c90a0bcb-768c-44de-a10f-52e897159e53\") " pod="openshift-network-operator/iptables-alerter-84gt5" May 22 10:35:11.329250 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.328097 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-etc-kubernetes\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.329250 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.328195 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb2a30bd-3761-45fe-80d6-b247b6ef6a31-cni-binary-copy\") pod \"multus-additional-cni-plugins-r5lqn\" (UID: \"cb2a30bd-3761-45fe-80d6-b247b6ef6a31\") " pod="openshift-multus/multus-additional-cni-plugins-r5lqn" May 22 10:35:11.329250 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.328244 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c90a0bcb-768c-44de-a10f-52e897159e53-host-slash\") pod \"iptables-alerter-84gt5\" (UID: \"c90a0bcb-768c-44de-a10f-52e897159e53\") " pod="openshift-network-operator/iptables-alerter-84gt5" May 22 10:35:11.329250 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.328428 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f78a7232-2308-46d7-b2c5-73e50d71fd25-konnectivity-ca\") pod \"konnectivity-agent-6f7c6\" (UID: \"f78a7232-2308-46d7-b2c5-73e50d71fd25\") " pod="kube-system/konnectivity-agent-6f7c6" May 22 10:35:11.329250 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.328497 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-multus-conf-dir\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.329250 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.328547 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-host-var-lib-kubelet\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.329250 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.328587 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-host-var-lib-cni-multus\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.329946 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.328630 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-host-run-multus-certs\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.329946 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.328663 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cb2a30bd-3761-45fe-80d6-b247b6ef6a31-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r5lqn\" (UID: \"cb2a30bd-3761-45fe-80d6-b247b6ef6a31\") " pod="openshift-multus/multus-additional-cni-plugins-r5lqn" May 22 10:35:11.329946 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.328668 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-host-run-k8s-cni-cncf-io\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.329946 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.328707 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-cni-binary-copy\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.329946 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.328763 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cb2a30bd-3761-45fe-80d6-b247b6ef6a31-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r5lqn\" (UID: \"cb2a30bd-3761-45fe-80d6-b247b6ef6a31\") " pod="openshift-multus/multus-additional-cni-plugins-r5lqn" May 22 10:35:11.329946 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.329118 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-multus-daemon-config\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.330909 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.330890 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f78a7232-2308-46d7-b2c5-73e50d71fd25-agent-certs\") pod \"konnectivity-agent-6f7c6\" (UID: \"f78a7232-2308-46d7-b2c5-73e50d71fd25\") " pod="kube-system/konnectivity-agent-6f7c6" May 22 10:35:11.341021 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.340992 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgzzg\" (UniqueName: \"kubernetes.io/projected/c90a0bcb-768c-44de-a10f-52e897159e53-kube-api-access-zgzzg\") pod \"iptables-alerter-84gt5\" (UID: \"c90a0bcb-768c-44de-a10f-52e897159e53\") " pod="openshift-network-operator/iptables-alerter-84gt5" May 22 10:35:11.341136 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.341044 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjfx8\" (UniqueName: \"kubernetes.io/projected/cb2a30bd-3761-45fe-80d6-b247b6ef6a31-kube-api-access-cjfx8\") pod \"multus-additional-cni-plugins-r5lqn\" (UID: \"cb2a30bd-3761-45fe-80d6-b247b6ef6a31\") " pod="openshift-multus/multus-additional-cni-plugins-r5lqn" May 22 10:35:11.341667 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.341452 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbrsk\" (UniqueName: \"kubernetes.io/projected/9f91428b-8137-4a51-9b7e-1b7d8b8011fd-kube-api-access-vbrsk\") pod \"multus-6j2d5\" (UID: \"9f91428b-8137-4a51-9b7e-1b7d8b8011fd\") " pod="openshift-multus/multus-6j2d5" May 22 10:35:11.341667 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.341618 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dj79\" (UniqueName: \"kubernetes.io/projected/206f863a-6549-4ed7-9b1c-3a20fd243d51-kube-api-access-4dj79\") pod \"node-resolver-7mj84\" (UID: \"206f863a-6549-4ed7-9b1c-3a20fd243d51\") " pod="openshift-dns/node-resolver-7mj84" May 22 10:35:11.341667 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.341635 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9qsq\" (UniqueName: \"kubernetes.io/projected/d7db0942-cfd5-4727-b490-62198c86d1e6-kube-api-access-z9qsq\") pod \"network-metrics-daemon-4t6q7\" (UID: \"d7db0942-cfd5-4727-b490-62198c86d1e6\") " pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:11.419820 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.419746 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:11.427706 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.427677 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zgshg" May 22 10:35:11.438660 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.438636 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cxx7z" May 22 10:35:11.443280 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.443259 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5trjw" May 22 10:35:11.451021 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.451001 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-84gt5" May 22 10:35:11.457634 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.457613 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6f7c6" May 22 10:35:11.464318 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.464298 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7mj84" May 22 10:35:11.470991 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.470969 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6j2d5" May 22 10:35:11.475601 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.475582 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r5lqn" May 22 10:35:11.830779 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.830706 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2bkfv\" (UniqueName: \"kubernetes.io/projected/63a0f782-b151-4b2a-be81-d0025df9fb35-kube-api-access-2bkfv\") pod \"network-check-target-ncpgn\" (UID: \"63a0f782-b151-4b2a-be81-d0025df9fb35\") " pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:35:11.830779 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:11.830757 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7db0942-cfd5-4727-b490-62198c86d1e6-metrics-certs\") pod \"network-metrics-daemon-4t6q7\" (UID: \"d7db0942-cfd5-4727-b490-62198c86d1e6\") " pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:11.830981 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:11.830867 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 22 10:35:11.830981 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:11.830885 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 22 10:35:11.830981 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:11.830911 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 22 10:35:11.830981 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:11.830923 2558 projected.go:194] Error preparing data for projected volume kube-api-access-2bkfv for pod openshift-network-diagnostics/network-check-target-ncpgn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 22 10:35:11.830981 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:11.830939 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7db0942-cfd5-4727-b490-62198c86d1e6-metrics-certs podName:d7db0942-cfd5-4727-b490-62198c86d1e6 nodeName:}" failed. No retries permitted until 2026-05-22 10:35:12.830920285 +0000 UTC m=+4.138180023 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d7db0942-cfd5-4727-b490-62198c86d1e6-metrics-certs") pod "network-metrics-daemon-4t6q7" (UID: "d7db0942-cfd5-4727-b490-62198c86d1e6") : object "openshift-multus"/"metrics-daemon-secret" not registered May 22 10:35:11.830981 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:11.830979 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/63a0f782-b151-4b2a-be81-d0025df9fb35-kube-api-access-2bkfv podName:63a0f782-b151-4b2a-be81-d0025df9fb35 nodeName:}" failed. No retries permitted until 2026-05-22 10:35:12.830962535 +0000 UTC m=+4.138222273 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2bkfv" (UniqueName: "kubernetes.io/projected/63a0f782-b151-4b2a-be81-d0025df9fb35-kube-api-access-2bkfv") pod "network-check-target-ncpgn" (UID: "63a0f782-b151-4b2a-be81-d0025df9fb35") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 22 10:35:11.894642 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:11.894619 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc90a0bcb_768c_44de_a10f_52e897159e53.slice/crio-63cc187d5bf1cb560ca0c45279251bc8044575e1c3d821b4fad10418673c6302 WatchSource:0}: Error finding container 63cc187d5bf1cb560ca0c45279251bc8044575e1c3d821b4fad10418673c6302: Status 404 returned error can't find the container with id 63cc187d5bf1cb560ca0c45279251bc8044575e1c3d821b4fad10418673c6302 May 22 10:35:11.896252 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:11.896223 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0265449b_fdb7_4537_a446_8d97653b2097.slice/crio-87e9ee4bb86c6d7b550291b138757d0edd0f564ffd1f32565edb2348b3dc1b0c WatchSource:0}: Error finding container 87e9ee4bb86c6d7b550291b138757d0edd0f564ffd1f32565edb2348b3dc1b0c: Status 404 returned error can't find the container with id 87e9ee4bb86c6d7b550291b138757d0edd0f564ffd1f32565edb2348b3dc1b0c May 22 10:35:11.900815 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:11.900791 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5fa7e55_73a3_4cec_bb73_fd75f35e3962.slice/crio-0725a8d5e4ad680058ac1e3c06ff96f95f2f34a0cc35129107661679a34a7de0 WatchSource:0}: Error finding container 0725a8d5e4ad680058ac1e3c06ff96f95f2f34a0cc35129107661679a34a7de0: Status 404 returned error can't find the container with id 0725a8d5e4ad680058ac1e3c06ff96f95f2f34a0cc35129107661679a34a7de0 May 22 10:35:11.902773 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:11.902370 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod206f863a_6549_4ed7_9b1c_3a20fd243d51.slice/crio-273be31d378c43bfdbf5043355b214ae30b2c2edad052c8bc7a39bc73b99911c WatchSource:0}: Error finding container 273be31d378c43bfdbf5043355b214ae30b2c2edad052c8bc7a39bc73b99911c: Status 404 returned error can't find the container with id 273be31d378c43bfdbf5043355b214ae30b2c2edad052c8bc7a39bc73b99911c May 22 10:35:11.902773 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:35:11.902581 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f91428b_8137_4a51_9b7e_1b7d8b8011fd.slice/crio-76cf2e51f2f029bbaea39c2c31b20bc559cf5ba02f471c0f0f8b9414bcc5450a WatchSource:0}: Error finding container 76cf2e51f2f029bbaea39c2c31b20bc559cf5ba02f471c0f0f8b9414bcc5450a: Status 404 returned error can't find the container with id 76cf2e51f2f029bbaea39c2c31b20bc559cf5ba02f471c0f0f8b9414bcc5450a May 22 10:35:12.156526 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:12.156363 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-21 10:30:10 +0000 UTC" deadline="2028-01-02 13:17:26.637072107 +0000 UTC" May 22 10:35:12.156824 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:12.156527 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14162h42m14.480547615s" May 22 10:35:12.250140 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:12.250113 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:35:12.250285 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:12.250218 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncpgn" podUID="63a0f782-b151-4b2a-be81-d0025df9fb35" May 22 10:35:12.260094 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:12.260064 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-186.ec2.internal" event={"ID":"b95c5d1fb0379c406cc76e5fce61434d","Type":"ContainerStarted","Data":"30e1d9e0ed9f7e439ac45deea3d85636b6a03659fa19b1edd2896272aaae7ff8"} May 22 10:35:12.261731 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:12.261707 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zgshg" event={"ID":"e5fa7e55-73a3-4cec-bb73-fd75f35e3962","Type":"ContainerStarted","Data":"0725a8d5e4ad680058ac1e3c06ff96f95f2f34a0cc35129107661679a34a7de0"} May 22 10:35:12.264353 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:12.264308 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r5lqn" event={"ID":"cb2a30bd-3761-45fe-80d6-b247b6ef6a31","Type":"ContainerStarted","Data":"214cf3157ae25f79e32b9038742582731ef5ef12d617e766f7e61a01943c0f5e"} May 22 10:35:12.265397 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:12.265375 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6f7c6" event={"ID":"f78a7232-2308-46d7-b2c5-73e50d71fd25","Type":"ContainerStarted","Data":"389ce7130f713dca9dca4f803851f643de1933fcbea2eee3484fece8695a516d"} May 22 10:35:12.266492 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:12.266470 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5trjw" event={"ID":"f0208365-c78b-4378-bb0a-ccc84a1b726b","Type":"ContainerStarted","Data":"6f06c4a6777856845df32123d9418dca43e5dda241f51664db2a9f2358162967"} May 22 10:35:12.267616 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:12.267584 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7mj84" event={"ID":"206f863a-6549-4ed7-9b1c-3a20fd243d51","Type":"ContainerStarted","Data":"273be31d378c43bfdbf5043355b214ae30b2c2edad052c8bc7a39bc73b99911c"} May 22 10:35:12.268606 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:12.268575 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" event={"ID":"0265449b-fdb7-4537-a446-8d97653b2097","Type":"ContainerStarted","Data":"87e9ee4bb86c6d7b550291b138757d0edd0f564ffd1f32565edb2348b3dc1b0c"} May 22 10:35:12.269965 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:12.269933 2558 generic.go:358] "Generic (PLEG): container finished" podID="fad8f2e01fa8e9d10bf87b1689efd852" containerID="cfed88287a6809b15179127392488096d5752855c3e4781be4c36cda9c24492e" exitCode=0 May 22 10:35:12.270062 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:12.270004 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal" event={"ID":"fad8f2e01fa8e9d10bf87b1689efd852","Type":"ContainerDied","Data":"cfed88287a6809b15179127392488096d5752855c3e4781be4c36cda9c24492e"} May 22 10:35:12.271211 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:12.271189 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cxx7z" event={"ID":"5a26bab0-ee1f-4322-9413-91c337de805a","Type":"ContainerStarted","Data":"c1f00d6cb68988e8581eb273707cc4a11d1765f021af250d30e8a18f40eb9c28"} May 22 10:35:12.271391 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:12.271323 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-186.ec2.internal" podStartSLOduration=2.271310101 podStartE2EDuration="2.271310101s" podCreationTimestamp="2026-05-22 10:35:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-22 10:35:12.270864505 +0000 UTC m=+3.578124252" watchObservedRunningTime="2026-05-22 10:35:12.271310101 +0000 UTC m=+3.578569849" May 22 10:35:12.272388 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:12.272367 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6j2d5" event={"ID":"9f91428b-8137-4a51-9b7e-1b7d8b8011fd","Type":"ContainerStarted","Data":"76cf2e51f2f029bbaea39c2c31b20bc559cf5ba02f471c0f0f8b9414bcc5450a"} May 22 10:35:12.274064 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:12.274042 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-84gt5" event={"ID":"c90a0bcb-768c-44de-a10f-52e897159e53","Type":"ContainerStarted","Data":"63cc187d5bf1cb560ca0c45279251bc8044575e1c3d821b4fad10418673c6302"} May 22 10:35:12.842293 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:12.842204 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7db0942-cfd5-4727-b490-62198c86d1e6-metrics-certs\") pod \"network-metrics-daemon-4t6q7\" (UID: \"d7db0942-cfd5-4727-b490-62198c86d1e6\") " pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:12.842293 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:12.842287 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2bkfv\" (UniqueName: \"kubernetes.io/projected/63a0f782-b151-4b2a-be81-d0025df9fb35-kube-api-access-2bkfv\") pod \"network-check-target-ncpgn\" (UID: \"63a0f782-b151-4b2a-be81-d0025df9fb35\") " pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:35:12.842535 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:12.842440 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 22 10:35:12.842535 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:12.842458 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 22 10:35:12.842535 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:12.842470 2558 projected.go:194] Error preparing data for projected volume kube-api-access-2bkfv for pod openshift-network-diagnostics/network-check-target-ncpgn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 22 10:35:12.842535 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:12.842528 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/63a0f782-b151-4b2a-be81-d0025df9fb35-kube-api-access-2bkfv podName:63a0f782-b151-4b2a-be81-d0025df9fb35 nodeName:}" failed. No retries permitted until 2026-05-22 10:35:14.842510494 +0000 UTC m=+6.149770220 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2bkfv" (UniqueName: "kubernetes.io/projected/63a0f782-b151-4b2a-be81-d0025df9fb35-kube-api-access-2bkfv") pod "network-check-target-ncpgn" (UID: "63a0f782-b151-4b2a-be81-d0025df9fb35") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 22 10:35:12.842937 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:12.842918 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 22 10:35:12.842999 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:12.842974 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7db0942-cfd5-4727-b490-62198c86d1e6-metrics-certs podName:d7db0942-cfd5-4727-b490-62198c86d1e6 nodeName:}" failed. No retries permitted until 2026-05-22 10:35:14.84295939 +0000 UTC m=+6.150219121 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d7db0942-cfd5-4727-b490-62198c86d1e6-metrics-certs") pod "network-metrics-daemon-4t6q7" (UID: "d7db0942-cfd5-4727-b490-62198c86d1e6") : object "openshift-multus"/"metrics-daemon-secret" not registered May 22 10:35:12.852278 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:12.852253 2558 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 22 10:35:13.253546 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:13.252601 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:13.253546 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:13.252739 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t6q7" podUID="d7db0942-cfd5-4727-b490-62198c86d1e6" May 22 10:35:13.312439 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:13.312406 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal" event={"ID":"fad8f2e01fa8e9d10bf87b1689efd852","Type":"ContainerStarted","Data":"f06cb79d450523c6caec76326710620369dd55298929b80b94ba152c8a1b944e"} May 22 10:35:13.325686 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:13.325629 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-186.ec2.internal" podStartSLOduration=3.32561168 podStartE2EDuration="3.32561168s" podCreationTimestamp="2026-05-22 10:35:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-22 10:35:13.324923968 +0000 UTC m=+4.632183714" watchObservedRunningTime="2026-05-22 10:35:13.32561168 +0000 UTC m=+4.632871427" May 22 10:35:14.250001 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:14.249456 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:35:14.250001 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:14.249602 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncpgn" podUID="63a0f782-b151-4b2a-be81-d0025df9fb35" May 22 10:35:14.859717 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:14.859673 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2bkfv\" (UniqueName: \"kubernetes.io/projected/63a0f782-b151-4b2a-be81-d0025df9fb35-kube-api-access-2bkfv\") pod \"network-check-target-ncpgn\" (UID: \"63a0f782-b151-4b2a-be81-d0025df9fb35\") " pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:35:14.860178 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:14.859742 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7db0942-cfd5-4727-b490-62198c86d1e6-metrics-certs\") pod \"network-metrics-daemon-4t6q7\" (UID: \"d7db0942-cfd5-4727-b490-62198c86d1e6\") " pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:14.860178 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:14.859866 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 22 10:35:14.860178 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:14.859929 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7db0942-cfd5-4727-b490-62198c86d1e6-metrics-certs podName:d7db0942-cfd5-4727-b490-62198c86d1e6 nodeName:}" failed. No retries permitted until 2026-05-22 10:35:18.859910458 +0000 UTC m=+10.167170188 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d7db0942-cfd5-4727-b490-62198c86d1e6-metrics-certs") pod "network-metrics-daemon-4t6q7" (UID: "d7db0942-cfd5-4727-b490-62198c86d1e6") : object "openshift-multus"/"metrics-daemon-secret" not registered May 22 10:35:14.860178 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:14.860097 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 22 10:35:14.860178 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:14.860112 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 22 10:35:14.860178 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:14.860125 2558 projected.go:194] Error preparing data for projected volume kube-api-access-2bkfv for pod openshift-network-diagnostics/network-check-target-ncpgn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 22 10:35:14.860178 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:14.860162 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/63a0f782-b151-4b2a-be81-d0025df9fb35-kube-api-access-2bkfv podName:63a0f782-b151-4b2a-be81-d0025df9fb35 nodeName:}" failed. No retries permitted until 2026-05-22 10:35:18.860149591 +0000 UTC m=+10.167409329 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2bkfv" (UniqueName: "kubernetes.io/projected/63a0f782-b151-4b2a-be81-d0025df9fb35-kube-api-access-2bkfv") pod "network-check-target-ncpgn" (UID: "63a0f782-b151-4b2a-be81-d0025df9fb35") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 22 10:35:15.252251 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:15.252173 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:15.252429 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:15.252311 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t6q7" podUID="d7db0942-cfd5-4727-b490-62198c86d1e6" May 22 10:35:16.250059 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:16.250023 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:35:16.250531 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:16.250166 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncpgn" podUID="63a0f782-b151-4b2a-be81-d0025df9fb35" May 22 10:35:17.250576 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:17.250544 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:17.251023 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:17.250684 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t6q7" podUID="d7db0942-cfd5-4727-b490-62198c86d1e6" May 22 10:35:18.249935 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:18.249893 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:35:18.250115 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:18.250030 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncpgn" podUID="63a0f782-b151-4b2a-be81-d0025df9fb35" May 22 10:35:18.892637 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:18.892005 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2bkfv\" (UniqueName: \"kubernetes.io/projected/63a0f782-b151-4b2a-be81-d0025df9fb35-kube-api-access-2bkfv\") pod \"network-check-target-ncpgn\" (UID: \"63a0f782-b151-4b2a-be81-d0025df9fb35\") " pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:35:18.892637 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:18.892055 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7db0942-cfd5-4727-b490-62198c86d1e6-metrics-certs\") pod \"network-metrics-daemon-4t6q7\" (UID: \"d7db0942-cfd5-4727-b490-62198c86d1e6\") " pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:18.892637 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:18.892166 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 22 10:35:18.892637 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:18.892215 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7db0942-cfd5-4727-b490-62198c86d1e6-metrics-certs podName:d7db0942-cfd5-4727-b490-62198c86d1e6 nodeName:}" failed. No retries permitted until 2026-05-22 10:35:26.892200728 +0000 UTC m=+18.199460451 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d7db0942-cfd5-4727-b490-62198c86d1e6-metrics-certs") pod "network-metrics-daemon-4t6q7" (UID: "d7db0942-cfd5-4727-b490-62198c86d1e6") : object "openshift-multus"/"metrics-daemon-secret" not registered May 22 10:35:18.892637 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:18.892558 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 22 10:35:18.892637 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:18.892573 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 22 10:35:18.892637 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:18.892582 2558 projected.go:194] Error preparing data for projected volume kube-api-access-2bkfv for pod openshift-network-diagnostics/network-check-target-ncpgn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 22 10:35:18.892637 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:18.892615 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/63a0f782-b151-4b2a-be81-d0025df9fb35-kube-api-access-2bkfv podName:63a0f782-b151-4b2a-be81-d0025df9fb35 nodeName:}" failed. No retries permitted until 2026-05-22 10:35:26.892604722 +0000 UTC m=+18.199864446 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2bkfv" (UniqueName: "kubernetes.io/projected/63a0f782-b151-4b2a-be81-d0025df9fb35-kube-api-access-2bkfv") pod "network-check-target-ncpgn" (UID: "63a0f782-b151-4b2a-be81-d0025df9fb35") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 22 10:35:19.251471 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:19.251393 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:19.251627 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:19.251525 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t6q7" podUID="d7db0942-cfd5-4727-b490-62198c86d1e6" May 22 10:35:20.249786 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:20.249750 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:35:20.250225 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:20.249880 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncpgn" podUID="63a0f782-b151-4b2a-be81-d0025df9fb35" May 22 10:35:21.250282 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:21.250248 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:21.250744 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:21.250394 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t6q7" podUID="d7db0942-cfd5-4727-b490-62198c86d1e6" May 22 10:35:22.249505 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:22.249473 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:35:22.249645 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:22.249573 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncpgn" podUID="63a0f782-b151-4b2a-be81-d0025df9fb35" May 22 10:35:23.250277 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:23.250239 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:23.250689 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:23.250402 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t6q7" podUID="d7db0942-cfd5-4727-b490-62198c86d1e6" May 22 10:35:24.249951 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:24.249916 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:35:24.250182 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:24.250043 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncpgn" podUID="63a0f782-b151-4b2a-be81-d0025df9fb35" May 22 10:35:25.250384 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:25.250330 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:25.250885 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:25.250486 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t6q7" podUID="d7db0942-cfd5-4727-b490-62198c86d1e6" May 22 10:35:26.250044 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:26.249957 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:35:26.250221 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:26.250075 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncpgn" podUID="63a0f782-b151-4b2a-be81-d0025df9fb35" May 22 10:35:26.952912 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:26.952872 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7db0942-cfd5-4727-b490-62198c86d1e6-metrics-certs\") pod \"network-metrics-daemon-4t6q7\" (UID: \"d7db0942-cfd5-4727-b490-62198c86d1e6\") " pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:26.953385 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:26.952932 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2bkfv\" (UniqueName: \"kubernetes.io/projected/63a0f782-b151-4b2a-be81-d0025df9fb35-kube-api-access-2bkfv\") pod \"network-check-target-ncpgn\" (UID: \"63a0f782-b151-4b2a-be81-d0025df9fb35\") " pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:35:26.953385 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:26.953047 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 22 10:35:26.953385 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:26.953047 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 22 10:35:26.953385 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:26.953064 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 22 10:35:26.953385 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:26.953081 2558 projected.go:194] Error preparing data for projected volume kube-api-access-2bkfv for pod openshift-network-diagnostics/network-check-target-ncpgn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 22 10:35:26.953385 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:26.953124 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/63a0f782-b151-4b2a-be81-d0025df9fb35-kube-api-access-2bkfv podName:63a0f782-b151-4b2a-be81-d0025df9fb35 nodeName:}" failed. No retries permitted until 2026-05-22 10:35:42.953110562 +0000 UTC m=+34.260370286 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2bkfv" (UniqueName: "kubernetes.io/projected/63a0f782-b151-4b2a-be81-d0025df9fb35-kube-api-access-2bkfv") pod "network-check-target-ncpgn" (UID: "63a0f782-b151-4b2a-be81-d0025df9fb35") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 22 10:35:26.953385 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:26.953143 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7db0942-cfd5-4727-b490-62198c86d1e6-metrics-certs podName:d7db0942-cfd5-4727-b490-62198c86d1e6 nodeName:}" failed. No retries permitted until 2026-05-22 10:35:42.953136742 +0000 UTC m=+34.260396466 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d7db0942-cfd5-4727-b490-62198c86d1e6-metrics-certs") pod "network-metrics-daemon-4t6q7" (UID: "d7db0942-cfd5-4727-b490-62198c86d1e6") : object "openshift-multus"/"metrics-daemon-secret" not registered May 22 10:35:27.249957 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:27.249441 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:27.249957 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:27.249570 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t6q7" podUID="d7db0942-cfd5-4727-b490-62198c86d1e6" May 22 10:35:28.250202 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:28.250163 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:35:28.250655 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:28.250292 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncpgn" podUID="63a0f782-b151-4b2a-be81-d0025df9fb35" May 22 10:35:29.250720 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:29.250685 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:29.251065 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:29.250812 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t6q7" podUID="d7db0942-cfd5-4727-b490-62198c86d1e6" May 22 10:35:30.249919 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:30.249738 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:35:30.249919 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:30.249848 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncpgn" podUID="63a0f782-b151-4b2a-be81-d0025df9fb35" May 22 10:35:31.249832 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:31.249641 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:31.250533 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:31.249934 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t6q7" podUID="d7db0942-cfd5-4727-b490-62198c86d1e6" May 22 10:35:31.354683 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:31.354646 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zgshg" event={"ID":"e5fa7e55-73a3-4cec-bb73-fd75f35e3962","Type":"ContainerStarted","Data":"c06b89dedb92737369d0a7538623912cf8c71a732c5cfa8b6a1d32b983dc8980"} May 22 10:35:31.356300 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:31.356270 2558 generic.go:358] "Generic (PLEG): container finished" podID="cb2a30bd-3761-45fe-80d6-b247b6ef6a31" containerID="8de51af79b2cc6e73bc5fb23771632ec4ce948c4c5e3de439f49dffda3da4eb1" exitCode=0 May 22 10:35:31.356455 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:31.356365 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r5lqn" event={"ID":"cb2a30bd-3761-45fe-80d6-b247b6ef6a31","Type":"ContainerDied","Data":"8de51af79b2cc6e73bc5fb23771632ec4ce948c4c5e3de439f49dffda3da4eb1"} May 22 10:35:31.357907 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:31.357876 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6f7c6" event={"ID":"f78a7232-2308-46d7-b2c5-73e50d71fd25","Type":"ContainerStarted","Data":"3bedc9a830217836402c20b38414d199809ad578ad7598c6bab31a02338fff2c"} May 22 10:35:31.359445 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:31.359417 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5trjw" event={"ID":"f0208365-c78b-4378-bb0a-ccc84a1b726b","Type":"ContainerStarted","Data":"7299642949a1b5d630111eda0d9bef701fc61a8558be8a9755d4da46be6a0e62"} May 22 10:35:31.360793 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:31.360762 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7mj84" event={"ID":"206f863a-6549-4ed7-9b1c-3a20fd243d51","Type":"ContainerStarted","Data":"cd8063422b399f2adbf3664c9a40dda50cd3d40c039aa5661b94b27f7dff9cb8"} May 22 10:35:31.363890 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:31.363867 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" event={"ID":"0265449b-fdb7-4537-a446-8d97653b2097","Type":"ContainerStarted","Data":"9689aa4390f423e386d4755663a781ed46e81b465fa0b12b2e390eba31d193a6"} May 22 10:35:31.363988 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:31.363895 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" event={"ID":"0265449b-fdb7-4537-a446-8d97653b2097","Type":"ContainerStarted","Data":"d704e3e542629378789aa6d9323d0a116dceb2daa0c9c10ef4c06a912053e52c"} May 22 10:35:31.363988 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:31.363909 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" event={"ID":"0265449b-fdb7-4537-a446-8d97653b2097","Type":"ContainerStarted","Data":"35c02996a42f320f726e174e3f8c58d3d586982480683dc3cd2ace0014c73369"} May 22 10:35:31.363988 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:31.363921 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" event={"ID":"0265449b-fdb7-4537-a446-8d97653b2097","Type":"ContainerStarted","Data":"ee1c145b39d032221ed14b5e22622ddf4a6c01eef08a9332b5890423877a4046"} May 22 10:35:31.363988 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:31.363934 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" event={"ID":"0265449b-fdb7-4537-a446-8d97653b2097","Type":"ContainerStarted","Data":"878ac2b38101afdd598d324031e1ee312d9c414e429486c29cfa132647b61d9d"} May 22 10:35:31.363988 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:31.363945 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" event={"ID":"0265449b-fdb7-4537-a446-8d97653b2097","Type":"ContainerStarted","Data":"9824269684d862d8a4c864d59b578d636ec5d77b45b2e935b3b1fba874806076"} May 22 10:35:31.365305 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:31.365281 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cxx7z" event={"ID":"5a26bab0-ee1f-4322-9413-91c337de805a","Type":"ContainerStarted","Data":"e571efae7d4bdd601e0628d29f3db23d0e9417e2ed1644c7b4e73dc55a3203a2"} May 22 10:35:31.366615 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:31.366594 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6j2d5" event={"ID":"9f91428b-8137-4a51-9b7e-1b7d8b8011fd","Type":"ContainerStarted","Data":"00ae1dbca893d32ba2273abbfedacc47bc9303efa7b67221ed6e736de3a0505e"} May 22 10:35:31.368939 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:31.368900 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zgshg" podStartSLOduration=3.7677796199999998 podStartE2EDuration="22.368887039s" podCreationTimestamp="2026-05-22 10:35:09 +0000 UTC" firstStartedPulling="2026-05-22 10:35:11.903590188 +0000 UTC m=+3.210849914" lastFinishedPulling="2026-05-22 10:35:30.504697599 +0000 UTC m=+21.811957333" observedRunningTime="2026-05-22 10:35:31.368483817 +0000 UTC m=+22.675743564" watchObservedRunningTime="2026-05-22 10:35:31.368887039 +0000 UTC m=+22.676146787" May 22 10:35:31.383439 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:31.383393 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-6j2d5" podStartSLOduration=3.7746656979999997 podStartE2EDuration="22.383378941s" podCreationTimestamp="2026-05-22 10:35:09 +0000 UTC" firstStartedPulling="2026-05-22 10:35:11.905260442 +0000 UTC m=+3.212520166" lastFinishedPulling="2026-05-22 10:35:30.513973685 +0000 UTC m=+21.821233409" observedRunningTime="2026-05-22 10:35:31.382989332 +0000 UTC m=+22.690249079" watchObservedRunningTime="2026-05-22 10:35:31.383378941 +0000 UTC m=+22.690638690" May 22 10:35:31.410200 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:31.410152 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6f7c6" podStartSLOduration=3.8895181770000002 podStartE2EDuration="22.410134651s" podCreationTimestamp="2026-05-22 10:35:09 +0000 UTC" firstStartedPulling="2026-05-22 10:35:11.90967304 +0000 UTC m=+3.216932764" lastFinishedPulling="2026-05-22 10:35:30.4302895 +0000 UTC m=+21.737549238" observedRunningTime="2026-05-22 10:35:31.410091983 +0000 UTC m=+22.717351732" watchObservedRunningTime="2026-05-22 10:35:31.410134651 +0000 UTC m=+22.717394398" May 22 10:35:31.410496 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:31.410462 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cxx7z" podStartSLOduration=3.814971357 podStartE2EDuration="22.410454529s" podCreationTimestamp="2026-05-22 10:35:09 +0000 UTC" firstStartedPulling="2026-05-22 10:35:11.907308376 +0000 UTC m=+3.214568100" lastFinishedPulling="2026-05-22 10:35:30.502791545 +0000 UTC m=+21.810051272" observedRunningTime="2026-05-22 10:35:31.398325753 +0000 UTC m=+22.705585501" watchObservedRunningTime="2026-05-22 10:35:31.410454529 +0000 UTC m=+22.717714274" May 22 10:35:31.426977 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:31.426933 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-7mj84" podStartSLOduration=3.900761999 podStartE2EDuration="22.426920508s" podCreationTimestamp="2026-05-22 10:35:09 +0000 UTC" firstStartedPulling="2026-05-22 10:35:11.904134912 +0000 UTC m=+3.211394642" lastFinishedPulling="2026-05-22 10:35:30.430293427 +0000 UTC m=+21.737553151" observedRunningTime="2026-05-22 10:35:31.426552565 +0000 UTC m=+22.733812324" watchObservedRunningTime="2026-05-22 10:35:31.426920508 +0000 UTC m=+22.734180254" May 22 10:35:31.960097 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:31.960077 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 22 10:35:32.182737 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:32.182607 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-22T10:35:31.960092114Z","UUID":"793b78f2-76ff-4624-a532-ae19dd5a2c68","Handler":null,"Name":"","Endpoint":""} May 22 10:35:32.184219 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:32.184201 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 22 10:35:32.184323 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:32.184225 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 22 10:35:32.250192 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:32.250167 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:35:32.250717 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:32.250285 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncpgn" podUID="63a0f782-b151-4b2a-be81-d0025df9fb35" May 22 10:35:32.370332 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:32.370297 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5trjw" event={"ID":"f0208365-c78b-4378-bb0a-ccc84a1b726b","Type":"ContainerStarted","Data":"8bc0947989c16462437708e511687fa177b46d570932e5ce35cd1552ac666592"} May 22 10:35:32.371781 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:32.371752 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-84gt5" event={"ID":"c90a0bcb-768c-44de-a10f-52e897159e53","Type":"ContainerStarted","Data":"98578776e724c24510634a5c465f8cfca3a32e42f34fa9dba72bfb4faf0ed619"} May 22 10:35:32.385350 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:32.385303 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-84gt5" podStartSLOduration=4.77380808 podStartE2EDuration="23.385290669s" podCreationTimestamp="2026-05-22 10:35:09 +0000 UTC" firstStartedPulling="2026-05-22 10:35:11.896843341 +0000 UTC m=+3.204103065" lastFinishedPulling="2026-05-22 10:35:30.508325926 +0000 UTC m=+21.815585654" observedRunningTime="2026-05-22 10:35:32.384749233 +0000 UTC m=+23.692008982" watchObservedRunningTime="2026-05-22 10:35:32.385290669 +0000 UTC m=+23.692550408" May 22 10:35:33.249869 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:33.249785 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:33.250028 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:33.249919 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t6q7" podUID="d7db0942-cfd5-4727-b490-62198c86d1e6" May 22 10:35:33.375007 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:33.374978 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5trjw" event={"ID":"f0208365-c78b-4378-bb0a-ccc84a1b726b","Type":"ContainerStarted","Data":"bb63c32af93c8b07863e9a57827972f7a34885f0983a3fa55c81a8e396000631"} May 22 10:35:33.390022 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:33.389970 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5trjw" podStartSLOduration=3.394827432 podStartE2EDuration="24.38995274s" podCreationTimestamp="2026-05-22 10:35:09 +0000 UTC" firstStartedPulling="2026-05-22 10:35:11.909402029 +0000 UTC m=+3.216661753" lastFinishedPulling="2026-05-22 10:35:32.904527324 +0000 UTC m=+24.211787061" observedRunningTime="2026-05-22 10:35:33.388477589 +0000 UTC m=+24.695737345" watchObservedRunningTime="2026-05-22 10:35:33.38995274 +0000 UTC m=+24.697212489" May 22 10:35:34.249317 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:34.249288 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:35:34.249484 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:34.249403 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncpgn" podUID="63a0f782-b151-4b2a-be81-d0025df9fb35" May 22 10:35:34.380634 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:34.380598 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" event={"ID":"0265449b-fdb7-4537-a446-8d97653b2097","Type":"ContainerStarted","Data":"5f33b0408891712f516efd7806e3ef21b8eb708ff6c6c6e5433e5320a67c28ca"} May 22 10:35:35.250143 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:35.249973 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:35.250301 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:35.250219 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t6q7" podUID="d7db0942-cfd5-4727-b490-62198c86d1e6" May 22 10:35:36.249400 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:36.249370 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:35:36.250035 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:36.249469 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncpgn" podUID="63a0f782-b151-4b2a-be81-d0025df9fb35" May 22 10:35:36.344259 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:36.344230 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6f7c6" May 22 10:35:36.345473 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:36.345445 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6f7c6" May 22 10:35:36.387760 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:36.387722 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" event={"ID":"0265449b-fdb7-4537-a446-8d97653b2097","Type":"ContainerStarted","Data":"91c11e339a1323c709f908055c9a15f4724c32e0b7ffecee89c07200b5d2226b"} May 22 10:35:36.388199 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:36.388171 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6f7c6" May 22 10:35:36.388332 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:36.388230 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:36.388332 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:36.388248 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:36.389012 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:36.388700 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:36.390237 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:36.390212 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6f7c6" May 22 10:35:36.406895 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:36.406870 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:36.407096 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:36.407085 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:35:36.413780 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:36.413738 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" podStartSLOduration=8.583863568 podStartE2EDuration="27.413723456s" podCreationTimestamp="2026-05-22 10:35:09 +0000 UTC" firstStartedPulling="2026-05-22 10:35:11.898433485 +0000 UTC m=+3.205693209" lastFinishedPulling="2026-05-22 10:35:30.728293359 +0000 UTC m=+22.035553097" observedRunningTime="2026-05-22 10:35:36.412502076 +0000 UTC m=+27.719761831" watchObservedRunningTime="2026-05-22 10:35:36.413723456 +0000 UTC m=+27.720983212" May 22 10:35:37.097669 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:37.097644 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7mj84_206f863a-6549-4ed7-9b1c-3a20fd243d51/dns-node-resolver/0.log" May 22 10:35:37.250038 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:37.249397 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:37.250038 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:37.249760 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t6q7" podUID="d7db0942-cfd5-4727-b490-62198c86d1e6" May 22 10:35:37.565859 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:37.565283 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ncpgn"] May 22 10:35:37.565859 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:37.565437 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:35:37.565859 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:37.565542 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncpgn" podUID="63a0f782-b151-4b2a-be81-d0025df9fb35" May 22 10:35:37.567807 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:37.567786 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4t6q7"] May 22 10:35:37.567923 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:37.567876 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:37.568004 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:37.567981 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t6q7" podUID="d7db0942-cfd5-4727-b490-62198c86d1e6" May 22 10:35:38.083155 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:38.083129 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cxx7z_5a26bab0-ee1f-4322-9413-91c337de805a/node-ca/0.log" May 22 10:35:38.393121 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:38.393091 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r5lqn" event={"ID":"cb2a30bd-3761-45fe-80d6-b247b6ef6a31","Type":"ContainerStarted","Data":"4ff45a048c6381577e6e97eec2009355d80f987d546fffa76fb3c7010a8132be"} May 22 10:35:39.250867 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:39.250836 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:35:39.251005 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:39.250913 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncpgn" podUID="63a0f782-b151-4b2a-be81-d0025df9fb35" May 22 10:35:39.251042 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:39.250998 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:39.251110 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:39.251092 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t6q7" podUID="d7db0942-cfd5-4727-b490-62198c86d1e6" May 22 10:35:39.396249 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:39.396215 2558 generic.go:358] "Generic (PLEG): container finished" podID="cb2a30bd-3761-45fe-80d6-b247b6ef6a31" containerID="4ff45a048c6381577e6e97eec2009355d80f987d546fffa76fb3c7010a8132be" exitCode=0 May 22 10:35:39.396607 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:39.396277 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r5lqn" event={"ID":"cb2a30bd-3761-45fe-80d6-b247b6ef6a31","Type":"ContainerDied","Data":"4ff45a048c6381577e6e97eec2009355d80f987d546fffa76fb3c7010a8132be"} May 22 10:35:41.250129 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:41.250095 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:35:41.250511 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:41.250195 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncpgn" podUID="63a0f782-b151-4b2a-be81-d0025df9fb35" May 22 10:35:41.250511 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:41.250282 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:41.250511 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:41.250385 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t6q7" podUID="d7db0942-cfd5-4727-b490-62198c86d1e6" May 22 10:35:41.401170 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:41.401135 2558 generic.go:358] "Generic (PLEG): container finished" podID="cb2a30bd-3761-45fe-80d6-b247b6ef6a31" containerID="190cdb1ced95240d9a033b473e3e9033c596a9f1afe46689ae455995a45bdbdc" exitCode=0 May 22 10:35:41.401300 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:41.401195 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r5lqn" event={"ID":"cb2a30bd-3761-45fe-80d6-b247b6ef6a31","Type":"ContainerDied","Data":"190cdb1ced95240d9a033b473e3e9033c596a9f1afe46689ae455995a45bdbdc"} May 22 10:35:42.977638 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:42.977606 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7db0942-cfd5-4727-b490-62198c86d1e6-metrics-certs\") pod \"network-metrics-daemon-4t6q7\" (UID: \"d7db0942-cfd5-4727-b490-62198c86d1e6\") " pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:42.978088 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:42.977659 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2bkfv\" (UniqueName: \"kubernetes.io/projected/63a0f782-b151-4b2a-be81-d0025df9fb35-kube-api-access-2bkfv\") pod \"network-check-target-ncpgn\" (UID: \"63a0f782-b151-4b2a-be81-d0025df9fb35\") " pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:35:42.978088 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:42.977758 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 22 10:35:42.978088 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:42.977759 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 22 10:35:42.978088 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:42.977770 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 22 10:35:42.978088 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:42.977784 2558 projected.go:194] Error preparing data for projected volume kube-api-access-2bkfv for pod openshift-network-diagnostics/network-check-target-ncpgn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 22 10:35:42.978088 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:42.977820 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/63a0f782-b151-4b2a-be81-d0025df9fb35-kube-api-access-2bkfv podName:63a0f782-b151-4b2a-be81-d0025df9fb35 nodeName:}" failed. No retries permitted until 2026-05-22 10:36:14.977807429 +0000 UTC m=+66.285067153 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2bkfv" (UniqueName: "kubernetes.io/projected/63a0f782-b151-4b2a-be81-d0025df9fb35-kube-api-access-2bkfv") pod "network-check-target-ncpgn" (UID: "63a0f782-b151-4b2a-be81-d0025df9fb35") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 22 10:35:42.978088 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:42.977834 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7db0942-cfd5-4727-b490-62198c86d1e6-metrics-certs podName:d7db0942-cfd5-4727-b490-62198c86d1e6 nodeName:}" failed. No retries permitted until 2026-05-22 10:36:14.977827309 +0000 UTC m=+66.285087033 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d7db0942-cfd5-4727-b490-62198c86d1e6-metrics-certs") pod "network-metrics-daemon-4t6q7" (UID: "d7db0942-cfd5-4727-b490-62198c86d1e6") : object "openshift-multus"/"metrics-daemon-secret" not registered May 22 10:35:43.249722 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:43.249638 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:35:43.249882 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:43.249638 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:43.249882 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:43.249755 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncpgn" podUID="63a0f782-b151-4b2a-be81-d0025df9fb35" May 22 10:35:43.249882 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:43.249852 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t6q7" podUID="d7db0942-cfd5-4727-b490-62198c86d1e6" May 22 10:35:43.407212 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:43.407180 2558 generic.go:358] "Generic (PLEG): container finished" podID="cb2a30bd-3761-45fe-80d6-b247b6ef6a31" containerID="2775ced8719468e0f96231c2dcb89ed543b78e1d22063d549d7b16436f618f07" exitCode=0 May 22 10:35:43.407385 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:43.407233 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r5lqn" event={"ID":"cb2a30bd-3761-45fe-80d6-b247b6ef6a31","Type":"ContainerDied","Data":"2775ced8719468e0f96231c2dcb89ed543b78e1d22063d549d7b16436f618f07"} May 22 10:35:45.249772 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:45.249734 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:35:45.250278 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:45.249836 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncpgn" podUID="63a0f782-b151-4b2a-be81-d0025df9fb35" May 22 10:35:45.250278 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:45.249902 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:45.250278 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:45.250024 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t6q7" podUID="d7db0942-cfd5-4727-b490-62198c86d1e6" May 22 10:35:47.249672 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:47.249633 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:35:47.250245 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:47.249646 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:47.250245 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:47.249748 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncpgn" podUID="63a0f782-b151-4b2a-be81-d0025df9fb35" May 22 10:35:47.250245 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:47.249817 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t6q7" podUID="d7db0942-cfd5-4727-b490-62198c86d1e6" May 22 10:35:49.250936 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:49.250900 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:49.251480 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:49.251009 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t6q7" podUID="d7db0942-cfd5-4727-b490-62198c86d1e6" May 22 10:35:49.251480 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:49.251094 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:35:49.251480 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:49.251200 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncpgn" podUID="63a0f782-b151-4b2a-be81-d0025df9fb35" May 22 10:35:49.421568 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:49.421525 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r5lqn" event={"ID":"cb2a30bd-3761-45fe-80d6-b247b6ef6a31","Type":"ContainerStarted","Data":"6891b04c8c6f34c385a95c23a692115baf7c14dc056ccf2eae1312b32181752a"} May 22 10:35:50.425609 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:50.425577 2558 generic.go:358] "Generic (PLEG): container finished" podID="cb2a30bd-3761-45fe-80d6-b247b6ef6a31" containerID="6891b04c8c6f34c385a95c23a692115baf7c14dc056ccf2eae1312b32181752a" exitCode=0 May 22 10:35:50.426052 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:50.425618 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r5lqn" event={"ID":"cb2a30bd-3761-45fe-80d6-b247b6ef6a31","Type":"ContainerDied","Data":"6891b04c8c6f34c385a95c23a692115baf7c14dc056ccf2eae1312b32181752a"} May 22 10:35:51.250217 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:51.250186 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:35:51.250389 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:51.250297 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncpgn" podUID="63a0f782-b151-4b2a-be81-d0025df9fb35" May 22 10:35:51.250437 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:51.250395 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:51.250504 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:51.250487 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t6q7" podUID="d7db0942-cfd5-4727-b490-62198c86d1e6" May 22 10:35:51.429661 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:51.429630 2558 generic.go:358] "Generic (PLEG): container finished" podID="cb2a30bd-3761-45fe-80d6-b247b6ef6a31" containerID="f96329164fec36eaf6edf01b4477f022623fc35d72a153e08b6d95a5c10f1bca" exitCode=0 May 22 10:35:51.430000 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:51.429690 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r5lqn" event={"ID":"cb2a30bd-3761-45fe-80d6-b247b6ef6a31","Type":"ContainerDied","Data":"f96329164fec36eaf6edf01b4477f022623fc35d72a153e08b6d95a5c10f1bca"} May 22 10:35:52.434229 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:52.434190 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r5lqn" event={"ID":"cb2a30bd-3761-45fe-80d6-b247b6ef6a31","Type":"ContainerStarted","Data":"cd3ce539eb3ee89e310465b413bf9e9c53092761b2f8948696df16986901b48a"} May 22 10:35:52.452918 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:52.452875 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-r5lqn" podStartSLOduration=6.087955441 podStartE2EDuration="43.452861245s" podCreationTimestamp="2026-05-22 10:35:09 +0000 UTC" firstStartedPulling="2026-05-22 10:35:11.909481151 +0000 UTC m=+3.216740888" lastFinishedPulling="2026-05-22 10:35:49.274386968 +0000 UTC m=+40.581646692" observedRunningTime="2026-05-22 10:35:52.451898464 +0000 UTC m=+43.759158207" watchObservedRunningTime="2026-05-22 10:35:52.452861245 +0000 UTC m=+43.760120990" May 22 10:35:53.249537 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:53.249507 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:53.249701 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:53.249616 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t6q7" podUID="d7db0942-cfd5-4727-b490-62198c86d1e6" May 22 10:35:53.249701 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:53.249675 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:35:53.249833 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:53.249755 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncpgn" podUID="63a0f782-b151-4b2a-be81-d0025df9fb35" May 22 10:35:55.250127 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:55.250085 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:35:55.250127 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:55.250122 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:55.250674 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:55.250188 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncpgn" podUID="63a0f782-b151-4b2a-be81-d0025df9fb35" May 22 10:35:55.250674 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:55.250310 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t6q7" podUID="d7db0942-cfd5-4727-b490-62198c86d1e6" May 22 10:35:57.250296 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:57.250259 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:57.250296 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:57.250291 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:35:57.250783 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:57.250385 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t6q7" podUID="d7db0942-cfd5-4727-b490-62198c86d1e6" May 22 10:35:57.250783 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:57.250489 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncpgn" podUID="63a0f782-b151-4b2a-be81-d0025df9fb35" May 22 10:35:59.250947 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:59.250916 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:35:59.251289 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:59.250997 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncpgn" podUID="63a0f782-b151-4b2a-be81-d0025df9fb35" May 22 10:35:59.251289 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:35:59.251035 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:35:59.251289 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:35:59.251086 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t6q7" podUID="d7db0942-cfd5-4727-b490-62198c86d1e6" May 22 10:36:01.249455 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.249427 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:36:01.249808 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.249427 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:36:01.249808 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:36:01.249534 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t6q7" podUID="d7db0942-cfd5-4727-b490-62198c86d1e6" May 22 10:36:01.249808 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:36:01.249603 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncpgn" podUID="63a0f782-b151-4b2a-be81-d0025df9fb35" May 22 10:36:01.498213 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.498185 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-186.ec2.internal" event="NodeReady" May 22 10:36:01.498392 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.498315 2558 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 22 10:36:01.540029 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.540002 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9qzlm"] May 22 10:36:01.542659 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.542637 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9qzlm" May 22 10:36:01.542767 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.542674 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dkpsq"] May 22 10:36:01.544313 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.544282 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 22 10:36:01.544475 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.544374 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dkpsq" May 22 10:36:01.544475 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.544417 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 22 10:36:01.544475 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.544456 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lhfbg\"" May 22 10:36:01.544635 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.544521 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 22 10:36:01.544806 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.544774 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 22 10:36:01.545998 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.545982 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 22 10:36:01.546763 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.546743 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rqqsm\"" May 22 10:36:01.546826 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.546767 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 22 10:36:01.546826 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.546749 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 22 10:36:01.551627 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.551604 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9qzlm"] May 22 10:36:01.554432 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.554378 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dkpsq"] May 22 10:36:01.609577 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.609542 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55c52\" (UniqueName: \"kubernetes.io/projected/b3ffc24b-3fd6-4134-964e-a2227bac423d-kube-api-access-55c52\") pod \"ingress-canary-dkpsq\" (UID: \"b3ffc24b-3fd6-4134-964e-a2227bac423d\") " pod="openshift-ingress-canary/ingress-canary-dkpsq" May 22 10:36:01.609744 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.609591 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c269b171-f1f4-4551-8858-30a160b62289-data-volume\") pod \"insights-runtime-extractor-9qzlm\" (UID: \"c269b171-f1f4-4551-8858-30a160b62289\") " pod="openshift-insights/insights-runtime-extractor-9qzlm" May 22 10:36:01.609744 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.609614 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcj7s\" (UniqueName: \"kubernetes.io/projected/c269b171-f1f4-4551-8858-30a160b62289-kube-api-access-pcj7s\") pod \"insights-runtime-extractor-9qzlm\" (UID: \"c269b171-f1f4-4551-8858-30a160b62289\") " pod="openshift-insights/insights-runtime-extractor-9qzlm" May 22 10:36:01.609744 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.609654 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c269b171-f1f4-4551-8858-30a160b62289-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9qzlm\" (UID: \"c269b171-f1f4-4551-8858-30a160b62289\") " pod="openshift-insights/insights-runtime-extractor-9qzlm" May 22 10:36:01.609744 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.609681 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c269b171-f1f4-4551-8858-30a160b62289-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9qzlm\" (UID: \"c269b171-f1f4-4551-8858-30a160b62289\") " pod="openshift-insights/insights-runtime-extractor-9qzlm" May 22 10:36:01.609744 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.609699 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3ffc24b-3fd6-4134-964e-a2227bac423d-cert\") pod \"ingress-canary-dkpsq\" (UID: \"b3ffc24b-3fd6-4134-964e-a2227bac423d\") " pod="openshift-ingress-canary/ingress-canary-dkpsq" May 22 10:36:01.609744 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.609716 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c269b171-f1f4-4551-8858-30a160b62289-crio-socket\") pod \"insights-runtime-extractor-9qzlm\" (UID: \"c269b171-f1f4-4551-8858-30a160b62289\") " pod="openshift-insights/insights-runtime-extractor-9qzlm" May 22 10:36:01.647375 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.647325 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kzbqx"] May 22 10:36:01.648960 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.648944 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kzbqx" May 22 10:36:01.650713 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.650693 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mx2kx\"" May 22 10:36:01.650802 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.650695 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 22 10:36:01.650802 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.650695 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 22 10:36:01.662032 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.662006 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kzbqx"] May 22 10:36:01.710207 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.710173 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhcqq\" (UniqueName: \"kubernetes.io/projected/3fa09c0c-5066-401d-b52f-6bf653c7e16a-kube-api-access-hhcqq\") pod \"dns-default-kzbqx\" (UID: \"3fa09c0c-5066-401d-b52f-6bf653c7e16a\") " pod="openshift-dns/dns-default-kzbqx" May 22 10:36:01.710408 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.710214 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fa09c0c-5066-401d-b52f-6bf653c7e16a-metrics-tls\") pod \"dns-default-kzbqx\" (UID: \"3fa09c0c-5066-401d-b52f-6bf653c7e16a\") " pod="openshift-dns/dns-default-kzbqx" May 22 10:36:01.710408 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.710243 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-55c52\" (UniqueName: \"kubernetes.io/projected/b3ffc24b-3fd6-4134-964e-a2227bac423d-kube-api-access-55c52\") pod \"ingress-canary-dkpsq\" (UID: \"b3ffc24b-3fd6-4134-964e-a2227bac423d\") " pod="openshift-ingress-canary/ingress-canary-dkpsq" May 22 10:36:01.710408 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.710271 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c269b171-f1f4-4551-8858-30a160b62289-data-volume\") pod \"insights-runtime-extractor-9qzlm\" (UID: \"c269b171-f1f4-4551-8858-30a160b62289\") " pod="openshift-insights/insights-runtime-extractor-9qzlm" May 22 10:36:01.710408 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.710288 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pcj7s\" (UniqueName: \"kubernetes.io/projected/c269b171-f1f4-4551-8858-30a160b62289-kube-api-access-pcj7s\") pod \"insights-runtime-extractor-9qzlm\" (UID: \"c269b171-f1f4-4551-8858-30a160b62289\") " pod="openshift-insights/insights-runtime-extractor-9qzlm" May 22 10:36:01.710408 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.710305 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3fa09c0c-5066-401d-b52f-6bf653c7e16a-config-volume\") pod \"dns-default-kzbqx\" (UID: \"3fa09c0c-5066-401d-b52f-6bf653c7e16a\") " pod="openshift-dns/dns-default-kzbqx" May 22 10:36:01.710408 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.710323 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fa09c0c-5066-401d-b52f-6bf653c7e16a-tmp-dir\") pod \"dns-default-kzbqx\" (UID: \"3fa09c0c-5066-401d-b52f-6bf653c7e16a\") " pod="openshift-dns/dns-default-kzbqx" May 22 10:36:01.710408 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.710377 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c269b171-f1f4-4551-8858-30a160b62289-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9qzlm\" (UID: \"c269b171-f1f4-4551-8858-30a160b62289\") " pod="openshift-insights/insights-runtime-extractor-9qzlm" May 22 10:36:01.710744 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.710417 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c269b171-f1f4-4551-8858-30a160b62289-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9qzlm\" (UID: \"c269b171-f1f4-4551-8858-30a160b62289\") " pod="openshift-insights/insights-runtime-extractor-9qzlm" May 22 10:36:01.710744 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.710452 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3ffc24b-3fd6-4134-964e-a2227bac423d-cert\") pod \"ingress-canary-dkpsq\" (UID: \"b3ffc24b-3fd6-4134-964e-a2227bac423d\") " pod="openshift-ingress-canary/ingress-canary-dkpsq" May 22 10:36:01.710744 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.710483 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c269b171-f1f4-4551-8858-30a160b62289-crio-socket\") pod \"insights-runtime-extractor-9qzlm\" (UID: \"c269b171-f1f4-4551-8858-30a160b62289\") " pod="openshift-insights/insights-runtime-extractor-9qzlm" May 22 10:36:01.710744 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.710689 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c269b171-f1f4-4551-8858-30a160b62289-crio-socket\") pod \"insights-runtime-extractor-9qzlm\" (UID: \"c269b171-f1f4-4551-8858-30a160b62289\") " pod="openshift-insights/insights-runtime-extractor-9qzlm" May 22 10:36:01.710744 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.710731 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c269b171-f1f4-4551-8858-30a160b62289-data-volume\") pod \"insights-runtime-extractor-9qzlm\" (UID: \"c269b171-f1f4-4551-8858-30a160b62289\") " pod="openshift-insights/insights-runtime-extractor-9qzlm" May 22 10:36:01.711056 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.711033 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c269b171-f1f4-4551-8858-30a160b62289-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9qzlm\" (UID: \"c269b171-f1f4-4551-8858-30a160b62289\") " pod="openshift-insights/insights-runtime-extractor-9qzlm" May 22 10:36:01.714394 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.714373 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c269b171-f1f4-4551-8858-30a160b62289-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9qzlm\" (UID: \"c269b171-f1f4-4551-8858-30a160b62289\") " pod="openshift-insights/insights-runtime-extractor-9qzlm" May 22 10:36:01.714478 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.714440 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3ffc24b-3fd6-4134-964e-a2227bac423d-cert\") pod \"ingress-canary-dkpsq\" (UID: \"b3ffc24b-3fd6-4134-964e-a2227bac423d\") " pod="openshift-ingress-canary/ingress-canary-dkpsq" May 22 10:36:01.717184 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.717161 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55c52\" (UniqueName: \"kubernetes.io/projected/b3ffc24b-3fd6-4134-964e-a2227bac423d-kube-api-access-55c52\") pod \"ingress-canary-dkpsq\" (UID: \"b3ffc24b-3fd6-4134-964e-a2227bac423d\") " pod="openshift-ingress-canary/ingress-canary-dkpsq" May 22 10:36:01.717716 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.717685 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcj7s\" (UniqueName: \"kubernetes.io/projected/c269b171-f1f4-4551-8858-30a160b62289-kube-api-access-pcj7s\") pod \"insights-runtime-extractor-9qzlm\" (UID: \"c269b171-f1f4-4551-8858-30a160b62289\") " pod="openshift-insights/insights-runtime-extractor-9qzlm" May 22 10:36:01.810917 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.810827 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3fa09c0c-5066-401d-b52f-6bf653c7e16a-config-volume\") pod \"dns-default-kzbqx\" (UID: \"3fa09c0c-5066-401d-b52f-6bf653c7e16a\") " pod="openshift-dns/dns-default-kzbqx" May 22 10:36:01.810917 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.810865 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fa09c0c-5066-401d-b52f-6bf653c7e16a-tmp-dir\") pod \"dns-default-kzbqx\" (UID: \"3fa09c0c-5066-401d-b52f-6bf653c7e16a\") " pod="openshift-dns/dns-default-kzbqx" May 22 10:36:01.810917 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.810908 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hhcqq\" (UniqueName: \"kubernetes.io/projected/3fa09c0c-5066-401d-b52f-6bf653c7e16a-kube-api-access-hhcqq\") pod \"dns-default-kzbqx\" (UID: \"3fa09c0c-5066-401d-b52f-6bf653c7e16a\") " pod="openshift-dns/dns-default-kzbqx" May 22 10:36:01.811179 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.810924 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fa09c0c-5066-401d-b52f-6bf653c7e16a-metrics-tls\") pod \"dns-default-kzbqx\" (UID: \"3fa09c0c-5066-401d-b52f-6bf653c7e16a\") " pod="openshift-dns/dns-default-kzbqx" May 22 10:36:01.811247 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.811227 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fa09c0c-5066-401d-b52f-6bf653c7e16a-tmp-dir\") pod \"dns-default-kzbqx\" (UID: \"3fa09c0c-5066-401d-b52f-6bf653c7e16a\") " pod="openshift-dns/dns-default-kzbqx" May 22 10:36:01.811401 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.811383 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3fa09c0c-5066-401d-b52f-6bf653c7e16a-config-volume\") pod \"dns-default-kzbqx\" (UID: \"3fa09c0c-5066-401d-b52f-6bf653c7e16a\") " pod="openshift-dns/dns-default-kzbqx" May 22 10:36:01.813320 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.813305 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fa09c0c-5066-401d-b52f-6bf653c7e16a-metrics-tls\") pod \"dns-default-kzbqx\" (UID: \"3fa09c0c-5066-401d-b52f-6bf653c7e16a\") " pod="openshift-dns/dns-default-kzbqx" May 22 10:36:01.817967 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.817948 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhcqq\" (UniqueName: \"kubernetes.io/projected/3fa09c0c-5066-401d-b52f-6bf653c7e16a-kube-api-access-hhcqq\") pod \"dns-default-kzbqx\" (UID: \"3fa09c0c-5066-401d-b52f-6bf653c7e16a\") " pod="openshift-dns/dns-default-kzbqx" May 22 10:36:01.852922 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.852887 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9qzlm" May 22 10:36:01.858289 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.858263 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dkpsq" May 22 10:36:01.957705 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:01.957678 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kzbqx" May 22 10:36:02.010140 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:02.010107 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9qzlm"] May 22 10:36:02.016493 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:36:02.016464 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc269b171_f1f4_4551_8858_30a160b62289.slice/crio-153a049c9505f3ef3dbc13687ffb2c8fc4eec50ab897996c197e40a65211e382 WatchSource:0}: Error finding container 153a049c9505f3ef3dbc13687ffb2c8fc4eec50ab897996c197e40a65211e382: Status 404 returned error can't find the container with id 153a049c9505f3ef3dbc13687ffb2c8fc4eec50ab897996c197e40a65211e382 May 22 10:36:02.022385 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:02.022361 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dkpsq"] May 22 10:36:02.025480 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:36:02.025457 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3ffc24b_3fd6_4134_964e_a2227bac423d.slice/crio-457f03da4d46081243ba210eb72d4759ecbed2165358b67bb97b3c3891b0f788 WatchSource:0}: Error finding container 457f03da4d46081243ba210eb72d4759ecbed2165358b67bb97b3c3891b0f788: Status 404 returned error can't find the container with id 457f03da4d46081243ba210eb72d4759ecbed2165358b67bb97b3c3891b0f788 May 22 10:36:02.109869 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:02.109836 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kzbqx"] May 22 10:36:02.113806 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:36:02.113778 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fa09c0c_5066_401d_b52f_6bf653c7e16a.slice/crio-639e3c72c63274d73f3281f406a977b29f82c7a397b36f92bb3dfdd985fed014 WatchSource:0}: Error finding container 639e3c72c63274d73f3281f406a977b29f82c7a397b36f92bb3dfdd985fed014: Status 404 returned error can't find the container with id 639e3c72c63274d73f3281f406a977b29f82c7a397b36f92bb3dfdd985fed014 May 22 10:36:02.453938 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:02.453896 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kzbqx" event={"ID":"3fa09c0c-5066-401d-b52f-6bf653c7e16a","Type":"ContainerStarted","Data":"639e3c72c63274d73f3281f406a977b29f82c7a397b36f92bb3dfdd985fed014"} May 22 10:36:02.455533 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:02.455502 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dkpsq" event={"ID":"b3ffc24b-3fd6-4134-964e-a2227bac423d","Type":"ContainerStarted","Data":"457f03da4d46081243ba210eb72d4759ecbed2165358b67bb97b3c3891b0f788"} May 22 10:36:02.457240 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:02.457216 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9qzlm" event={"ID":"c269b171-f1f4-4551-8858-30a160b62289","Type":"ContainerStarted","Data":"c9389e06b04aff590dc7cd772d29c6fd53212467f082a8297389ab287140f9db"} May 22 10:36:02.457240 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:02.457250 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9qzlm" event={"ID":"c269b171-f1f4-4551-8858-30a160b62289","Type":"ContainerStarted","Data":"153a049c9505f3ef3dbc13687ffb2c8fc4eec50ab897996c197e40a65211e382"} May 22 10:36:02.730081 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:02.730050 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-fb7rh"] May 22 10:36:02.732833 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:02.732813 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-fb7rh" May 22 10:36:02.734465 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:02.734444 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-c6fwx\"" May 22 10:36:02.734619 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:02.734605 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 22 10:36:02.742778 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:02.741982 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-fb7rh"] May 22 10:36:02.918390 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:02.918333 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e509b290-5763-4eaf-9657-944b739825b2-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-fb7rh\" (UID: \"e509b290-5763-4eaf-9657-944b739825b2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-fb7rh" May 22 10:36:03.018818 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:03.018741 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e509b290-5763-4eaf-9657-944b739825b2-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-fb7rh\" (UID: \"e509b290-5763-4eaf-9657-944b739825b2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-fb7rh" May 22 10:36:03.018979 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:36:03.018906 2558 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found May 22 10:36:03.019050 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:36:03.018990 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e509b290-5763-4eaf-9657-944b739825b2-tls-certificates podName:e509b290-5763-4eaf-9657-944b739825b2 nodeName:}" failed. No retries permitted until 2026-05-22 10:36:03.518968094 +0000 UTC m=+54.826227820 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/e509b290-5763-4eaf-9657-944b739825b2-tls-certificates") pod "prometheus-operator-admission-webhook-6c4bbc67b7-fb7rh" (UID: "e509b290-5763-4eaf-9657-944b739825b2") : secret "prometheus-operator-admission-webhook-tls" not found May 22 10:36:03.250931 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:03.250507 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:36:03.250931 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:03.250551 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:36:03.252751 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:03.252726 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 22 10:36:03.254433 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:03.254412 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 22 10:36:03.254641 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:03.254623 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 22 10:36:03.255544 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:03.255523 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4crrl\"" May 22 10:36:03.256027 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:03.255723 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vcplp\"" May 22 10:36:03.462490 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:03.462447 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9qzlm" event={"ID":"c269b171-f1f4-4551-8858-30a160b62289","Type":"ContainerStarted","Data":"7cdbffd360654e259e507a24fdae3c1dc8de7b782a76d945571679a45a98192f"} May 22 10:36:03.522775 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:03.522688 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e509b290-5763-4eaf-9657-944b739825b2-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-fb7rh\" (UID: \"e509b290-5763-4eaf-9657-944b739825b2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-fb7rh" May 22 10:36:03.522898 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:36:03.522837 2558 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found May 22 10:36:03.522945 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:36:03.522902 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e509b290-5763-4eaf-9657-944b739825b2-tls-certificates podName:e509b290-5763-4eaf-9657-944b739825b2 nodeName:}" failed. No retries permitted until 2026-05-22 10:36:04.522887525 +0000 UTC m=+55.830147253 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/e509b290-5763-4eaf-9657-944b739825b2-tls-certificates") pod "prometheus-operator-admission-webhook-6c4bbc67b7-fb7rh" (UID: "e509b290-5763-4eaf-9657-944b739825b2") : secret "prometheus-operator-admission-webhook-tls" not found May 22 10:36:04.528828 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:04.528802 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e509b290-5763-4eaf-9657-944b739825b2-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-fb7rh\" (UID: \"e509b290-5763-4eaf-9657-944b739825b2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-fb7rh" May 22 10:36:04.531257 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:04.531234 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e509b290-5763-4eaf-9657-944b739825b2-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-fb7rh\" (UID: \"e509b290-5763-4eaf-9657-944b739825b2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-fb7rh" May 22 10:36:04.543298 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:04.542824 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-fb7rh" May 22 10:36:04.683177 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:04.683089 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-fb7rh"] May 22 10:36:04.686935 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:36:04.686894 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode509b290_5763_4eaf_9657_944b739825b2.slice/crio-debe4bab6c844a1dba7e8dedb8fe9915274f5f548cbd5e201906beef97ffc0a5 WatchSource:0}: Error finding container debe4bab6c844a1dba7e8dedb8fe9915274f5f548cbd5e201906beef97ffc0a5: Status 404 returned error can't find the container with id debe4bab6c844a1dba7e8dedb8fe9915274f5f548cbd5e201906beef97ffc0a5 May 22 10:36:05.470594 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.470538 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-fb7rh" event={"ID":"e509b290-5763-4eaf-9657-944b739825b2","Type":"ContainerStarted","Data":"debe4bab6c844a1dba7e8dedb8fe9915274f5f548cbd5e201906beef97ffc0a5"} May 22 10:36:05.472237 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.472200 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kzbqx" event={"ID":"3fa09c0c-5066-401d-b52f-6bf653c7e16a","Type":"ContainerStarted","Data":"c3c84ef347a78cfef6594e3099676ec3c45181a871a4a125d2d706c401f74f55"} May 22 10:36:05.472237 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.472238 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kzbqx" event={"ID":"3fa09c0c-5066-401d-b52f-6bf653c7e16a","Type":"ContainerStarted","Data":"f8d34726cf3edea638dd50849b9df81dd2c122667a19958c6cb09d402b4b677f"} May 22 10:36:05.472447 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.472329 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kzbqx" May 22 10:36:05.473770 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.473743 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dkpsq" event={"ID":"b3ffc24b-3fd6-4134-964e-a2227bac423d","Type":"ContainerStarted","Data":"7709a08bd3ab180491d2c300970785e191bbfa1e7881ff0b2ed3cfd51b183a09"} May 22 10:36:05.475591 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.475569 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9qzlm" event={"ID":"c269b171-f1f4-4551-8858-30a160b62289","Type":"ContainerStarted","Data":"cdce2c0f3f6caf7283e0fd8e9bb5356c6e1da7ef34fa74647536267f34df2d14"} May 22 10:36:05.487221 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.487182 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-kzbqx" podStartSLOduration=2.172490553 podStartE2EDuration="4.487167104s" podCreationTimestamp="2026-05-22 10:36:01 +0000 UTC" firstStartedPulling="2026-05-22 10:36:02.115582105 +0000 UTC m=+53.422841830" lastFinishedPulling="2026-05-22 10:36:04.430258643 +0000 UTC m=+55.737518381" observedRunningTime="2026-05-22 10:36:05.485873395 +0000 UTC m=+56.793133141" watchObservedRunningTime="2026-05-22 10:36:05.487167104 +0000 UTC m=+56.794426852" May 22 10:36:05.504823 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.504152 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9qzlm" podStartSLOduration=2.161915587 podStartE2EDuration="4.504139934s" podCreationTimestamp="2026-05-22 10:36:01 +0000 UTC" firstStartedPulling="2026-05-22 10:36:02.09137988 +0000 UTC m=+53.398639608" lastFinishedPulling="2026-05-22 10:36:04.433604226 +0000 UTC m=+55.740863955" observedRunningTime="2026-05-22 10:36:05.504033094 +0000 UTC m=+56.811292851" watchObservedRunningTime="2026-05-22 10:36:05.504139934 +0000 UTC m=+56.811399680" May 22 10:36:05.518632 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.518465 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dkpsq" podStartSLOduration=2.112679479 podStartE2EDuration="4.518450057s" podCreationTimestamp="2026-05-22 10:36:01 +0000 UTC" firstStartedPulling="2026-05-22 10:36:02.027519119 +0000 UTC m=+53.334778843" lastFinishedPulling="2026-05-22 10:36:04.433289697 +0000 UTC m=+55.740549421" observedRunningTime="2026-05-22 10:36:05.518233991 +0000 UTC m=+56.825493739" watchObservedRunningTime="2026-05-22 10:36:05.518450057 +0000 UTC m=+56.825709801" May 22 10:36:05.652232 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.652199 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-74b767dd95-9dd58"] May 22 10:36:05.655462 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.655437 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74b767dd95-9dd58" May 22 10:36:05.657289 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.657225 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 22 10:36:05.657418 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.657228 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 22 10:36:05.657418 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.657324 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 22 10:36:05.657418 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.657238 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 22 10:36:05.657568 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.657306 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-crnvf\"" May 22 10:36:05.657568 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.657556 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 22 10:36:05.657677 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.657660 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 22 10:36:05.657771 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.657751 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 22 10:36:05.664779 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.664760 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 22 10:36:05.665420 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.665399 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74b767dd95-9dd58"] May 22 10:36:05.737646 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.737558 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f0ba409-dcff-463a-900d-bd2ffdeb1122-service-ca\") pod \"console-74b767dd95-9dd58\" (UID: \"7f0ba409-dcff-463a-900d-bd2ffdeb1122\") " pod="openshift-console/console-74b767dd95-9dd58" May 22 10:36:05.737646 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.737637 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f0ba409-dcff-463a-900d-bd2ffdeb1122-console-oauth-config\") pod \"console-74b767dd95-9dd58\" (UID: \"7f0ba409-dcff-463a-900d-bd2ffdeb1122\") " pod="openshift-console/console-74b767dd95-9dd58" May 22 10:36:05.737869 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.737686 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f0ba409-dcff-463a-900d-bd2ffdeb1122-console-config\") pod \"console-74b767dd95-9dd58\" (UID: \"7f0ba409-dcff-463a-900d-bd2ffdeb1122\") " pod="openshift-console/console-74b767dd95-9dd58" May 22 10:36:05.737869 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.737758 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f0ba409-dcff-463a-900d-bd2ffdeb1122-console-serving-cert\") pod \"console-74b767dd95-9dd58\" (UID: \"7f0ba409-dcff-463a-900d-bd2ffdeb1122\") " pod="openshift-console/console-74b767dd95-9dd58" May 22 10:36:05.737869 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.737788 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-544z4\" (UniqueName: \"kubernetes.io/projected/7f0ba409-dcff-463a-900d-bd2ffdeb1122-kube-api-access-544z4\") pod \"console-74b767dd95-9dd58\" (UID: \"7f0ba409-dcff-463a-900d-bd2ffdeb1122\") " pod="openshift-console/console-74b767dd95-9dd58" May 22 10:36:05.737869 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.737817 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f0ba409-dcff-463a-900d-bd2ffdeb1122-trusted-ca-bundle\") pod \"console-74b767dd95-9dd58\" (UID: \"7f0ba409-dcff-463a-900d-bd2ffdeb1122\") " pod="openshift-console/console-74b767dd95-9dd58" May 22 10:36:05.737869 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.737852 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f0ba409-dcff-463a-900d-bd2ffdeb1122-oauth-serving-cert\") pod \"console-74b767dd95-9dd58\" (UID: \"7f0ba409-dcff-463a-900d-bd2ffdeb1122\") " pod="openshift-console/console-74b767dd95-9dd58" May 22 10:36:05.838274 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.838249 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f0ba409-dcff-463a-900d-bd2ffdeb1122-console-config\") pod \"console-74b767dd95-9dd58\" (UID: \"7f0ba409-dcff-463a-900d-bd2ffdeb1122\") " pod="openshift-console/console-74b767dd95-9dd58" May 22 10:36:05.838435 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.838301 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f0ba409-dcff-463a-900d-bd2ffdeb1122-console-serving-cert\") pod \"console-74b767dd95-9dd58\" (UID: \"7f0ba409-dcff-463a-900d-bd2ffdeb1122\") " pod="openshift-console/console-74b767dd95-9dd58" May 22 10:36:05.838435 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.838320 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-544z4\" (UniqueName: \"kubernetes.io/projected/7f0ba409-dcff-463a-900d-bd2ffdeb1122-kube-api-access-544z4\") pod \"console-74b767dd95-9dd58\" (UID: \"7f0ba409-dcff-463a-900d-bd2ffdeb1122\") " pod="openshift-console/console-74b767dd95-9dd58" May 22 10:36:05.838435 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.838356 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f0ba409-dcff-463a-900d-bd2ffdeb1122-trusted-ca-bundle\") pod \"console-74b767dd95-9dd58\" (UID: \"7f0ba409-dcff-463a-900d-bd2ffdeb1122\") " pod="openshift-console/console-74b767dd95-9dd58" May 22 10:36:05.838435 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.838385 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f0ba409-dcff-463a-900d-bd2ffdeb1122-oauth-serving-cert\") pod \"console-74b767dd95-9dd58\" (UID: \"7f0ba409-dcff-463a-900d-bd2ffdeb1122\") " pod="openshift-console/console-74b767dd95-9dd58" May 22 10:36:05.838647 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.838571 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f0ba409-dcff-463a-900d-bd2ffdeb1122-service-ca\") pod \"console-74b767dd95-9dd58\" (UID: \"7f0ba409-dcff-463a-900d-bd2ffdeb1122\") " pod="openshift-console/console-74b767dd95-9dd58" May 22 10:36:05.838647 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.838635 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f0ba409-dcff-463a-900d-bd2ffdeb1122-console-oauth-config\") pod \"console-74b767dd95-9dd58\" (UID: \"7f0ba409-dcff-463a-900d-bd2ffdeb1122\") " pod="openshift-console/console-74b767dd95-9dd58" May 22 10:36:05.839040 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.839014 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f0ba409-dcff-463a-900d-bd2ffdeb1122-console-config\") pod \"console-74b767dd95-9dd58\" (UID: \"7f0ba409-dcff-463a-900d-bd2ffdeb1122\") " pod="openshift-console/console-74b767dd95-9dd58" May 22 10:36:05.839148 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.839131 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f0ba409-dcff-463a-900d-bd2ffdeb1122-service-ca\") pod \"console-74b767dd95-9dd58\" (UID: \"7f0ba409-dcff-463a-900d-bd2ffdeb1122\") " pod="openshift-console/console-74b767dd95-9dd58" May 22 10:36:05.839210 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.839169 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f0ba409-dcff-463a-900d-bd2ffdeb1122-trusted-ca-bundle\") pod \"console-74b767dd95-9dd58\" (UID: \"7f0ba409-dcff-463a-900d-bd2ffdeb1122\") " pod="openshift-console/console-74b767dd95-9dd58" May 22 10:36:05.839458 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.839285 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f0ba409-dcff-463a-900d-bd2ffdeb1122-oauth-serving-cert\") pod \"console-74b767dd95-9dd58\" (UID: \"7f0ba409-dcff-463a-900d-bd2ffdeb1122\") " pod="openshift-console/console-74b767dd95-9dd58" May 22 10:36:05.841038 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.841011 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f0ba409-dcff-463a-900d-bd2ffdeb1122-console-serving-cert\") pod \"console-74b767dd95-9dd58\" (UID: \"7f0ba409-dcff-463a-900d-bd2ffdeb1122\") " pod="openshift-console/console-74b767dd95-9dd58" May 22 10:36:05.841146 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.841131 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f0ba409-dcff-463a-900d-bd2ffdeb1122-console-oauth-config\") pod \"console-74b767dd95-9dd58\" (UID: \"7f0ba409-dcff-463a-900d-bd2ffdeb1122\") " pod="openshift-console/console-74b767dd95-9dd58" May 22 10:36:05.844536 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.844513 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-544z4\" (UniqueName: \"kubernetes.io/projected/7f0ba409-dcff-463a-900d-bd2ffdeb1122-kube-api-access-544z4\") pod \"console-74b767dd95-9dd58\" (UID: \"7f0ba409-dcff-463a-900d-bd2ffdeb1122\") " pod="openshift-console/console-74b767dd95-9dd58" May 22 10:36:05.966695 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:05.966667 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74b767dd95-9dd58" May 22 10:36:06.084734 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:06.084704 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74b767dd95-9dd58"] May 22 10:36:06.087460 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:36:06.087436 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f0ba409_dcff_463a_900d_bd2ffdeb1122.slice/crio-e93040fe8629d5dc3cfcbf2e81309fff31c8058855371ee2d31c32904747b008 WatchSource:0}: Error finding container e93040fe8629d5dc3cfcbf2e81309fff31c8058855371ee2d31c32904747b008: Status 404 returned error can't find the container with id e93040fe8629d5dc3cfcbf2e81309fff31c8058855371ee2d31c32904747b008 May 22 10:36:06.480162 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:06.480123 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74b767dd95-9dd58" event={"ID":"7f0ba409-dcff-463a-900d-bd2ffdeb1122","Type":"ContainerStarted","Data":"e93040fe8629d5dc3cfcbf2e81309fff31c8058855371ee2d31c32904747b008"} May 22 10:36:06.481732 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:06.481691 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-fb7rh" event={"ID":"e509b290-5763-4eaf-9657-944b739825b2","Type":"ContainerStarted","Data":"87a2e7f9ac8566adf1c801039bd7870e278692e0cbda51024fc32d81d042449f"} May 22 10:36:06.495506 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:06.495457 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-fb7rh" podStartSLOduration=3.349305362 podStartE2EDuration="4.495441612s" podCreationTimestamp="2026-05-22 10:36:02 +0000 UTC" firstStartedPulling="2026-05-22 10:36:04.688969963 +0000 UTC m=+55.996229688" lastFinishedPulling="2026-05-22 10:36:05.835106209 +0000 UTC m=+57.142365938" observedRunningTime="2026-05-22 10:36:06.49521129 +0000 UTC m=+57.802471038" watchObservedRunningTime="2026-05-22 10:36:06.495441612 +0000 UTC m=+57.802701362" May 22 10:36:07.484732 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:07.484682 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-fb7rh" May 22 10:36:07.490173 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:07.490145 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-fb7rh" May 22 10:36:07.790264 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:07.790184 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-7l26n"] May 22 10:36:07.793548 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:07.793527 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-7l26n" May 22 10:36:07.795298 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:07.795269 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 22 10:36:07.795440 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:07.795282 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 22 10:36:07.795857 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:07.795833 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 22 10:36:07.795961 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:07.795937 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 22 10:36:07.796023 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:07.795973 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 22 10:36:07.796085 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:07.796035 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-rtrwz\"" May 22 10:36:07.799746 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:07.799723 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-7l26n"] May 22 10:36:07.852203 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:07.852156 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fca21eb7-1c8b-4dab-bb32-8d933b497156-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-7l26n\" (UID: \"fca21eb7-1c8b-4dab-bb32-8d933b497156\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7l26n" May 22 10:36:07.852203 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:07.852203 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fca21eb7-1c8b-4dab-bb32-8d933b497156-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-7l26n\" (UID: \"fca21eb7-1c8b-4dab-bb32-8d933b497156\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7l26n" May 22 10:36:07.852483 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:07.852264 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fca21eb7-1c8b-4dab-bb32-8d933b497156-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-7l26n\" (UID: \"fca21eb7-1c8b-4dab-bb32-8d933b497156\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7l26n" May 22 10:36:07.852483 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:07.852291 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpq9x\" (UniqueName: \"kubernetes.io/projected/fca21eb7-1c8b-4dab-bb32-8d933b497156-kube-api-access-jpq9x\") pod \"prometheus-operator-7779bbdd78-7l26n\" (UID: \"fca21eb7-1c8b-4dab-bb32-8d933b497156\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7l26n" May 22 10:36:07.953026 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:07.952990 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fca21eb7-1c8b-4dab-bb32-8d933b497156-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-7l26n\" (UID: \"fca21eb7-1c8b-4dab-bb32-8d933b497156\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7l26n" May 22 10:36:07.953026 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:07.953036 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fca21eb7-1c8b-4dab-bb32-8d933b497156-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-7l26n\" (UID: \"fca21eb7-1c8b-4dab-bb32-8d933b497156\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7l26n" May 22 10:36:07.953277 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:07.953100 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fca21eb7-1c8b-4dab-bb32-8d933b497156-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-7l26n\" (UID: \"fca21eb7-1c8b-4dab-bb32-8d933b497156\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7l26n" May 22 10:36:07.953277 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:07.953129 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jpq9x\" (UniqueName: \"kubernetes.io/projected/fca21eb7-1c8b-4dab-bb32-8d933b497156-kube-api-access-jpq9x\") pod \"prometheus-operator-7779bbdd78-7l26n\" (UID: \"fca21eb7-1c8b-4dab-bb32-8d933b497156\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7l26n" May 22 10:36:07.953277 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:36:07.953178 2558 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found May 22 10:36:07.953277 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:36:07.953271 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fca21eb7-1c8b-4dab-bb32-8d933b497156-prometheus-operator-tls podName:fca21eb7-1c8b-4dab-bb32-8d933b497156 nodeName:}" failed. No retries permitted until 2026-05-22 10:36:08.45324671 +0000 UTC m=+59.760506436 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/fca21eb7-1c8b-4dab-bb32-8d933b497156-prometheus-operator-tls") pod "prometheus-operator-7779bbdd78-7l26n" (UID: "fca21eb7-1c8b-4dab-bb32-8d933b497156") : secret "prometheus-operator-tls" not found May 22 10:36:07.953841 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:07.953807 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fca21eb7-1c8b-4dab-bb32-8d933b497156-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-7l26n\" (UID: \"fca21eb7-1c8b-4dab-bb32-8d933b497156\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7l26n" May 22 10:36:07.956264 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:07.956238 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fca21eb7-1c8b-4dab-bb32-8d933b497156-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-7l26n\" (UID: \"fca21eb7-1c8b-4dab-bb32-8d933b497156\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7l26n" May 22 10:36:07.963167 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:07.963146 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpq9x\" (UniqueName: \"kubernetes.io/projected/fca21eb7-1c8b-4dab-bb32-8d933b497156-kube-api-access-jpq9x\") pod \"prometheus-operator-7779bbdd78-7l26n\" (UID: \"fca21eb7-1c8b-4dab-bb32-8d933b497156\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7l26n" May 22 10:36:08.405102 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:08.405072 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jzgxh" May 22 10:36:08.457577 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:08.457544 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fca21eb7-1c8b-4dab-bb32-8d933b497156-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-7l26n\" (UID: \"fca21eb7-1c8b-4dab-bb32-8d933b497156\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7l26n" May 22 10:36:08.460572 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:08.460545 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fca21eb7-1c8b-4dab-bb32-8d933b497156-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-7l26n\" (UID: \"fca21eb7-1c8b-4dab-bb32-8d933b497156\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7l26n" May 22 10:36:08.704847 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:08.704820 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-7l26n" May 22 10:36:08.826487 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:08.826445 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-7l26n"] May 22 10:36:08.832253 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:36:08.832216 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfca21eb7_1c8b_4dab_bb32_8d933b497156.slice/crio-0dfa09af74d97d03f9f55bda066449e87f1f5e720cf6a6cc819071363ef8ff20 WatchSource:0}: Error finding container 0dfa09af74d97d03f9f55bda066449e87f1f5e720cf6a6cc819071363ef8ff20: Status 404 returned error can't find the container with id 0dfa09af74d97d03f9f55bda066449e87f1f5e720cf6a6cc819071363ef8ff20 May 22 10:36:09.491667 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:09.491624 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74b767dd95-9dd58" event={"ID":"7f0ba409-dcff-463a-900d-bd2ffdeb1122","Type":"ContainerStarted","Data":"a3cc5ce90433cad5a662456238f2cbad69c7fe61fbaa3998b324afbffee91150"} May 22 10:36:09.492839 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:09.492806 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-7l26n" event={"ID":"fca21eb7-1c8b-4dab-bb32-8d933b497156","Type":"ContainerStarted","Data":"0dfa09af74d97d03f9f55bda066449e87f1f5e720cf6a6cc819071363ef8ff20"} May 22 10:36:09.507345 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:09.507265 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-74b767dd95-9dd58" podStartSLOduration=1.996983462 podStartE2EDuration="4.5072519s" podCreationTimestamp="2026-05-22 10:36:05 +0000 UTC" firstStartedPulling="2026-05-22 10:36:06.089165287 +0000 UTC m=+57.396425011" lastFinishedPulling="2026-05-22 10:36:08.599433725 +0000 UTC m=+59.906693449" observedRunningTime="2026-05-22 10:36:09.505524683 +0000 UTC m=+60.812784429" watchObservedRunningTime="2026-05-22 10:36:09.5072519 +0000 UTC m=+60.814511648" May 22 10:36:10.497827 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:10.497785 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-7l26n" event={"ID":"fca21eb7-1c8b-4dab-bb32-8d933b497156","Type":"ContainerStarted","Data":"e6bb1b4cba0fa4a88f772e0af53080802f7f08c81c937077948afb3b6b84c548"} May 22 10:36:10.498282 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:10.497843 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-7l26n" event={"ID":"fca21eb7-1c8b-4dab-bb32-8d933b497156","Type":"ContainerStarted","Data":"92e57133dbaebe6316259da3bf38281397f27241a5396c09282bfb0d281d7227"} May 22 10:36:10.511674 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:10.511625 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-7l26n" podStartSLOduration=2.052273738 podStartE2EDuration="3.511611077s" podCreationTimestamp="2026-05-22 10:36:07 +0000 UTC" firstStartedPulling="2026-05-22 10:36:08.833808957 +0000 UTC m=+60.141068682" lastFinishedPulling="2026-05-22 10:36:10.293146293 +0000 UTC m=+61.600406021" observedRunningTime="2026-05-22 10:36:10.511365055 +0000 UTC m=+61.818624795" watchObservedRunningTime="2026-05-22 10:36:10.511611077 +0000 UTC m=+61.818870823" May 22 10:36:12.136394 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.136360 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-zbrp2"] May 22 10:36:12.138188 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.138172 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-zbrp2" May 22 10:36:12.140500 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.140476 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-t2hzp\"" May 22 10:36:12.140655 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.140476 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 22 10:36:12.140655 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.140537 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 22 10:36:12.147106 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.147087 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-8cb4d"] May 22 10:36:12.148863 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.148848 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8cb4d" May 22 10:36:12.150510 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.150492 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 22 10:36:12.150595 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.150547 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 22 10:36:12.150595 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.150554 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-rc2kv\"" May 22 10:36:12.150595 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.150580 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 22 10:36:12.156468 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.156442 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-zbrp2"] May 22 10:36:12.157439 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.157420 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-8cb4d"] May 22 10:36:12.175739 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.175712 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-c84ld"] May 22 10:36:12.177831 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.177817 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c84ld" May 22 10:36:12.179585 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.179560 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 22 10:36:12.179698 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.179612 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 22 10:36:12.179698 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.179566 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gdkhw\"" May 22 10:36:12.179698 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.179570 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 22 10:36:12.184542 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.184516 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-zbrp2\" (UID: \"4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zbrp2" May 22 10:36:12.184621 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.184577 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7d6db79-9593-42ee-b392-f6462706dcc0-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-8cb4d\" (UID: \"b7d6db79-9593-42ee-b392-f6462706dcc0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8cb4d" May 22 10:36:12.184621 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.184601 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b7d6db79-9593-42ee-b392-f6462706dcc0-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-8cb4d\" (UID: \"b7d6db79-9593-42ee-b392-f6462706dcc0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8cb4d" May 22 10:36:12.184687 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.184625 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-zbrp2\" (UID: \"4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zbrp2" May 22 10:36:12.184687 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.184649 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdkmd\" (UniqueName: \"kubernetes.io/projected/4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd-kube-api-access-hdkmd\") pod \"openshift-state-metrics-9c959559f-zbrp2\" (UID: \"4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zbrp2" May 22 10:36:12.184764 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.184692 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b7d6db79-9593-42ee-b392-f6462706dcc0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-8cb4d\" (UID: \"b7d6db79-9593-42ee-b392-f6462706dcc0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8cb4d" May 22 10:36:12.184764 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.184712 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6zf4\" (UniqueName: \"kubernetes.io/projected/b7d6db79-9593-42ee-b392-f6462706dcc0-kube-api-access-h6zf4\") pod \"kube-state-metrics-54fd6bc5c4-8cb4d\" (UID: \"b7d6db79-9593-42ee-b392-f6462706dcc0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8cb4d" May 22 10:36:12.184764 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.184753 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b7d6db79-9593-42ee-b392-f6462706dcc0-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-8cb4d\" (UID: \"b7d6db79-9593-42ee-b392-f6462706dcc0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8cb4d" May 22 10:36:12.184871 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.184854 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-zbrp2\" (UID: \"4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zbrp2" May 22 10:36:12.184910 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.184897 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7d6db79-9593-42ee-b392-f6462706dcc0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-8cb4d\" (UID: \"b7d6db79-9593-42ee-b392-f6462706dcc0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8cb4d" May 22 10:36:12.285233 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.285198 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-zbrp2\" (UID: \"4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zbrp2" May 22 10:36:12.285233 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.285237 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrvng\" (UniqueName: \"kubernetes.io/projected/d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a-kube-api-access-rrvng\") pod \"node-exporter-c84ld\" (UID: \"d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a\") " pod="openshift-monitoring/node-exporter-c84ld" May 22 10:36:12.285457 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.285257 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7d6db79-9593-42ee-b392-f6462706dcc0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-8cb4d\" (UID: \"b7d6db79-9593-42ee-b392-f6462706dcc0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8cb4d" May 22 10:36:12.285457 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.285274 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a-root\") pod \"node-exporter-c84ld\" (UID: \"d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a\") " pod="openshift-monitoring/node-exporter-c84ld" May 22 10:36:12.285457 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:36:12.285363 2558 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found May 22 10:36:12.285457 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.285387 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-zbrp2\" (UID: \"4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zbrp2" May 22 10:36:12.285457 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:36:12.285431 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd-openshift-state-metrics-tls podName:4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd nodeName:}" failed. No retries permitted until 2026-05-22 10:36:12.785411269 +0000 UTC m=+64.092670995 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-zbrp2" (UID: "4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd") : secret "openshift-state-metrics-tls" not found May 22 10:36:12.285457 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.285450 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a-node-exporter-tls\") pod \"node-exporter-c84ld\" (UID: \"d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a\") " pod="openshift-monitoring/node-exporter-c84ld" May 22 10:36:12.285696 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.285482 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a-node-exporter-textfile\") pod \"node-exporter-c84ld\" (UID: \"d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a\") " pod="openshift-monitoring/node-exporter-c84ld" May 22 10:36:12.285696 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.285507 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a-node-exporter-accelerators-collector-config\") pod \"node-exporter-c84ld\" (UID: \"d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a\") " pod="openshift-monitoring/node-exporter-c84ld" May 22 10:36:12.285696 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.285541 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c84ld\" (UID: \"d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a\") " pod="openshift-monitoring/node-exporter-c84ld" May 22 10:36:12.285696 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.285576 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7d6db79-9593-42ee-b392-f6462706dcc0-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-8cb4d\" (UID: \"b7d6db79-9593-42ee-b392-f6462706dcc0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8cb4d" May 22 10:36:12.285696 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.285601 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a-node-exporter-wtmp\") pod \"node-exporter-c84ld\" (UID: \"d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a\") " pod="openshift-monitoring/node-exporter-c84ld" May 22 10:36:12.285696 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.285646 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b7d6db79-9593-42ee-b392-f6462706dcc0-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-8cb4d\" (UID: \"b7d6db79-9593-42ee-b392-f6462706dcc0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8cb4d" May 22 10:36:12.285696 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.285678 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-zbrp2\" (UID: \"4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zbrp2" May 22 10:36:12.286213 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.285703 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hdkmd\" (UniqueName: \"kubernetes.io/projected/4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd-kube-api-access-hdkmd\") pod \"openshift-state-metrics-9c959559f-zbrp2\" (UID: \"4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zbrp2" May 22 10:36:12.286213 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:36:12.285740 2558 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found May 22 10:36:12.286213 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.285748 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b7d6db79-9593-42ee-b392-f6462706dcc0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-8cb4d\" (UID: \"b7d6db79-9593-42ee-b392-f6462706dcc0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8cb4d" May 22 10:36:12.286213 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.285777 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a-metrics-client-ca\") pod \"node-exporter-c84ld\" (UID: \"d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a\") " pod="openshift-monitoring/node-exporter-c84ld" May 22 10:36:12.286213 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:36:12.285812 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7d6db79-9593-42ee-b392-f6462706dcc0-kube-state-metrics-tls podName:b7d6db79-9593-42ee-b392-f6462706dcc0 nodeName:}" failed. No retries permitted until 2026-05-22 10:36:12.785796573 +0000 UTC m=+64.093056302 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b7d6db79-9593-42ee-b392-f6462706dcc0-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-8cb4d" (UID: "b7d6db79-9593-42ee-b392-f6462706dcc0") : secret "kube-state-metrics-tls" not found May 22 10:36:12.286213 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.285831 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h6zf4\" (UniqueName: \"kubernetes.io/projected/b7d6db79-9593-42ee-b392-f6462706dcc0-kube-api-access-h6zf4\") pod \"kube-state-metrics-54fd6bc5c4-8cb4d\" (UID: \"b7d6db79-9593-42ee-b392-f6462706dcc0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8cb4d" May 22 10:36:12.286213 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.285857 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b7d6db79-9593-42ee-b392-f6462706dcc0-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-8cb4d\" (UID: \"b7d6db79-9593-42ee-b392-f6462706dcc0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8cb4d" May 22 10:36:12.286213 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.285882 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a-sys\") pod \"node-exporter-c84ld\" (UID: \"d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a\") " pod="openshift-monitoring/node-exporter-c84ld" May 22 10:36:12.286213 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.286086 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-zbrp2\" (UID: \"4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zbrp2" May 22 10:36:12.286688 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.286285 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b7d6db79-9593-42ee-b392-f6462706dcc0-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-8cb4d\" (UID: \"b7d6db79-9593-42ee-b392-f6462706dcc0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8cb4d" May 22 10:36:12.286688 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.286317 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7d6db79-9593-42ee-b392-f6462706dcc0-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-8cb4d\" (UID: \"b7d6db79-9593-42ee-b392-f6462706dcc0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8cb4d" May 22 10:36:12.286688 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.286486 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b7d6db79-9593-42ee-b392-f6462706dcc0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-8cb4d\" (UID: \"b7d6db79-9593-42ee-b392-f6462706dcc0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8cb4d" May 22 10:36:12.287999 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.287973 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7d6db79-9593-42ee-b392-f6462706dcc0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-8cb4d\" (UID: \"b7d6db79-9593-42ee-b392-f6462706dcc0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8cb4d" May 22 10:36:12.288115 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.287996 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-zbrp2\" (UID: \"4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zbrp2" May 22 10:36:12.295967 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.295944 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6zf4\" (UniqueName: \"kubernetes.io/projected/b7d6db79-9593-42ee-b392-f6462706dcc0-kube-api-access-h6zf4\") pod \"kube-state-metrics-54fd6bc5c4-8cb4d\" (UID: \"b7d6db79-9593-42ee-b392-f6462706dcc0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8cb4d" May 22 10:36:12.296048 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.295969 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdkmd\" (UniqueName: \"kubernetes.io/projected/4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd-kube-api-access-hdkmd\") pod \"openshift-state-metrics-9c959559f-zbrp2\" (UID: \"4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zbrp2" May 22 10:36:12.386599 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.386521 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rrvng\" (UniqueName: \"kubernetes.io/projected/d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a-kube-api-access-rrvng\") pod \"node-exporter-c84ld\" (UID: \"d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a\") " pod="openshift-monitoring/node-exporter-c84ld" May 22 10:36:12.386599 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.386556 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a-root\") pod \"node-exporter-c84ld\" (UID: \"d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a\") " pod="openshift-monitoring/node-exporter-c84ld" May 22 10:36:12.386802 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.386694 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a-root\") pod \"node-exporter-c84ld\" (UID: \"d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a\") " pod="openshift-monitoring/node-exporter-c84ld" May 22 10:36:12.386802 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.386725 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a-node-exporter-tls\") pod \"node-exporter-c84ld\" (UID: \"d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a\") " pod="openshift-monitoring/node-exporter-c84ld" May 22 10:36:12.386802 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.386749 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a-node-exporter-textfile\") pod \"node-exporter-c84ld\" (UID: \"d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a\") " pod="openshift-monitoring/node-exporter-c84ld" May 22 10:36:12.386802 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.386765 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a-node-exporter-accelerators-collector-config\") pod \"node-exporter-c84ld\" (UID: \"d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a\") " pod="openshift-monitoring/node-exporter-c84ld" May 22 10:36:12.386802 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.386789 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c84ld\" (UID: \"d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a\") " pod="openshift-monitoring/node-exporter-c84ld" May 22 10:36:12.387039 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.386823 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a-node-exporter-wtmp\") pod \"node-exporter-c84ld\" (UID: \"d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a\") " pod="openshift-monitoring/node-exporter-c84ld" May 22 10:36:12.387039 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.386882 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a-metrics-client-ca\") pod \"node-exporter-c84ld\" (UID: \"d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a\") " pod="openshift-monitoring/node-exporter-c84ld" May 22 10:36:12.387039 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:36:12.386883 2558 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 22 10:36:12.387039 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.386908 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a-sys\") pod \"node-exporter-c84ld\" (UID: \"d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a\") " pod="openshift-monitoring/node-exporter-c84ld" May 22 10:36:12.387039 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:36:12.386947 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a-node-exporter-tls podName:d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a nodeName:}" failed. No retries permitted until 2026-05-22 10:36:12.886927965 +0000 UTC m=+64.194187689 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a-node-exporter-tls") pod "node-exporter-c84ld" (UID: "d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a") : secret "node-exporter-tls" not found May 22 10:36:12.387039 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.386968 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a-sys\") pod \"node-exporter-c84ld\" (UID: \"d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a\") " pod="openshift-monitoring/node-exporter-c84ld" May 22 10:36:12.387329 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.387081 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a-node-exporter-wtmp\") pod \"node-exporter-c84ld\" (UID: \"d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a\") " pod="openshift-monitoring/node-exporter-c84ld" May 22 10:36:12.387329 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.387125 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a-node-exporter-textfile\") pod \"node-exporter-c84ld\" (UID: \"d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a\") " pod="openshift-monitoring/node-exporter-c84ld" May 22 10:36:12.387446 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.387373 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a-node-exporter-accelerators-collector-config\") pod \"node-exporter-c84ld\" (UID: \"d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a\") " pod="openshift-monitoring/node-exporter-c84ld" May 22 10:36:12.387512 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.387489 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a-metrics-client-ca\") pod \"node-exporter-c84ld\" (UID: \"d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a\") " pod="openshift-monitoring/node-exporter-c84ld" May 22 10:36:12.389183 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.389162 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c84ld\" (UID: \"d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a\") " pod="openshift-monitoring/node-exporter-c84ld" May 22 10:36:12.395006 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.394989 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrvng\" (UniqueName: \"kubernetes.io/projected/d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a-kube-api-access-rrvng\") pod \"node-exporter-c84ld\" (UID: \"d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a\") " pod="openshift-monitoring/node-exporter-c84ld" May 22 10:36:12.790758 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.790725 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-zbrp2\" (UID: \"4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zbrp2" May 22 10:36:12.790928 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.790791 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b7d6db79-9593-42ee-b392-f6462706dcc0-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-8cb4d\" (UID: \"b7d6db79-9593-42ee-b392-f6462706dcc0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8cb4d" May 22 10:36:12.793229 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.793206 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-zbrp2\" (UID: \"4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-zbrp2" May 22 10:36:12.793229 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.793219 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b7d6db79-9593-42ee-b392-f6462706dcc0-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-8cb4d\" (UID: \"b7d6db79-9593-42ee-b392-f6462706dcc0\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8cb4d" May 22 10:36:12.891709 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.891679 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a-node-exporter-tls\") pod \"node-exporter-c84ld\" (UID: \"d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a\") " pod="openshift-monitoring/node-exporter-c84ld" May 22 10:36:12.893944 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:12.893920 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a-node-exporter-tls\") pod \"node-exporter-c84ld\" (UID: \"d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a\") " pod="openshift-monitoring/node-exporter-c84ld" May 22 10:36:13.046743 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.046662 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-zbrp2" May 22 10:36:13.057684 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.057660 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8cb4d" May 22 10:36:13.086659 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.086180 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c84ld" May 22 10:36:13.099481 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:36:13.099385 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8f3a1b8_e6a4_416e_b24d_908c0ac7a40a.slice/crio-9ef2af517e59186a6bba1053bc33f5425173e1c4c07c4d551b04a1b1915d1931 WatchSource:0}: Error finding container 9ef2af517e59186a6bba1053bc33f5425173e1c4c07c4d551b04a1b1915d1931: Status 404 returned error can't find the container with id 9ef2af517e59186a6bba1053bc33f5425173e1c4c07c4d551b04a1b1915d1931 May 22 10:36:13.189041 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.188972 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-zbrp2"] May 22 10:36:13.192685 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:36:13.192656 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d1f7bd3_8dd2_4213_a3ae_4cfca07dd1fd.slice/crio-781e208634a8e2c3c14203015bf47f25b630cf04e582844a34760933ee09e4db WatchSource:0}: Error finding container 781e208634a8e2c3c14203015bf47f25b630cf04e582844a34760933ee09e4db: Status 404 returned error can't find the container with id 781e208634a8e2c3c14203015bf47f25b630cf04e582844a34760933ee09e4db May 22 10:36:13.209007 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.208982 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-8cb4d"] May 22 10:36:13.212326 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:36:13.212295 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7d6db79_9593_42ee_b392_f6462706dcc0.slice/crio-49301f8847abf473dada4738bb5d2540aee4e4ec8f297e35f734f003bb9a2ac1 WatchSource:0}: Error finding container 49301f8847abf473dada4738bb5d2540aee4e4ec8f297e35f734f003bb9a2ac1: Status 404 returned error can't find the container with id 49301f8847abf473dada4738bb5d2540aee4e4ec8f297e35f734f003bb9a2ac1 May 22 10:36:13.215710 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.215689 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 22 10:36:13.218435 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.218415 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.220131 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.220115 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 22 10:36:13.220194 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.220115 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 22 10:36:13.220393 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.220372 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 22 10:36:13.220949 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.220588 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 22 10:36:13.220949 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.220677 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 22 10:36:13.220949 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.220695 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 22 10:36:13.220949 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.220772 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 22 10:36:13.220949 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.220874 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 22 10:36:13.220949 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.220909 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 22 10:36:13.221321 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.220983 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-sm7q5\"" May 22 10:36:13.230991 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.230941 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 22 10:36:13.297802 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.297722 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/026972a8-c35b-4157-a84b-b877e8ed7fa8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.297925 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.297845 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/026972a8-c35b-4157-a84b-b877e8ed7fa8-config-volume\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.297925 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.297871 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/026972a8-c35b-4157-a84b-b877e8ed7fa8-web-config\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.297925 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.297903 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/026972a8-c35b-4157-a84b-b877e8ed7fa8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.297925 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.297923 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/026972a8-c35b-4157-a84b-b877e8ed7fa8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.298135 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.297968 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/026972a8-c35b-4157-a84b-b877e8ed7fa8-config-out\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.298135 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.298001 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/026972a8-c35b-4157-a84b-b877e8ed7fa8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.298135 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.298032 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/026972a8-c35b-4157-a84b-b877e8ed7fa8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.298135 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.298059 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/026972a8-c35b-4157-a84b-b877e8ed7fa8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.298267 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.298158 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/026972a8-c35b-4157-a84b-b877e8ed7fa8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.298267 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.298183 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/026972a8-c35b-4157-a84b-b877e8ed7fa8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.298267 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.298214 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/026972a8-c35b-4157-a84b-b877e8ed7fa8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.298267 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.298245 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkg7p\" (UniqueName: \"kubernetes.io/projected/026972a8-c35b-4157-a84b-b877e8ed7fa8-kube-api-access-kkg7p\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.399598 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.399566 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/026972a8-c35b-4157-a84b-b877e8ed7fa8-config-out\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.399598 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.399600 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/026972a8-c35b-4157-a84b-b877e8ed7fa8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.399759 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.399623 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/026972a8-c35b-4157-a84b-b877e8ed7fa8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.399759 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.399652 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/026972a8-c35b-4157-a84b-b877e8ed7fa8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.399759 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.399705 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/026972a8-c35b-4157-a84b-b877e8ed7fa8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.399759 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.399733 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/026972a8-c35b-4157-a84b-b877e8ed7fa8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.399924 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.399766 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/026972a8-c35b-4157-a84b-b877e8ed7fa8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.399924 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.399784 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kkg7p\" (UniqueName: \"kubernetes.io/projected/026972a8-c35b-4157-a84b-b877e8ed7fa8-kube-api-access-kkg7p\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.399924 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.399819 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/026972a8-c35b-4157-a84b-b877e8ed7fa8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.399924 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.399878 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/026972a8-c35b-4157-a84b-b877e8ed7fa8-config-volume\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.399924 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:36:13.399908 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/026972a8-c35b-4157-a84b-b877e8ed7fa8-alertmanager-trusted-ca-bundle podName:026972a8-c35b-4157-a84b-b877e8ed7fa8 nodeName:}" failed. No retries permitted until 2026-05-22 10:36:13.899885383 +0000 UTC m=+65.207145126 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/026972a8-c35b-4157-a84b-b877e8ed7fa8-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "026972a8-c35b-4157-a84b-b877e8ed7fa8") : configmap references non-existent config key: ca-bundle.crt May 22 10:36:13.400193 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.399953 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/026972a8-c35b-4157-a84b-b877e8ed7fa8-web-config\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.400193 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.399994 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/026972a8-c35b-4157-a84b-b877e8ed7fa8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.400193 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.400024 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/026972a8-c35b-4157-a84b-b877e8ed7fa8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.400193 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.400074 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/026972a8-c35b-4157-a84b-b877e8ed7fa8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.400966 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.400885 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/026972a8-c35b-4157-a84b-b877e8ed7fa8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.402818 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.402764 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/026972a8-c35b-4157-a84b-b877e8ed7fa8-config-out\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.402949 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.402843 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/026972a8-c35b-4157-a84b-b877e8ed7fa8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.403186 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.403161 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/026972a8-c35b-4157-a84b-b877e8ed7fa8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.403558 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.403538 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/026972a8-c35b-4157-a84b-b877e8ed7fa8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.403634 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.403581 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/026972a8-c35b-4157-a84b-b877e8ed7fa8-config-volume\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.403697 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.403634 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/026972a8-c35b-4157-a84b-b877e8ed7fa8-web-config\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.404029 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.404009 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/026972a8-c35b-4157-a84b-b877e8ed7fa8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.404541 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.404521 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/026972a8-c35b-4157-a84b-b877e8ed7fa8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.404932 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.404918 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/026972a8-c35b-4157-a84b-b877e8ed7fa8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.409473 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.409455 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkg7p\" (UniqueName: \"kubernetes.io/projected/026972a8-c35b-4157-a84b-b877e8ed7fa8-kube-api-access-kkg7p\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.507533 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.507499 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c84ld" event={"ID":"d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a","Type":"ContainerStarted","Data":"9ef2af517e59186a6bba1053bc33f5425173e1c4c07c4d551b04a1b1915d1931"} May 22 10:36:13.509030 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.509003 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-zbrp2" event={"ID":"4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd","Type":"ContainerStarted","Data":"8fffbfc2f066baf431d298f52047ccad833dc581ffa3474e827c95adefa8915c"} May 22 10:36:13.509030 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.509040 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-zbrp2" event={"ID":"4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd","Type":"ContainerStarted","Data":"4ca5c974862d79f4c0236f768a2774f55eca918f4beba50d6b6a2f3114bf14e9"} May 22 10:36:13.509224 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.509054 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-zbrp2" event={"ID":"4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd","Type":"ContainerStarted","Data":"781e208634a8e2c3c14203015bf47f25b630cf04e582844a34760933ee09e4db"} May 22 10:36:13.509991 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.509968 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8cb4d" event={"ID":"b7d6db79-9593-42ee-b392-f6462706dcc0","Type":"ContainerStarted","Data":"49301f8847abf473dada4738bb5d2540aee4e4ec8f297e35f734f003bb9a2ac1"} May 22 10:36:13.906318 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.906277 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/026972a8-c35b-4157-a84b-b877e8ed7fa8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:13.907089 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:13.907064 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/026972a8-c35b-4157-a84b-b877e8ed7fa8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"026972a8-c35b-4157-a84b-b877e8ed7fa8\") " pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:14.146070 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.146009 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 22 10:36:14.216933 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.216241 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj"] May 22 10:36:14.222610 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.222552 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj" May 22 10:36:14.225874 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.225062 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 22 10:36:14.225874 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.225595 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 22 10:36:14.227597 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.226696 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-54u93kr9hnos3\"" May 22 10:36:14.227597 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.227065 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-xd8h4\"" May 22 10:36:14.227597 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.227132 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 22 10:36:14.227597 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.227255 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 22 10:36:14.227597 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.227267 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 22 10:36:14.229155 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.229129 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj"] May 22 10:36:14.310436 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.310399 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/917b15f6-54fd-4d77-86e0-5faab1b9d996-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6f48fb8bdd-55nqj\" (UID: \"917b15f6-54fd-4d77-86e0-5faab1b9d996\") " pod="openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj" May 22 10:36:14.310586 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.310447 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/917b15f6-54fd-4d77-86e0-5faab1b9d996-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6f48fb8bdd-55nqj\" (UID: \"917b15f6-54fd-4d77-86e0-5faab1b9d996\") " pod="openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj" May 22 10:36:14.310586 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.310487 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/917b15f6-54fd-4d77-86e0-5faab1b9d996-secret-grpc-tls\") pod \"thanos-querier-6f48fb8bdd-55nqj\" (UID: \"917b15f6-54fd-4d77-86e0-5faab1b9d996\") " pod="openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj" May 22 10:36:14.310586 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.310518 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/917b15f6-54fd-4d77-86e0-5faab1b9d996-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6f48fb8bdd-55nqj\" (UID: \"917b15f6-54fd-4d77-86e0-5faab1b9d996\") " pod="openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj" May 22 10:36:14.310586 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.310579 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/917b15f6-54fd-4d77-86e0-5faab1b9d996-metrics-client-ca\") pod \"thanos-querier-6f48fb8bdd-55nqj\" (UID: \"917b15f6-54fd-4d77-86e0-5faab1b9d996\") " pod="openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj" May 22 10:36:14.310712 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.310619 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/917b15f6-54fd-4d77-86e0-5faab1b9d996-secret-thanos-querier-tls\") pod \"thanos-querier-6f48fb8bdd-55nqj\" (UID: \"917b15f6-54fd-4d77-86e0-5faab1b9d996\") " pod="openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj" May 22 10:36:14.310712 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.310655 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/917b15f6-54fd-4d77-86e0-5faab1b9d996-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6f48fb8bdd-55nqj\" (UID: \"917b15f6-54fd-4d77-86e0-5faab1b9d996\") " pod="openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj" May 22 10:36:14.310712 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.310692 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7qdq\" (UniqueName: \"kubernetes.io/projected/917b15f6-54fd-4d77-86e0-5faab1b9d996-kube-api-access-w7qdq\") pod \"thanos-querier-6f48fb8bdd-55nqj\" (UID: \"917b15f6-54fd-4d77-86e0-5faab1b9d996\") " pod="openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj" May 22 10:36:14.313444 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.313399 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 22 10:36:14.411603 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.411538 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/917b15f6-54fd-4d77-86e0-5faab1b9d996-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6f48fb8bdd-55nqj\" (UID: \"917b15f6-54fd-4d77-86e0-5faab1b9d996\") " pod="openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj" May 22 10:36:14.411603 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.411588 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/917b15f6-54fd-4d77-86e0-5faab1b9d996-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6f48fb8bdd-55nqj\" (UID: \"917b15f6-54fd-4d77-86e0-5faab1b9d996\") " pod="openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj" May 22 10:36:14.411784 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.411622 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/917b15f6-54fd-4d77-86e0-5faab1b9d996-secret-grpc-tls\") pod \"thanos-querier-6f48fb8bdd-55nqj\" (UID: \"917b15f6-54fd-4d77-86e0-5faab1b9d996\") " pod="openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj" May 22 10:36:14.411784 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.411654 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/917b15f6-54fd-4d77-86e0-5faab1b9d996-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6f48fb8bdd-55nqj\" (UID: \"917b15f6-54fd-4d77-86e0-5faab1b9d996\") " pod="openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj" May 22 10:36:14.411784 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.411697 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/917b15f6-54fd-4d77-86e0-5faab1b9d996-metrics-client-ca\") pod \"thanos-querier-6f48fb8bdd-55nqj\" (UID: \"917b15f6-54fd-4d77-86e0-5faab1b9d996\") " pod="openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj" May 22 10:36:14.411784 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.411724 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/917b15f6-54fd-4d77-86e0-5faab1b9d996-secret-thanos-querier-tls\") pod \"thanos-querier-6f48fb8bdd-55nqj\" (UID: \"917b15f6-54fd-4d77-86e0-5faab1b9d996\") " pod="openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj" May 22 10:36:14.411784 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.411751 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/917b15f6-54fd-4d77-86e0-5faab1b9d996-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6f48fb8bdd-55nqj\" (UID: \"917b15f6-54fd-4d77-86e0-5faab1b9d996\") " pod="openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj" May 22 10:36:14.411784 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.411780 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w7qdq\" (UniqueName: \"kubernetes.io/projected/917b15f6-54fd-4d77-86e0-5faab1b9d996-kube-api-access-w7qdq\") pod \"thanos-querier-6f48fb8bdd-55nqj\" (UID: \"917b15f6-54fd-4d77-86e0-5faab1b9d996\") " pod="openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj" May 22 10:36:14.412990 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.412962 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/917b15f6-54fd-4d77-86e0-5faab1b9d996-metrics-client-ca\") pod \"thanos-querier-6f48fb8bdd-55nqj\" (UID: \"917b15f6-54fd-4d77-86e0-5faab1b9d996\") " pod="openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj" May 22 10:36:14.414828 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.414783 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/917b15f6-54fd-4d77-86e0-5faab1b9d996-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6f48fb8bdd-55nqj\" (UID: \"917b15f6-54fd-4d77-86e0-5faab1b9d996\") " pod="openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj" May 22 10:36:14.414931 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.414861 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/917b15f6-54fd-4d77-86e0-5faab1b9d996-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6f48fb8bdd-55nqj\" (UID: \"917b15f6-54fd-4d77-86e0-5faab1b9d996\") " pod="openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj" May 22 10:36:14.415636 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.415615 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/917b15f6-54fd-4d77-86e0-5faab1b9d996-secret-thanos-querier-tls\") pod \"thanos-querier-6f48fb8bdd-55nqj\" (UID: \"917b15f6-54fd-4d77-86e0-5faab1b9d996\") " pod="openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj" May 22 10:36:14.416426 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.416403 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/917b15f6-54fd-4d77-86e0-5faab1b9d996-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6f48fb8bdd-55nqj\" (UID: \"917b15f6-54fd-4d77-86e0-5faab1b9d996\") " pod="openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj" May 22 10:36:14.416890 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.416862 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/917b15f6-54fd-4d77-86e0-5faab1b9d996-secret-grpc-tls\") pod \"thanos-querier-6f48fb8bdd-55nqj\" (UID: \"917b15f6-54fd-4d77-86e0-5faab1b9d996\") " pod="openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj" May 22 10:36:14.418935 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.418913 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/917b15f6-54fd-4d77-86e0-5faab1b9d996-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6f48fb8bdd-55nqj\" (UID: \"917b15f6-54fd-4d77-86e0-5faab1b9d996\") " pod="openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj" May 22 10:36:14.425384 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.425364 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7qdq\" (UniqueName: \"kubernetes.io/projected/917b15f6-54fd-4d77-86e0-5faab1b9d996-kube-api-access-w7qdq\") pod \"thanos-querier-6f48fb8bdd-55nqj\" (UID: \"917b15f6-54fd-4d77-86e0-5faab1b9d996\") " pod="openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj" May 22 10:36:14.514384 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.514326 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c84ld" event={"ID":"d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a","Type":"ContainerStarted","Data":"1f2c7b8c614055ec742e90cd1129ae6ad99666ee12928642016487d89894b39f"} May 22 10:36:14.541870 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:36:14.541840 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod026972a8_c35b_4157_a84b_b877e8ed7fa8.slice/crio-923a30a3eb5e65f4675d7efd9f36dac591ed8c40a1c6c687095c4f0373e229f3 WatchSource:0}: Error finding container 923a30a3eb5e65f4675d7efd9f36dac591ed8c40a1c6c687095c4f0373e229f3: Status 404 returned error can't find the container with id 923a30a3eb5e65f4675d7efd9f36dac591ed8c40a1c6c687095c4f0373e229f3 May 22 10:36:14.546739 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:14.546395 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj" May 22 10:36:15.018152 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:15.017707 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7db0942-cfd5-4727-b490-62198c86d1e6-metrics-certs\") pod \"network-metrics-daemon-4t6q7\" (UID: \"d7db0942-cfd5-4727-b490-62198c86d1e6\") " pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:36:15.018152 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:15.017779 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2bkfv\" (UniqueName: \"kubernetes.io/projected/63a0f782-b151-4b2a-be81-d0025df9fb35-kube-api-access-2bkfv\") pod \"network-check-target-ncpgn\" (UID: \"63a0f782-b151-4b2a-be81-d0025df9fb35\") " pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:36:15.019641 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:15.019418 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 22 10:36:15.019866 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:15.019847 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 22 10:36:15.033066 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:15.032795 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj"] May 22 10:36:15.034626 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:15.034603 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 22 10:36:15.036073 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:15.036045 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7db0942-cfd5-4727-b490-62198c86d1e6-metrics-certs\") pod \"network-metrics-daemon-4t6q7\" (UID: \"d7db0942-cfd5-4727-b490-62198c86d1e6\") " pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:36:15.038289 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:36:15.038167 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod917b15f6_54fd_4d77_86e0_5faab1b9d996.slice/crio-1685c99979138634366f499dd3d953c1ee40384b7c4bfec27cbe2fcb1c242387 WatchSource:0}: Error finding container 1685c99979138634366f499dd3d953c1ee40384b7c4bfec27cbe2fcb1c242387: Status 404 returned error can't find the container with id 1685c99979138634366f499dd3d953c1ee40384b7c4bfec27cbe2fcb1c242387 May 22 10:36:15.052160 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:15.052133 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bkfv\" (UniqueName: \"kubernetes.io/projected/63a0f782-b151-4b2a-be81-d0025df9fb35-kube-api-access-2bkfv\") pod \"network-check-target-ncpgn\" (UID: \"63a0f782-b151-4b2a-be81-d0025df9fb35\") " pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:36:15.270390 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:15.270362 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vcplp\"" May 22 10:36:15.276308 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:15.276282 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4crrl\"" May 22 10:36:15.278540 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:15.278516 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:36:15.285249 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:15.285230 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t6q7" May 22 10:36:15.441606 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:15.441536 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ncpgn"] May 22 10:36:15.463912 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:15.463887 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4t6q7"] May 22 10:36:15.467951 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:36:15.467913 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7db0942_cfd5_4727_b490_62198c86d1e6.slice/crio-110ccf74bce7c18f5057640a048b701b1372ed03ee520fb901df5e970d5f5e75 WatchSource:0}: Error finding container 110ccf74bce7c18f5057640a048b701b1372ed03ee520fb901df5e970d5f5e75: Status 404 returned error can't find the container with id 110ccf74bce7c18f5057640a048b701b1372ed03ee520fb901df5e970d5f5e75 May 22 10:36:15.484263 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:15.484242 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kzbqx" May 22 10:36:15.519776 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:15.519728 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"026972a8-c35b-4157-a84b-b877e8ed7fa8","Type":"ContainerStarted","Data":"923a30a3eb5e65f4675d7efd9f36dac591ed8c40a1c6c687095c4f0373e229f3"} May 22 10:36:15.522446 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:15.522371 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8cb4d" event={"ID":"b7d6db79-9593-42ee-b392-f6462706dcc0","Type":"ContainerStarted","Data":"dd4bb4820a84c153f87ba9168d1efeb23dafd714c8b4bccae6323746e7cca4dc"} May 22 10:36:15.522446 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:15.522418 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8cb4d" event={"ID":"b7d6db79-9593-42ee-b392-f6462706dcc0","Type":"ContainerStarted","Data":"7a61039fd85cc69bda2450960fd9597866ecfadb08a0f2f13432aa16f5798201"} May 22 10:36:15.522446 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:15.522432 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8cb4d" event={"ID":"b7d6db79-9593-42ee-b392-f6462706dcc0","Type":"ContainerStarted","Data":"f2327bf72e584c16f1d11708bf23644e284fffc1cb51f06876616cf99fee34b4"} May 22 10:36:15.524206 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:15.524179 2558 generic.go:358] "Generic (PLEG): container finished" podID="d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a" containerID="1f2c7b8c614055ec742e90cd1129ae6ad99666ee12928642016487d89894b39f" exitCode=0 May 22 10:36:15.524382 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:15.524243 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c84ld" event={"ID":"d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a","Type":"ContainerDied","Data":"1f2c7b8c614055ec742e90cd1129ae6ad99666ee12928642016487d89894b39f"} May 22 10:36:15.541880 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:15.541826 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-zbrp2" event={"ID":"4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd","Type":"ContainerStarted","Data":"a3bdfb4cf2a1f91c2db1facea5ad2c0b5f925e812739c7af3cfc4352d50c3d16"} May 22 10:36:15.543868 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:15.543837 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj" event={"ID":"917b15f6-54fd-4d77-86e0-5faab1b9d996","Type":"ContainerStarted","Data":"1685c99979138634366f499dd3d953c1ee40384b7c4bfec27cbe2fcb1c242387"} May 22 10:36:15.545758 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:15.545733 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4t6q7" event={"ID":"d7db0942-cfd5-4727-b490-62198c86d1e6","Type":"ContainerStarted","Data":"110ccf74bce7c18f5057640a048b701b1372ed03ee520fb901df5e970d5f5e75"} May 22 10:36:15.547084 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:15.547064 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ncpgn" event={"ID":"63a0f782-b151-4b2a-be81-d0025df9fb35","Type":"ContainerStarted","Data":"e3ff48a5a90b1107e31306ebe8e57219284c2442ef5c973db69ffe90ac2243e2"} May 22 10:36:15.551461 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:15.551389 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-8cb4d" podStartSLOduration=1.8720801790000001 podStartE2EDuration="3.551373596s" podCreationTimestamp="2026-05-22 10:36:12 +0000 UTC" firstStartedPulling="2026-05-22 10:36:13.213943207 +0000 UTC m=+64.521202931" lastFinishedPulling="2026-05-22 10:36:14.893236624 +0000 UTC m=+66.200496348" observedRunningTime="2026-05-22 10:36:15.549758584 +0000 UTC m=+66.857018329" watchObservedRunningTime="2026-05-22 10:36:15.551373596 +0000 UTC m=+66.858633343" May 22 10:36:15.580162 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:15.580008 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-zbrp2" podStartSLOduration=2.026089582 podStartE2EDuration="3.57999297s" podCreationTimestamp="2026-05-22 10:36:12 +0000 UTC" firstStartedPulling="2026-05-22 10:36:13.335582779 +0000 UTC m=+64.642842510" lastFinishedPulling="2026-05-22 10:36:14.889486155 +0000 UTC m=+66.196745898" observedRunningTime="2026-05-22 10:36:15.578518476 +0000 UTC m=+66.885778223" watchObservedRunningTime="2026-05-22 10:36:15.57999297 +0000 UTC m=+66.887252751" May 22 10:36:15.967135 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:15.967095 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74b767dd95-9dd58" May 22 10:36:15.967135 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:15.967145 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74b767dd95-9dd58" May 22 10:36:15.977311 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:15.977280 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74b767dd95-9dd58" May 22 10:36:16.445147 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.445109 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-854766bfc8-zdtfp"] May 22 10:36:16.449637 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.448691 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-854766bfc8-zdtfp" May 22 10:36:16.450947 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.450766 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 22 10:36:16.451981 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.451959 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 22 10:36:16.452188 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.452172 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-j2s5x\"" May 22 10:36:16.452398 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.452378 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9b02jsnaqu1g5\"" May 22 10:36:16.452592 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.452574 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 22 10:36:16.452677 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.452597 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 22 10:36:16.455730 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.455707 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-854766bfc8-zdtfp"] May 22 10:36:16.530877 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.530835 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6adacca9-45a6-43bf-a834-ced100294d3d-secret-metrics-server-client-certs\") pod \"metrics-server-854766bfc8-zdtfp\" (UID: \"6adacca9-45a6-43bf-a834-ced100294d3d\") " pod="openshift-monitoring/metrics-server-854766bfc8-zdtfp" May 22 10:36:16.531069 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.530887 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6adacca9-45a6-43bf-a834-ced100294d3d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-854766bfc8-zdtfp\" (UID: \"6adacca9-45a6-43bf-a834-ced100294d3d\") " pod="openshift-monitoring/metrics-server-854766bfc8-zdtfp" May 22 10:36:16.531069 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.530916 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6adacca9-45a6-43bf-a834-ced100294d3d-metrics-server-audit-profiles\") pod \"metrics-server-854766bfc8-zdtfp\" (UID: \"6adacca9-45a6-43bf-a834-ced100294d3d\") " pod="openshift-monitoring/metrics-server-854766bfc8-zdtfp" May 22 10:36:16.531069 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.530946 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6adacca9-45a6-43bf-a834-ced100294d3d-secret-metrics-server-tls\") pod \"metrics-server-854766bfc8-zdtfp\" (UID: \"6adacca9-45a6-43bf-a834-ced100294d3d\") " pod="openshift-monitoring/metrics-server-854766bfc8-zdtfp" May 22 10:36:16.531069 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.531010 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6adacca9-45a6-43bf-a834-ced100294d3d-audit-log\") pod \"metrics-server-854766bfc8-zdtfp\" (UID: \"6adacca9-45a6-43bf-a834-ced100294d3d\") " pod="openshift-monitoring/metrics-server-854766bfc8-zdtfp" May 22 10:36:16.531287 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.531081 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6adacca9-45a6-43bf-a834-ced100294d3d-client-ca-bundle\") pod \"metrics-server-854766bfc8-zdtfp\" (UID: \"6adacca9-45a6-43bf-a834-ced100294d3d\") " pod="openshift-monitoring/metrics-server-854766bfc8-zdtfp" May 22 10:36:16.531287 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.531108 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqqwn\" (UniqueName: \"kubernetes.io/projected/6adacca9-45a6-43bf-a834-ced100294d3d-kube-api-access-mqqwn\") pod \"metrics-server-854766bfc8-zdtfp\" (UID: \"6adacca9-45a6-43bf-a834-ced100294d3d\") " pod="openshift-monitoring/metrics-server-854766bfc8-zdtfp" May 22 10:36:16.552732 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.552694 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c84ld" event={"ID":"d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a","Type":"ContainerStarted","Data":"e0090d9f438f42e7885939925cfce3b99619ac76836e675687a52f90b843a9ac"} May 22 10:36:16.552732 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.552736 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c84ld" event={"ID":"d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a","Type":"ContainerStarted","Data":"9eaf4f6ce2fc3b3ad2fdbf15e40f67e0e5c5c50abdad35e3d867ff31ae8154aa"} May 22 10:36:16.554198 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.554170 2558 generic.go:358] "Generic (PLEG): container finished" podID="026972a8-c35b-4157-a84b-b877e8ed7fa8" containerID="4ce4549313dfa0f265eaa39f24b6a2c000e884c3ae0eecf19d196447ce70cd07" exitCode=0 May 22 10:36:16.554316 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.554241 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"026972a8-c35b-4157-a84b-b877e8ed7fa8","Type":"ContainerDied","Data":"4ce4549313dfa0f265eaa39f24b6a2c000e884c3ae0eecf19d196447ce70cd07"} May 22 10:36:16.559062 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.559037 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74b767dd95-9dd58" May 22 10:36:16.569031 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.568894 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-c84ld" podStartSLOduration=3.48475 podStartE2EDuration="4.568878393s" podCreationTimestamp="2026-05-22 10:36:12 +0000 UTC" firstStartedPulling="2026-05-22 10:36:13.101949153 +0000 UTC m=+64.409208887" lastFinishedPulling="2026-05-22 10:36:14.186077542 +0000 UTC m=+65.493337280" observedRunningTime="2026-05-22 10:36:16.568493451 +0000 UTC m=+67.875753197" watchObservedRunningTime="2026-05-22 10:36:16.568878393 +0000 UTC m=+67.876138141" May 22 10:36:16.634280 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.631685 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6adacca9-45a6-43bf-a834-ced100294d3d-audit-log\") pod \"metrics-server-854766bfc8-zdtfp\" (UID: \"6adacca9-45a6-43bf-a834-ced100294d3d\") " pod="openshift-monitoring/metrics-server-854766bfc8-zdtfp" May 22 10:36:16.634280 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.631841 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6adacca9-45a6-43bf-a834-ced100294d3d-client-ca-bundle\") pod \"metrics-server-854766bfc8-zdtfp\" (UID: \"6adacca9-45a6-43bf-a834-ced100294d3d\") " pod="openshift-monitoring/metrics-server-854766bfc8-zdtfp" May 22 10:36:16.634280 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.631872 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mqqwn\" (UniqueName: \"kubernetes.io/projected/6adacca9-45a6-43bf-a834-ced100294d3d-kube-api-access-mqqwn\") pod \"metrics-server-854766bfc8-zdtfp\" (UID: \"6adacca9-45a6-43bf-a834-ced100294d3d\") " pod="openshift-monitoring/metrics-server-854766bfc8-zdtfp" May 22 10:36:16.634280 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.632628 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6adacca9-45a6-43bf-a834-ced100294d3d-audit-log\") pod \"metrics-server-854766bfc8-zdtfp\" (UID: \"6adacca9-45a6-43bf-a834-ced100294d3d\") " pod="openshift-monitoring/metrics-server-854766bfc8-zdtfp" May 22 10:36:16.634280 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.632762 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6adacca9-45a6-43bf-a834-ced100294d3d-secret-metrics-server-client-certs\") pod \"metrics-server-854766bfc8-zdtfp\" (UID: \"6adacca9-45a6-43bf-a834-ced100294d3d\") " pod="openshift-monitoring/metrics-server-854766bfc8-zdtfp" May 22 10:36:16.634280 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.632858 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6adacca9-45a6-43bf-a834-ced100294d3d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-854766bfc8-zdtfp\" (UID: \"6adacca9-45a6-43bf-a834-ced100294d3d\") " pod="openshift-monitoring/metrics-server-854766bfc8-zdtfp" May 22 10:36:16.634280 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.632890 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6adacca9-45a6-43bf-a834-ced100294d3d-metrics-server-audit-profiles\") pod \"metrics-server-854766bfc8-zdtfp\" (UID: \"6adacca9-45a6-43bf-a834-ced100294d3d\") " pod="openshift-monitoring/metrics-server-854766bfc8-zdtfp" May 22 10:36:16.634280 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.632986 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6adacca9-45a6-43bf-a834-ced100294d3d-secret-metrics-server-tls\") pod \"metrics-server-854766bfc8-zdtfp\" (UID: \"6adacca9-45a6-43bf-a834-ced100294d3d\") " pod="openshift-monitoring/metrics-server-854766bfc8-zdtfp" May 22 10:36:16.634280 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.634021 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6adacca9-45a6-43bf-a834-ced100294d3d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-854766bfc8-zdtfp\" (UID: \"6adacca9-45a6-43bf-a834-ced100294d3d\") " pod="openshift-monitoring/metrics-server-854766bfc8-zdtfp" May 22 10:36:16.635551 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.635486 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6adacca9-45a6-43bf-a834-ced100294d3d-metrics-server-audit-profiles\") pod \"metrics-server-854766bfc8-zdtfp\" (UID: \"6adacca9-45a6-43bf-a834-ced100294d3d\") " pod="openshift-monitoring/metrics-server-854766bfc8-zdtfp" May 22 10:36:16.635824 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.635779 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6adacca9-45a6-43bf-a834-ced100294d3d-client-ca-bundle\") pod \"metrics-server-854766bfc8-zdtfp\" (UID: \"6adacca9-45a6-43bf-a834-ced100294d3d\") " pod="openshift-monitoring/metrics-server-854766bfc8-zdtfp" May 22 10:36:16.636935 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.636910 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6adacca9-45a6-43bf-a834-ced100294d3d-secret-metrics-server-tls\") pod \"metrics-server-854766bfc8-zdtfp\" (UID: \"6adacca9-45a6-43bf-a834-ced100294d3d\") " pod="openshift-monitoring/metrics-server-854766bfc8-zdtfp" May 22 10:36:16.637595 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.637576 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6adacca9-45a6-43bf-a834-ced100294d3d-secret-metrics-server-client-certs\") pod \"metrics-server-854766bfc8-zdtfp\" (UID: \"6adacca9-45a6-43bf-a834-ced100294d3d\") " pod="openshift-monitoring/metrics-server-854766bfc8-zdtfp" May 22 10:36:16.644889 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.644869 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqqwn\" (UniqueName: \"kubernetes.io/projected/6adacca9-45a6-43bf-a834-ced100294d3d-kube-api-access-mqqwn\") pod \"metrics-server-854766bfc8-zdtfp\" (UID: \"6adacca9-45a6-43bf-a834-ced100294d3d\") " pod="openshift-monitoring/metrics-server-854766bfc8-zdtfp" May 22 10:36:16.764085 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.764051 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-854766bfc8-zdtfp" May 22 10:36:16.923194 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.923160 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-4n59w"] May 22 10:36:16.927194 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.926659 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-4n59w" May 22 10:36:16.928582 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.928554 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 22 10:36:16.928703 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.928643 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-mdkzh\"" May 22 10:36:16.936247 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:16.936222 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-4n59w"] May 22 10:36:17.041675 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.041582 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e4095573-5bef-4351-8fa6-0bfa9e99efbb-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-4n59w\" (UID: \"e4095573-5bef-4351-8fa6-0bfa9e99efbb\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-4n59w" May 22 10:36:17.142456 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.142403 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e4095573-5bef-4351-8fa6-0bfa9e99efbb-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-4n59w\" (UID: \"e4095573-5bef-4351-8fa6-0bfa9e99efbb\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-4n59w" May 22 10:36:17.142963 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:36:17.142601 2558 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found May 22 10:36:17.142963 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:36:17.142676 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4095573-5bef-4351-8fa6-0bfa9e99efbb-monitoring-plugin-cert podName:e4095573-5bef-4351-8fa6-0bfa9e99efbb nodeName:}" failed. No retries permitted until 2026-05-22 10:36:17.64265252 +0000 UTC m=+68.949912244 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/e4095573-5bef-4351-8fa6-0bfa9e99efbb-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-4n59w" (UID: "e4095573-5bef-4351-8fa6-0bfa9e99efbb") : secret "monitoring-plugin-cert" not found May 22 10:36:17.348367 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.348230 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-756586f74d-cwck8"] May 22 10:36:17.356419 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.355105 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-756586f74d-cwck8" May 22 10:36:17.358151 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.357806 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" May 22 10:36:17.358151 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.357895 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" May 22 10:36:17.358151 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.358040 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" May 22 10:36:17.358151 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.358053 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-smwm6\"" May 22 10:36:17.359097 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.358805 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" May 22 10:36:17.359412 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.359262 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" May 22 10:36:17.366777 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.366738 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-756586f74d-cwck8"] May 22 10:36:17.370360 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.370284 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" May 22 10:36:17.439843 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.439764 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-854766bfc8-zdtfp"] May 22 10:36:17.445356 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:36:17.445308 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6adacca9_45a6_43bf_a834_ced100294d3d.slice/crio-f1001b8c4440b399e1bda9b0bca25d0b35ba2e9e00c21f23cb4172a9cec546ae WatchSource:0}: Error finding container f1001b8c4440b399e1bda9b0bca25d0b35ba2e9e00c21f23cb4172a9cec546ae: Status 404 returned error can't find the container with id f1001b8c4440b399e1bda9b0bca25d0b35ba2e9e00c21f23cb4172a9cec546ae May 22 10:36:17.447811 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.447670 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/03bbe1ab-da55-4d33-b09b-e02c8098b59b-telemeter-client-tls\") pod \"telemeter-client-756586f74d-cwck8\" (UID: \"03bbe1ab-da55-4d33-b09b-e02c8098b59b\") " pod="openshift-monitoring/telemeter-client-756586f74d-cwck8" May 22 10:36:17.447811 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.447730 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03bbe1ab-da55-4d33-b09b-e02c8098b59b-serving-certs-ca-bundle\") pod \"telemeter-client-756586f74d-cwck8\" (UID: \"03bbe1ab-da55-4d33-b09b-e02c8098b59b\") " pod="openshift-monitoring/telemeter-client-756586f74d-cwck8" May 22 10:36:17.447811 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.447777 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnvzx\" (UniqueName: \"kubernetes.io/projected/03bbe1ab-da55-4d33-b09b-e02c8098b59b-kube-api-access-tnvzx\") pod \"telemeter-client-756586f74d-cwck8\" (UID: \"03bbe1ab-da55-4d33-b09b-e02c8098b59b\") " pod="openshift-monitoring/telemeter-client-756586f74d-cwck8" May 22 10:36:17.448089 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.447841 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03bbe1ab-da55-4d33-b09b-e02c8098b59b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-756586f74d-cwck8\" (UID: \"03bbe1ab-da55-4d33-b09b-e02c8098b59b\") " pod="openshift-monitoring/telemeter-client-756586f74d-cwck8" May 22 10:36:17.448089 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.447883 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03bbe1ab-da55-4d33-b09b-e02c8098b59b-metrics-client-ca\") pod \"telemeter-client-756586f74d-cwck8\" (UID: \"03bbe1ab-da55-4d33-b09b-e02c8098b59b\") " pod="openshift-monitoring/telemeter-client-756586f74d-cwck8" May 22 10:36:17.448089 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.447919 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/03bbe1ab-da55-4d33-b09b-e02c8098b59b-federate-client-tls\") pod \"telemeter-client-756586f74d-cwck8\" (UID: \"03bbe1ab-da55-4d33-b09b-e02c8098b59b\") " pod="openshift-monitoring/telemeter-client-756586f74d-cwck8" May 22 10:36:17.448089 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.447964 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03bbe1ab-da55-4d33-b09b-e02c8098b59b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-756586f74d-cwck8\" (UID: \"03bbe1ab-da55-4d33-b09b-e02c8098b59b\") " pod="openshift-monitoring/telemeter-client-756586f74d-cwck8" May 22 10:36:17.448089 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.448009 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/03bbe1ab-da55-4d33-b09b-e02c8098b59b-secret-telemeter-client\") pod \"telemeter-client-756586f74d-cwck8\" (UID: \"03bbe1ab-da55-4d33-b09b-e02c8098b59b\") " pod="openshift-monitoring/telemeter-client-756586f74d-cwck8" May 22 10:36:17.548598 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.548571 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/03bbe1ab-da55-4d33-b09b-e02c8098b59b-telemeter-client-tls\") pod \"telemeter-client-756586f74d-cwck8\" (UID: \"03bbe1ab-da55-4d33-b09b-e02c8098b59b\") " pod="openshift-monitoring/telemeter-client-756586f74d-cwck8" May 22 10:36:17.548704 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.548626 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03bbe1ab-da55-4d33-b09b-e02c8098b59b-serving-certs-ca-bundle\") pod \"telemeter-client-756586f74d-cwck8\" (UID: \"03bbe1ab-da55-4d33-b09b-e02c8098b59b\") " pod="openshift-monitoring/telemeter-client-756586f74d-cwck8" May 22 10:36:17.548704 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.548666 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tnvzx\" (UniqueName: \"kubernetes.io/projected/03bbe1ab-da55-4d33-b09b-e02c8098b59b-kube-api-access-tnvzx\") pod \"telemeter-client-756586f74d-cwck8\" (UID: \"03bbe1ab-da55-4d33-b09b-e02c8098b59b\") " pod="openshift-monitoring/telemeter-client-756586f74d-cwck8" May 22 10:36:17.548807 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.548702 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03bbe1ab-da55-4d33-b09b-e02c8098b59b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-756586f74d-cwck8\" (UID: \"03bbe1ab-da55-4d33-b09b-e02c8098b59b\") " pod="openshift-monitoring/telemeter-client-756586f74d-cwck8" May 22 10:36:17.549649 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.549174 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03bbe1ab-da55-4d33-b09b-e02c8098b59b-metrics-client-ca\") pod \"telemeter-client-756586f74d-cwck8\" (UID: \"03bbe1ab-da55-4d33-b09b-e02c8098b59b\") " pod="openshift-monitoring/telemeter-client-756586f74d-cwck8" May 22 10:36:17.549649 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.549220 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/03bbe1ab-da55-4d33-b09b-e02c8098b59b-federate-client-tls\") pod \"telemeter-client-756586f74d-cwck8\" (UID: \"03bbe1ab-da55-4d33-b09b-e02c8098b59b\") " pod="openshift-monitoring/telemeter-client-756586f74d-cwck8" May 22 10:36:17.549649 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.549251 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03bbe1ab-da55-4d33-b09b-e02c8098b59b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-756586f74d-cwck8\" (UID: \"03bbe1ab-da55-4d33-b09b-e02c8098b59b\") " pod="openshift-monitoring/telemeter-client-756586f74d-cwck8" May 22 10:36:17.549649 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.549289 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/03bbe1ab-da55-4d33-b09b-e02c8098b59b-secret-telemeter-client\") pod \"telemeter-client-756586f74d-cwck8\" (UID: \"03bbe1ab-da55-4d33-b09b-e02c8098b59b\") " pod="openshift-monitoring/telemeter-client-756586f74d-cwck8" May 22 10:36:17.549649 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.549476 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03bbe1ab-da55-4d33-b09b-e02c8098b59b-serving-certs-ca-bundle\") pod \"telemeter-client-756586f74d-cwck8\" (UID: \"03bbe1ab-da55-4d33-b09b-e02c8098b59b\") " pod="openshift-monitoring/telemeter-client-756586f74d-cwck8" May 22 10:36:17.549998 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.549857 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03bbe1ab-da55-4d33-b09b-e02c8098b59b-metrics-client-ca\") pod \"telemeter-client-756586f74d-cwck8\" (UID: \"03bbe1ab-da55-4d33-b09b-e02c8098b59b\") " pod="openshift-monitoring/telemeter-client-756586f74d-cwck8" May 22 10:36:17.550470 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.550446 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03bbe1ab-da55-4d33-b09b-e02c8098b59b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-756586f74d-cwck8\" (UID: \"03bbe1ab-da55-4d33-b09b-e02c8098b59b\") " pod="openshift-monitoring/telemeter-client-756586f74d-cwck8" May 22 10:36:17.552788 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.552568 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/03bbe1ab-da55-4d33-b09b-e02c8098b59b-federate-client-tls\") pod \"telemeter-client-756586f74d-cwck8\" (UID: \"03bbe1ab-da55-4d33-b09b-e02c8098b59b\") " pod="openshift-monitoring/telemeter-client-756586f74d-cwck8" May 22 10:36:17.553854 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.553708 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03bbe1ab-da55-4d33-b09b-e02c8098b59b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-756586f74d-cwck8\" (UID: \"03bbe1ab-da55-4d33-b09b-e02c8098b59b\") " pod="openshift-monitoring/telemeter-client-756586f74d-cwck8" May 22 10:36:17.554204 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.554176 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/03bbe1ab-da55-4d33-b09b-e02c8098b59b-secret-telemeter-client\") pod \"telemeter-client-756586f74d-cwck8\" (UID: \"03bbe1ab-da55-4d33-b09b-e02c8098b59b\") " pod="openshift-monitoring/telemeter-client-756586f74d-cwck8" May 22 10:36:17.556774 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.556750 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnvzx\" (UniqueName: \"kubernetes.io/projected/03bbe1ab-da55-4d33-b09b-e02c8098b59b-kube-api-access-tnvzx\") pod \"telemeter-client-756586f74d-cwck8\" (UID: \"03bbe1ab-da55-4d33-b09b-e02c8098b59b\") " pod="openshift-monitoring/telemeter-client-756586f74d-cwck8" May 22 10:36:17.556868 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.556840 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/03bbe1ab-da55-4d33-b09b-e02c8098b59b-telemeter-client-tls\") pod \"telemeter-client-756586f74d-cwck8\" (UID: \"03bbe1ab-da55-4d33-b09b-e02c8098b59b\") " pod="openshift-monitoring/telemeter-client-756586f74d-cwck8" May 22 10:36:17.563448 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.563394 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj" event={"ID":"917b15f6-54fd-4d77-86e0-5faab1b9d996","Type":"ContainerStarted","Data":"90dac21f6fb30f463fa4176ff3bd05d15d2a5b23514b883ec6be63b9a814de3e"} May 22 10:36:17.563448 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.563443 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj" event={"ID":"917b15f6-54fd-4d77-86e0-5faab1b9d996","Type":"ContainerStarted","Data":"d13835700165321b6268b1b3f2d7d2a633662853decada9f8685c4399b5355a4"} May 22 10:36:17.563575 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.563457 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj" event={"ID":"917b15f6-54fd-4d77-86e0-5faab1b9d996","Type":"ContainerStarted","Data":"eeceeff85fe90ac40a4a0527e408d12de813a14731ab2a9341a77df20083622e"} May 22 10:36:17.566227 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.566196 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4t6q7" event={"ID":"d7db0942-cfd5-4727-b490-62198c86d1e6","Type":"ContainerStarted","Data":"d3cb09d40cd3cc5bcdd28548a9baf4c97f6cb41e72f48ffef06daaa5c4ba23ed"} May 22 10:36:17.568349 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.568310 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-854766bfc8-zdtfp" event={"ID":"6adacca9-45a6-43bf-a834-ced100294d3d","Type":"ContainerStarted","Data":"f1001b8c4440b399e1bda9b0bca25d0b35ba2e9e00c21f23cb4172a9cec546ae"} May 22 10:36:17.579794 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.579731 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4t6q7" podStartSLOduration=66.776449354 podStartE2EDuration="1m8.579714126s" podCreationTimestamp="2026-05-22 10:35:09 +0000 UTC" firstStartedPulling="2026-05-22 10:36:15.470176525 +0000 UTC m=+66.777436252" lastFinishedPulling="2026-05-22 10:36:17.27344128 +0000 UTC m=+68.580701024" observedRunningTime="2026-05-22 10:36:17.579063668 +0000 UTC m=+68.886323458" watchObservedRunningTime="2026-05-22 10:36:17.579714126 +0000 UTC m=+68.886973873" May 22 10:36:17.650504 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.650462 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e4095573-5bef-4351-8fa6-0bfa9e99efbb-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-4n59w\" (UID: \"e4095573-5bef-4351-8fa6-0bfa9e99efbb\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-4n59w" May 22 10:36:17.654940 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.654906 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e4095573-5bef-4351-8fa6-0bfa9e99efbb-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-4n59w\" (UID: \"e4095573-5bef-4351-8fa6-0bfa9e99efbb\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-4n59w" May 22 10:36:17.688047 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.687650 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-756586f74d-cwck8" May 22 10:36:17.839191 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.839106 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-4n59w" May 22 10:36:17.841895 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.841866 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-756586f74d-cwck8"] May 22 10:36:17.846169 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:36:17.846145 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03bbe1ab_da55_4d33_b09b_e02c8098b59b.slice/crio-2c6b459d9c300b63280b46e1425149d4d6522320289ad5e092cb0bd60bdc8ffd WatchSource:0}: Error finding container 2c6b459d9c300b63280b46e1425149d4d6522320289ad5e092cb0bd60bdc8ffd: Status 404 returned error can't find the container with id 2c6b459d9c300b63280b46e1425149d4d6522320289ad5e092cb0bd60bdc8ffd May 22 10:36:17.982088 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:17.982044 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-4n59w"] May 22 10:36:17.985233 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:36:17.985193 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4095573_5bef_4351_8fa6_0bfa9e99efbb.slice/crio-2eb504c655e93bbda0a008be4c047cadd87a55158a6382ee8c1c3918ef42827c WatchSource:0}: Error finding container 2eb504c655e93bbda0a008be4c047cadd87a55158a6382ee8c1c3918ef42827c: Status 404 returned error can't find the container with id 2eb504c655e93bbda0a008be4c047cadd87a55158a6382ee8c1c3918ef42827c May 22 10:36:18.428205 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.427591 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 22 10:36:18.437032 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.436996 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.439807 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.439781 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 22 10:36:18.439952 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.439876 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 22 10:36:18.440028 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.439790 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tkgs6\"" May 22 10:36:18.440119 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.440035 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 22 10:36:18.440282 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.440261 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 22 10:36:18.440454 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.440436 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-e95c198hgjb2m\"" May 22 10:36:18.440590 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.440571 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 22 10:36:18.440674 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.440331 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 22 10:36:18.440914 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.440285 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 22 10:36:18.441012 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.440952 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 22 10:36:18.441229 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.441210 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 22 10:36:18.442532 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.442423 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 22 10:36:18.448531 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.448509 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 22 10:36:18.449109 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.449088 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 22 10:36:18.450363 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.449415 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 22 10:36:18.567164 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.566282 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c031229-b7c7-4dea-a9ee-df5ccc30c465-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.567164 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.566362 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c031229-b7c7-4dea-a9ee-df5ccc30c465-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.567164 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.566394 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4c031229-b7c7-4dea-a9ee-df5ccc30c465-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.567164 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.566418 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4c031229-b7c7-4dea-a9ee-df5ccc30c465-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.567164 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.566442 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4c031229-b7c7-4dea-a9ee-df5ccc30c465-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.567164 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.566468 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4c031229-b7c7-4dea-a9ee-df5ccc30c465-config\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.567164 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.566497 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c031229-b7c7-4dea-a9ee-df5ccc30c465-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.567164 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.566631 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4c031229-b7c7-4dea-a9ee-df5ccc30c465-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.567164 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.566659 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c031229-b7c7-4dea-a9ee-df5ccc30c465-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.567164 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.566698 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4c031229-b7c7-4dea-a9ee-df5ccc30c465-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.567164 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.566720 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4c031229-b7c7-4dea-a9ee-df5ccc30c465-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.567164 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.566750 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c031229-b7c7-4dea-a9ee-df5ccc30c465-web-config\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.567164 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.566789 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4c031229-b7c7-4dea-a9ee-df5ccc30c465-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.567164 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.566815 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c031229-b7c7-4dea-a9ee-df5ccc30c465-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.567164 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.566862 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c031229-b7c7-4dea-a9ee-df5ccc30c465-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.567164 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.566884 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c031229-b7c7-4dea-a9ee-df5ccc30c465-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.568163 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.566910 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skvvm\" (UniqueName: \"kubernetes.io/projected/4c031229-b7c7-4dea-a9ee-df5ccc30c465-kube-api-access-skvvm\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.568163 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.566940 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c031229-b7c7-4dea-a9ee-df5ccc30c465-config-out\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.574460 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.574408 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4t6q7" event={"ID":"d7db0942-cfd5-4727-b490-62198c86d1e6","Type":"ContainerStarted","Data":"c16e90bb08200b75ddc28140eba3de193dd8b65a58cd5a51ff4414593181dc0c"} May 22 10:36:18.579148 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.579099 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-4n59w" event={"ID":"e4095573-5bef-4351-8fa6-0bfa9e99efbb","Type":"ContainerStarted","Data":"2eb504c655e93bbda0a008be4c047cadd87a55158a6382ee8c1c3918ef42827c"} May 22 10:36:18.580797 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.580773 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-756586f74d-cwck8" event={"ID":"03bbe1ab-da55-4d33-b09b-e02c8098b59b","Type":"ContainerStarted","Data":"2c6b459d9c300b63280b46e1425149d4d6522320289ad5e092cb0bd60bdc8ffd"} May 22 10:36:18.667680 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.667637 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c031229-b7c7-4dea-a9ee-df5ccc30c465-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.667863 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.667722 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4c031229-b7c7-4dea-a9ee-df5ccc30c465-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.667863 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.667751 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c031229-b7c7-4dea-a9ee-df5ccc30c465-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.667863 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.667787 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4c031229-b7c7-4dea-a9ee-df5ccc30c465-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.667863 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.667813 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4c031229-b7c7-4dea-a9ee-df5ccc30c465-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.667863 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.667839 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c031229-b7c7-4dea-a9ee-df5ccc30c465-web-config\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.668131 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.667879 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4c031229-b7c7-4dea-a9ee-df5ccc30c465-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.668131 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.667906 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c031229-b7c7-4dea-a9ee-df5ccc30c465-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.668131 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.667976 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c031229-b7c7-4dea-a9ee-df5ccc30c465-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.668131 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.668003 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c031229-b7c7-4dea-a9ee-df5ccc30c465-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.668131 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.668029 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-skvvm\" (UniqueName: \"kubernetes.io/projected/4c031229-b7c7-4dea-a9ee-df5ccc30c465-kube-api-access-skvvm\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.668131 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.668058 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c031229-b7c7-4dea-a9ee-df5ccc30c465-config-out\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.668131 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.668085 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c031229-b7c7-4dea-a9ee-df5ccc30c465-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.668131 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.668124 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c031229-b7c7-4dea-a9ee-df5ccc30c465-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.668539 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.668149 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4c031229-b7c7-4dea-a9ee-df5ccc30c465-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.668539 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.668170 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4c031229-b7c7-4dea-a9ee-df5ccc30c465-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.668539 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.668199 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4c031229-b7c7-4dea-a9ee-df5ccc30c465-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.668539 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.668227 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4c031229-b7c7-4dea-a9ee-df5ccc30c465-config\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.671250 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.669482 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c031229-b7c7-4dea-a9ee-df5ccc30c465-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.671250 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.670513 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c031229-b7c7-4dea-a9ee-df5ccc30c465-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.671250 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.670754 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4c031229-b7c7-4dea-a9ee-df5ccc30c465-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.671250 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.671244 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c031229-b7c7-4dea-a9ee-df5ccc30c465-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.672611 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.672583 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c031229-b7c7-4dea-a9ee-df5ccc30c465-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.672840 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.672818 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4c031229-b7c7-4dea-a9ee-df5ccc30c465-config\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.674580 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.673003 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4c031229-b7c7-4dea-a9ee-df5ccc30c465-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.674580 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.674441 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c031229-b7c7-4dea-a9ee-df5ccc30c465-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.676451 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.676406 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4c031229-b7c7-4dea-a9ee-df5ccc30c465-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.679313 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.679257 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skvvm\" (UniqueName: \"kubernetes.io/projected/4c031229-b7c7-4dea-a9ee-df5ccc30c465-kube-api-access-skvvm\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.680222 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.680191 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4c031229-b7c7-4dea-a9ee-df5ccc30c465-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.680595 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.680530 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c031229-b7c7-4dea-a9ee-df5ccc30c465-web-config\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.680595 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.680536 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c031229-b7c7-4dea-a9ee-df5ccc30c465-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.680885 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.680844 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c031229-b7c7-4dea-a9ee-df5ccc30c465-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.681996 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.681912 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4c031229-b7c7-4dea-a9ee-df5ccc30c465-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.683311 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.683276 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4c031229-b7c7-4dea-a9ee-df5ccc30c465-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.683424 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.683379 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4c031229-b7c7-4dea-a9ee-df5ccc30c465-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.683622 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.683571 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c031229-b7c7-4dea-a9ee-df5ccc30c465-config-out\") pod \"prometheus-k8s-0\" (UID: \"4c031229-b7c7-4dea-a9ee-df5ccc30c465\") " pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:18.753933 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:18.753895 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:21.122408 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:21.122373 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 22 10:36:21.621641 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:36:21.621611 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c031229_b7c7_4dea_a9ee_df5ccc30c465.slice/crio-4863f19727839d169c9ea5437212559decc72bfaf19007f38ef5e4c9c8e22660 WatchSource:0}: Error finding container 4863f19727839d169c9ea5437212559decc72bfaf19007f38ef5e4c9c8e22660: Status 404 returned error can't find the container with id 4863f19727839d169c9ea5437212559decc72bfaf19007f38ef5e4c9c8e22660 May 22 10:36:22.055890 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.054148 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-65dfdf9c59-lsvwb"] May 22 10:36:22.080100 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.080076 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65dfdf9c59-lsvwb"] May 22 10:36:22.080213 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.080200 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65dfdf9c59-lsvwb" May 22 10:36:22.200098 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.200008 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5282f24c-c581-4813-bb8e-92458708d7f6-trusted-ca-bundle\") pod \"console-65dfdf9c59-lsvwb\" (UID: \"5282f24c-c581-4813-bb8e-92458708d7f6\") " pod="openshift-console/console-65dfdf9c59-lsvwb" May 22 10:36:22.200098 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.200063 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snnk9\" (UniqueName: \"kubernetes.io/projected/5282f24c-c581-4813-bb8e-92458708d7f6-kube-api-access-snnk9\") pod \"console-65dfdf9c59-lsvwb\" (UID: \"5282f24c-c581-4813-bb8e-92458708d7f6\") " pod="openshift-console/console-65dfdf9c59-lsvwb" May 22 10:36:22.200531 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.200146 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5282f24c-c581-4813-bb8e-92458708d7f6-console-serving-cert\") pod \"console-65dfdf9c59-lsvwb\" (UID: \"5282f24c-c581-4813-bb8e-92458708d7f6\") " pod="openshift-console/console-65dfdf9c59-lsvwb" May 22 10:36:22.200531 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.200220 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5282f24c-c581-4813-bb8e-92458708d7f6-console-config\") pod \"console-65dfdf9c59-lsvwb\" (UID: \"5282f24c-c581-4813-bb8e-92458708d7f6\") " pod="openshift-console/console-65dfdf9c59-lsvwb" May 22 10:36:22.200531 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.200261 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5282f24c-c581-4813-bb8e-92458708d7f6-service-ca\") pod \"console-65dfdf9c59-lsvwb\" (UID: \"5282f24c-c581-4813-bb8e-92458708d7f6\") " pod="openshift-console/console-65dfdf9c59-lsvwb" May 22 10:36:22.200531 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.200287 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5282f24c-c581-4813-bb8e-92458708d7f6-oauth-serving-cert\") pod \"console-65dfdf9c59-lsvwb\" (UID: \"5282f24c-c581-4813-bb8e-92458708d7f6\") " pod="openshift-console/console-65dfdf9c59-lsvwb" May 22 10:36:22.200531 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.200364 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5282f24c-c581-4813-bb8e-92458708d7f6-console-oauth-config\") pod \"console-65dfdf9c59-lsvwb\" (UID: \"5282f24c-c581-4813-bb8e-92458708d7f6\") " pod="openshift-console/console-65dfdf9c59-lsvwb" May 22 10:36:22.301177 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.301147 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5282f24c-c581-4813-bb8e-92458708d7f6-console-oauth-config\") pod \"console-65dfdf9c59-lsvwb\" (UID: \"5282f24c-c581-4813-bb8e-92458708d7f6\") " pod="openshift-console/console-65dfdf9c59-lsvwb" May 22 10:36:22.301290 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.301199 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5282f24c-c581-4813-bb8e-92458708d7f6-trusted-ca-bundle\") pod \"console-65dfdf9c59-lsvwb\" (UID: \"5282f24c-c581-4813-bb8e-92458708d7f6\") " pod="openshift-console/console-65dfdf9c59-lsvwb" May 22 10:36:22.301290 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.301243 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-snnk9\" (UniqueName: \"kubernetes.io/projected/5282f24c-c581-4813-bb8e-92458708d7f6-kube-api-access-snnk9\") pod \"console-65dfdf9c59-lsvwb\" (UID: \"5282f24c-c581-4813-bb8e-92458708d7f6\") " pod="openshift-console/console-65dfdf9c59-lsvwb" May 22 10:36:22.301646 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.301589 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5282f24c-c581-4813-bb8e-92458708d7f6-console-serving-cert\") pod \"console-65dfdf9c59-lsvwb\" (UID: \"5282f24c-c581-4813-bb8e-92458708d7f6\") " pod="openshift-console/console-65dfdf9c59-lsvwb" May 22 10:36:22.301765 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.301708 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5282f24c-c581-4813-bb8e-92458708d7f6-console-config\") pod \"console-65dfdf9c59-lsvwb\" (UID: \"5282f24c-c581-4813-bb8e-92458708d7f6\") " pod="openshift-console/console-65dfdf9c59-lsvwb" May 22 10:36:22.301765 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.301753 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5282f24c-c581-4813-bb8e-92458708d7f6-service-ca\") pod \"console-65dfdf9c59-lsvwb\" (UID: \"5282f24c-c581-4813-bb8e-92458708d7f6\") " pod="openshift-console/console-65dfdf9c59-lsvwb" May 22 10:36:22.301867 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.301777 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5282f24c-c581-4813-bb8e-92458708d7f6-oauth-serving-cert\") pod \"console-65dfdf9c59-lsvwb\" (UID: \"5282f24c-c581-4813-bb8e-92458708d7f6\") " pod="openshift-console/console-65dfdf9c59-lsvwb" May 22 10:36:22.302496 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.302468 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5282f24c-c581-4813-bb8e-92458708d7f6-trusted-ca-bundle\") pod \"console-65dfdf9c59-lsvwb\" (UID: \"5282f24c-c581-4813-bb8e-92458708d7f6\") " pod="openshift-console/console-65dfdf9c59-lsvwb" May 22 10:36:22.302754 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.302709 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5282f24c-c581-4813-bb8e-92458708d7f6-oauth-serving-cert\") pod \"console-65dfdf9c59-lsvwb\" (UID: \"5282f24c-c581-4813-bb8e-92458708d7f6\") " pod="openshift-console/console-65dfdf9c59-lsvwb" May 22 10:36:22.303040 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.303015 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5282f24c-c581-4813-bb8e-92458708d7f6-service-ca\") pod \"console-65dfdf9c59-lsvwb\" (UID: \"5282f24c-c581-4813-bb8e-92458708d7f6\") " pod="openshift-console/console-65dfdf9c59-lsvwb" May 22 10:36:22.303200 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.303176 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5282f24c-c581-4813-bb8e-92458708d7f6-console-config\") pod \"console-65dfdf9c59-lsvwb\" (UID: \"5282f24c-c581-4813-bb8e-92458708d7f6\") " pod="openshift-console/console-65dfdf9c59-lsvwb" May 22 10:36:22.303963 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.303941 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5282f24c-c581-4813-bb8e-92458708d7f6-console-oauth-config\") pod \"console-65dfdf9c59-lsvwb\" (UID: \"5282f24c-c581-4813-bb8e-92458708d7f6\") " pod="openshift-console/console-65dfdf9c59-lsvwb" May 22 10:36:22.304900 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.304882 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5282f24c-c581-4813-bb8e-92458708d7f6-console-serving-cert\") pod \"console-65dfdf9c59-lsvwb\" (UID: \"5282f24c-c581-4813-bb8e-92458708d7f6\") " pod="openshift-console/console-65dfdf9c59-lsvwb" May 22 10:36:22.307819 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.307793 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snnk9\" (UniqueName: \"kubernetes.io/projected/5282f24c-c581-4813-bb8e-92458708d7f6-kube-api-access-snnk9\") pod \"console-65dfdf9c59-lsvwb\" (UID: \"5282f24c-c581-4813-bb8e-92458708d7f6\") " pod="openshift-console/console-65dfdf9c59-lsvwb" May 22 10:36:22.421427 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.421288 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65dfdf9c59-lsvwb" May 22 10:36:22.552355 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.552308 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65dfdf9c59-lsvwb"] May 22 10:36:22.556463 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:36:22.556437 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5282f24c_c581_4813_bb8e_92458708d7f6.slice/crio-7e11dd02cc0613185b87ebbcb7ac5eb9d6a4fb6b95f289ee6dd2d7c09106f890 WatchSource:0}: Error finding container 7e11dd02cc0613185b87ebbcb7ac5eb9d6a4fb6b95f289ee6dd2d7c09106f890: Status 404 returned error can't find the container with id 7e11dd02cc0613185b87ebbcb7ac5eb9d6a4fb6b95f289ee6dd2d7c09106f890 May 22 10:36:22.601750 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.601724 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-756586f74d-cwck8" event={"ID":"03bbe1ab-da55-4d33-b09b-e02c8098b59b","Type":"ContainerStarted","Data":"23df277247a97bc26508cd9f0af95902833017a74198ed0be7f815d3d2925309"} May 22 10:36:22.601848 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.601764 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-756586f74d-cwck8" event={"ID":"03bbe1ab-da55-4d33-b09b-e02c8098b59b","Type":"ContainerStarted","Data":"ab6b8f1b9bff27e009cabb64764776d92f8a7a176324c0d9e88cfa6e872479b8"} May 22 10:36:22.601848 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.601774 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-756586f74d-cwck8" event={"ID":"03bbe1ab-da55-4d33-b09b-e02c8098b59b","Type":"ContainerStarted","Data":"395ea9b0c768dd10f630a0361889ea1706cf16b9e795d92499deee56e6388f4b"} May 22 10:36:22.602750 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.602725 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65dfdf9c59-lsvwb" event={"ID":"5282f24c-c581-4813-bb8e-92458708d7f6","Type":"ContainerStarted","Data":"7e11dd02cc0613185b87ebbcb7ac5eb9d6a4fb6b95f289ee6dd2d7c09106f890"} May 22 10:36:22.603904 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.603882 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-4n59w" event={"ID":"e4095573-5bef-4351-8fa6-0bfa9e99efbb","Type":"ContainerStarted","Data":"c9d5d5fe1d3563ba278a7eb6274245d82c0bfafb97c063640f0132e1dee7997c"} May 22 10:36:22.605133 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.605111 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ncpgn" event={"ID":"63a0f782-b151-4b2a-be81-d0025df9fb35","Type":"ContainerStarted","Data":"592c0c74272f4c19c2f79b94a47dca42b778ec6183bba31d77558c15ec213388"} May 22 10:36:22.606385 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.606365 2558 generic.go:358] "Generic (PLEG): container finished" podID="4c031229-b7c7-4dea-a9ee-df5ccc30c465" containerID="4c56ba6610c3c48d68b35dce4e2af3b9b2a9e6fa34c5e39c4a644c8b7f07cf2e" exitCode=0 May 22 10:36:22.606475 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.606454 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4c031229-b7c7-4dea-a9ee-df5ccc30c465","Type":"ContainerDied","Data":"4c56ba6610c3c48d68b35dce4e2af3b9b2a9e6fa34c5e39c4a644c8b7f07cf2e"} May 22 10:36:22.606522 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.606485 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4c031229-b7c7-4dea-a9ee-df5ccc30c465","Type":"ContainerStarted","Data":"4863f19727839d169c9ea5437212559decc72bfaf19007f38ef5e4c9c8e22660"} May 22 10:36:22.609207 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.609182 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj" event={"ID":"917b15f6-54fd-4d77-86e0-5faab1b9d996","Type":"ContainerStarted","Data":"db4a3e22f5254c9661d9645c702d6598f7c73509b499e9becbbe024f195945b0"} May 22 10:36:22.609207 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.609207 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj" event={"ID":"917b15f6-54fd-4d77-86e0-5faab1b9d996","Type":"ContainerStarted","Data":"9b58ecd2b6bf9140884282994214bc4ea15e6060f4f62e068e4682250cab6a89"} May 22 10:36:22.609378 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.609216 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj" event={"ID":"917b15f6-54fd-4d77-86e0-5faab1b9d996","Type":"ContainerStarted","Data":"566d9b3a77b8a36312349f90a399a3799eab3c5d669c21c0395a30ee7f8622ae"} May 22 10:36:22.612199 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.612181 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"026972a8-c35b-4157-a84b-b877e8ed7fa8","Type":"ContainerStarted","Data":"515c90185e12b2aa794bd8e3f5988759901e8581014836820d5024f416f02bbd"} May 22 10:36:22.612279 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.612205 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"026972a8-c35b-4157-a84b-b877e8ed7fa8","Type":"ContainerStarted","Data":"5dbdfd50d6397438bebeb141f7dc9fe989c2f4530b13d24c57736fa21addce1a"} May 22 10:36:22.612279 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.612215 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"026972a8-c35b-4157-a84b-b877e8ed7fa8","Type":"ContainerStarted","Data":"64f56c5b1ee1ff0418ee7668cc12a252a3742b22e2840d19095802bcc5274445"} May 22 10:36:22.612279 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.612223 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"026972a8-c35b-4157-a84b-b877e8ed7fa8","Type":"ContainerStarted","Data":"3028f5b39683a6bf0b6f2de75cc039d3873675f86e0eb114194a492e62f88615"} May 22 10:36:22.612279 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.612234 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"026972a8-c35b-4157-a84b-b877e8ed7fa8","Type":"ContainerStarted","Data":"5916397f2f4d0af174485bc8c3efe7a8bd62e420a7adb9bfac7525c861305cc2"} May 22 10:36:22.613539 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.613519 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-854766bfc8-zdtfp" event={"ID":"6adacca9-45a6-43bf-a834-ced100294d3d","Type":"ContainerStarted","Data":"18903e3f08b97ba6a20796f9f8bc60eeb678c919f873faddbd9daadd5efee6dc"} May 22 10:36:22.620275 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.620179 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-4n59w" May 22 10:36:22.620275 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.620209 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj" May 22 10:36:22.620275 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.620245 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:36:22.626122 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.626085 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-4n59w" May 22 10:36:22.627293 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.627277 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj" May 22 10:36:22.657513 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.657464 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-854766bfc8-zdtfp" podStartSLOduration=2.668797319 podStartE2EDuration="6.657448865s" podCreationTimestamp="2026-05-22 10:36:16 +0000 UTC" firstStartedPulling="2026-05-22 10:36:17.449295942 +0000 UTC m=+68.756555670" lastFinishedPulling="2026-05-22 10:36:21.437947479 +0000 UTC m=+72.745207216" observedRunningTime="2026-05-22 10:36:22.655931158 +0000 UTC m=+73.963190906" watchObservedRunningTime="2026-05-22 10:36:22.657448865 +0000 UTC m=+73.964708652" May 22 10:36:22.670844 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.670800 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-4n59w" podStartSLOduration=2.8191643170000003 podStartE2EDuration="6.670744866s" podCreationTimestamp="2026-05-22 10:36:16 +0000 UTC" firstStartedPulling="2026-05-22 10:36:17.987457743 +0000 UTC m=+69.294717468" lastFinishedPulling="2026-05-22 10:36:21.839038278 +0000 UTC m=+73.146298017" observedRunningTime="2026-05-22 10:36:22.670675793 +0000 UTC m=+73.977935559" watchObservedRunningTime="2026-05-22 10:36:22.670744866 +0000 UTC m=+73.978004613" May 22 10:36:22.694538 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.694483 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-756586f74d-cwck8" podStartSLOduration=1.70722045 podStartE2EDuration="5.694464151s" podCreationTimestamp="2026-05-22 10:36:17 +0000 UTC" firstStartedPulling="2026-05-22 10:36:17.848611715 +0000 UTC m=+69.155871443" lastFinishedPulling="2026-05-22 10:36:21.835855421 +0000 UTC m=+73.143115144" observedRunningTime="2026-05-22 10:36:22.6935912 +0000 UTC m=+74.000850949" watchObservedRunningTime="2026-05-22 10:36:22.694464151 +0000 UTC m=+74.001723899" May 22 10:36:22.715985 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.715930 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ncpgn" podStartSLOduration=67.731715376 podStartE2EDuration="1m13.715910829s" podCreationTimestamp="2026-05-22 10:35:09 +0000 UTC" firstStartedPulling="2026-05-22 10:36:15.453760118 +0000 UTC m=+66.761019843" lastFinishedPulling="2026-05-22 10:36:21.437955563 +0000 UTC m=+72.745215296" observedRunningTime="2026-05-22 10:36:22.715307833 +0000 UTC m=+74.022567580" watchObservedRunningTime="2026-05-22 10:36:22.715910829 +0000 UTC m=+74.023170577" May 22 10:36:22.746605 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:22.746534 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6f48fb8bdd-55nqj" podStartSLOduration=2.349763099 podStartE2EDuration="8.746517149s" podCreationTimestamp="2026-05-22 10:36:14 +0000 UTC" firstStartedPulling="2026-05-22 10:36:15.041199123 +0000 UTC m=+66.348458861" lastFinishedPulling="2026-05-22 10:36:21.437953181 +0000 UTC m=+72.745212911" observedRunningTime="2026-05-22 10:36:22.744774398 +0000 UTC m=+74.052034146" watchObservedRunningTime="2026-05-22 10:36:22.746517149 +0000 UTC m=+74.053776926" May 22 10:36:23.620735 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:23.620697 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"026972a8-c35b-4157-a84b-b877e8ed7fa8","Type":"ContainerStarted","Data":"31d116750eef22a7d56801dad2df1b252e8d72682fa746ed72dc15afc66d070b"} May 22 10:36:23.622418 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:23.622263 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65dfdf9c59-lsvwb" event={"ID":"5282f24c-c581-4813-bb8e-92458708d7f6","Type":"ContainerStarted","Data":"576363944e548b26cda26cddefb74ffb72930d57f2c45da309f4cf3768268ad6"} May 22 10:36:23.644246 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:23.644186 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.200705378 podStartE2EDuration="10.644169765s" podCreationTimestamp="2026-05-22 10:36:13 +0000 UTC" firstStartedPulling="2026-05-22 10:36:14.543804965 +0000 UTC m=+65.851064690" lastFinishedPulling="2026-05-22 10:36:20.987269348 +0000 UTC m=+72.294529077" observedRunningTime="2026-05-22 10:36:23.642393386 +0000 UTC m=+74.949653133" watchObservedRunningTime="2026-05-22 10:36:23.644169765 +0000 UTC m=+74.951429512" May 22 10:36:23.661261 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:23.661206 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-65dfdf9c59-lsvwb" podStartSLOduration=1.661186136 podStartE2EDuration="1.661186136s" podCreationTimestamp="2026-05-22 10:36:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-22 10:36:23.65948659 +0000 UTC m=+74.966746347" watchObservedRunningTime="2026-05-22 10:36:23.661186136 +0000 UTC m=+74.968445874" May 22 10:36:26.634534 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:26.634497 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4c031229-b7c7-4dea-a9ee-df5ccc30c465","Type":"ContainerStarted","Data":"45ed53e820f7014e280cc188e3299282ddc8ac9ede2fcfa1a517a04b039de0fa"} May 22 10:36:26.634534 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:26.634540 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4c031229-b7c7-4dea-a9ee-df5ccc30c465","Type":"ContainerStarted","Data":"783c7b268e40b05ea69757b89aa9da7921629e77efde831bfea1e63a00c3c292"} May 22 10:36:26.634931 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:26.634552 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4c031229-b7c7-4dea-a9ee-df5ccc30c465","Type":"ContainerStarted","Data":"08c3e5beb9f9b5f9218877e6fa9c1324fc44b9613bf91d5224a13892875bc20b"} May 22 10:36:26.634931 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:26.634565 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4c031229-b7c7-4dea-a9ee-df5ccc30c465","Type":"ContainerStarted","Data":"052061b650aab375f3db71d354c7c951331bca6b4868d462a2aaccbf1979f8f2"} May 22 10:36:26.634931 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:26.634573 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4c031229-b7c7-4dea-a9ee-df5ccc30c465","Type":"ContainerStarted","Data":"6c66ac7146cb17ecf8f75d59f266b5e51a7f6cb3b07cb94df493b0ab6b9c1a19"} May 22 10:36:26.634931 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:26.634581 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4c031229-b7c7-4dea-a9ee-df5ccc30c465","Type":"ContainerStarted","Data":"a9c774c3c9e1df74884ee8a0c0ab5e2015626e4584b086ab14b518de53d65b73"} May 22 10:36:26.658416 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:26.657684 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.616631406 podStartE2EDuration="8.657665764s" podCreationTimestamp="2026-05-22 10:36:18 +0000 UTC" firstStartedPulling="2026-05-22 10:36:22.607736043 +0000 UTC m=+73.914995771" lastFinishedPulling="2026-05-22 10:36:25.648770406 +0000 UTC m=+76.956030129" observedRunningTime="2026-05-22 10:36:26.655492483 +0000 UTC m=+77.962752229" watchObservedRunningTime="2026-05-22 10:36:26.657665764 +0000 UTC m=+77.964925511" May 22 10:36:28.754514 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:28.754481 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 22 10:36:30.420826 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:30.420791 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65dfdf9c59-lsvwb"] May 22 10:36:30.446206 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:30.446176 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-644bf7ddbb-wbw86"] May 22 10:36:30.450669 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:30.450647 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-644bf7ddbb-wbw86" May 22 10:36:30.464624 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:30.464603 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-644bf7ddbb-wbw86"] May 22 10:36:30.580648 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:30.580613 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/022d5778-54a2-47b7-b9c4-ecf7c1307ede-console-oauth-config\") pod \"console-644bf7ddbb-wbw86\" (UID: \"022d5778-54a2-47b7-b9c4-ecf7c1307ede\") " pod="openshift-console/console-644bf7ddbb-wbw86" May 22 10:36:30.580648 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:30.580650 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjrcm\" (UniqueName: \"kubernetes.io/projected/022d5778-54a2-47b7-b9c4-ecf7c1307ede-kube-api-access-gjrcm\") pod \"console-644bf7ddbb-wbw86\" (UID: \"022d5778-54a2-47b7-b9c4-ecf7c1307ede\") " pod="openshift-console/console-644bf7ddbb-wbw86" May 22 10:36:30.580857 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:30.580669 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/022d5778-54a2-47b7-b9c4-ecf7c1307ede-oauth-serving-cert\") pod \"console-644bf7ddbb-wbw86\" (UID: \"022d5778-54a2-47b7-b9c4-ecf7c1307ede\") " pod="openshift-console/console-644bf7ddbb-wbw86" May 22 10:36:30.580857 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:30.580735 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/022d5778-54a2-47b7-b9c4-ecf7c1307ede-console-config\") pod \"console-644bf7ddbb-wbw86\" (UID: \"022d5778-54a2-47b7-b9c4-ecf7c1307ede\") " pod="openshift-console/console-644bf7ddbb-wbw86" May 22 10:36:30.580857 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:30.580765 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/022d5778-54a2-47b7-b9c4-ecf7c1307ede-console-serving-cert\") pod \"console-644bf7ddbb-wbw86\" (UID: \"022d5778-54a2-47b7-b9c4-ecf7c1307ede\") " pod="openshift-console/console-644bf7ddbb-wbw86" May 22 10:36:30.580857 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:30.580782 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/022d5778-54a2-47b7-b9c4-ecf7c1307ede-trusted-ca-bundle\") pod \"console-644bf7ddbb-wbw86\" (UID: \"022d5778-54a2-47b7-b9c4-ecf7c1307ede\") " pod="openshift-console/console-644bf7ddbb-wbw86" May 22 10:36:30.580857 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:30.580842 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/022d5778-54a2-47b7-b9c4-ecf7c1307ede-service-ca\") pod \"console-644bf7ddbb-wbw86\" (UID: \"022d5778-54a2-47b7-b9c4-ecf7c1307ede\") " pod="openshift-console/console-644bf7ddbb-wbw86" May 22 10:36:30.681528 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:30.681440 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/022d5778-54a2-47b7-b9c4-ecf7c1307ede-service-ca\") pod \"console-644bf7ddbb-wbw86\" (UID: \"022d5778-54a2-47b7-b9c4-ecf7c1307ede\") " pod="openshift-console/console-644bf7ddbb-wbw86" May 22 10:36:30.681528 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:30.681485 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/022d5778-54a2-47b7-b9c4-ecf7c1307ede-console-oauth-config\") pod \"console-644bf7ddbb-wbw86\" (UID: \"022d5778-54a2-47b7-b9c4-ecf7c1307ede\") " pod="openshift-console/console-644bf7ddbb-wbw86" May 22 10:36:30.681528 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:30.681504 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gjrcm\" (UniqueName: \"kubernetes.io/projected/022d5778-54a2-47b7-b9c4-ecf7c1307ede-kube-api-access-gjrcm\") pod \"console-644bf7ddbb-wbw86\" (UID: \"022d5778-54a2-47b7-b9c4-ecf7c1307ede\") " pod="openshift-console/console-644bf7ddbb-wbw86" May 22 10:36:30.681779 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:30.681624 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/022d5778-54a2-47b7-b9c4-ecf7c1307ede-oauth-serving-cert\") pod \"console-644bf7ddbb-wbw86\" (UID: \"022d5778-54a2-47b7-b9c4-ecf7c1307ede\") " pod="openshift-console/console-644bf7ddbb-wbw86" May 22 10:36:30.681779 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:30.681704 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/022d5778-54a2-47b7-b9c4-ecf7c1307ede-console-config\") pod \"console-644bf7ddbb-wbw86\" (UID: \"022d5778-54a2-47b7-b9c4-ecf7c1307ede\") " pod="openshift-console/console-644bf7ddbb-wbw86" May 22 10:36:30.681779 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:30.681752 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/022d5778-54a2-47b7-b9c4-ecf7c1307ede-console-serving-cert\") pod \"console-644bf7ddbb-wbw86\" (UID: \"022d5778-54a2-47b7-b9c4-ecf7c1307ede\") " pod="openshift-console/console-644bf7ddbb-wbw86" May 22 10:36:30.681922 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:30.681777 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/022d5778-54a2-47b7-b9c4-ecf7c1307ede-trusted-ca-bundle\") pod \"console-644bf7ddbb-wbw86\" (UID: \"022d5778-54a2-47b7-b9c4-ecf7c1307ede\") " pod="openshift-console/console-644bf7ddbb-wbw86" May 22 10:36:30.682287 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:30.682223 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/022d5778-54a2-47b7-b9c4-ecf7c1307ede-service-ca\") pod \"console-644bf7ddbb-wbw86\" (UID: \"022d5778-54a2-47b7-b9c4-ecf7c1307ede\") " pod="openshift-console/console-644bf7ddbb-wbw86" May 22 10:36:30.682287 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:30.682240 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/022d5778-54a2-47b7-b9c4-ecf7c1307ede-oauth-serving-cert\") pod \"console-644bf7ddbb-wbw86\" (UID: \"022d5778-54a2-47b7-b9c4-ecf7c1307ede\") " pod="openshift-console/console-644bf7ddbb-wbw86" May 22 10:36:30.682604 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:30.682371 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/022d5778-54a2-47b7-b9c4-ecf7c1307ede-console-config\") pod \"console-644bf7ddbb-wbw86\" (UID: \"022d5778-54a2-47b7-b9c4-ecf7c1307ede\") " pod="openshift-console/console-644bf7ddbb-wbw86" May 22 10:36:30.682803 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:30.682783 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/022d5778-54a2-47b7-b9c4-ecf7c1307ede-trusted-ca-bundle\") pod \"console-644bf7ddbb-wbw86\" (UID: \"022d5778-54a2-47b7-b9c4-ecf7c1307ede\") " pod="openshift-console/console-644bf7ddbb-wbw86" May 22 10:36:30.684176 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:30.684149 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/022d5778-54a2-47b7-b9c4-ecf7c1307ede-console-oauth-config\") pod \"console-644bf7ddbb-wbw86\" (UID: \"022d5778-54a2-47b7-b9c4-ecf7c1307ede\") " pod="openshift-console/console-644bf7ddbb-wbw86" May 22 10:36:30.684321 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:30.684301 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/022d5778-54a2-47b7-b9c4-ecf7c1307ede-console-serving-cert\") pod \"console-644bf7ddbb-wbw86\" (UID: \"022d5778-54a2-47b7-b9c4-ecf7c1307ede\") " pod="openshift-console/console-644bf7ddbb-wbw86" May 22 10:36:30.688589 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:30.688568 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjrcm\" (UniqueName: \"kubernetes.io/projected/022d5778-54a2-47b7-b9c4-ecf7c1307ede-kube-api-access-gjrcm\") pod \"console-644bf7ddbb-wbw86\" (UID: \"022d5778-54a2-47b7-b9c4-ecf7c1307ede\") " pod="openshift-console/console-644bf7ddbb-wbw86" May 22 10:36:30.759970 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:30.759941 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-644bf7ddbb-wbw86" May 22 10:36:30.919734 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:30.919709 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-644bf7ddbb-wbw86"] May 22 10:36:30.922238 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:36:30.922205 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod022d5778_54a2_47b7_b9c4_ecf7c1307ede.slice/crio-8b1f6c3745e3bbe293a22ff1cc67e5f3c6c1dba475a0f0b08fce78775a998bb7 WatchSource:0}: Error finding container 8b1f6c3745e3bbe293a22ff1cc67e5f3c6c1dba475a0f0b08fce78775a998bb7: Status 404 returned error can't find the container with id 8b1f6c3745e3bbe293a22ff1cc67e5f3c6c1dba475a0f0b08fce78775a998bb7 May 22 10:36:31.651088 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:31.651052 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-644bf7ddbb-wbw86" event={"ID":"022d5778-54a2-47b7-b9c4-ecf7c1307ede","Type":"ContainerStarted","Data":"05afdd2c662daeae7446ec88867ee3195eacfa145e25955814768fd7d2fc96fa"} May 22 10:36:31.651088 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:31.651089 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-644bf7ddbb-wbw86" event={"ID":"022d5778-54a2-47b7-b9c4-ecf7c1307ede","Type":"ContainerStarted","Data":"8b1f6c3745e3bbe293a22ff1cc67e5f3c6c1dba475a0f0b08fce78775a998bb7"} May 22 10:36:31.666286 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:31.666240 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-644bf7ddbb-wbw86" podStartSLOduration=1.666224462 podStartE2EDuration="1.666224462s" podCreationTimestamp="2026-05-22 10:36:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-22 10:36:31.664455949 +0000 UTC m=+82.971715697" watchObservedRunningTime="2026-05-22 10:36:31.666224462 +0000 UTC m=+82.973484208" May 22 10:36:32.422231 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:32.422195 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65dfdf9c59-lsvwb" May 22 10:36:36.764550 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:36.764516 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-854766bfc8-zdtfp" May 22 10:36:36.764889 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:36.764596 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-854766bfc8-zdtfp" May 22 10:36:40.761004 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:40.760972 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-644bf7ddbb-wbw86" May 22 10:36:40.761004 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:40.761006 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-644bf7ddbb-wbw86" May 22 10:36:40.765460 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:40.765438 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-644bf7ddbb-wbw86" May 22 10:36:41.685121 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:41.685092 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-644bf7ddbb-wbw86" May 22 10:36:41.730010 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:41.729977 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74b767dd95-9dd58"] May 22 10:36:54.628965 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:54.628928 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ncpgn" May 22 10:36:55.440516 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:55.440458 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-65dfdf9c59-lsvwb" podUID="5282f24c-c581-4813-bb8e-92458708d7f6" containerName="console" containerID="cri-o://576363944e548b26cda26cddefb74ffb72930d57f2c45da309f4cf3768268ad6" gracePeriod=15 May 22 10:36:55.676503 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:55.676481 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-65dfdf9c59-lsvwb_5282f24c-c581-4813-bb8e-92458708d7f6/console/0.log" May 22 10:36:55.676789 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:55.676551 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65dfdf9c59-lsvwb" May 22 10:36:55.727086 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:55.727049 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-65dfdf9c59-lsvwb_5282f24c-c581-4813-bb8e-92458708d7f6/console/0.log" May 22 10:36:55.727252 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:55.727104 2558 generic.go:358] "Generic (PLEG): container finished" podID="5282f24c-c581-4813-bb8e-92458708d7f6" containerID="576363944e548b26cda26cddefb74ffb72930d57f2c45da309f4cf3768268ad6" exitCode=2 May 22 10:36:55.727252 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:55.727172 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65dfdf9c59-lsvwb" event={"ID":"5282f24c-c581-4813-bb8e-92458708d7f6","Type":"ContainerDied","Data":"576363944e548b26cda26cddefb74ffb72930d57f2c45da309f4cf3768268ad6"} May 22 10:36:55.727252 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:55.727194 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65dfdf9c59-lsvwb" event={"ID":"5282f24c-c581-4813-bb8e-92458708d7f6","Type":"ContainerDied","Data":"7e11dd02cc0613185b87ebbcb7ac5eb9d6a4fb6b95f289ee6dd2d7c09106f890"} May 22 10:36:55.727252 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:55.727209 2558 scope.go:117] "RemoveContainer" containerID="576363944e548b26cda26cddefb74ffb72930d57f2c45da309f4cf3768268ad6" May 22 10:36:55.727252 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:55.727174 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65dfdf9c59-lsvwb" May 22 10:36:55.735244 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:55.735228 2558 scope.go:117] "RemoveContainer" containerID="576363944e548b26cda26cddefb74ffb72930d57f2c45da309f4cf3768268ad6" May 22 10:36:55.735517 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:36:55.735498 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"576363944e548b26cda26cddefb74ffb72930d57f2c45da309f4cf3768268ad6\": container with ID starting with 576363944e548b26cda26cddefb74ffb72930d57f2c45da309f4cf3768268ad6 not found: ID does not exist" containerID="576363944e548b26cda26cddefb74ffb72930d57f2c45da309f4cf3768268ad6" May 22 10:36:55.735598 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:55.735524 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"576363944e548b26cda26cddefb74ffb72930d57f2c45da309f4cf3768268ad6"} err="failed to get container status \"576363944e548b26cda26cddefb74ffb72930d57f2c45da309f4cf3768268ad6\": rpc error: code = NotFound desc = could not find container \"576363944e548b26cda26cddefb74ffb72930d57f2c45da309f4cf3768268ad6\": container with ID starting with 576363944e548b26cda26cddefb74ffb72930d57f2c45da309f4cf3768268ad6 not found: ID does not exist" May 22 10:36:55.806485 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:55.806454 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5282f24c-c581-4813-bb8e-92458708d7f6-trusted-ca-bundle\") pod \"5282f24c-c581-4813-bb8e-92458708d7f6\" (UID: \"5282f24c-c581-4813-bb8e-92458708d7f6\") " May 22 10:36:55.806485 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:55.806489 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5282f24c-c581-4813-bb8e-92458708d7f6-service-ca\") pod \"5282f24c-c581-4813-bb8e-92458708d7f6\" (UID: \"5282f24c-c581-4813-bb8e-92458708d7f6\") " May 22 10:36:55.806670 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:55.806520 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-snnk9\" (UniqueName: \"kubernetes.io/projected/5282f24c-c581-4813-bb8e-92458708d7f6-kube-api-access-snnk9\") pod \"5282f24c-c581-4813-bb8e-92458708d7f6\" (UID: \"5282f24c-c581-4813-bb8e-92458708d7f6\") " May 22 10:36:55.806670 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:55.806563 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5282f24c-c581-4813-bb8e-92458708d7f6-console-oauth-config\") pod \"5282f24c-c581-4813-bb8e-92458708d7f6\" (UID: \"5282f24c-c581-4813-bb8e-92458708d7f6\") " May 22 10:36:55.806670 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:55.806596 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5282f24c-c581-4813-bb8e-92458708d7f6-oauth-serving-cert\") pod \"5282f24c-c581-4813-bb8e-92458708d7f6\" (UID: \"5282f24c-c581-4813-bb8e-92458708d7f6\") " May 22 10:36:55.806670 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:55.806623 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5282f24c-c581-4813-bb8e-92458708d7f6-console-config\") pod \"5282f24c-c581-4813-bb8e-92458708d7f6\" (UID: \"5282f24c-c581-4813-bb8e-92458708d7f6\") " May 22 10:36:55.806861 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:55.806681 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5282f24c-c581-4813-bb8e-92458708d7f6-console-serving-cert\") pod \"5282f24c-c581-4813-bb8e-92458708d7f6\" (UID: \"5282f24c-c581-4813-bb8e-92458708d7f6\") " May 22 10:36:55.806956 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:55.806922 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5282f24c-c581-4813-bb8e-92458708d7f6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5282f24c-c581-4813-bb8e-92458708d7f6" (UID: "5282f24c-c581-4813-bb8e-92458708d7f6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 22 10:36:55.807074 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:55.806985 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5282f24c-c581-4813-bb8e-92458708d7f6-service-ca" (OuterVolumeSpecName: "service-ca") pod "5282f24c-c581-4813-bb8e-92458708d7f6" (UID: "5282f24c-c581-4813-bb8e-92458708d7f6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 22 10:36:55.807074 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:55.807037 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5282f24c-c581-4813-bb8e-92458708d7f6-trusted-ca-bundle\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" May 22 10:36:55.807074 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:55.807041 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5282f24c-c581-4813-bb8e-92458708d7f6-console-config" (OuterVolumeSpecName: "console-config") pod "5282f24c-c581-4813-bb8e-92458708d7f6" (UID: "5282f24c-c581-4813-bb8e-92458708d7f6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 22 10:36:55.807186 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:55.807122 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5282f24c-c581-4813-bb8e-92458708d7f6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5282f24c-c581-4813-bb8e-92458708d7f6" (UID: "5282f24c-c581-4813-bb8e-92458708d7f6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 22 10:36:55.809122 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:55.809096 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5282f24c-c581-4813-bb8e-92458708d7f6-kube-api-access-snnk9" (OuterVolumeSpecName: "kube-api-access-snnk9") pod "5282f24c-c581-4813-bb8e-92458708d7f6" (UID: "5282f24c-c581-4813-bb8e-92458708d7f6"). InnerVolumeSpecName "kube-api-access-snnk9". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 22 10:36:55.809122 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:55.809099 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5282f24c-c581-4813-bb8e-92458708d7f6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5282f24c-c581-4813-bb8e-92458708d7f6" (UID: "5282f24c-c581-4813-bb8e-92458708d7f6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 22 10:36:55.809239 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:55.809119 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5282f24c-c581-4813-bb8e-92458708d7f6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5282f24c-c581-4813-bb8e-92458708d7f6" (UID: "5282f24c-c581-4813-bb8e-92458708d7f6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 22 10:36:55.908657 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:55.908543 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5282f24c-c581-4813-bb8e-92458708d7f6-service-ca\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" May 22 10:36:55.908657 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:55.908580 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snnk9\" (UniqueName: \"kubernetes.io/projected/5282f24c-c581-4813-bb8e-92458708d7f6-kube-api-access-snnk9\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" May 22 10:36:55.908657 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:55.908598 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5282f24c-c581-4813-bb8e-92458708d7f6-console-oauth-config\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" May 22 10:36:55.908657 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:55.908610 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5282f24c-c581-4813-bb8e-92458708d7f6-oauth-serving-cert\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" May 22 10:36:55.908657 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:55.908622 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5282f24c-c581-4813-bb8e-92458708d7f6-console-config\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" May 22 10:36:55.908657 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:55.908634 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5282f24c-c581-4813-bb8e-92458708d7f6-console-serving-cert\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" May 22 10:36:56.047003 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:56.046974 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65dfdf9c59-lsvwb"] May 22 10:36:56.050217 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:56.050193 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65dfdf9c59-lsvwb"] May 22 10:36:56.770361 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:56.770314 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-854766bfc8-zdtfp" May 22 10:36:56.774167 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:56.774142 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-854766bfc8-zdtfp" May 22 10:36:57.254661 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:36:57.254628 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5282f24c-c581-4813-bb8e-92458708d7f6" path="/var/lib/kubelet/pods/5282f24c-c581-4813-bb8e-92458708d7f6/volumes" May 22 10:37:06.752316 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:06.752250 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-74b767dd95-9dd58" podUID="7f0ba409-dcff-463a-900d-bd2ffdeb1122" containerName="console" containerID="cri-o://a3cc5ce90433cad5a662456238f2cbad69c7fe61fbaa3998b324afbffee91150" gracePeriod=15 May 22 10:37:06.992107 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:06.992086 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-74b767dd95-9dd58_7f0ba409-dcff-463a-900d-bd2ffdeb1122/console/0.log" May 22 10:37:06.992222 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:06.992147 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74b767dd95-9dd58" May 22 10:37:07.112806 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:07.112728 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f0ba409-dcff-463a-900d-bd2ffdeb1122-trusted-ca-bundle\") pod \"7f0ba409-dcff-463a-900d-bd2ffdeb1122\" (UID: \"7f0ba409-dcff-463a-900d-bd2ffdeb1122\") " May 22 10:37:07.112806 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:07.112800 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f0ba409-dcff-463a-900d-bd2ffdeb1122-console-oauth-config\") pod \"7f0ba409-dcff-463a-900d-bd2ffdeb1122\" (UID: \"7f0ba409-dcff-463a-900d-bd2ffdeb1122\") " May 22 10:37:07.113034 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:07.112829 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f0ba409-dcff-463a-900d-bd2ffdeb1122-service-ca\") pod \"7f0ba409-dcff-463a-900d-bd2ffdeb1122\" (UID: \"7f0ba409-dcff-463a-900d-bd2ffdeb1122\") " May 22 10:37:07.113034 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:07.112855 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f0ba409-dcff-463a-900d-bd2ffdeb1122-oauth-serving-cert\") pod \"7f0ba409-dcff-463a-900d-bd2ffdeb1122\" (UID: \"7f0ba409-dcff-463a-900d-bd2ffdeb1122\") " May 22 10:37:07.113034 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:07.112901 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f0ba409-dcff-463a-900d-bd2ffdeb1122-console-serving-cert\") pod \"7f0ba409-dcff-463a-900d-bd2ffdeb1122\" (UID: \"7f0ba409-dcff-463a-900d-bd2ffdeb1122\") " May 22 10:37:07.113034 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:07.112924 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-544z4\" (UniqueName: \"kubernetes.io/projected/7f0ba409-dcff-463a-900d-bd2ffdeb1122-kube-api-access-544z4\") pod \"7f0ba409-dcff-463a-900d-bd2ffdeb1122\" (UID: \"7f0ba409-dcff-463a-900d-bd2ffdeb1122\") " May 22 10:37:07.113034 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:07.112976 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f0ba409-dcff-463a-900d-bd2ffdeb1122-console-config\") pod \"7f0ba409-dcff-463a-900d-bd2ffdeb1122\" (UID: \"7f0ba409-dcff-463a-900d-bd2ffdeb1122\") " May 22 10:37:07.113277 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:07.113189 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f0ba409-dcff-463a-900d-bd2ffdeb1122-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7f0ba409-dcff-463a-900d-bd2ffdeb1122" (UID: "7f0ba409-dcff-463a-900d-bd2ffdeb1122"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 22 10:37:07.113277 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:07.113250 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f0ba409-dcff-463a-900d-bd2ffdeb1122-trusted-ca-bundle\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" May 22 10:37:07.113394 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:07.113301 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f0ba409-dcff-463a-900d-bd2ffdeb1122-service-ca" (OuterVolumeSpecName: "service-ca") pod "7f0ba409-dcff-463a-900d-bd2ffdeb1122" (UID: "7f0ba409-dcff-463a-900d-bd2ffdeb1122"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 22 10:37:07.113394 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:07.113309 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f0ba409-dcff-463a-900d-bd2ffdeb1122-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7f0ba409-dcff-463a-900d-bd2ffdeb1122" (UID: "7f0ba409-dcff-463a-900d-bd2ffdeb1122"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 22 10:37:07.113542 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:07.113515 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f0ba409-dcff-463a-900d-bd2ffdeb1122-console-config" (OuterVolumeSpecName: "console-config") pod "7f0ba409-dcff-463a-900d-bd2ffdeb1122" (UID: "7f0ba409-dcff-463a-900d-bd2ffdeb1122"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 22 10:37:07.115212 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:07.115183 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f0ba409-dcff-463a-900d-bd2ffdeb1122-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7f0ba409-dcff-463a-900d-bd2ffdeb1122" (UID: "7f0ba409-dcff-463a-900d-bd2ffdeb1122"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 22 10:37:07.115212 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:07.115196 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f0ba409-dcff-463a-900d-bd2ffdeb1122-kube-api-access-544z4" (OuterVolumeSpecName: "kube-api-access-544z4") pod "7f0ba409-dcff-463a-900d-bd2ffdeb1122" (UID: "7f0ba409-dcff-463a-900d-bd2ffdeb1122"). InnerVolumeSpecName "kube-api-access-544z4". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 22 10:37:07.115212 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:07.115201 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f0ba409-dcff-463a-900d-bd2ffdeb1122-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7f0ba409-dcff-463a-900d-bd2ffdeb1122" (UID: "7f0ba409-dcff-463a-900d-bd2ffdeb1122"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 22 10:37:07.213802 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:07.213766 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f0ba409-dcff-463a-900d-bd2ffdeb1122-console-oauth-config\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" May 22 10:37:07.213802 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:07.213796 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f0ba409-dcff-463a-900d-bd2ffdeb1122-service-ca\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" May 22 10:37:07.213802 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:07.213806 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f0ba409-dcff-463a-900d-bd2ffdeb1122-oauth-serving-cert\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" May 22 10:37:07.214064 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:07.213814 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f0ba409-dcff-463a-900d-bd2ffdeb1122-console-serving-cert\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" May 22 10:37:07.214064 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:07.213824 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-544z4\" (UniqueName: \"kubernetes.io/projected/7f0ba409-dcff-463a-900d-bd2ffdeb1122-kube-api-access-544z4\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" May 22 10:37:07.214064 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:07.213833 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f0ba409-dcff-463a-900d-bd2ffdeb1122-console-config\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" May 22 10:37:07.762559 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:07.762534 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-74b767dd95-9dd58_7f0ba409-dcff-463a-900d-bd2ffdeb1122/console/0.log" May 22 10:37:07.763021 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:07.762571 2558 generic.go:358] "Generic (PLEG): container finished" podID="7f0ba409-dcff-463a-900d-bd2ffdeb1122" containerID="a3cc5ce90433cad5a662456238f2cbad69c7fe61fbaa3998b324afbffee91150" exitCode=2 May 22 10:37:07.763021 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:07.762653 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74b767dd95-9dd58" May 22 10:37:07.763021 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:07.762668 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74b767dd95-9dd58" event={"ID":"7f0ba409-dcff-463a-900d-bd2ffdeb1122","Type":"ContainerDied","Data":"a3cc5ce90433cad5a662456238f2cbad69c7fe61fbaa3998b324afbffee91150"} May 22 10:37:07.763021 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:07.762703 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74b767dd95-9dd58" event={"ID":"7f0ba409-dcff-463a-900d-bd2ffdeb1122","Type":"ContainerDied","Data":"e93040fe8629d5dc3cfcbf2e81309fff31c8058855371ee2d31c32904747b008"} May 22 10:37:07.763021 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:07.762718 2558 scope.go:117] "RemoveContainer" containerID="a3cc5ce90433cad5a662456238f2cbad69c7fe61fbaa3998b324afbffee91150" May 22 10:37:07.771100 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:07.771084 2558 scope.go:117] "RemoveContainer" containerID="a3cc5ce90433cad5a662456238f2cbad69c7fe61fbaa3998b324afbffee91150" May 22 10:37:07.771351 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:37:07.771322 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3cc5ce90433cad5a662456238f2cbad69c7fe61fbaa3998b324afbffee91150\": container with ID starting with a3cc5ce90433cad5a662456238f2cbad69c7fe61fbaa3998b324afbffee91150 not found: ID does not exist" containerID="a3cc5ce90433cad5a662456238f2cbad69c7fe61fbaa3998b324afbffee91150" May 22 10:37:07.771410 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:07.771371 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3cc5ce90433cad5a662456238f2cbad69c7fe61fbaa3998b324afbffee91150"} err="failed to get container status \"a3cc5ce90433cad5a662456238f2cbad69c7fe61fbaa3998b324afbffee91150\": rpc error: code = NotFound desc = could not find container \"a3cc5ce90433cad5a662456238f2cbad69c7fe61fbaa3998b324afbffee91150\": container with ID starting with a3cc5ce90433cad5a662456238f2cbad69c7fe61fbaa3998b324afbffee91150 not found: ID does not exist" May 22 10:37:07.776480 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:07.776458 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74b767dd95-9dd58"] May 22 10:37:07.779474 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:07.779454 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74b767dd95-9dd58"] May 22 10:37:09.253673 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:09.253640 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f0ba409-dcff-463a-900d-bd2ffdeb1122" path="/var/lib/kubelet/pods/7f0ba409-dcff-463a-900d-bd2ffdeb1122/volumes" May 22 10:37:18.754395 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:18.754324 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 22 10:37:18.787415 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:18.787373 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 22 10:37:18.811445 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:18.811376 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 22 10:37:43.035482 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:37:43.035442 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-644bf7ddbb-wbw86"] May 22 10:38:08.055259 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:08.055142 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-644bf7ddbb-wbw86" podUID="022d5778-54a2-47b7-b9c4-ecf7c1307ede" containerName="console" containerID="cri-o://05afdd2c662daeae7446ec88867ee3195eacfa145e25955814768fd7d2fc96fa" gracePeriod=15 May 22 10:38:08.300703 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:08.300682 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-644bf7ddbb-wbw86_022d5778-54a2-47b7-b9c4-ecf7c1307ede/console/0.log" May 22 10:38:08.300811 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:08.300744 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-644bf7ddbb-wbw86" May 22 10:38:08.367632 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:08.367555 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/022d5778-54a2-47b7-b9c4-ecf7c1307ede-console-serving-cert\") pod \"022d5778-54a2-47b7-b9c4-ecf7c1307ede\" (UID: \"022d5778-54a2-47b7-b9c4-ecf7c1307ede\") " May 22 10:38:08.367632 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:08.367613 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/022d5778-54a2-47b7-b9c4-ecf7c1307ede-console-oauth-config\") pod \"022d5778-54a2-47b7-b9c4-ecf7c1307ede\" (UID: \"022d5778-54a2-47b7-b9c4-ecf7c1307ede\") " May 22 10:38:08.367845 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:08.367641 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/022d5778-54a2-47b7-b9c4-ecf7c1307ede-trusted-ca-bundle\") pod \"022d5778-54a2-47b7-b9c4-ecf7c1307ede\" (UID: \"022d5778-54a2-47b7-b9c4-ecf7c1307ede\") " May 22 10:38:08.367845 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:08.367664 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjrcm\" (UniqueName: \"kubernetes.io/projected/022d5778-54a2-47b7-b9c4-ecf7c1307ede-kube-api-access-gjrcm\") pod \"022d5778-54a2-47b7-b9c4-ecf7c1307ede\" (UID: \"022d5778-54a2-47b7-b9c4-ecf7c1307ede\") " May 22 10:38:08.367845 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:08.367684 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/022d5778-54a2-47b7-b9c4-ecf7c1307ede-service-ca\") pod \"022d5778-54a2-47b7-b9c4-ecf7c1307ede\" (UID: \"022d5778-54a2-47b7-b9c4-ecf7c1307ede\") " May 22 10:38:08.367845 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:08.367709 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/022d5778-54a2-47b7-b9c4-ecf7c1307ede-console-config\") pod \"022d5778-54a2-47b7-b9c4-ecf7c1307ede\" (UID: \"022d5778-54a2-47b7-b9c4-ecf7c1307ede\") " May 22 10:38:08.368033 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:08.367792 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/022d5778-54a2-47b7-b9c4-ecf7c1307ede-oauth-serving-cert\") pod \"022d5778-54a2-47b7-b9c4-ecf7c1307ede\" (UID: \"022d5778-54a2-47b7-b9c4-ecf7c1307ede\") " May 22 10:38:08.368097 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:08.368062 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/022d5778-54a2-47b7-b9c4-ecf7c1307ede-service-ca" (OuterVolumeSpecName: "service-ca") pod "022d5778-54a2-47b7-b9c4-ecf7c1307ede" (UID: "022d5778-54a2-47b7-b9c4-ecf7c1307ede"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 22 10:38:08.368163 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:08.368132 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/022d5778-54a2-47b7-b9c4-ecf7c1307ede-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "022d5778-54a2-47b7-b9c4-ecf7c1307ede" (UID: "022d5778-54a2-47b7-b9c4-ecf7c1307ede"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 22 10:38:08.368241 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:08.368163 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/022d5778-54a2-47b7-b9c4-ecf7c1307ede-console-config" (OuterVolumeSpecName: "console-config") pod "022d5778-54a2-47b7-b9c4-ecf7c1307ede" (UID: "022d5778-54a2-47b7-b9c4-ecf7c1307ede"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 22 10:38:08.368241 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:08.368180 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/022d5778-54a2-47b7-b9c4-ecf7c1307ede-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "022d5778-54a2-47b7-b9c4-ecf7c1307ede" (UID: "022d5778-54a2-47b7-b9c4-ecf7c1307ede"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 22 10:38:08.368362 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:08.368309 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/022d5778-54a2-47b7-b9c4-ecf7c1307ede-trusted-ca-bundle\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" May 22 10:38:08.368362 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:08.368327 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/022d5778-54a2-47b7-b9c4-ecf7c1307ede-service-ca\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" May 22 10:38:08.368431 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:08.368367 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/022d5778-54a2-47b7-b9c4-ecf7c1307ede-console-config\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" May 22 10:38:08.368431 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:08.368381 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/022d5778-54a2-47b7-b9c4-ecf7c1307ede-oauth-serving-cert\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" May 22 10:38:08.369997 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:08.369967 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/022d5778-54a2-47b7-b9c4-ecf7c1307ede-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "022d5778-54a2-47b7-b9c4-ecf7c1307ede" (UID: "022d5778-54a2-47b7-b9c4-ecf7c1307ede"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 22 10:38:08.370120 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:08.370002 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/022d5778-54a2-47b7-b9c4-ecf7c1307ede-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "022d5778-54a2-47b7-b9c4-ecf7c1307ede" (UID: "022d5778-54a2-47b7-b9c4-ecf7c1307ede"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 22 10:38:08.370178 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:08.370124 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/022d5778-54a2-47b7-b9c4-ecf7c1307ede-kube-api-access-gjrcm" (OuterVolumeSpecName: "kube-api-access-gjrcm") pod "022d5778-54a2-47b7-b9c4-ecf7c1307ede" (UID: "022d5778-54a2-47b7-b9c4-ecf7c1307ede"). InnerVolumeSpecName "kube-api-access-gjrcm". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 22 10:38:08.469355 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:08.469318 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/022d5778-54a2-47b7-b9c4-ecf7c1307ede-console-serving-cert\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" May 22 10:38:08.469507 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:08.469367 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/022d5778-54a2-47b7-b9c4-ecf7c1307ede-console-oauth-config\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" May 22 10:38:08.469507 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:08.469381 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjrcm\" (UniqueName: \"kubernetes.io/projected/022d5778-54a2-47b7-b9c4-ecf7c1307ede-kube-api-access-gjrcm\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" May 22 10:38:08.939801 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:08.939768 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-644bf7ddbb-wbw86_022d5778-54a2-47b7-b9c4-ecf7c1307ede/console/0.log" May 22 10:38:08.939975 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:08.939807 2558 generic.go:358] "Generic (PLEG): container finished" podID="022d5778-54a2-47b7-b9c4-ecf7c1307ede" containerID="05afdd2c662daeae7446ec88867ee3195eacfa145e25955814768fd7d2fc96fa" exitCode=2 May 22 10:38:08.939975 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:08.939870 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-644bf7ddbb-wbw86" May 22 10:38:08.939975 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:08.939897 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-644bf7ddbb-wbw86" event={"ID":"022d5778-54a2-47b7-b9c4-ecf7c1307ede","Type":"ContainerDied","Data":"05afdd2c662daeae7446ec88867ee3195eacfa145e25955814768fd7d2fc96fa"} May 22 10:38:08.939975 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:08.939934 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-644bf7ddbb-wbw86" event={"ID":"022d5778-54a2-47b7-b9c4-ecf7c1307ede","Type":"ContainerDied","Data":"8b1f6c3745e3bbe293a22ff1cc67e5f3c6c1dba475a0f0b08fce78775a998bb7"} May 22 10:38:08.939975 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:08.939948 2558 scope.go:117] "RemoveContainer" containerID="05afdd2c662daeae7446ec88867ee3195eacfa145e25955814768fd7d2fc96fa" May 22 10:38:08.948741 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:08.948722 2558 scope.go:117] "RemoveContainer" containerID="05afdd2c662daeae7446ec88867ee3195eacfa145e25955814768fd7d2fc96fa" May 22 10:38:08.949001 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:38:08.948981 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05afdd2c662daeae7446ec88867ee3195eacfa145e25955814768fd7d2fc96fa\": container with ID starting with 05afdd2c662daeae7446ec88867ee3195eacfa145e25955814768fd7d2fc96fa not found: ID does not exist" containerID="05afdd2c662daeae7446ec88867ee3195eacfa145e25955814768fd7d2fc96fa" May 22 10:38:08.949047 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:08.949014 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05afdd2c662daeae7446ec88867ee3195eacfa145e25955814768fd7d2fc96fa"} err="failed to get container status \"05afdd2c662daeae7446ec88867ee3195eacfa145e25955814768fd7d2fc96fa\": rpc error: code = NotFound desc = could not find container \"05afdd2c662daeae7446ec88867ee3195eacfa145e25955814768fd7d2fc96fa\": container with ID starting with 05afdd2c662daeae7446ec88867ee3195eacfa145e25955814768fd7d2fc96fa not found: ID does not exist" May 22 10:38:08.958861 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:08.958839 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-644bf7ddbb-wbw86"] May 22 10:38:08.962380 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:08.962356 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-644bf7ddbb-wbw86"] May 22 10:38:09.254704 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:09.254676 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="022d5778-54a2-47b7-b9c4-ecf7c1307ede" path="/var/lib/kubelet/pods/022d5778-54a2-47b7-b9c4-ecf7c1307ede/volumes" May 22 10:38:14.380991 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:14.380952 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-wzr8q"] May 22 10:38:14.381391 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:14.381275 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5282f24c-c581-4813-bb8e-92458708d7f6" containerName="console" May 22 10:38:14.381391 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:14.381286 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5282f24c-c581-4813-bb8e-92458708d7f6" containerName="console" May 22 10:38:14.381391 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:14.381298 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="022d5778-54a2-47b7-b9c4-ecf7c1307ede" containerName="console" May 22 10:38:14.381391 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:14.381304 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="022d5778-54a2-47b7-b9c4-ecf7c1307ede" containerName="console" May 22 10:38:14.381391 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:14.381313 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f0ba409-dcff-463a-900d-bd2ffdeb1122" containerName="console" May 22 10:38:14.381391 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:14.381319 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f0ba409-dcff-463a-900d-bd2ffdeb1122" containerName="console" May 22 10:38:14.381391 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:14.381379 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="022d5778-54a2-47b7-b9c4-ecf7c1307ede" containerName="console" May 22 10:38:14.381391 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:14.381389 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f0ba409-dcff-463a-900d-bd2ffdeb1122" containerName="console" May 22 10:38:14.381391 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:14.381395 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="5282f24c-c581-4813-bb8e-92458708d7f6" containerName="console" May 22 10:38:14.386077 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:14.386058 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzr8q" May 22 10:38:14.387763 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:14.387743 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 22 10:38:14.395142 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:14.395121 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wzr8q"] May 22 10:38:14.422282 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:14.422255 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d13549d7-4931-4d1d-a293-5f5405042297-original-pull-secret\") pod \"global-pull-secret-syncer-wzr8q\" (UID: \"d13549d7-4931-4d1d-a293-5f5405042297\") " pod="kube-system/global-pull-secret-syncer-wzr8q" May 22 10:38:14.422397 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:14.422296 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d13549d7-4931-4d1d-a293-5f5405042297-kubelet-config\") pod \"global-pull-secret-syncer-wzr8q\" (UID: \"d13549d7-4931-4d1d-a293-5f5405042297\") " pod="kube-system/global-pull-secret-syncer-wzr8q" May 22 10:38:14.422397 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:14.422316 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d13549d7-4931-4d1d-a293-5f5405042297-dbus\") pod \"global-pull-secret-syncer-wzr8q\" (UID: \"d13549d7-4931-4d1d-a293-5f5405042297\") " pod="kube-system/global-pull-secret-syncer-wzr8q" May 22 10:38:14.523607 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:14.523571 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d13549d7-4931-4d1d-a293-5f5405042297-original-pull-secret\") pod \"global-pull-secret-syncer-wzr8q\" (UID: \"d13549d7-4931-4d1d-a293-5f5405042297\") " pod="kube-system/global-pull-secret-syncer-wzr8q" May 22 10:38:14.523744 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:14.523613 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d13549d7-4931-4d1d-a293-5f5405042297-kubelet-config\") pod \"global-pull-secret-syncer-wzr8q\" (UID: \"d13549d7-4931-4d1d-a293-5f5405042297\") " pod="kube-system/global-pull-secret-syncer-wzr8q" May 22 10:38:14.523744 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:14.523634 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d13549d7-4931-4d1d-a293-5f5405042297-dbus\") pod \"global-pull-secret-syncer-wzr8q\" (UID: \"d13549d7-4931-4d1d-a293-5f5405042297\") " pod="kube-system/global-pull-secret-syncer-wzr8q" May 22 10:38:14.523744 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:14.523708 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d13549d7-4931-4d1d-a293-5f5405042297-kubelet-config\") pod \"global-pull-secret-syncer-wzr8q\" (UID: \"d13549d7-4931-4d1d-a293-5f5405042297\") " pod="kube-system/global-pull-secret-syncer-wzr8q" May 22 10:38:14.523863 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:14.523778 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d13549d7-4931-4d1d-a293-5f5405042297-dbus\") pod \"global-pull-secret-syncer-wzr8q\" (UID: \"d13549d7-4931-4d1d-a293-5f5405042297\") " pod="kube-system/global-pull-secret-syncer-wzr8q" May 22 10:38:14.526034 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:14.526013 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d13549d7-4931-4d1d-a293-5f5405042297-original-pull-secret\") pod \"global-pull-secret-syncer-wzr8q\" (UID: \"d13549d7-4931-4d1d-a293-5f5405042297\") " pod="kube-system/global-pull-secret-syncer-wzr8q" May 22 10:38:14.695456 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:14.695373 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzr8q" May 22 10:38:14.823449 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:14.823418 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wzr8q"] May 22 10:38:14.826837 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:38:14.826800 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd13549d7_4931_4d1d_a293_5f5405042297.slice/crio-4233f585bfe834531dbbd9ac3083db10d56ac8574dc4f7967d515e757931602e WatchSource:0}: Error finding container 4233f585bfe834531dbbd9ac3083db10d56ac8574dc4f7967d515e757931602e: Status 404 returned error can't find the container with id 4233f585bfe834531dbbd9ac3083db10d56ac8574dc4f7967d515e757931602e May 22 10:38:14.958421 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:14.958392 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wzr8q" event={"ID":"d13549d7-4931-4d1d-a293-5f5405042297","Type":"ContainerStarted","Data":"4233f585bfe834531dbbd9ac3083db10d56ac8574dc4f7967d515e757931602e"} May 22 10:38:18.972094 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:18.972049 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wzr8q" event={"ID":"d13549d7-4931-4d1d-a293-5f5405042297","Type":"ContainerStarted","Data":"2d8380266e76a043d75ada3cf34ad4367cbe164c7c1844a71a38c8933449a2d0"} May 22 10:38:18.986114 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:18.986072 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wzr8q" podStartSLOduration=1.208795819 podStartE2EDuration="4.986058767s" podCreationTimestamp="2026-05-22 10:38:14 +0000 UTC" firstStartedPulling="2026-05-22 10:38:14.828679886 +0000 UTC m=+186.135939611" lastFinishedPulling="2026-05-22 10:38:18.605942836 +0000 UTC m=+189.913202559" observedRunningTime="2026-05-22 10:38:18.984885902 +0000 UTC m=+190.292145651" watchObservedRunningTime="2026-05-22 10:38:18.986058767 +0000 UTC m=+190.293318514" May 22 10:38:56.002362 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:56.002309 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-twnln"] May 22 10:38:56.004544 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:56.004528 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-twnln" May 22 10:38:56.006370 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:56.006317 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 22 10:38:56.006915 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:56.006891 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-qv8dq\"" May 22 10:38:56.006993 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:56.006896 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 22 10:38:56.012207 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:56.012177 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-twnln"] May 22 10:38:56.075252 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:56.075216 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cslg4\" (UniqueName: \"kubernetes.io/projected/5e685363-3e20-4d83-a8bd-17b17ec91dce-kube-api-access-cslg4\") pod \"cert-manager-cainjector-68b757865b-twnln\" (UID: \"5e685363-3e20-4d83-a8bd-17b17ec91dce\") " pod="cert-manager/cert-manager-cainjector-68b757865b-twnln" May 22 10:38:56.075432 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:56.075260 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5e685363-3e20-4d83-a8bd-17b17ec91dce-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-twnln\" (UID: \"5e685363-3e20-4d83-a8bd-17b17ec91dce\") " pod="cert-manager/cert-manager-cainjector-68b757865b-twnln" May 22 10:38:56.176216 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:56.176182 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cslg4\" (UniqueName: \"kubernetes.io/projected/5e685363-3e20-4d83-a8bd-17b17ec91dce-kube-api-access-cslg4\") pod \"cert-manager-cainjector-68b757865b-twnln\" (UID: \"5e685363-3e20-4d83-a8bd-17b17ec91dce\") " pod="cert-manager/cert-manager-cainjector-68b757865b-twnln" May 22 10:38:56.176390 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:56.176235 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5e685363-3e20-4d83-a8bd-17b17ec91dce-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-twnln\" (UID: \"5e685363-3e20-4d83-a8bd-17b17ec91dce\") " pod="cert-manager/cert-manager-cainjector-68b757865b-twnln" May 22 10:38:56.184394 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:56.184362 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cslg4\" (UniqueName: \"kubernetes.io/projected/5e685363-3e20-4d83-a8bd-17b17ec91dce-kube-api-access-cslg4\") pod \"cert-manager-cainjector-68b757865b-twnln\" (UID: \"5e685363-3e20-4d83-a8bd-17b17ec91dce\") " pod="cert-manager/cert-manager-cainjector-68b757865b-twnln" May 22 10:38:56.184517 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:56.184367 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5e685363-3e20-4d83-a8bd-17b17ec91dce-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-twnln\" (UID: \"5e685363-3e20-4d83-a8bd-17b17ec91dce\") " pod="cert-manager/cert-manager-cainjector-68b757865b-twnln" May 22 10:38:56.320053 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:56.319976 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-twnln" May 22 10:38:56.441048 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:56.441017 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-twnln"] May 22 10:38:56.444087 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:38:56.444056 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e685363_3e20_4d83_a8bd_17b17ec91dce.slice/crio-5dd6a9be72e0c428e7ec6fd56693bd1bed5669895bcd3d29dc711ca36dfde98e WatchSource:0}: Error finding container 5dd6a9be72e0c428e7ec6fd56693bd1bed5669895bcd3d29dc711ca36dfde98e: Status 404 returned error can't find the container with id 5dd6a9be72e0c428e7ec6fd56693bd1bed5669895bcd3d29dc711ca36dfde98e May 22 10:38:57.085783 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:38:57.085740 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-twnln" event={"ID":"5e685363-3e20-4d83-a8bd-17b17ec91dce","Type":"ContainerStarted","Data":"5dd6a9be72e0c428e7ec6fd56693bd1bed5669895bcd3d29dc711ca36dfde98e"} May 22 10:39:00.096095 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:00.096058 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-twnln" event={"ID":"5e685363-3e20-4d83-a8bd-17b17ec91dce","Type":"ContainerStarted","Data":"16e9ebc39c1ee79d3884057882a8f12671b7c03a24f48ab3adcad09a1c21cb54"} May 22 10:39:00.108991 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:00.108941 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-twnln" podStartSLOduration=2.343771271 podStartE2EDuration="5.108924777s" podCreationTimestamp="2026-05-22 10:38:55 +0000 UTC" firstStartedPulling="2026-05-22 10:38:56.445959356 +0000 UTC m=+227.753219088" lastFinishedPulling="2026-05-22 10:38:59.211112871 +0000 UTC m=+230.518372594" observedRunningTime="2026-05-22 10:39:00.108769743 +0000 UTC m=+231.416029502" watchObservedRunningTime="2026-05-22 10:39:00.108924777 +0000 UTC m=+231.416184525" May 22 10:39:10.589248 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:10.589189 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-72wzb"] May 22 10:39:10.592305 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:10.592285 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-72wzb" May 22 10:39:10.594371 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:10.594330 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 22 10:39:10.594837 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:10.594817 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 22 10:39:10.594958 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:10.594906 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-mw9pk\"" May 22 10:39:10.599494 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:10.599477 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-72wzb"] May 22 10:39:10.698978 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:10.698944 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95f5a756-e2f8-4096-a082-4f9d104301a2-tmp\") pod \"openshift-lws-operator-bfc7f696d-72wzb\" (UID: \"95f5a756-e2f8-4096-a082-4f9d104301a2\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-72wzb" May 22 10:39:10.698978 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:10.698978 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsp2q\" (UniqueName: \"kubernetes.io/projected/95f5a756-e2f8-4096-a082-4f9d104301a2-kube-api-access-lsp2q\") pod \"openshift-lws-operator-bfc7f696d-72wzb\" (UID: \"95f5a756-e2f8-4096-a082-4f9d104301a2\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-72wzb" May 22 10:39:10.800118 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:10.800088 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95f5a756-e2f8-4096-a082-4f9d104301a2-tmp\") pod \"openshift-lws-operator-bfc7f696d-72wzb\" (UID: \"95f5a756-e2f8-4096-a082-4f9d104301a2\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-72wzb" May 22 10:39:10.800118 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:10.800121 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lsp2q\" (UniqueName: \"kubernetes.io/projected/95f5a756-e2f8-4096-a082-4f9d104301a2-kube-api-access-lsp2q\") pod \"openshift-lws-operator-bfc7f696d-72wzb\" (UID: \"95f5a756-e2f8-4096-a082-4f9d104301a2\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-72wzb" May 22 10:39:10.800471 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:10.800453 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95f5a756-e2f8-4096-a082-4f9d104301a2-tmp\") pod \"openshift-lws-operator-bfc7f696d-72wzb\" (UID: \"95f5a756-e2f8-4096-a082-4f9d104301a2\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-72wzb" May 22 10:39:10.807251 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:10.807229 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsp2q\" (UniqueName: \"kubernetes.io/projected/95f5a756-e2f8-4096-a082-4f9d104301a2-kube-api-access-lsp2q\") pod \"openshift-lws-operator-bfc7f696d-72wzb\" (UID: \"95f5a756-e2f8-4096-a082-4f9d104301a2\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-72wzb" May 22 10:39:10.902436 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:10.902361 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-72wzb" May 22 10:39:11.026360 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:11.026307 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-72wzb"] May 22 10:39:11.028644 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:39:11.028612 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95f5a756_e2f8_4096_a082_4f9d104301a2.slice/crio-bf5f5f02d1c186f2840963f790ad51b4a054f27ece5956b1d58859601cf26add WatchSource:0}: Error finding container bf5f5f02d1c186f2840963f790ad51b4a054f27ece5956b1d58859601cf26add: Status 404 returned error can't find the container with id bf5f5f02d1c186f2840963f790ad51b4a054f27ece5956b1d58859601cf26add May 22 10:39:11.128255 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:11.128208 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-72wzb" event={"ID":"95f5a756-e2f8-4096-a082-4f9d104301a2","Type":"ContainerStarted","Data":"bf5f5f02d1c186f2840963f790ad51b4a054f27ece5956b1d58859601cf26add"} May 22 10:39:14.139713 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:14.139679 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-72wzb" event={"ID":"95f5a756-e2f8-4096-a082-4f9d104301a2","Type":"ContainerStarted","Data":"e900e1e7c141ad658b79751acfa766fc7df070941a5020d378dec347d5a707bd"} May 22 10:39:14.151779 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:14.151723 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-72wzb" podStartSLOduration=1.96400875 podStartE2EDuration="4.151709909s" podCreationTimestamp="2026-05-22 10:39:10 +0000 UTC" firstStartedPulling="2026-05-22 10:39:11.030244226 +0000 UTC m=+242.337503954" lastFinishedPulling="2026-05-22 10:39:13.217945384 +0000 UTC m=+244.525205113" observedRunningTime="2026-05-22 10:39:14.151527211 +0000 UTC m=+245.458786956" watchObservedRunningTime="2026-05-22 10:39:14.151709909 +0000 UTC m=+245.458969654" May 22 10:39:30.009297 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:30.009210 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-649ffb4464-cz6z6"] May 22 10:39:30.013053 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:30.013028 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-649ffb4464-cz6z6" May 22 10:39:30.015707 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:30.015684 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6ckjk\"" May 22 10:39:30.015855 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:30.015772 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 22 10:39:30.015923 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:30.015912 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 22 10:39:30.016236 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:30.016205 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 22 10:39:30.016536 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:30.016518 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 22 10:39:30.038285 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:30.038256 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-649ffb4464-cz6z6"] May 22 10:39:30.074026 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:30.073986 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvdj2\" (UniqueName: \"kubernetes.io/projected/8b4d3031-812b-4e31-b27d-15a3d7b634a7-kube-api-access-kvdj2\") pod \"opendatahub-operator-controller-manager-649ffb4464-cz6z6\" (UID: \"8b4d3031-812b-4e31-b27d-15a3d7b634a7\") " pod="opendatahub/opendatahub-operator-controller-manager-649ffb4464-cz6z6" May 22 10:39:30.074197 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:30.074071 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8b4d3031-812b-4e31-b27d-15a3d7b634a7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-649ffb4464-cz6z6\" (UID: \"8b4d3031-812b-4e31-b27d-15a3d7b634a7\") " pod="opendatahub/opendatahub-operator-controller-manager-649ffb4464-cz6z6" May 22 10:39:30.074197 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:30.074117 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b4d3031-812b-4e31-b27d-15a3d7b634a7-webhook-cert\") pod \"opendatahub-operator-controller-manager-649ffb4464-cz6z6\" (UID: \"8b4d3031-812b-4e31-b27d-15a3d7b634a7\") " pod="opendatahub/opendatahub-operator-controller-manager-649ffb4464-cz6z6" May 22 10:39:30.175140 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:30.175105 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8b4d3031-812b-4e31-b27d-15a3d7b634a7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-649ffb4464-cz6z6\" (UID: \"8b4d3031-812b-4e31-b27d-15a3d7b634a7\") " pod="opendatahub/opendatahub-operator-controller-manager-649ffb4464-cz6z6" May 22 10:39:30.175372 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:30.175153 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b4d3031-812b-4e31-b27d-15a3d7b634a7-webhook-cert\") pod \"opendatahub-operator-controller-manager-649ffb4464-cz6z6\" (UID: \"8b4d3031-812b-4e31-b27d-15a3d7b634a7\") " pod="opendatahub/opendatahub-operator-controller-manager-649ffb4464-cz6z6" May 22 10:39:30.175372 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:30.175198 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kvdj2\" (UniqueName: \"kubernetes.io/projected/8b4d3031-812b-4e31-b27d-15a3d7b634a7-kube-api-access-kvdj2\") pod \"opendatahub-operator-controller-manager-649ffb4464-cz6z6\" (UID: \"8b4d3031-812b-4e31-b27d-15a3d7b634a7\") " pod="opendatahub/opendatahub-operator-controller-manager-649ffb4464-cz6z6" May 22 10:39:30.177796 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:30.177769 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8b4d3031-812b-4e31-b27d-15a3d7b634a7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-649ffb4464-cz6z6\" (UID: \"8b4d3031-812b-4e31-b27d-15a3d7b634a7\") " pod="opendatahub/opendatahub-operator-controller-manager-649ffb4464-cz6z6" May 22 10:39:30.178000 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:30.177980 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b4d3031-812b-4e31-b27d-15a3d7b634a7-webhook-cert\") pod \"opendatahub-operator-controller-manager-649ffb4464-cz6z6\" (UID: \"8b4d3031-812b-4e31-b27d-15a3d7b634a7\") " pod="opendatahub/opendatahub-operator-controller-manager-649ffb4464-cz6z6" May 22 10:39:30.183664 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:30.183637 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvdj2\" (UniqueName: \"kubernetes.io/projected/8b4d3031-812b-4e31-b27d-15a3d7b634a7-kube-api-access-kvdj2\") pod \"opendatahub-operator-controller-manager-649ffb4464-cz6z6\" (UID: \"8b4d3031-812b-4e31-b27d-15a3d7b634a7\") " pod="opendatahub/opendatahub-operator-controller-manager-649ffb4464-cz6z6" May 22 10:39:30.327242 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:30.327165 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-649ffb4464-cz6z6" May 22 10:39:30.461728 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:30.461702 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-649ffb4464-cz6z6"] May 22 10:39:30.464196 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:39:30.464167 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b4d3031_812b_4e31_b27d_15a3d7b634a7.slice/crio-2823a88376dd73431704074133b441971567cba4069cf0dd6375b886b6fdb8e2 WatchSource:0}: Error finding container 2823a88376dd73431704074133b441971567cba4069cf0dd6375b886b6fdb8e2: Status 404 returned error can't find the container with id 2823a88376dd73431704074133b441971567cba4069cf0dd6375b886b6fdb8e2 May 22 10:39:31.193950 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:31.193911 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-649ffb4464-cz6z6" event={"ID":"8b4d3031-812b-4e31-b27d-15a3d7b634a7","Type":"ContainerStarted","Data":"2823a88376dd73431704074133b441971567cba4069cf0dd6375b886b6fdb8e2"} May 22 10:39:34.206772 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:34.206727 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-649ffb4464-cz6z6" event={"ID":"8b4d3031-812b-4e31-b27d-15a3d7b634a7","Type":"ContainerStarted","Data":"4547e1dc9e360433f3b52efbb07b6cd5168095d3b50d37356d784c88ec9a8cf6"} May 22 10:39:34.207149 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:34.206994 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-649ffb4464-cz6z6" May 22 10:39:34.223307 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:34.223260 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-649ffb4464-cz6z6" podStartSLOduration=2.34005027 podStartE2EDuration="5.223245779s" podCreationTimestamp="2026-05-22 10:39:29 +0000 UTC" firstStartedPulling="2026-05-22 10:39:30.466041133 +0000 UTC m=+261.773300860" lastFinishedPulling="2026-05-22 10:39:33.349236642 +0000 UTC m=+264.656496369" observedRunningTime="2026-05-22 10:39:34.220768319 +0000 UTC m=+265.528028064" watchObservedRunningTime="2026-05-22 10:39:34.223245779 +0000 UTC m=+265.530505524" May 22 10:39:44.362230 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:44.362195 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8578576cfb-29v45"] May 22 10:39:44.406163 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:44.406128 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8578576cfb-29v45"] May 22 10:39:44.406373 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:44.406249 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8578576cfb-29v45" May 22 10:39:44.408165 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:44.408120 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 22 10:39:44.408165 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:44.408135 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 22 10:39:44.408372 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:44.408267 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 22 10:39:44.408372 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:44.408275 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-gc9m2\"" May 22 10:39:44.502160 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:44.502133 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d4eaeebb-01ea-4053-bed4-7c5bce108ff2-manager-config\") pod \"lws-controller-manager-8578576cfb-29v45\" (UID: \"d4eaeebb-01ea-4053-bed4-7c5bce108ff2\") " pod="openshift-lws-operator/lws-controller-manager-8578576cfb-29v45" May 22 10:39:44.502357 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:44.502176 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d4eaeebb-01ea-4053-bed4-7c5bce108ff2-metrics-cert\") pod \"lws-controller-manager-8578576cfb-29v45\" (UID: \"d4eaeebb-01ea-4053-bed4-7c5bce108ff2\") " pod="openshift-lws-operator/lws-controller-manager-8578576cfb-29v45" May 22 10:39:44.502357 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:44.502202 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4eaeebb-01ea-4053-bed4-7c5bce108ff2-cert\") pod \"lws-controller-manager-8578576cfb-29v45\" (UID: \"d4eaeebb-01ea-4053-bed4-7c5bce108ff2\") " pod="openshift-lws-operator/lws-controller-manager-8578576cfb-29v45" May 22 10:39:44.502357 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:44.502249 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64mzx\" (UniqueName: \"kubernetes.io/projected/d4eaeebb-01ea-4053-bed4-7c5bce108ff2-kube-api-access-64mzx\") pod \"lws-controller-manager-8578576cfb-29v45\" (UID: \"d4eaeebb-01ea-4053-bed4-7c5bce108ff2\") " pod="openshift-lws-operator/lws-controller-manager-8578576cfb-29v45" May 22 10:39:44.602726 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:44.602693 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d4eaeebb-01ea-4053-bed4-7c5bce108ff2-metrics-cert\") pod \"lws-controller-manager-8578576cfb-29v45\" (UID: \"d4eaeebb-01ea-4053-bed4-7c5bce108ff2\") " pod="openshift-lws-operator/lws-controller-manager-8578576cfb-29v45" May 22 10:39:44.602884 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:44.602741 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4eaeebb-01ea-4053-bed4-7c5bce108ff2-cert\") pod \"lws-controller-manager-8578576cfb-29v45\" (UID: \"d4eaeebb-01ea-4053-bed4-7c5bce108ff2\") " pod="openshift-lws-operator/lws-controller-manager-8578576cfb-29v45" May 22 10:39:44.602884 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:44.602772 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-64mzx\" (UniqueName: \"kubernetes.io/projected/d4eaeebb-01ea-4053-bed4-7c5bce108ff2-kube-api-access-64mzx\") pod \"lws-controller-manager-8578576cfb-29v45\" (UID: \"d4eaeebb-01ea-4053-bed4-7c5bce108ff2\") " pod="openshift-lws-operator/lws-controller-manager-8578576cfb-29v45" May 22 10:39:44.602884 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:44.602874 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d4eaeebb-01ea-4053-bed4-7c5bce108ff2-manager-config\") pod \"lws-controller-manager-8578576cfb-29v45\" (UID: \"d4eaeebb-01ea-4053-bed4-7c5bce108ff2\") " pod="openshift-lws-operator/lws-controller-manager-8578576cfb-29v45" May 22 10:39:44.603534 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:44.603511 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d4eaeebb-01ea-4053-bed4-7c5bce108ff2-manager-config\") pod \"lws-controller-manager-8578576cfb-29v45\" (UID: \"d4eaeebb-01ea-4053-bed4-7c5bce108ff2\") " pod="openshift-lws-operator/lws-controller-manager-8578576cfb-29v45" May 22 10:39:44.605245 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:44.605223 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d4eaeebb-01ea-4053-bed4-7c5bce108ff2-metrics-cert\") pod \"lws-controller-manager-8578576cfb-29v45\" (UID: \"d4eaeebb-01ea-4053-bed4-7c5bce108ff2\") " pod="openshift-lws-operator/lws-controller-manager-8578576cfb-29v45" May 22 10:39:44.605332 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:44.605312 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4eaeebb-01ea-4053-bed4-7c5bce108ff2-cert\") pod \"lws-controller-manager-8578576cfb-29v45\" (UID: \"d4eaeebb-01ea-4053-bed4-7c5bce108ff2\") " pod="openshift-lws-operator/lws-controller-manager-8578576cfb-29v45" May 22 10:39:44.610694 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:44.610667 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64mzx\" (UniqueName: \"kubernetes.io/projected/d4eaeebb-01ea-4053-bed4-7c5bce108ff2-kube-api-access-64mzx\") pod \"lws-controller-manager-8578576cfb-29v45\" (UID: \"d4eaeebb-01ea-4053-bed4-7c5bce108ff2\") " pod="openshift-lws-operator/lws-controller-manager-8578576cfb-29v45" May 22 10:39:44.716372 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:44.716327 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8578576cfb-29v45" May 22 10:39:44.845985 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:44.845838 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8578576cfb-29v45"] May 22 10:39:44.848528 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:39:44.848485 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4eaeebb_01ea_4053_bed4_7c5bce108ff2.slice/crio-07ff96e7efbf64a32298961ef2519bc30ec803ff7c7b032ccb83fe7800481ea4 WatchSource:0}: Error finding container 07ff96e7efbf64a32298961ef2519bc30ec803ff7c7b032ccb83fe7800481ea4: Status 404 returned error can't find the container with id 07ff96e7efbf64a32298961ef2519bc30ec803ff7c7b032ccb83fe7800481ea4 May 22 10:39:45.212670 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:45.212639 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-649ffb4464-cz6z6" May 22 10:39:45.246457 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:45.246426 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8578576cfb-29v45" event={"ID":"d4eaeebb-01ea-4053-bed4-7c5bce108ff2","Type":"ContainerStarted","Data":"07ff96e7efbf64a32298961ef2519bc30ec803ff7c7b032ccb83fe7800481ea4"} May 22 10:39:47.255960 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:47.255919 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8578576cfb-29v45" event={"ID":"d4eaeebb-01ea-4053-bed4-7c5bce108ff2","Type":"ContainerStarted","Data":"ca91f34d82132167bac85a858606c18e83072bf5bc617ad3638122cdb2553fae"} May 22 10:39:47.256442 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:47.256068 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8578576cfb-29v45" May 22 10:39:47.271622 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:47.271571 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8578576cfb-29v45" podStartSLOduration=1.682889182 podStartE2EDuration="3.271555939s" podCreationTimestamp="2026-05-22 10:39:44 +0000 UTC" firstStartedPulling="2026-05-22 10:39:44.850524585 +0000 UTC m=+276.157784312" lastFinishedPulling="2026-05-22 10:39:46.439191341 +0000 UTC m=+277.746451069" observedRunningTime="2026-05-22 10:39:47.269629882 +0000 UTC m=+278.576889639" watchObservedRunningTime="2026-05-22 10:39:47.271555939 +0000 UTC m=+278.578815685" May 22 10:39:47.816283 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:47.816245 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7f4bf49c7f-n5jv2"] May 22 10:39:47.819576 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:47.819560 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f4bf49c7f-n5jv2" May 22 10:39:47.822281 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:47.822255 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-n225g\"" May 22 10:39:47.826590 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:47.826568 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 22 10:39:47.826769 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:47.826751 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 22 10:39:47.826769 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:47.826761 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 22 10:39:47.826906 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:47.826809 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 22 10:39:47.853662 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:47.853619 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f4bf49c7f-n5jv2"] May 22 10:39:47.933735 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:47.933699 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59vvt\" (UniqueName: \"kubernetes.io/projected/4d465498-d6c7-451a-b98e-4303a75be227-kube-api-access-59vvt\") pod \"kube-auth-proxy-7f4bf49c7f-n5jv2\" (UID: \"4d465498-d6c7-451a-b98e-4303a75be227\") " pod="openshift-ingress/kube-auth-proxy-7f4bf49c7f-n5jv2" May 22 10:39:47.933890 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:47.933744 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d465498-d6c7-451a-b98e-4303a75be227-tls-certs\") pod \"kube-auth-proxy-7f4bf49c7f-n5jv2\" (UID: \"4d465498-d6c7-451a-b98e-4303a75be227\") " pod="openshift-ingress/kube-auth-proxy-7f4bf49c7f-n5jv2" May 22 10:39:47.933890 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:47.933879 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d465498-d6c7-451a-b98e-4303a75be227-tmp\") pod \"kube-auth-proxy-7f4bf49c7f-n5jv2\" (UID: \"4d465498-d6c7-451a-b98e-4303a75be227\") " pod="openshift-ingress/kube-auth-proxy-7f4bf49c7f-n5jv2" May 22 10:39:48.035154 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:48.035113 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d465498-d6c7-451a-b98e-4303a75be227-tmp\") pod \"kube-auth-proxy-7f4bf49c7f-n5jv2\" (UID: \"4d465498-d6c7-451a-b98e-4303a75be227\") " pod="openshift-ingress/kube-auth-proxy-7f4bf49c7f-n5jv2" May 22 10:39:48.035308 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:48.035211 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-59vvt\" (UniqueName: \"kubernetes.io/projected/4d465498-d6c7-451a-b98e-4303a75be227-kube-api-access-59vvt\") pod \"kube-auth-proxy-7f4bf49c7f-n5jv2\" (UID: \"4d465498-d6c7-451a-b98e-4303a75be227\") " pod="openshift-ingress/kube-auth-proxy-7f4bf49c7f-n5jv2" May 22 10:39:48.035308 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:48.035251 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d465498-d6c7-451a-b98e-4303a75be227-tls-certs\") pod \"kube-auth-proxy-7f4bf49c7f-n5jv2\" (UID: \"4d465498-d6c7-451a-b98e-4303a75be227\") " pod="openshift-ingress/kube-auth-proxy-7f4bf49c7f-n5jv2" May 22 10:39:48.037524 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:48.037493 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d465498-d6c7-451a-b98e-4303a75be227-tmp\") pod \"kube-auth-proxy-7f4bf49c7f-n5jv2\" (UID: \"4d465498-d6c7-451a-b98e-4303a75be227\") " pod="openshift-ingress/kube-auth-proxy-7f4bf49c7f-n5jv2" May 22 10:39:48.037920 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:48.037900 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d465498-d6c7-451a-b98e-4303a75be227-tls-certs\") pod \"kube-auth-proxy-7f4bf49c7f-n5jv2\" (UID: \"4d465498-d6c7-451a-b98e-4303a75be227\") " pod="openshift-ingress/kube-auth-proxy-7f4bf49c7f-n5jv2" May 22 10:39:48.042367 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:48.042324 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59vvt\" (UniqueName: \"kubernetes.io/projected/4d465498-d6c7-451a-b98e-4303a75be227-kube-api-access-59vvt\") pod \"kube-auth-proxy-7f4bf49c7f-n5jv2\" (UID: \"4d465498-d6c7-451a-b98e-4303a75be227\") " pod="openshift-ingress/kube-auth-proxy-7f4bf49c7f-n5jv2" May 22 10:39:48.129679 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:48.129586 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f4bf49c7f-n5jv2" May 22 10:39:48.261451 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:48.261311 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f4bf49c7f-n5jv2"] May 22 10:39:48.263962 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:39:48.263933 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d465498_d6c7_451a_b98e_4303a75be227.slice/crio-9a3dced9b59ba2697c9e3028a716f15a952980d51ac522e4b9e3b632143cd5e9 WatchSource:0}: Error finding container 9a3dced9b59ba2697c9e3028a716f15a952980d51ac522e4b9e3b632143cd5e9: Status 404 returned error can't find the container with id 9a3dced9b59ba2697c9e3028a716f15a952980d51ac522e4b9e3b632143cd5e9 May 22 10:39:49.264235 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:49.264183 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f4bf49c7f-n5jv2" event={"ID":"4d465498-d6c7-451a-b98e-4303a75be227","Type":"ContainerStarted","Data":"9a3dced9b59ba2697c9e3028a716f15a952980d51ac522e4b9e3b632143cd5e9"} May 22 10:39:52.278634 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:52.278589 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f4bf49c7f-n5jv2" event={"ID":"4d465498-d6c7-451a-b98e-4303a75be227","Type":"ContainerStarted","Data":"6387cbb4ee16e6825ba3b89d21c20985805b2de9716144ef6730c58c82821a21"} May 22 10:39:52.293096 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:52.293043 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7f4bf49c7f-n5jv2" podStartSLOduration=1.883907658 podStartE2EDuration="5.293028144s" podCreationTimestamp="2026-05-22 10:39:47 +0000 UTC" firstStartedPulling="2026-05-22 10:39:48.265736193 +0000 UTC m=+279.572995924" lastFinishedPulling="2026-05-22 10:39:51.674856683 +0000 UTC m=+282.982116410" observedRunningTime="2026-05-22 10:39:52.291560975 +0000 UTC m=+283.598820721" watchObservedRunningTime="2026-05-22 10:39:52.293028144 +0000 UTC m=+283.600287890" May 22 10:39:58.262006 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:39:58.261976 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8578576cfb-29v45" May 22 10:40:09.145948 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:40:09.145920 2558 kubelet.go:1628] "Image garbage collection succeeded" May 22 10:41:31.814931 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:31.814850 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-68bbb6577c-sg68z"] May 22 10:41:31.818418 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:31.818399 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68bbb6577c-sg68z" May 22 10:41:31.821233 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:31.821210 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 22 10:41:31.821357 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:31.821270 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 22 10:41:31.821642 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:31.821620 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-crnvf\"" May 22 10:41:31.821642 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:31.821631 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 22 10:41:31.821766 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:31.821729 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 22 10:41:31.821819 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:31.821798 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 22 10:41:31.822059 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:31.822047 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 22 10:41:31.822583 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:31.822568 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 22 10:41:31.832022 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:31.832005 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 22 10:41:31.843720 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:31.843700 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68bbb6577c-sg68z"] May 22 10:41:31.952429 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:31.952391 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ff246fb-d774-4400-b5f4-1bbdaaafa25e-console-oauth-config\") pod \"console-68bbb6577c-sg68z\" (UID: \"6ff246fb-d774-4400-b5f4-1bbdaaafa25e\") " pod="openshift-console/console-68bbb6577c-sg68z" May 22 10:41:31.952613 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:31.952472 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ff246fb-d774-4400-b5f4-1bbdaaafa25e-console-serving-cert\") pod \"console-68bbb6577c-sg68z\" (UID: \"6ff246fb-d774-4400-b5f4-1bbdaaafa25e\") " pod="openshift-console/console-68bbb6577c-sg68z" May 22 10:41:31.952613 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:31.952506 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9whvv\" (UniqueName: \"kubernetes.io/projected/6ff246fb-d774-4400-b5f4-1bbdaaafa25e-kube-api-access-9whvv\") pod \"console-68bbb6577c-sg68z\" (UID: \"6ff246fb-d774-4400-b5f4-1bbdaaafa25e\") " pod="openshift-console/console-68bbb6577c-sg68z" May 22 10:41:31.952613 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:31.952534 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ff246fb-d774-4400-b5f4-1bbdaaafa25e-console-config\") pod \"console-68bbb6577c-sg68z\" (UID: \"6ff246fb-d774-4400-b5f4-1bbdaaafa25e\") " pod="openshift-console/console-68bbb6577c-sg68z" May 22 10:41:31.952613 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:31.952564 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ff246fb-d774-4400-b5f4-1bbdaaafa25e-oauth-serving-cert\") pod \"console-68bbb6577c-sg68z\" (UID: \"6ff246fb-d774-4400-b5f4-1bbdaaafa25e\") " pod="openshift-console/console-68bbb6577c-sg68z" May 22 10:41:31.952613 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:31.952587 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ff246fb-d774-4400-b5f4-1bbdaaafa25e-trusted-ca-bundle\") pod \"console-68bbb6577c-sg68z\" (UID: \"6ff246fb-d774-4400-b5f4-1bbdaaafa25e\") " pod="openshift-console/console-68bbb6577c-sg68z" May 22 10:41:31.952794 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:31.952652 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ff246fb-d774-4400-b5f4-1bbdaaafa25e-service-ca\") pod \"console-68bbb6577c-sg68z\" (UID: \"6ff246fb-d774-4400-b5f4-1bbdaaafa25e\") " pod="openshift-console/console-68bbb6577c-sg68z" May 22 10:41:32.053231 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:32.053196 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9whvv\" (UniqueName: \"kubernetes.io/projected/6ff246fb-d774-4400-b5f4-1bbdaaafa25e-kube-api-access-9whvv\") pod \"console-68bbb6577c-sg68z\" (UID: \"6ff246fb-d774-4400-b5f4-1bbdaaafa25e\") " pod="openshift-console/console-68bbb6577c-sg68z" May 22 10:41:32.053231 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:32.053243 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ff246fb-d774-4400-b5f4-1bbdaaafa25e-console-config\") pod \"console-68bbb6577c-sg68z\" (UID: \"6ff246fb-d774-4400-b5f4-1bbdaaafa25e\") " pod="openshift-console/console-68bbb6577c-sg68z" May 22 10:41:32.053522 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:32.053263 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ff246fb-d774-4400-b5f4-1bbdaaafa25e-oauth-serving-cert\") pod \"console-68bbb6577c-sg68z\" (UID: \"6ff246fb-d774-4400-b5f4-1bbdaaafa25e\") " pod="openshift-console/console-68bbb6577c-sg68z" May 22 10:41:32.053522 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:32.053280 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ff246fb-d774-4400-b5f4-1bbdaaafa25e-trusted-ca-bundle\") pod \"console-68bbb6577c-sg68z\" (UID: \"6ff246fb-d774-4400-b5f4-1bbdaaafa25e\") " pod="openshift-console/console-68bbb6577c-sg68z" May 22 10:41:32.053522 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:32.053301 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ff246fb-d774-4400-b5f4-1bbdaaafa25e-service-ca\") pod \"console-68bbb6577c-sg68z\" (UID: \"6ff246fb-d774-4400-b5f4-1bbdaaafa25e\") " pod="openshift-console/console-68bbb6577c-sg68z" May 22 10:41:32.053522 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:32.053414 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ff246fb-d774-4400-b5f4-1bbdaaafa25e-console-oauth-config\") pod \"console-68bbb6577c-sg68z\" (UID: \"6ff246fb-d774-4400-b5f4-1bbdaaafa25e\") " pod="openshift-console/console-68bbb6577c-sg68z" May 22 10:41:32.053522 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:32.053494 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ff246fb-d774-4400-b5f4-1bbdaaafa25e-console-serving-cert\") pod \"console-68bbb6577c-sg68z\" (UID: \"6ff246fb-d774-4400-b5f4-1bbdaaafa25e\") " pod="openshift-console/console-68bbb6577c-sg68z" May 22 10:41:32.054129 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:32.054103 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ff246fb-d774-4400-b5f4-1bbdaaafa25e-oauth-serving-cert\") pod \"console-68bbb6577c-sg68z\" (UID: \"6ff246fb-d774-4400-b5f4-1bbdaaafa25e\") " pod="openshift-console/console-68bbb6577c-sg68z" May 22 10:41:32.054428 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:32.054104 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ff246fb-d774-4400-b5f4-1bbdaaafa25e-console-config\") pod \"console-68bbb6577c-sg68z\" (UID: \"6ff246fb-d774-4400-b5f4-1bbdaaafa25e\") " pod="openshift-console/console-68bbb6577c-sg68z" May 22 10:41:32.054428 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:32.054210 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ff246fb-d774-4400-b5f4-1bbdaaafa25e-trusted-ca-bundle\") pod \"console-68bbb6577c-sg68z\" (UID: \"6ff246fb-d774-4400-b5f4-1bbdaaafa25e\") " pod="openshift-console/console-68bbb6577c-sg68z" May 22 10:41:32.054428 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:32.054222 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ff246fb-d774-4400-b5f4-1bbdaaafa25e-service-ca\") pod \"console-68bbb6577c-sg68z\" (UID: \"6ff246fb-d774-4400-b5f4-1bbdaaafa25e\") " pod="openshift-console/console-68bbb6577c-sg68z" May 22 10:41:32.056238 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:32.056180 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ff246fb-d774-4400-b5f4-1bbdaaafa25e-console-oauth-config\") pod \"console-68bbb6577c-sg68z\" (UID: \"6ff246fb-d774-4400-b5f4-1bbdaaafa25e\") " pod="openshift-console/console-68bbb6577c-sg68z" May 22 10:41:32.056238 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:32.056233 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ff246fb-d774-4400-b5f4-1bbdaaafa25e-console-serving-cert\") pod \"console-68bbb6577c-sg68z\" (UID: \"6ff246fb-d774-4400-b5f4-1bbdaaafa25e\") " pod="openshift-console/console-68bbb6577c-sg68z" May 22 10:41:32.060901 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:32.060879 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9whvv\" (UniqueName: \"kubernetes.io/projected/6ff246fb-d774-4400-b5f4-1bbdaaafa25e-kube-api-access-9whvv\") pod \"console-68bbb6577c-sg68z\" (UID: \"6ff246fb-d774-4400-b5f4-1bbdaaafa25e\") " pod="openshift-console/console-68bbb6577c-sg68z" May 22 10:41:32.129032 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:32.128938 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68bbb6577c-sg68z" May 22 10:41:32.261931 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:32.261905 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68bbb6577c-sg68z"] May 22 10:41:32.264883 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:41:32.264839 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ff246fb_d774_4400_b5f4_1bbdaaafa25e.slice/crio-6a611cf71c5eebed72373d2d22230faa3e3d244fabae8bc6cd4b6d1e20a13960 WatchSource:0}: Error finding container 6a611cf71c5eebed72373d2d22230faa3e3d244fabae8bc6cd4b6d1e20a13960: Status 404 returned error can't find the container with id 6a611cf71c5eebed72373d2d22230faa3e3d244fabae8bc6cd4b6d1e20a13960 May 22 10:41:32.266761 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:32.266743 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 22 10:41:32.614693 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:32.614652 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68bbb6577c-sg68z" event={"ID":"6ff246fb-d774-4400-b5f4-1bbdaaafa25e","Type":"ContainerStarted","Data":"98503420ed5bdae16f1dfcc71d1928a9783e60dae6ad08821dbd79c32b36fda9"} May 22 10:41:32.614693 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:32.614690 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68bbb6577c-sg68z" event={"ID":"6ff246fb-d774-4400-b5f4-1bbdaaafa25e","Type":"ContainerStarted","Data":"6a611cf71c5eebed72373d2d22230faa3e3d244fabae8bc6cd4b6d1e20a13960"} May 22 10:41:32.631051 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:32.630997 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-68bbb6577c-sg68z" podStartSLOduration=1.630981293 podStartE2EDuration="1.630981293s" podCreationTimestamp="2026-05-22 10:41:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-22 10:41:32.628757323 +0000 UTC m=+383.936017069" watchObservedRunningTime="2026-05-22 10:41:32.630981293 +0000 UTC m=+383.938241039" May 22 10:41:41.004187 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:41.004146 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-z6wm5"] May 22 10:41:41.007709 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:41.007689 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-z6wm5" May 22 10:41:41.010215 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:41.010199 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 22 10:41:41.010565 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:41.010545 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 22 10:41:41.010565 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:41.010564 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-86tc9\"" May 22 10:41:41.020209 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:41.020177 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-z6wm5"] May 22 10:41:41.132897 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:41.132860 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e8ed3b0c-5767-44d5-8b2c-9000347638b6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-z6wm5\" (UID: \"e8ed3b0c-5767-44d5-8b2c-9000347638b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-z6wm5" May 22 10:41:41.133063 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:41.132962 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5klxz\" (UniqueName: \"kubernetes.io/projected/e8ed3b0c-5767-44d5-8b2c-9000347638b6-kube-api-access-5klxz\") pod \"kuadrant-operator-controller-manager-84b657d985-z6wm5\" (UID: \"e8ed3b0c-5767-44d5-8b2c-9000347638b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-z6wm5" May 22 10:41:41.234046 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:41.234013 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e8ed3b0c-5767-44d5-8b2c-9000347638b6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-z6wm5\" (UID: \"e8ed3b0c-5767-44d5-8b2c-9000347638b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-z6wm5" May 22 10:41:41.234200 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:41.234088 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5klxz\" (UniqueName: \"kubernetes.io/projected/e8ed3b0c-5767-44d5-8b2c-9000347638b6-kube-api-access-5klxz\") pod \"kuadrant-operator-controller-manager-84b657d985-z6wm5\" (UID: \"e8ed3b0c-5767-44d5-8b2c-9000347638b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-z6wm5" May 22 10:41:41.234415 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:41.234393 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e8ed3b0c-5767-44d5-8b2c-9000347638b6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-z6wm5\" (UID: \"e8ed3b0c-5767-44d5-8b2c-9000347638b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-z6wm5" May 22 10:41:41.243028 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:41.243003 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5klxz\" (UniqueName: \"kubernetes.io/projected/e8ed3b0c-5767-44d5-8b2c-9000347638b6-kube-api-access-5klxz\") pod \"kuadrant-operator-controller-manager-84b657d985-z6wm5\" (UID: \"e8ed3b0c-5767-44d5-8b2c-9000347638b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-z6wm5" May 22 10:41:41.318810 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:41.318742 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-z6wm5" May 22 10:41:41.457256 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:41.457225 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-z6wm5"] May 22 10:41:41.460924 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:41:41.460155 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8ed3b0c_5767_44d5_8b2c_9000347638b6.slice/crio-74e01a4b556b6ec5b9ad1a06b72d2de70d9986b202e02d6ef1a709668e7bbc17 WatchSource:0}: Error finding container 74e01a4b556b6ec5b9ad1a06b72d2de70d9986b202e02d6ef1a709668e7bbc17: Status 404 returned error can't find the container with id 74e01a4b556b6ec5b9ad1a06b72d2de70d9986b202e02d6ef1a709668e7bbc17 May 22 10:41:41.463485 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:41.463118 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-z6wm5"] May 22 10:41:41.468852 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:41.468825 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-z6wm5"] May 22 10:41:41.492143 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:41.492118 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8kr28"] May 22 10:41:41.496683 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:41.496659 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8kr28" May 22 10:41:41.508492 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:41.508464 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8kr28"] May 22 10:41:41.637931 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:41.637847 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-8kr28\" (UID: \"e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8kr28" May 22 10:41:41.638072 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:41.637936 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7fnm\" (UniqueName: \"kubernetes.io/projected/e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282-kube-api-access-j7fnm\") pod \"kuadrant-operator-controller-manager-84b657d985-8kr28\" (UID: \"e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8kr28" May 22 10:41:41.739002 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:41.738966 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j7fnm\" (UniqueName: \"kubernetes.io/projected/e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282-kube-api-access-j7fnm\") pod \"kuadrant-operator-controller-manager-84b657d985-8kr28\" (UID: \"e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8kr28" May 22 10:41:41.739215 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:41.739035 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-8kr28\" (UID: \"e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8kr28" May 22 10:41:41.739442 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:41.739423 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-8kr28\" (UID: \"e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8kr28" May 22 10:41:41.746703 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:41.746680 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7fnm\" (UniqueName: \"kubernetes.io/projected/e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282-kube-api-access-j7fnm\") pod \"kuadrant-operator-controller-manager-84b657d985-8kr28\" (UID: \"e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8kr28" May 22 10:41:41.809475 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:41.809442 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8kr28" May 22 10:41:41.954290 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:41.954265 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8kr28"] May 22 10:41:41.989602 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:41:41.989561 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4528b4f_a15b_46a4_b7ab_7e1c5f9eb282.slice/crio-f9c16c0b56632e0e7237f52d4608c7970bcf0c4c830f9c8f074f058aaaab7205 WatchSource:0}: Error finding container f9c16c0b56632e0e7237f52d4608c7970bcf0c4c830f9c8f074f058aaaab7205: Status 404 returned error can't find the container with id f9c16c0b56632e0e7237f52d4608c7970bcf0c4c830f9c8f074f058aaaab7205 May 22 10:41:42.129743 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:42.129707 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68bbb6577c-sg68z" May 22 10:41:42.129743 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:42.129753 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68bbb6577c-sg68z" May 22 10:41:42.134654 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:42.134626 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68bbb6577c-sg68z" May 22 10:41:42.650610 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:42.650574 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8kr28" event={"ID":"e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282","Type":"ContainerStarted","Data":"f9c16c0b56632e0e7237f52d4608c7970bcf0c4c830f9c8f074f058aaaab7205"} May 22 10:41:42.654825 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:42.654785 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68bbb6577c-sg68z" May 22 10:41:46.667164 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:46.667105 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-z6wm5" podUID="e8ed3b0c-5767-44d5-8b2c-9000347638b6" containerName="manager" containerID="cri-o://6c64e76a23e911899031b43f7cc3f7d692bfbd49a1ea2f8e3cfa080dd2fbf945" gracePeriod=2 May 22 10:41:46.668601 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:46.668575 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8kr28" event={"ID":"e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282","Type":"ContainerStarted","Data":"ab1fcb9bde6a14a6f0aceaab0c1293390de7b7bddfb54c04cf047472a5e45074"} May 22 10:41:46.668707 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:46.668625 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8kr28" May 22 10:41:46.685612 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:46.685574 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8kr28" podStartSLOduration=2.0386314 podStartE2EDuration="5.685558823s" podCreationTimestamp="2026-05-22 10:41:41 +0000 UTC" firstStartedPulling="2026-05-22 10:41:41.991866433 +0000 UTC m=+393.299126158" lastFinishedPulling="2026-05-22 10:41:45.638793848 +0000 UTC m=+396.946053581" observedRunningTime="2026-05-22 10:41:46.685025531 +0000 UTC m=+397.992285276" watchObservedRunningTime="2026-05-22 10:41:46.685558823 +0000 UTC m=+397.992818571" May 22 10:41:46.903006 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:46.902982 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-z6wm5" May 22 10:41:46.904514 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:46.904490 2558 status_manager.go:895] "Failed to get status for pod" podUID="e8ed3b0c-5767-44d5-8b2c-9000347638b6" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-z6wm5" err="pods \"kuadrant-operator-controller-manager-84b657d985-z6wm5\" is forbidden: User \"system:node:ip-10-0-138-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-186.ec2.internal' and this object" May 22 10:41:47.090381 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:47.090323 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e8ed3b0c-5767-44d5-8b2c-9000347638b6-extensions-socket-volume\") pod \"e8ed3b0c-5767-44d5-8b2c-9000347638b6\" (UID: \"e8ed3b0c-5767-44d5-8b2c-9000347638b6\") " May 22 10:41:47.090554 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:47.090399 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5klxz\" (UniqueName: \"kubernetes.io/projected/e8ed3b0c-5767-44d5-8b2c-9000347638b6-kube-api-access-5klxz\") pod \"e8ed3b0c-5767-44d5-8b2c-9000347638b6\" (UID: \"e8ed3b0c-5767-44d5-8b2c-9000347638b6\") " May 22 10:41:47.090604 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:47.090583 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8ed3b0c-5767-44d5-8b2c-9000347638b6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e8ed3b0c-5767-44d5-8b2c-9000347638b6" (UID: "e8ed3b0c-5767-44d5-8b2c-9000347638b6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 22 10:41:47.092795 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:47.092768 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8ed3b0c-5767-44d5-8b2c-9000347638b6-kube-api-access-5klxz" (OuterVolumeSpecName: "kube-api-access-5klxz") pod "e8ed3b0c-5767-44d5-8b2c-9000347638b6" (UID: "e8ed3b0c-5767-44d5-8b2c-9000347638b6"). InnerVolumeSpecName "kube-api-access-5klxz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 22 10:41:47.191405 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:47.191371 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e8ed3b0c-5767-44d5-8b2c-9000347638b6-extensions-socket-volume\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" May 22 10:41:47.191405 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:47.191400 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5klxz\" (UniqueName: \"kubernetes.io/projected/e8ed3b0c-5767-44d5-8b2c-9000347638b6-kube-api-access-5klxz\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" May 22 10:41:47.254098 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:47.254059 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8ed3b0c-5767-44d5-8b2c-9000347638b6" path="/var/lib/kubelet/pods/e8ed3b0c-5767-44d5-8b2c-9000347638b6/volumes" May 22 10:41:47.672784 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:47.672733 2558 generic.go:358] "Generic (PLEG): container finished" podID="e8ed3b0c-5767-44d5-8b2c-9000347638b6" containerID="6c64e76a23e911899031b43f7cc3f7d692bfbd49a1ea2f8e3cfa080dd2fbf945" exitCode=2 May 22 10:41:47.672784 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:47.672786 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-z6wm5" May 22 10:41:47.673274 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:47.672807 2558 scope.go:117] "RemoveContainer" containerID="6c64e76a23e911899031b43f7cc3f7d692bfbd49a1ea2f8e3cfa080dd2fbf945" May 22 10:41:47.676977 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:47.676943 2558 status_manager.go:895] "Failed to get status for pod" podUID="e8ed3b0c-5767-44d5-8b2c-9000347638b6" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-z6wm5" err="pods \"kuadrant-operator-controller-manager-84b657d985-z6wm5\" is forbidden: User \"system:node:ip-10-0-138-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-186.ec2.internal' and this object" May 22 10:41:47.681213 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:47.681190 2558 scope.go:117] "RemoveContainer" containerID="6c64e76a23e911899031b43f7cc3f7d692bfbd49a1ea2f8e3cfa080dd2fbf945" May 22 10:41:47.681497 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:41:47.681477 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c64e76a23e911899031b43f7cc3f7d692bfbd49a1ea2f8e3cfa080dd2fbf945\": container with ID starting with 6c64e76a23e911899031b43f7cc3f7d692bfbd49a1ea2f8e3cfa080dd2fbf945 not found: ID does not exist" containerID="6c64e76a23e911899031b43f7cc3f7d692bfbd49a1ea2f8e3cfa080dd2fbf945" May 22 10:41:47.681556 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:47.681506 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c64e76a23e911899031b43f7cc3f7d692bfbd49a1ea2f8e3cfa080dd2fbf945"} err="failed to get container status \"6c64e76a23e911899031b43f7cc3f7d692bfbd49a1ea2f8e3cfa080dd2fbf945\": rpc error: code = NotFound desc = could not find container \"6c64e76a23e911899031b43f7cc3f7d692bfbd49a1ea2f8e3cfa080dd2fbf945\": container with ID starting with 6c64e76a23e911899031b43f7cc3f7d692bfbd49a1ea2f8e3cfa080dd2fbf945 not found: ID does not exist" May 22 10:41:49.253812 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:49.253774 2558 status_manager.go:895] "Failed to get status for pod" podUID="e8ed3b0c-5767-44d5-8b2c-9000347638b6" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-z6wm5" err="pods \"kuadrant-operator-controller-manager-84b657d985-z6wm5\" is forbidden: User \"system:node:ip-10-0-138-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-186.ec2.internal' and this object" May 22 10:41:57.674954 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:41:57.674923 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8kr28" May 22 10:42:09.868089 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:09.868045 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8kr28"] May 22 10:42:09.868515 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:09.868299 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8kr28" podUID="e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282" containerName="manager" containerID="cri-o://ab1fcb9bde6a14a6f0aceaab0c1293390de7b7bddfb54c04cf047472a5e45074" gracePeriod=10 May 22 10:42:10.115980 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:10.115957 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8kr28" May 22 10:42:10.198074 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:10.197991 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282-extensions-socket-volume\") pod \"e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282\" (UID: \"e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282\") " May 22 10:42:10.198074 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:10.198068 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7fnm\" (UniqueName: \"kubernetes.io/projected/e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282-kube-api-access-j7fnm\") pod \"e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282\" (UID: \"e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282\") " May 22 10:42:10.198518 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:10.198486 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282" (UID: "e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 22 10:42:10.200369 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:10.200328 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282-kube-api-access-j7fnm" (OuterVolumeSpecName: "kube-api-access-j7fnm") pod "e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282" (UID: "e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282"). InnerVolumeSpecName "kube-api-access-j7fnm". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 22 10:42:10.298946 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:10.298908 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7fnm\" (UniqueName: \"kubernetes.io/projected/e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282-kube-api-access-j7fnm\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" May 22 10:42:10.298946 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:10.298939 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282-extensions-socket-volume\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" May 22 10:42:10.749505 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:10.749468 2558 generic.go:358] "Generic (PLEG): container finished" podID="e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282" containerID="ab1fcb9bde6a14a6f0aceaab0c1293390de7b7bddfb54c04cf047472a5e45074" exitCode=0 May 22 10:42:10.749663 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:10.749533 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8kr28" May 22 10:42:10.749663 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:10.749557 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8kr28" event={"ID":"e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282","Type":"ContainerDied","Data":"ab1fcb9bde6a14a6f0aceaab0c1293390de7b7bddfb54c04cf047472a5e45074"} May 22 10:42:10.749663 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:10.749593 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8kr28" event={"ID":"e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282","Type":"ContainerDied","Data":"f9c16c0b56632e0e7237f52d4608c7970bcf0c4c830f9c8f074f058aaaab7205"} May 22 10:42:10.749663 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:10.749608 2558 scope.go:117] "RemoveContainer" containerID="ab1fcb9bde6a14a6f0aceaab0c1293390de7b7bddfb54c04cf047472a5e45074" May 22 10:42:10.760626 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:10.760603 2558 scope.go:117] "RemoveContainer" containerID="ab1fcb9bde6a14a6f0aceaab0c1293390de7b7bddfb54c04cf047472a5e45074" May 22 10:42:10.761209 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:42:10.761191 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab1fcb9bde6a14a6f0aceaab0c1293390de7b7bddfb54c04cf047472a5e45074\": container with ID starting with ab1fcb9bde6a14a6f0aceaab0c1293390de7b7bddfb54c04cf047472a5e45074 not found: ID does not exist" containerID="ab1fcb9bde6a14a6f0aceaab0c1293390de7b7bddfb54c04cf047472a5e45074" May 22 10:42:10.761251 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:10.761219 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab1fcb9bde6a14a6f0aceaab0c1293390de7b7bddfb54c04cf047472a5e45074"} err="failed to get container status \"ab1fcb9bde6a14a6f0aceaab0c1293390de7b7bddfb54c04cf047472a5e45074\": rpc error: code = NotFound desc = could not find container \"ab1fcb9bde6a14a6f0aceaab0c1293390de7b7bddfb54c04cf047472a5e45074\": container with ID starting with ab1fcb9bde6a14a6f0aceaab0c1293390de7b7bddfb54c04cf047472a5e45074 not found: ID does not exist" May 22 10:42:10.770177 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:10.770155 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8kr28"] May 22 10:42:10.776926 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:10.776898 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8kr28"] May 22 10:42:11.254789 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:11.254756 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282" path="/var/lib/kubelet/pods/e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282/volumes" May 22 10:42:26.644326 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:26.644248 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-jlj7r"] May 22 10:42:26.644752 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:26.644662 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8ed3b0c-5767-44d5-8b2c-9000347638b6" containerName="manager" May 22 10:42:26.644752 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:26.644677 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8ed3b0c-5767-44d5-8b2c-9000347638b6" containerName="manager" May 22 10:42:26.644752 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:26.644686 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282" containerName="manager" May 22 10:42:26.644752 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:26.644691 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282" containerName="manager" May 22 10:42:26.644872 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:26.644760 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="e8ed3b0c-5767-44d5-8b2c-9000347638b6" containerName="manager" May 22 10:42:26.644872 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:26.644768 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4528b4f-a15b-46a4-b7ab-7e1c5f9eb282" containerName="manager" May 22 10:42:26.647586 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:26.647569 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-jlj7r" May 22 10:42:26.649400 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:26.649369 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 22 10:42:26.649550 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:26.649531 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 22 10:42:26.649913 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:26.649897 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-b2sr5\"" May 22 10:42:26.649993 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:26.649962 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 22 10:42:26.656294 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:26.656270 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-jlj7r"] May 22 10:42:26.748455 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:26.748418 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-jlj7r"] May 22 10:42:26.749088 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:26.749058 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t6ql\" (UniqueName: \"kubernetes.io/projected/3b5257c4-ac56-46ae-84a8-962fbf4dc1c1-kube-api-access-7t6ql\") pod \"limitador-limitador-7d549b5b-jlj7r\" (UID: \"3b5257c4-ac56-46ae-84a8-962fbf4dc1c1\") " pod="kuadrant-system/limitador-limitador-7d549b5b-jlj7r" May 22 10:42:26.749186 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:26.749160 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3b5257c4-ac56-46ae-84a8-962fbf4dc1c1-config-file\") pod \"limitador-limitador-7d549b5b-jlj7r\" (UID: \"3b5257c4-ac56-46ae-84a8-962fbf4dc1c1\") " pod="kuadrant-system/limitador-limitador-7d549b5b-jlj7r" May 22 10:42:26.850225 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:26.850186 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3b5257c4-ac56-46ae-84a8-962fbf4dc1c1-config-file\") pod \"limitador-limitador-7d549b5b-jlj7r\" (UID: \"3b5257c4-ac56-46ae-84a8-962fbf4dc1c1\") " pod="kuadrant-system/limitador-limitador-7d549b5b-jlj7r" May 22 10:42:26.850419 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:26.850299 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7t6ql\" (UniqueName: \"kubernetes.io/projected/3b5257c4-ac56-46ae-84a8-962fbf4dc1c1-kube-api-access-7t6ql\") pod \"limitador-limitador-7d549b5b-jlj7r\" (UID: \"3b5257c4-ac56-46ae-84a8-962fbf4dc1c1\") " pod="kuadrant-system/limitador-limitador-7d549b5b-jlj7r" May 22 10:42:26.850862 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:26.850843 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3b5257c4-ac56-46ae-84a8-962fbf4dc1c1-config-file\") pod \"limitador-limitador-7d549b5b-jlj7r\" (UID: \"3b5257c4-ac56-46ae-84a8-962fbf4dc1c1\") " pod="kuadrant-system/limitador-limitador-7d549b5b-jlj7r" May 22 10:42:26.858245 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:26.858222 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t6ql\" (UniqueName: \"kubernetes.io/projected/3b5257c4-ac56-46ae-84a8-962fbf4dc1c1-kube-api-access-7t6ql\") pod \"limitador-limitador-7d549b5b-jlj7r\" (UID: \"3b5257c4-ac56-46ae-84a8-962fbf4dc1c1\") " pod="kuadrant-system/limitador-limitador-7d549b5b-jlj7r" May 22 10:42:26.958635 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:26.958608 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-jlj7r" May 22 10:42:27.088964 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:27.088938 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-jlj7r"] May 22 10:42:27.091709 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:42:27.091683 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b5257c4_ac56_46ae_84a8_962fbf4dc1c1.slice/crio-ccaae586bf7a88a5c211a98d522aa5ff3d268762b0651daa6168ac620cfe399d WatchSource:0}: Error finding container ccaae586bf7a88a5c211a98d522aa5ff3d268762b0651daa6168ac620cfe399d: Status 404 returned error can't find the container with id ccaae586bf7a88a5c211a98d522aa5ff3d268762b0651daa6168ac620cfe399d May 22 10:42:27.669136 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:27.669099 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-bjrnw"] May 22 10:42:27.673675 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:27.673654 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-bjrnw" May 22 10:42:27.675544 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:27.675522 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6f82p\"" May 22 10:42:27.676072 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:27.676043 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-bjrnw"] May 22 10:42:27.815660 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:27.815608 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-jlj7r" event={"ID":"3b5257c4-ac56-46ae-84a8-962fbf4dc1c1","Type":"ContainerStarted","Data":"ccaae586bf7a88a5c211a98d522aa5ff3d268762b0651daa6168ac620cfe399d"} May 22 10:42:27.859371 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:27.859273 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdm8g\" (UniqueName: \"kubernetes.io/projected/fc961589-542a-40a0-b5d2-b8e9c81ee5d5-kube-api-access-sdm8g\") pod \"authorino-7498df8756-bjrnw\" (UID: \"fc961589-542a-40a0-b5d2-b8e9c81ee5d5\") " pod="kuadrant-system/authorino-7498df8756-bjrnw" May 22 10:42:27.960534 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:27.960049 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sdm8g\" (UniqueName: \"kubernetes.io/projected/fc961589-542a-40a0-b5d2-b8e9c81ee5d5-kube-api-access-sdm8g\") pod \"authorino-7498df8756-bjrnw\" (UID: \"fc961589-542a-40a0-b5d2-b8e9c81ee5d5\") " pod="kuadrant-system/authorino-7498df8756-bjrnw" May 22 10:42:27.968139 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:27.968102 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdm8g\" (UniqueName: \"kubernetes.io/projected/fc961589-542a-40a0-b5d2-b8e9c81ee5d5-kube-api-access-sdm8g\") pod \"authorino-7498df8756-bjrnw\" (UID: \"fc961589-542a-40a0-b5d2-b8e9c81ee5d5\") " pod="kuadrant-system/authorino-7498df8756-bjrnw" May 22 10:42:27.984978 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:27.984947 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-bjrnw" May 22 10:42:28.155443 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:28.154655 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-bjrnw"] May 22 10:42:28.160813 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:42:28.160772 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc961589_542a_40a0_b5d2_b8e9c81ee5d5.slice/crio-76490cd7e7f0f4792a9abfc90c4da5772b987bc48b9be0b7d9f1b818559b15b0 WatchSource:0}: Error finding container 76490cd7e7f0f4792a9abfc90c4da5772b987bc48b9be0b7d9f1b818559b15b0: Status 404 returned error can't find the container with id 76490cd7e7f0f4792a9abfc90c4da5772b987bc48b9be0b7d9f1b818559b15b0 May 22 10:42:28.820516 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:28.820481 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-bjrnw" event={"ID":"fc961589-542a-40a0-b5d2-b8e9c81ee5d5","Type":"ContainerStarted","Data":"76490cd7e7f0f4792a9abfc90c4da5772b987bc48b9be0b7d9f1b818559b15b0"} May 22 10:42:30.834014 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:30.833979 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-jlj7r" event={"ID":"3b5257c4-ac56-46ae-84a8-962fbf4dc1c1","Type":"ContainerStarted","Data":"19ba65f0dbeca4e45737ce84a994a70a88419ff044ba0259d673ff314f20d6d4"} May 22 10:42:30.834480 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:30.834111 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-jlj7r" May 22 10:42:30.849661 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:30.849590 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-jlj7r" podStartSLOduration=1.93484944 podStartE2EDuration="4.849572808s" podCreationTimestamp="2026-05-22 10:42:26 +0000 UTC" firstStartedPulling="2026-05-22 10:42:27.093530356 +0000 UTC m=+438.400790081" lastFinishedPulling="2026-05-22 10:42:30.008253721 +0000 UTC m=+441.315513449" observedRunningTime="2026-05-22 10:42:30.846920559 +0000 UTC m=+442.154180308" watchObservedRunningTime="2026-05-22 10:42:30.849572808 +0000 UTC m=+442.156832594" May 22 10:42:32.844042 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:32.844002 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-bjrnw" event={"ID":"fc961589-542a-40a0-b5d2-b8e9c81ee5d5","Type":"ContainerStarted","Data":"1608680f0ba07a0f4c9f9f90987a46fb6077082dfffaa38d7f108412334d5307"} May 22 10:42:32.857543 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:32.857493 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-bjrnw" podStartSLOduration=2.167682215 podStartE2EDuration="5.857478578s" podCreationTimestamp="2026-05-22 10:42:27 +0000 UTC" firstStartedPulling="2026-05-22 10:42:28.162925081 +0000 UTC m=+439.470184820" lastFinishedPulling="2026-05-22 10:42:31.852721459 +0000 UTC m=+443.159981183" observedRunningTime="2026-05-22 10:42:32.855749495 +0000 UTC m=+444.163009264" watchObservedRunningTime="2026-05-22 10:42:32.857478578 +0000 UTC m=+444.164738324" May 22 10:42:41.111502 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:41.111470 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-jlj7r"] May 22 10:42:41.112001 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:41.111745 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-jlj7r" podUID="3b5257c4-ac56-46ae-84a8-962fbf4dc1c1" containerName="limitador" containerID="cri-o://19ba65f0dbeca4e45737ce84a994a70a88419ff044ba0259d673ff314f20d6d4" gracePeriod=30 May 22 10:42:41.112475 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:41.112453 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-jlj7r" May 22 10:42:41.660860 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:41.660837 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-jlj7r" May 22 10:42:41.680289 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:41.680224 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3b5257c4-ac56-46ae-84a8-962fbf4dc1c1-config-file\") pod \"3b5257c4-ac56-46ae-84a8-962fbf4dc1c1\" (UID: \"3b5257c4-ac56-46ae-84a8-962fbf4dc1c1\") " May 22 10:42:41.680444 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:41.680360 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7t6ql\" (UniqueName: \"kubernetes.io/projected/3b5257c4-ac56-46ae-84a8-962fbf4dc1c1-kube-api-access-7t6ql\") pod \"3b5257c4-ac56-46ae-84a8-962fbf4dc1c1\" (UID: \"3b5257c4-ac56-46ae-84a8-962fbf4dc1c1\") " May 22 10:42:41.680643 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:41.680609 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b5257c4-ac56-46ae-84a8-962fbf4dc1c1-config-file" (OuterVolumeSpecName: "config-file") pod "3b5257c4-ac56-46ae-84a8-962fbf4dc1c1" (UID: "3b5257c4-ac56-46ae-84a8-962fbf4dc1c1"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 22 10:42:41.682523 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:41.682494 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b5257c4-ac56-46ae-84a8-962fbf4dc1c1-kube-api-access-7t6ql" (OuterVolumeSpecName: "kube-api-access-7t6ql") pod "3b5257c4-ac56-46ae-84a8-962fbf4dc1c1" (UID: "3b5257c4-ac56-46ae-84a8-962fbf4dc1c1"). InnerVolumeSpecName "kube-api-access-7t6ql". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 22 10:42:41.781198 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:41.781156 2558 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3b5257c4-ac56-46ae-84a8-962fbf4dc1c1-config-file\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" May 22 10:42:41.781198 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:41.781190 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7t6ql\" (UniqueName: \"kubernetes.io/projected/3b5257c4-ac56-46ae-84a8-962fbf4dc1c1-kube-api-access-7t6ql\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" May 22 10:42:41.875383 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:41.875327 2558 generic.go:358] "Generic (PLEG): container finished" podID="3b5257c4-ac56-46ae-84a8-962fbf4dc1c1" containerID="19ba65f0dbeca4e45737ce84a994a70a88419ff044ba0259d673ff314f20d6d4" exitCode=0 May 22 10:42:41.875568 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:41.875382 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-jlj7r" event={"ID":"3b5257c4-ac56-46ae-84a8-962fbf4dc1c1","Type":"ContainerDied","Data":"19ba65f0dbeca4e45737ce84a994a70a88419ff044ba0259d673ff314f20d6d4"} May 22 10:42:41.875568 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:41.875415 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-jlj7r" May 22 10:42:41.875568 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:41.875431 2558 scope.go:117] "RemoveContainer" containerID="19ba65f0dbeca4e45737ce84a994a70a88419ff044ba0259d673ff314f20d6d4" May 22 10:42:41.875568 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:41.875421 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-jlj7r" event={"ID":"3b5257c4-ac56-46ae-84a8-962fbf4dc1c1","Type":"ContainerDied","Data":"ccaae586bf7a88a5c211a98d522aa5ff3d268762b0651daa6168ac620cfe399d"} May 22 10:42:41.885425 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:41.885408 2558 scope.go:117] "RemoveContainer" containerID="19ba65f0dbeca4e45737ce84a994a70a88419ff044ba0259d673ff314f20d6d4" May 22 10:42:41.885693 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:42:41.885670 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19ba65f0dbeca4e45737ce84a994a70a88419ff044ba0259d673ff314f20d6d4\": container with ID starting with 19ba65f0dbeca4e45737ce84a994a70a88419ff044ba0259d673ff314f20d6d4 not found: ID does not exist" containerID="19ba65f0dbeca4e45737ce84a994a70a88419ff044ba0259d673ff314f20d6d4" May 22 10:42:41.885755 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:41.885700 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19ba65f0dbeca4e45737ce84a994a70a88419ff044ba0259d673ff314f20d6d4"} err="failed to get container status \"19ba65f0dbeca4e45737ce84a994a70a88419ff044ba0259d673ff314f20d6d4\": rpc error: code = NotFound desc = could not find container \"19ba65f0dbeca4e45737ce84a994a70a88419ff044ba0259d673ff314f20d6d4\": container with ID starting with 19ba65f0dbeca4e45737ce84a994a70a88419ff044ba0259d673ff314f20d6d4 not found: ID does not exist" May 22 10:42:41.897137 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:41.897104 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-jlj7r"] May 22 10:42:41.898604 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:41.898583 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-jlj7r"] May 22 10:42:43.254796 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:43.254762 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b5257c4-ac56-46ae-84a8-962fbf4dc1c1" path="/var/lib/kubelet/pods/3b5257c4-ac56-46ae-84a8-962fbf4dc1c1/volumes" May 22 10:42:44.439451 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:44.436683 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-5xf6k"] May 22 10:42:44.439451 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:44.437529 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b5257c4-ac56-46ae-84a8-962fbf4dc1c1" containerName="limitador" May 22 10:42:44.439451 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:44.437549 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b5257c4-ac56-46ae-84a8-962fbf4dc1c1" containerName="limitador" May 22 10:42:44.439451 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:44.437716 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="3b5257c4-ac56-46ae-84a8-962fbf4dc1c1" containerName="limitador" May 22 10:42:44.442287 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:44.442233 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-5xf6k" May 22 10:42:44.444364 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:44.444310 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-5xf6k"] May 22 10:42:44.444521 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:44.444399 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" May 22 10:42:44.444521 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:44.444482 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-z8bqf\"" May 22 10:42:44.505403 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:44.505366 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9a5de466-2462-4eab-8201-458be46a4299-data\") pod \"postgres-68c4fbbd6f-5xf6k\" (UID: \"9a5de466-2462-4eab-8201-458be46a4299\") " pod="opendatahub/postgres-68c4fbbd6f-5xf6k" May 22 10:42:44.505568 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:44.505434 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztjh9\" (UniqueName: \"kubernetes.io/projected/9a5de466-2462-4eab-8201-458be46a4299-kube-api-access-ztjh9\") pod \"postgres-68c4fbbd6f-5xf6k\" (UID: \"9a5de466-2462-4eab-8201-458be46a4299\") " pod="opendatahub/postgres-68c4fbbd6f-5xf6k" May 22 10:42:44.606102 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:44.606065 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ztjh9\" (UniqueName: \"kubernetes.io/projected/9a5de466-2462-4eab-8201-458be46a4299-kube-api-access-ztjh9\") pod \"postgres-68c4fbbd6f-5xf6k\" (UID: \"9a5de466-2462-4eab-8201-458be46a4299\") " pod="opendatahub/postgres-68c4fbbd6f-5xf6k" May 22 10:42:44.606246 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:44.606170 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9a5de466-2462-4eab-8201-458be46a4299-data\") pod \"postgres-68c4fbbd6f-5xf6k\" (UID: \"9a5de466-2462-4eab-8201-458be46a4299\") " pod="opendatahub/postgres-68c4fbbd6f-5xf6k" May 22 10:42:44.606524 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:44.606507 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9a5de466-2462-4eab-8201-458be46a4299-data\") pod \"postgres-68c4fbbd6f-5xf6k\" (UID: \"9a5de466-2462-4eab-8201-458be46a4299\") " pod="opendatahub/postgres-68c4fbbd6f-5xf6k" May 22 10:42:44.616424 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:44.616397 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztjh9\" (UniqueName: \"kubernetes.io/projected/9a5de466-2462-4eab-8201-458be46a4299-kube-api-access-ztjh9\") pod \"postgres-68c4fbbd6f-5xf6k\" (UID: \"9a5de466-2462-4eab-8201-458be46a4299\") " pod="opendatahub/postgres-68c4fbbd6f-5xf6k" May 22 10:42:44.753898 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:44.753868 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-5xf6k" May 22 10:42:44.882574 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:44.882510 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-5xf6k"] May 22 10:42:44.885390 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:42:44.885357 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a5de466_2462_4eab_8201_458be46a4299.slice/crio-c1d3626ac91ae5c77351ef598859896e841989ccc17c153c9a31c421fc335836 WatchSource:0}: Error finding container c1d3626ac91ae5c77351ef598859896e841989ccc17c153c9a31c421fc335836: Status 404 returned error can't find the container with id c1d3626ac91ae5c77351ef598859896e841989ccc17c153c9a31c421fc335836 May 22 10:42:45.892496 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:45.892440 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-5xf6k" event={"ID":"9a5de466-2462-4eab-8201-458be46a4299","Type":"ContainerStarted","Data":"c1d3626ac91ae5c77351ef598859896e841989ccc17c153c9a31c421fc335836"} May 22 10:42:49.907850 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:49.907807 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-5xf6k" event={"ID":"9a5de466-2462-4eab-8201-458be46a4299","Type":"ContainerStarted","Data":"93e3ad206efb7f85708e6d55ece2567ead2424fb8a3bb22e689161e15f5cf7b2"} May 22 10:42:49.908213 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:49.907865 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-5xf6k" May 22 10:42:49.921554 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:49.921442 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-5xf6k" podStartSLOduration=1.143787541 podStartE2EDuration="5.921423935s" podCreationTimestamp="2026-05-22 10:42:44 +0000 UTC" firstStartedPulling="2026-05-22 10:42:44.886904433 +0000 UTC m=+456.194164159" lastFinishedPulling="2026-05-22 10:42:49.664540815 +0000 UTC m=+460.971800553" observedRunningTime="2026-05-22 10:42:49.92065523 +0000 UTC m=+461.227914977" watchObservedRunningTime="2026-05-22 10:42:49.921423935 +0000 UTC m=+461.228683682" May 22 10:42:55.940355 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:55.940302 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-5xf6k" May 22 10:42:56.466577 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:56.466541 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-xmx9j"] May 22 10:42:56.473153 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:56.473130 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-xmx9j" May 22 10:42:56.475563 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:56.475536 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-xmx9j"] May 22 10:42:56.525914 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:56.525871 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq5ps\" (UniqueName: \"kubernetes.io/projected/acb2ba8e-f50f-4ef6-9767-1af4e89f8179-kube-api-access-hq5ps\") pod \"authorino-8b475cf9f-xmx9j\" (UID: \"acb2ba8e-f50f-4ef6-9767-1af4e89f8179\") " pod="kuadrant-system/authorino-8b475cf9f-xmx9j" May 22 10:42:56.626491 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:56.626449 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hq5ps\" (UniqueName: \"kubernetes.io/projected/acb2ba8e-f50f-4ef6-9767-1af4e89f8179-kube-api-access-hq5ps\") pod \"authorino-8b475cf9f-xmx9j\" (UID: \"acb2ba8e-f50f-4ef6-9767-1af4e89f8179\") " pod="kuadrant-system/authorino-8b475cf9f-xmx9j" May 22 10:42:56.633394 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:56.633371 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq5ps\" (UniqueName: \"kubernetes.io/projected/acb2ba8e-f50f-4ef6-9767-1af4e89f8179-kube-api-access-hq5ps\") pod \"authorino-8b475cf9f-xmx9j\" (UID: \"acb2ba8e-f50f-4ef6-9767-1af4e89f8179\") " pod="kuadrant-system/authorino-8b475cf9f-xmx9j" May 22 10:42:56.707661 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:56.707627 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-xmx9j"] May 22 10:42:56.707909 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:56.707898 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-xmx9j" May 22 10:42:56.731373 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:56.731270 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8db7dfbcf-c9756"] May 22 10:42:56.736898 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:56.736880 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8db7dfbcf-c9756" May 22 10:42:56.739579 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:56.739541 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 22 10:42:56.741685 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:56.741660 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8db7dfbcf-c9756"] May 22 10:42:56.829322 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:56.829291 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/336d30d4-be5f-4d0b-8576-705cd6dd0545-tls-cert\") pod \"authorino-8db7dfbcf-c9756\" (UID: \"336d30d4-be5f-4d0b-8576-705cd6dd0545\") " pod="kuadrant-system/authorino-8db7dfbcf-c9756" May 22 10:42:56.829513 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:56.829376 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkch6\" (UniqueName: \"kubernetes.io/projected/336d30d4-be5f-4d0b-8576-705cd6dd0545-kube-api-access-zkch6\") pod \"authorino-8db7dfbcf-c9756\" (UID: \"336d30d4-be5f-4d0b-8576-705cd6dd0545\") " pod="kuadrant-system/authorino-8db7dfbcf-c9756" May 22 10:42:56.837882 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:56.837845 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-xmx9j"] May 22 10:42:56.841455 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:42:56.841430 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podacb2ba8e_f50f_4ef6_9767_1af4e89f8179.slice/crio-9104f5c199c7519f029e441db1fc9e4ea68e6287cb307c5287199ac0034c1fda WatchSource:0}: Error finding container 9104f5c199c7519f029e441db1fc9e4ea68e6287cb307c5287199ac0034c1fda: Status 404 returned error can't find the container with id 9104f5c199c7519f029e441db1fc9e4ea68e6287cb307c5287199ac0034c1fda May 22 10:42:56.930407 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:56.930331 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zkch6\" (UniqueName: \"kubernetes.io/projected/336d30d4-be5f-4d0b-8576-705cd6dd0545-kube-api-access-zkch6\") pod \"authorino-8db7dfbcf-c9756\" (UID: \"336d30d4-be5f-4d0b-8576-705cd6dd0545\") " pod="kuadrant-system/authorino-8db7dfbcf-c9756" May 22 10:42:56.930603 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:56.930508 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/336d30d4-be5f-4d0b-8576-705cd6dd0545-tls-cert\") pod \"authorino-8db7dfbcf-c9756\" (UID: \"336d30d4-be5f-4d0b-8576-705cd6dd0545\") " pod="kuadrant-system/authorino-8db7dfbcf-c9756" May 22 10:42:56.933310 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:56.933274 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/336d30d4-be5f-4d0b-8576-705cd6dd0545-tls-cert\") pod \"authorino-8db7dfbcf-c9756\" (UID: \"336d30d4-be5f-4d0b-8576-705cd6dd0545\") " pod="kuadrant-system/authorino-8db7dfbcf-c9756" May 22 10:42:56.935252 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:56.935216 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-xmx9j" event={"ID":"acb2ba8e-f50f-4ef6-9767-1af4e89f8179","Type":"ContainerStarted","Data":"9104f5c199c7519f029e441db1fc9e4ea68e6287cb307c5287199ac0034c1fda"} May 22 10:42:56.937010 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:56.936991 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkch6\" (UniqueName: \"kubernetes.io/projected/336d30d4-be5f-4d0b-8576-705cd6dd0545-kube-api-access-zkch6\") pod \"authorino-8db7dfbcf-c9756\" (UID: \"336d30d4-be5f-4d0b-8576-705cd6dd0545\") " pod="kuadrant-system/authorino-8db7dfbcf-c9756" May 22 10:42:57.050196 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:57.050106 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8db7dfbcf-c9756" May 22 10:42:57.177247 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:57.177221 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8db7dfbcf-c9756"] May 22 10:42:57.179288 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:42:57.179251 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod336d30d4_be5f_4d0b_8576_705cd6dd0545.slice/crio-3637e065c5956d9c2ae844a1ee68130639d3eed4f83be8bdc33bc711c31da409 WatchSource:0}: Error finding container 3637e065c5956d9c2ae844a1ee68130639d3eed4f83be8bdc33bc711c31da409: Status 404 returned error can't find the container with id 3637e065c5956d9c2ae844a1ee68130639d3eed4f83be8bdc33bc711c31da409 May 22 10:42:57.940374 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:57.940266 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8db7dfbcf-c9756" event={"ID":"336d30d4-be5f-4d0b-8576-705cd6dd0545","Type":"ContainerStarted","Data":"ce70cafdd47e0b424a6ed970a22f1f46ac9f37dc6ab3a66a52a6b3a572d80596"} May 22 10:42:57.940374 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:57.940308 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8db7dfbcf-c9756" event={"ID":"336d30d4-be5f-4d0b-8576-705cd6dd0545","Type":"ContainerStarted","Data":"3637e065c5956d9c2ae844a1ee68130639d3eed4f83be8bdc33bc711c31da409"} May 22 10:42:57.941547 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:57.941516 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-xmx9j" event={"ID":"acb2ba8e-f50f-4ef6-9767-1af4e89f8179","Type":"ContainerStarted","Data":"d75568b18eb417c0bd3fae0c166fbe4f16a9b4e0b91d1440d294d0ecb9719980"} May 22 10:42:57.941674 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:57.941599 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-xmx9j" podUID="acb2ba8e-f50f-4ef6-9767-1af4e89f8179" containerName="authorino" containerID="cri-o://d75568b18eb417c0bd3fae0c166fbe4f16a9b4e0b91d1440d294d0ecb9719980" gracePeriod=30 May 22 10:42:57.953829 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:57.953785 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8db7dfbcf-c9756" podStartSLOduration=1.60876747 podStartE2EDuration="1.953771706s" podCreationTimestamp="2026-05-22 10:42:56 +0000 UTC" firstStartedPulling="2026-05-22 10:42:57.180581136 +0000 UTC m=+468.487840861" lastFinishedPulling="2026-05-22 10:42:57.525585372 +0000 UTC m=+468.832845097" observedRunningTime="2026-05-22 10:42:57.952364745 +0000 UTC m=+469.259624485" watchObservedRunningTime="2026-05-22 10:42:57.953771706 +0000 UTC m=+469.261031452" May 22 10:42:57.967394 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:57.967320 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-xmx9j" podStartSLOduration=1.5821698610000001 podStartE2EDuration="1.967304746s" podCreationTimestamp="2026-05-22 10:42:56 +0000 UTC" firstStartedPulling="2026-05-22 10:42:56.842578138 +0000 UTC m=+468.149837863" lastFinishedPulling="2026-05-22 10:42:57.227713022 +0000 UTC m=+468.534972748" observedRunningTime="2026-05-22 10:42:57.9648975 +0000 UTC m=+469.272157244" watchObservedRunningTime="2026-05-22 10:42:57.967304746 +0000 UTC m=+469.274564540" May 22 10:42:57.980609 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:57.980585 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-bjrnw"] May 22 10:42:57.980797 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:57.980777 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-bjrnw" podUID="fc961589-542a-40a0-b5d2-b8e9c81ee5d5" containerName="authorino" containerID="cri-o://1608680f0ba07a0f4c9f9f90987a46fb6077082dfffaa38d7f108412334d5307" gracePeriod=30 May 22 10:42:58.247468 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:58.247446 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-xmx9j" May 22 10:42:58.250704 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:58.250685 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-bjrnw" May 22 10:42:58.343382 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:58.343332 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdm8g\" (UniqueName: \"kubernetes.io/projected/fc961589-542a-40a0-b5d2-b8e9c81ee5d5-kube-api-access-sdm8g\") pod \"fc961589-542a-40a0-b5d2-b8e9c81ee5d5\" (UID: \"fc961589-542a-40a0-b5d2-b8e9c81ee5d5\") " May 22 10:42:58.343543 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:58.343403 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hq5ps\" (UniqueName: \"kubernetes.io/projected/acb2ba8e-f50f-4ef6-9767-1af4e89f8179-kube-api-access-hq5ps\") pod \"acb2ba8e-f50f-4ef6-9767-1af4e89f8179\" (UID: \"acb2ba8e-f50f-4ef6-9767-1af4e89f8179\") " May 22 10:42:58.345610 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:58.345583 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acb2ba8e-f50f-4ef6-9767-1af4e89f8179-kube-api-access-hq5ps" (OuterVolumeSpecName: "kube-api-access-hq5ps") pod "acb2ba8e-f50f-4ef6-9767-1af4e89f8179" (UID: "acb2ba8e-f50f-4ef6-9767-1af4e89f8179"). InnerVolumeSpecName "kube-api-access-hq5ps". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 22 10:42:58.345712 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:58.345647 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc961589-542a-40a0-b5d2-b8e9c81ee5d5-kube-api-access-sdm8g" (OuterVolumeSpecName: "kube-api-access-sdm8g") pod "fc961589-542a-40a0-b5d2-b8e9c81ee5d5" (UID: "fc961589-542a-40a0-b5d2-b8e9c81ee5d5"). InnerVolumeSpecName "kube-api-access-sdm8g". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 22 10:42:58.445168 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:58.445126 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdm8g\" (UniqueName: \"kubernetes.io/projected/fc961589-542a-40a0-b5d2-b8e9c81ee5d5-kube-api-access-sdm8g\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" May 22 10:42:58.445168 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:58.445162 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hq5ps\" (UniqueName: \"kubernetes.io/projected/acb2ba8e-f50f-4ef6-9767-1af4e89f8179-kube-api-access-hq5ps\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" May 22 10:42:58.945557 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:58.945461 2558 generic.go:358] "Generic (PLEG): container finished" podID="fc961589-542a-40a0-b5d2-b8e9c81ee5d5" containerID="1608680f0ba07a0f4c9f9f90987a46fb6077082dfffaa38d7f108412334d5307" exitCode=0 May 22 10:42:58.945557 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:58.945510 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-bjrnw" May 22 10:42:58.945557 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:58.945510 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-bjrnw" event={"ID":"fc961589-542a-40a0-b5d2-b8e9c81ee5d5","Type":"ContainerDied","Data":"1608680f0ba07a0f4c9f9f90987a46fb6077082dfffaa38d7f108412334d5307"} May 22 10:42:58.945834 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:58.945556 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-bjrnw" event={"ID":"fc961589-542a-40a0-b5d2-b8e9c81ee5d5","Type":"ContainerDied","Data":"76490cd7e7f0f4792a9abfc90c4da5772b987bc48b9be0b7d9f1b818559b15b0"} May 22 10:42:58.945834 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:58.945578 2558 scope.go:117] "RemoveContainer" containerID="1608680f0ba07a0f4c9f9f90987a46fb6077082dfffaa38d7f108412334d5307" May 22 10:42:58.946875 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:58.946810 2558 generic.go:358] "Generic (PLEG): container finished" podID="acb2ba8e-f50f-4ef6-9767-1af4e89f8179" containerID="d75568b18eb417c0bd3fae0c166fbe4f16a9b4e0b91d1440d294d0ecb9719980" exitCode=0 May 22 10:42:58.946875 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:58.946854 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-xmx9j" May 22 10:42:58.946988 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:58.946883 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-xmx9j" event={"ID":"acb2ba8e-f50f-4ef6-9767-1af4e89f8179","Type":"ContainerDied","Data":"d75568b18eb417c0bd3fae0c166fbe4f16a9b4e0b91d1440d294d0ecb9719980"} May 22 10:42:58.946988 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:58.946907 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-xmx9j" event={"ID":"acb2ba8e-f50f-4ef6-9767-1af4e89f8179","Type":"ContainerDied","Data":"9104f5c199c7519f029e441db1fc9e4ea68e6287cb307c5287199ac0034c1fda"} May 22 10:42:58.955596 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:58.955572 2558 scope.go:117] "RemoveContainer" containerID="1608680f0ba07a0f4c9f9f90987a46fb6077082dfffaa38d7f108412334d5307" May 22 10:42:58.955869 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:42:58.955850 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1608680f0ba07a0f4c9f9f90987a46fb6077082dfffaa38d7f108412334d5307\": container with ID starting with 1608680f0ba07a0f4c9f9f90987a46fb6077082dfffaa38d7f108412334d5307 not found: ID does not exist" containerID="1608680f0ba07a0f4c9f9f90987a46fb6077082dfffaa38d7f108412334d5307" May 22 10:42:58.955941 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:58.955878 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1608680f0ba07a0f4c9f9f90987a46fb6077082dfffaa38d7f108412334d5307"} err="failed to get container status \"1608680f0ba07a0f4c9f9f90987a46fb6077082dfffaa38d7f108412334d5307\": rpc error: code = NotFound desc = could not find container \"1608680f0ba07a0f4c9f9f90987a46fb6077082dfffaa38d7f108412334d5307\": container with ID starting with 1608680f0ba07a0f4c9f9f90987a46fb6077082dfffaa38d7f108412334d5307 not found: ID does not exist" May 22 10:42:58.955941 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:58.955895 2558 scope.go:117] "RemoveContainer" containerID="d75568b18eb417c0bd3fae0c166fbe4f16a9b4e0b91d1440d294d0ecb9719980" May 22 10:42:58.963624 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:58.963589 2558 scope.go:117] "RemoveContainer" containerID="d75568b18eb417c0bd3fae0c166fbe4f16a9b4e0b91d1440d294d0ecb9719980" May 22 10:42:58.964385 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:42:58.964355 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d75568b18eb417c0bd3fae0c166fbe4f16a9b4e0b91d1440d294d0ecb9719980\": container with ID starting with d75568b18eb417c0bd3fae0c166fbe4f16a9b4e0b91d1440d294d0ecb9719980 not found: ID does not exist" containerID="d75568b18eb417c0bd3fae0c166fbe4f16a9b4e0b91d1440d294d0ecb9719980" May 22 10:42:58.964462 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:58.964393 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d75568b18eb417c0bd3fae0c166fbe4f16a9b4e0b91d1440d294d0ecb9719980"} err="failed to get container status \"d75568b18eb417c0bd3fae0c166fbe4f16a9b4e0b91d1440d294d0ecb9719980\": rpc error: code = NotFound desc = could not find container \"d75568b18eb417c0bd3fae0c166fbe4f16a9b4e0b91d1440d294d0ecb9719980\": container with ID starting with d75568b18eb417c0bd3fae0c166fbe4f16a9b4e0b91d1440d294d0ecb9719980 not found: ID does not exist" May 22 10:42:58.965515 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:58.965494 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-bjrnw"] May 22 10:42:58.968584 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:58.968550 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-bjrnw"] May 22 10:42:58.976302 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:58.976276 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-xmx9j"] May 22 10:42:58.977871 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:58.977850 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-xmx9j"] May 22 10:42:59.255962 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:59.255928 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acb2ba8e-f50f-4ef6-9767-1af4e89f8179" path="/var/lib/kubelet/pods/acb2ba8e-f50f-4ef6-9767-1af4e89f8179/volumes" May 22 10:42:59.256364 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:42:59.256284 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc961589-542a-40a0-b5d2-b8e9c81ee5d5" path="/var/lib/kubelet/pods/fc961589-542a-40a0-b5d2-b8e9c81ee5d5/volumes" May 22 10:43:36.585257 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:43:36.585223 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-6f7f75cb-wzlr8"] May 22 10:43:36.585696 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:43:36.585680 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acb2ba8e-f50f-4ef6-9767-1af4e89f8179" containerName="authorino" May 22 10:43:36.585740 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:43:36.585698 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="acb2ba8e-f50f-4ef6-9767-1af4e89f8179" containerName="authorino" May 22 10:43:36.585740 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:43:36.585717 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc961589-542a-40a0-b5d2-b8e9c81ee5d5" containerName="authorino" May 22 10:43:36.585740 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:43:36.585722 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc961589-542a-40a0-b5d2-b8e9c81ee5d5" containerName="authorino" May 22 10:43:36.585836 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:43:36.585783 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="fc961589-542a-40a0-b5d2-b8e9c81ee5d5" containerName="authorino" May 22 10:43:36.585836 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:43:36.585797 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="acb2ba8e-f50f-4ef6-9767-1af4e89f8179" containerName="authorino" May 22 10:43:36.588838 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:43:36.588821 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6f7f75cb-wzlr8" May 22 10:43:36.590570 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:43:36.590548 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" May 22 10:43:36.596692 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:43:36.596675 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6f7f75cb-wzlr8"] May 22 10:43:36.689851 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:43:36.689818 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkm8z\" (UniqueName: \"kubernetes.io/projected/6d8811a6-7013-4b28-bc1c-13bd0ad9ee3b-kube-api-access-dkm8z\") pod \"maas-api-6f7f75cb-wzlr8\" (UID: \"6d8811a6-7013-4b28-bc1c-13bd0ad9ee3b\") " pod="opendatahub/maas-api-6f7f75cb-wzlr8" May 22 10:43:36.690009 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:43:36.689883 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d8811a6-7013-4b28-bc1c-13bd0ad9ee3b-maas-api-tls\") pod \"maas-api-6f7f75cb-wzlr8\" (UID: \"6d8811a6-7013-4b28-bc1c-13bd0ad9ee3b\") " pod="opendatahub/maas-api-6f7f75cb-wzlr8" May 22 10:43:36.790790 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:43:36.790757 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d8811a6-7013-4b28-bc1c-13bd0ad9ee3b-maas-api-tls\") pod \"maas-api-6f7f75cb-wzlr8\" (UID: \"6d8811a6-7013-4b28-bc1c-13bd0ad9ee3b\") " pod="opendatahub/maas-api-6f7f75cb-wzlr8" May 22 10:43:36.790949 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:43:36.790845 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dkm8z\" (UniqueName: \"kubernetes.io/projected/6d8811a6-7013-4b28-bc1c-13bd0ad9ee3b-kube-api-access-dkm8z\") pod \"maas-api-6f7f75cb-wzlr8\" (UID: \"6d8811a6-7013-4b28-bc1c-13bd0ad9ee3b\") " pod="opendatahub/maas-api-6f7f75cb-wzlr8" May 22 10:43:36.793281 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:43:36.793252 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d8811a6-7013-4b28-bc1c-13bd0ad9ee3b-maas-api-tls\") pod \"maas-api-6f7f75cb-wzlr8\" (UID: \"6d8811a6-7013-4b28-bc1c-13bd0ad9ee3b\") " pod="opendatahub/maas-api-6f7f75cb-wzlr8" May 22 10:43:36.798160 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:43:36.798136 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkm8z\" (UniqueName: \"kubernetes.io/projected/6d8811a6-7013-4b28-bc1c-13bd0ad9ee3b-kube-api-access-dkm8z\") pod \"maas-api-6f7f75cb-wzlr8\" (UID: \"6d8811a6-7013-4b28-bc1c-13bd0ad9ee3b\") " pod="opendatahub/maas-api-6f7f75cb-wzlr8" May 22 10:43:36.900237 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:43:36.900148 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6f7f75cb-wzlr8" May 22 10:43:37.033294 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:43:37.033267 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6f7f75cb-wzlr8"] May 22 10:43:37.035943 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:43:37.035910 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d8811a6_7013_4b28_bc1c_13bd0ad9ee3b.slice/crio-9cea05cd500b2b0923e585c875ef2a9bedb0622b0c6731990921d570bfcaae9c WatchSource:0}: Error finding container 9cea05cd500b2b0923e585c875ef2a9bedb0622b0c6731990921d570bfcaae9c: Status 404 returned error can't find the container with id 9cea05cd500b2b0923e585c875ef2a9bedb0622b0c6731990921d570bfcaae9c May 22 10:43:37.092797 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:43:37.092763 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6f7f75cb-wzlr8" event={"ID":"6d8811a6-7013-4b28-bc1c-13bd0ad9ee3b","Type":"ContainerStarted","Data":"9cea05cd500b2b0923e585c875ef2a9bedb0622b0c6731990921d570bfcaae9c"} May 22 10:43:40.106356 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:43:40.106299 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6f7f75cb-wzlr8" event={"ID":"6d8811a6-7013-4b28-bc1c-13bd0ad9ee3b","Type":"ContainerStarted","Data":"5de3455c90b3a8285f485d32748445ecf905813175381c329cf23cd0a2a81d4e"} May 22 10:43:40.106817 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:43:40.106408 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6f7f75cb-wzlr8" May 22 10:43:40.121577 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:43:40.121526 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-6f7f75cb-wzlr8" podStartSLOduration=1.846809114 podStartE2EDuration="4.121512652s" podCreationTimestamp="2026-05-22 10:43:36 +0000 UTC" firstStartedPulling="2026-05-22 10:43:37.037236377 +0000 UTC m=+508.344496116" lastFinishedPulling="2026-05-22 10:43:39.31193993 +0000 UTC m=+510.619199654" observedRunningTime="2026-05-22 10:43:40.119781231 +0000 UTC m=+511.427040977" watchObservedRunningTime="2026-05-22 10:43:40.121512652 +0000 UTC m=+511.428772397" May 22 10:43:46.115716 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:43:46.115688 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6f7f75cb-wzlr8" May 22 10:44:03.782209 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:03.782137 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6"] May 22 10:44:03.785574 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:03.785558 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6" May 22 10:44:03.787578 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:03.787555 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 22 10:44:03.788568 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:03.788546 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 22 10:44:03.788665 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:03.788551 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" May 22 10:44:03.788665 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:03.788575 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-sqvkl\"" May 22 10:44:03.793725 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:03.793707 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6"] May 22 10:44:03.932848 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:03.932806 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/761a92e7-d6cf-4590-a119-37b4caa5309b-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6\" (UID: \"761a92e7-d6cf-4590-a119-37b4caa5309b\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6" May 22 10:44:03.932848 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:03.932843 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/761a92e7-d6cf-4590-a119-37b4caa5309b-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6\" (UID: \"761a92e7-d6cf-4590-a119-37b4caa5309b\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6" May 22 10:44:03.933111 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:03.932863 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/761a92e7-d6cf-4590-a119-37b4caa5309b-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6\" (UID: \"761a92e7-d6cf-4590-a119-37b4caa5309b\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6" May 22 10:44:03.933111 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:03.933034 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8j2r\" (UniqueName: \"kubernetes.io/projected/761a92e7-d6cf-4590-a119-37b4caa5309b-kube-api-access-r8j2r\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6\" (UID: \"761a92e7-d6cf-4590-a119-37b4caa5309b\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6" May 22 10:44:03.933111 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:03.933075 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/761a92e7-d6cf-4590-a119-37b4caa5309b-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6\" (UID: \"761a92e7-d6cf-4590-a119-37b4caa5309b\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6" May 22 10:44:03.933111 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:03.933108 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/761a92e7-d6cf-4590-a119-37b4caa5309b-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6\" (UID: \"761a92e7-d6cf-4590-a119-37b4caa5309b\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6" May 22 10:44:04.034417 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:04.034305 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r8j2r\" (UniqueName: \"kubernetes.io/projected/761a92e7-d6cf-4590-a119-37b4caa5309b-kube-api-access-r8j2r\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6\" (UID: \"761a92e7-d6cf-4590-a119-37b4caa5309b\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6" May 22 10:44:04.034417 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:04.034379 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/761a92e7-d6cf-4590-a119-37b4caa5309b-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6\" (UID: \"761a92e7-d6cf-4590-a119-37b4caa5309b\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6" May 22 10:44:04.034417 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:04.034404 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/761a92e7-d6cf-4590-a119-37b4caa5309b-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6\" (UID: \"761a92e7-d6cf-4590-a119-37b4caa5309b\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6" May 22 10:44:04.034682 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:04.034450 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/761a92e7-d6cf-4590-a119-37b4caa5309b-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6\" (UID: \"761a92e7-d6cf-4590-a119-37b4caa5309b\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6" May 22 10:44:04.034682 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:04.034466 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/761a92e7-d6cf-4590-a119-37b4caa5309b-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6\" (UID: \"761a92e7-d6cf-4590-a119-37b4caa5309b\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6" May 22 10:44:04.034682 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:04.034485 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/761a92e7-d6cf-4590-a119-37b4caa5309b-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6\" (UID: \"761a92e7-d6cf-4590-a119-37b4caa5309b\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6" May 22 10:44:04.034929 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:04.034904 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/761a92e7-d6cf-4590-a119-37b4caa5309b-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6\" (UID: \"761a92e7-d6cf-4590-a119-37b4caa5309b\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6" May 22 10:44:04.034992 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:04.034921 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/761a92e7-d6cf-4590-a119-37b4caa5309b-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6\" (UID: \"761a92e7-d6cf-4590-a119-37b4caa5309b\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6" May 22 10:44:04.034992 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:04.034964 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/761a92e7-d6cf-4590-a119-37b4caa5309b-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6\" (UID: \"761a92e7-d6cf-4590-a119-37b4caa5309b\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6" May 22 10:44:04.036915 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:04.036896 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/761a92e7-d6cf-4590-a119-37b4caa5309b-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6\" (UID: \"761a92e7-d6cf-4590-a119-37b4caa5309b\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6" May 22 10:44:04.036990 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:04.036975 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/761a92e7-d6cf-4590-a119-37b4caa5309b-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6\" (UID: \"761a92e7-d6cf-4590-a119-37b4caa5309b\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6" May 22 10:44:04.041210 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:04.041191 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8j2r\" (UniqueName: \"kubernetes.io/projected/761a92e7-d6cf-4590-a119-37b4caa5309b-kube-api-access-r8j2r\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6\" (UID: \"761a92e7-d6cf-4590-a119-37b4caa5309b\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6" May 22 10:44:04.096522 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:04.096494 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6" May 22 10:44:04.225398 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:04.225310 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6"] May 22 10:44:04.227912 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:44:04.227876 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod761a92e7_d6cf_4590_a119_37b4caa5309b.slice/crio-762979cb14deb40234c05a5bfd4185073ff13ed2ac4aa2c2861f89ab59147e38 WatchSource:0}: Error finding container 762979cb14deb40234c05a5bfd4185073ff13ed2ac4aa2c2861f89ab59147e38: Status 404 returned error can't find the container with id 762979cb14deb40234c05a5bfd4185073ff13ed2ac4aa2c2861f89ab59147e38 May 22 10:44:05.203831 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:05.203791 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6" event={"ID":"761a92e7-d6cf-4590-a119-37b4caa5309b","Type":"ContainerStarted","Data":"762979cb14deb40234c05a5bfd4185073ff13ed2ac4aa2c2861f89ab59147e38"} May 22 10:44:11.228947 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:11.228912 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6" event={"ID":"761a92e7-d6cf-4590-a119-37b4caa5309b","Type":"ContainerStarted","Data":"5d1b9e17a73e86d7777140d45e89dac3cbdd6f5328bd6d4feccb217c55b6135d"} May 22 10:44:16.248681 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:16.248645 2558 generic.go:358] "Generic (PLEG): container finished" podID="761a92e7-d6cf-4590-a119-37b4caa5309b" containerID="5d1b9e17a73e86d7777140d45e89dac3cbdd6f5328bd6d4feccb217c55b6135d" exitCode=0 May 22 10:44:16.249047 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:16.248717 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6" event={"ID":"761a92e7-d6cf-4590-a119-37b4caa5309b","Type":"ContainerDied","Data":"5d1b9e17a73e86d7777140d45e89dac3cbdd6f5328bd6d4feccb217c55b6135d"} May 22 10:44:18.189105 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:18.189074 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd"] May 22 10:44:18.193026 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:18.193009 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd" May 22 10:44:18.194945 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:18.194926 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" May 22 10:44:18.201812 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:18.201789 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd"] May 22 10:44:18.257810 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:18.257779 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6" event={"ID":"761a92e7-d6cf-4590-a119-37b4caa5309b","Type":"ContainerStarted","Data":"a6dff8126f36bc7ad46dc21f55439ecf5dee071bade9a2efa57a134b61e9d949"} May 22 10:44:18.257972 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:18.257963 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6" May 22 10:44:18.278957 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:18.278291 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6" podStartSLOduration=2.054236516 podStartE2EDuration="15.278264189s" podCreationTimestamp="2026-05-22 10:44:03 +0000 UTC" firstStartedPulling="2026-05-22 10:44:04.229952293 +0000 UTC m=+535.537212017" lastFinishedPulling="2026-05-22 10:44:17.453979966 +0000 UTC m=+548.761239690" observedRunningTime="2026-05-22 10:44:18.276666727 +0000 UTC m=+549.583926519" watchObservedRunningTime="2026-05-22 10:44:18.278264189 +0000 UTC m=+549.585523932" May 22 10:44:18.283983 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:18.281691 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5052ab27-a323-441a-91fa-a16e34e15de0-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd\" (UID: \"5052ab27-a323-441a-91fa-a16e34e15de0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd" May 22 10:44:18.283983 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:18.281755 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5052ab27-a323-441a-91fa-a16e34e15de0-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd\" (UID: \"5052ab27-a323-441a-91fa-a16e34e15de0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd" May 22 10:44:18.283983 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:18.281825 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5052ab27-a323-441a-91fa-a16e34e15de0-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd\" (UID: \"5052ab27-a323-441a-91fa-a16e34e15de0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd" May 22 10:44:18.283983 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:18.281860 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrwqg\" (UniqueName: \"kubernetes.io/projected/5052ab27-a323-441a-91fa-a16e34e15de0-kube-api-access-wrwqg\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd\" (UID: \"5052ab27-a323-441a-91fa-a16e34e15de0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd" May 22 10:44:18.283983 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:18.281898 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5052ab27-a323-441a-91fa-a16e34e15de0-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd\" (UID: \"5052ab27-a323-441a-91fa-a16e34e15de0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd" May 22 10:44:18.283983 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:18.281932 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5052ab27-a323-441a-91fa-a16e34e15de0-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd\" (UID: \"5052ab27-a323-441a-91fa-a16e34e15de0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd" May 22 10:44:18.383361 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:18.383303 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5052ab27-a323-441a-91fa-a16e34e15de0-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd\" (UID: \"5052ab27-a323-441a-91fa-a16e34e15de0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd" May 22 10:44:18.383491 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:18.383375 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5052ab27-a323-441a-91fa-a16e34e15de0-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd\" (UID: \"5052ab27-a323-441a-91fa-a16e34e15de0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd" May 22 10:44:18.383491 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:18.383471 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5052ab27-a323-441a-91fa-a16e34e15de0-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd\" (UID: \"5052ab27-a323-441a-91fa-a16e34e15de0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd" May 22 10:44:18.383619 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:18.383508 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5052ab27-a323-441a-91fa-a16e34e15de0-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd\" (UID: \"5052ab27-a323-441a-91fa-a16e34e15de0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd" May 22 10:44:18.383691 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:18.383663 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5052ab27-a323-441a-91fa-a16e34e15de0-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd\" (UID: \"5052ab27-a323-441a-91fa-a16e34e15de0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd" May 22 10:44:18.383747 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:18.383716 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wrwqg\" (UniqueName: \"kubernetes.io/projected/5052ab27-a323-441a-91fa-a16e34e15de0-kube-api-access-wrwqg\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd\" (UID: \"5052ab27-a323-441a-91fa-a16e34e15de0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd" May 22 10:44:18.383800 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:18.383771 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5052ab27-a323-441a-91fa-a16e34e15de0-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd\" (UID: \"5052ab27-a323-441a-91fa-a16e34e15de0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd" May 22 10:44:18.384068 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:18.384046 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5052ab27-a323-441a-91fa-a16e34e15de0-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd\" (UID: \"5052ab27-a323-441a-91fa-a16e34e15de0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd" May 22 10:44:18.384199 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:18.384092 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5052ab27-a323-441a-91fa-a16e34e15de0-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd\" (UID: \"5052ab27-a323-441a-91fa-a16e34e15de0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd" May 22 10:44:18.385767 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:18.385745 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5052ab27-a323-441a-91fa-a16e34e15de0-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd\" (UID: \"5052ab27-a323-441a-91fa-a16e34e15de0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd" May 22 10:44:18.386747 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:18.386728 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5052ab27-a323-441a-91fa-a16e34e15de0-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd\" (UID: \"5052ab27-a323-441a-91fa-a16e34e15de0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd" May 22 10:44:18.390291 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:18.390269 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrwqg\" (UniqueName: \"kubernetes.io/projected/5052ab27-a323-441a-91fa-a16e34e15de0-kube-api-access-wrwqg\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd\" (UID: \"5052ab27-a323-441a-91fa-a16e34e15de0\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd" May 22 10:44:18.504715 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:18.504688 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd" May 22 10:44:18.632603 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:18.632378 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd"] May 22 10:44:18.634826 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:44:18.634799 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5052ab27_a323_441a_91fa_a16e34e15de0.slice/crio-40410c54d421cea53f12ebf64adea0e26ed1ecc3478d097adc8f1b9eda9a5ac6 WatchSource:0}: Error finding container 40410c54d421cea53f12ebf64adea0e26ed1ecc3478d097adc8f1b9eda9a5ac6: Status 404 returned error can't find the container with id 40410c54d421cea53f12ebf64adea0e26ed1ecc3478d097adc8f1b9eda9a5ac6 May 22 10:44:19.262997 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:19.262955 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd" event={"ID":"5052ab27-a323-441a-91fa-a16e34e15de0","Type":"ContainerStarted","Data":"516b20c0dde20ee17cc0d4d4e3a9d09cbd233417c58b59fefbdd91507e14db41"} May 22 10:44:19.262997 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:19.262995 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd" event={"ID":"5052ab27-a323-441a-91fa-a16e34e15de0","Type":"ContainerStarted","Data":"40410c54d421cea53f12ebf64adea0e26ed1ecc3478d097adc8f1b9eda9a5ac6"} May 22 10:44:24.280310 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:24.280214 2558 generic.go:358] "Generic (PLEG): container finished" podID="5052ab27-a323-441a-91fa-a16e34e15de0" containerID="516b20c0dde20ee17cc0d4d4e3a9d09cbd233417c58b59fefbdd91507e14db41" exitCode=0 May 22 10:44:24.280310 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:24.280285 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd" event={"ID":"5052ab27-a323-441a-91fa-a16e34e15de0","Type":"ContainerDied","Data":"516b20c0dde20ee17cc0d4d4e3a9d09cbd233417c58b59fefbdd91507e14db41"} May 22 10:44:25.288072 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:25.288037 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd" event={"ID":"5052ab27-a323-441a-91fa-a16e34e15de0","Type":"ContainerStarted","Data":"001024cfebc6006f38924ac4e0fed87bf023d6921d528b22f2dd92011f853800"} May 22 10:44:25.288527 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:25.288265 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd" May 22 10:44:25.304761 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:25.304714 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd" podStartSLOduration=7.114781499 podStartE2EDuration="7.304701635s" podCreationTimestamp="2026-05-22 10:44:18 +0000 UTC" firstStartedPulling="2026-05-22 10:44:24.281047516 +0000 UTC m=+555.588307241" lastFinishedPulling="2026-05-22 10:44:24.470967637 +0000 UTC m=+555.778227377" observedRunningTime="2026-05-22 10:44:25.303008553 +0000 UTC m=+556.610268310" watchObservedRunningTime="2026-05-22 10:44:25.304701635 +0000 UTC m=+556.611961380" May 22 10:44:29.276708 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:29.276682 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6" May 22 10:44:36.304094 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:44:36.304061 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd" May 22 10:45:09.858120 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:45:09.858081 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d4765f5d-dv5kt"] May 22 10:45:09.860656 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:45:09.860633 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d4765f5d-dv5kt" May 22 10:45:09.865962 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:45:09.865926 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d4765f5d-dv5kt"] May 22 10:45:09.962184 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:45:09.962147 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2d3e696b-6094-4b98-88c5-e37201411bc6-tls-cert\") pod \"authorino-75d4765f5d-dv5kt\" (UID: \"2d3e696b-6094-4b98-88c5-e37201411bc6\") " pod="kuadrant-system/authorino-75d4765f5d-dv5kt" May 22 10:45:09.962381 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:45:09.962318 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7grvn\" (UniqueName: \"kubernetes.io/projected/2d3e696b-6094-4b98-88c5-e37201411bc6-kube-api-access-7grvn\") pod \"authorino-75d4765f5d-dv5kt\" (UID: \"2d3e696b-6094-4b98-88c5-e37201411bc6\") " pod="kuadrant-system/authorino-75d4765f5d-dv5kt" May 22 10:45:10.063116 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:45:10.063075 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7grvn\" (UniqueName: \"kubernetes.io/projected/2d3e696b-6094-4b98-88c5-e37201411bc6-kube-api-access-7grvn\") pod \"authorino-75d4765f5d-dv5kt\" (UID: \"2d3e696b-6094-4b98-88c5-e37201411bc6\") " pod="kuadrant-system/authorino-75d4765f5d-dv5kt" May 22 10:45:10.063116 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:45:10.063118 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2d3e696b-6094-4b98-88c5-e37201411bc6-tls-cert\") pod \"authorino-75d4765f5d-dv5kt\" (UID: \"2d3e696b-6094-4b98-88c5-e37201411bc6\") " pod="kuadrant-system/authorino-75d4765f5d-dv5kt" May 22 10:45:10.065651 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:45:10.065622 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2d3e696b-6094-4b98-88c5-e37201411bc6-tls-cert\") pod \"authorino-75d4765f5d-dv5kt\" (UID: \"2d3e696b-6094-4b98-88c5-e37201411bc6\") " pod="kuadrant-system/authorino-75d4765f5d-dv5kt" May 22 10:45:10.069796 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:45:10.069764 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7grvn\" (UniqueName: \"kubernetes.io/projected/2d3e696b-6094-4b98-88c5-e37201411bc6-kube-api-access-7grvn\") pod \"authorino-75d4765f5d-dv5kt\" (UID: \"2d3e696b-6094-4b98-88c5-e37201411bc6\") " pod="kuadrant-system/authorino-75d4765f5d-dv5kt" May 22 10:45:10.171663 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:45:10.171574 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d4765f5d-dv5kt" May 22 10:45:10.300424 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:45:10.300328 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d4765f5d-dv5kt"] May 22 10:45:10.303200 ip-10-0-138-186 kubenswrapper[2558]: W0522 10:45:10.303170 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d3e696b_6094_4b98_88c5_e37201411bc6.slice/crio-2fb0c34a21afc1f4628b225e5f986bb92da442259ced56dfbbf22f2ecc830abe WatchSource:0}: Error finding container 2fb0c34a21afc1f4628b225e5f986bb92da442259ced56dfbbf22f2ecc830abe: Status 404 returned error can't find the container with id 2fb0c34a21afc1f4628b225e5f986bb92da442259ced56dfbbf22f2ecc830abe May 22 10:45:10.448381 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:45:10.448269 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d4765f5d-dv5kt" event={"ID":"2d3e696b-6094-4b98-88c5-e37201411bc6","Type":"ContainerStarted","Data":"2fb0c34a21afc1f4628b225e5f986bb92da442259ced56dfbbf22f2ecc830abe"} May 22 10:45:11.453486 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:45:11.453443 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d4765f5d-dv5kt" event={"ID":"2d3e696b-6094-4b98-88c5-e37201411bc6","Type":"ContainerStarted","Data":"7e4468e1b82d3813351abc851f049c1a7b1582291c15dab8332f0094d6038920"} May 22 10:45:11.466777 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:45:11.466725 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-75d4765f5d-dv5kt" podStartSLOduration=1.988033645 podStartE2EDuration="2.466712308s" podCreationTimestamp="2026-05-22 10:45:09 +0000 UTC" firstStartedPulling="2026-05-22 10:45:10.304942246 +0000 UTC m=+601.612201970" lastFinishedPulling="2026-05-22 10:45:10.783620909 +0000 UTC m=+602.090880633" observedRunningTime="2026-05-22 10:45:11.46399172 +0000 UTC m=+602.771251466" watchObservedRunningTime="2026-05-22 10:45:11.466712308 +0000 UTC m=+602.773972137" May 22 10:45:11.484152 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:45:11.484120 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8db7dfbcf-c9756"] May 22 10:45:11.484391 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:45:11.484366 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8db7dfbcf-c9756" podUID="336d30d4-be5f-4d0b-8576-705cd6dd0545" containerName="authorino" containerID="cri-o://ce70cafdd47e0b424a6ed970a22f1f46ac9f37dc6ab3a66a52a6b3a572d80596" gracePeriod=30 May 22 10:45:11.734612 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:45:11.731719 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8db7dfbcf-c9756" May 22 10:45:11.880115 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:45:11.880082 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkch6\" (UniqueName: \"kubernetes.io/projected/336d30d4-be5f-4d0b-8576-705cd6dd0545-kube-api-access-zkch6\") pod \"336d30d4-be5f-4d0b-8576-705cd6dd0545\" (UID: \"336d30d4-be5f-4d0b-8576-705cd6dd0545\") " May 22 10:45:11.880300 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:45:11.880193 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/336d30d4-be5f-4d0b-8576-705cd6dd0545-tls-cert\") pod \"336d30d4-be5f-4d0b-8576-705cd6dd0545\" (UID: \"336d30d4-be5f-4d0b-8576-705cd6dd0545\") " May 22 10:45:11.882469 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:45:11.882436 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/336d30d4-be5f-4d0b-8576-705cd6dd0545-kube-api-access-zkch6" (OuterVolumeSpecName: "kube-api-access-zkch6") pod "336d30d4-be5f-4d0b-8576-705cd6dd0545" (UID: "336d30d4-be5f-4d0b-8576-705cd6dd0545"). InnerVolumeSpecName "kube-api-access-zkch6". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 22 10:45:11.891308 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:45:11.891278 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/336d30d4-be5f-4d0b-8576-705cd6dd0545-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "336d30d4-be5f-4d0b-8576-705cd6dd0545" (UID: "336d30d4-be5f-4d0b-8576-705cd6dd0545"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 22 10:45:11.981914 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:45:11.981820 2558 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/336d30d4-be5f-4d0b-8576-705cd6dd0545-tls-cert\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" May 22 10:45:11.981914 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:45:11.981862 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkch6\" (UniqueName: \"kubernetes.io/projected/336d30d4-be5f-4d0b-8576-705cd6dd0545-kube-api-access-zkch6\") on node \"ip-10-0-138-186.ec2.internal\" DevicePath \"\"" May 22 10:45:12.458527 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:45:12.458488 2558 generic.go:358] "Generic (PLEG): container finished" podID="336d30d4-be5f-4d0b-8576-705cd6dd0545" containerID="ce70cafdd47e0b424a6ed970a22f1f46ac9f37dc6ab3a66a52a6b3a572d80596" exitCode=0 May 22 10:45:12.458956 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:45:12.458531 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8db7dfbcf-c9756" May 22 10:45:12.458956 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:45:12.458565 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8db7dfbcf-c9756" event={"ID":"336d30d4-be5f-4d0b-8576-705cd6dd0545","Type":"ContainerDied","Data":"ce70cafdd47e0b424a6ed970a22f1f46ac9f37dc6ab3a66a52a6b3a572d80596"} May 22 10:45:12.458956 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:45:12.458609 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8db7dfbcf-c9756" event={"ID":"336d30d4-be5f-4d0b-8576-705cd6dd0545","Type":"ContainerDied","Data":"3637e065c5956d9c2ae844a1ee68130639d3eed4f83be8bdc33bc711c31da409"} May 22 10:45:12.458956 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:45:12.458631 2558 scope.go:117] "RemoveContainer" containerID="ce70cafdd47e0b424a6ed970a22f1f46ac9f37dc6ab3a66a52a6b3a572d80596" May 22 10:45:12.467264 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:45:12.467244 2558 scope.go:117] "RemoveContainer" containerID="ce70cafdd47e0b424a6ed970a22f1f46ac9f37dc6ab3a66a52a6b3a572d80596" May 22 10:45:12.467537 ip-10-0-138-186 kubenswrapper[2558]: E0522 10:45:12.467518 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce70cafdd47e0b424a6ed970a22f1f46ac9f37dc6ab3a66a52a6b3a572d80596\": container with ID starting with ce70cafdd47e0b424a6ed970a22f1f46ac9f37dc6ab3a66a52a6b3a572d80596 not found: ID does not exist" containerID="ce70cafdd47e0b424a6ed970a22f1f46ac9f37dc6ab3a66a52a6b3a572d80596" May 22 10:45:12.467601 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:45:12.467544 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce70cafdd47e0b424a6ed970a22f1f46ac9f37dc6ab3a66a52a6b3a572d80596"} err="failed to get container status \"ce70cafdd47e0b424a6ed970a22f1f46ac9f37dc6ab3a66a52a6b3a572d80596\": rpc error: code = NotFound desc = could not find container \"ce70cafdd47e0b424a6ed970a22f1f46ac9f37dc6ab3a66a52a6b3a572d80596\": container with ID starting with ce70cafdd47e0b424a6ed970a22f1f46ac9f37dc6ab3a66a52a6b3a572d80596 not found: ID does not exist" May 22 10:45:12.475548 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:45:12.475522 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8db7dfbcf-c9756"] May 22 10:45:12.478159 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:45:12.478137 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8db7dfbcf-c9756"] May 22 10:45:13.254102 ip-10-0-138-186 kubenswrapper[2558]: I0522 10:45:13.254067 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="336d30d4-be5f-4d0b-8576-705cd6dd0545" path="/var/lib/kubelet/pods/336d30d4-be5f-4d0b-8576-705cd6dd0545/volumes" May 22 11:07:36.828942 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:36.828912 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-75d4765f5d-dv5kt_2d3e696b-6094-4b98-88c5-e37201411bc6/authorino/0.log" May 22 11:07:41.289270 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:41.289234 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6f7f75cb-wzlr8_6d8811a6-7013-4b28-bc1c-13bd0ad9ee3b/maas-api/0.log" May 22 11:07:41.647372 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:41.647272 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-649ffb4464-cz6z6_8b4d3031-812b-4e31-b27d-15a3d7b634a7/manager/0.log" May 22 11:07:41.996049 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:41.996023 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-5xf6k_9a5de466-2462-4eab-8201-458be46a4299/postgres/0.log" May 22 11:07:43.241091 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:43.241063 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-75d4765f5d-dv5kt_2d3e696b-6094-4b98-88c5-e37201411bc6/authorino/0.log" May 22 11:07:44.593174 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:44.593139 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f4bf49c7f-n5jv2_4d465498-d6c7-451a-b98e-4303a75be227/kube-auth-proxy/0.log" May 22 11:07:45.513824 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:45.513793 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6_761a92e7-d6cf-4590-a119-37b4caa5309b/storage-initializer/0.log" May 22 11:07:45.521549 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:45.521527 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-8x8h6_761a92e7-d6cf-4590-a119-37b4caa5309b/main/0.log" May 22 11:07:45.869270 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:45.869195 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd_5052ab27-a323-441a-91fa-a16e34e15de0/storage-initializer/0.log" May 22 11:07:45.876777 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:45.876758 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-zw5jd_5052ab27-a323-441a-91fa-a16e34e15de0/main/0.log" May 22 11:07:53.167457 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:53.167425 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wzr8q_d13549d7-4931-4d1d-a293-5f5405042297/global-pull-secret-syncer/0.log" May 22 11:07:53.214266 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:53.214242 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6f7c6_f78a7232-2308-46d7-b2c5-73e50d71fd25/konnectivity-agent/0.log" May 22 11:07:53.311309 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:53.311279 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-186.ec2.internal_b95c5d1fb0379c406cc76e5fce61434d/haproxy/0.log" May 22 11:07:57.491292 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:57.491263 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-75d4765f5d-dv5kt_2d3e696b-6094-4b98-88c5-e37201411bc6/authorino/0.log" May 22 11:07:59.233064 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:59.232999 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_026972a8-c35b-4157-a84b-b877e8ed7fa8/alertmanager/0.log" May 22 11:07:59.259089 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:59.259063 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_026972a8-c35b-4157-a84b-b877e8ed7fa8/config-reloader/0.log" May 22 11:07:59.284185 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:59.284159 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_026972a8-c35b-4157-a84b-b877e8ed7fa8/kube-rbac-proxy-web/0.log" May 22 11:07:59.307963 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:59.307944 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_026972a8-c35b-4157-a84b-b877e8ed7fa8/kube-rbac-proxy/0.log" May 22 11:07:59.328988 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:59.328961 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_026972a8-c35b-4157-a84b-b877e8ed7fa8/kube-rbac-proxy-metric/0.log" May 22 11:07:59.351630 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:59.351606 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_026972a8-c35b-4157-a84b-b877e8ed7fa8/prom-label-proxy/0.log" May 22 11:07:59.371887 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:59.371860 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_026972a8-c35b-4157-a84b-b877e8ed7fa8/init-config-reloader/0.log" May 22 11:07:59.437056 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:59.437035 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-8cb4d_b7d6db79-9593-42ee-b392-f6462706dcc0/kube-state-metrics/0.log" May 22 11:07:59.457009 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:59.456993 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-8cb4d_b7d6db79-9593-42ee-b392-f6462706dcc0/kube-rbac-proxy-main/0.log" May 22 11:07:59.477972 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:59.477954 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-8cb4d_b7d6db79-9593-42ee-b392-f6462706dcc0/kube-rbac-proxy-self/0.log" May 22 11:07:59.509350 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:59.509318 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-854766bfc8-zdtfp_6adacca9-45a6-43bf-a834-ced100294d3d/metrics-server/0.log" May 22 11:07:59.538535 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:59.538510 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-4n59w_e4095573-5bef-4351-8fa6-0bfa9e99efbb/monitoring-plugin/0.log" May 22 11:07:59.639771 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:59.639742 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c84ld_d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a/node-exporter/0.log" May 22 11:07:59.665657 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:59.665633 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c84ld_d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a/kube-rbac-proxy/0.log" May 22 11:07:59.694036 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:59.694015 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c84ld_d8f3a1b8-e6a4-416e-b24d-908c0ac7a40a/init-textfile/0.log" May 22 11:07:59.800780 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:59.800710 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-zbrp2_4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd/kube-rbac-proxy-main/0.log" May 22 11:07:59.821926 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:59.821905 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-zbrp2_4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd/kube-rbac-proxy-self/0.log" May 22 11:07:59.843576 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:59.843556 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-zbrp2_4d1f7bd3-8dd2-4213-a3ae-4cfca07dd1fd/openshift-state-metrics/0.log" May 22 11:07:59.881256 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:59.881213 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4c031229-b7c7-4dea-a9ee-df5ccc30c465/prometheus/0.log" May 22 11:07:59.900890 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:59.900866 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4c031229-b7c7-4dea-a9ee-df5ccc30c465/config-reloader/0.log" May 22 11:07:59.923156 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:59.923136 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4c031229-b7c7-4dea-a9ee-df5ccc30c465/thanos-sidecar/0.log" May 22 11:07:59.942842 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:59.942824 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4c031229-b7c7-4dea-a9ee-df5ccc30c465/kube-rbac-proxy-web/0.log" May 22 11:07:59.964002 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:59.963979 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4c031229-b7c7-4dea-a9ee-df5ccc30c465/kube-rbac-proxy/0.log" May 22 11:07:59.985081 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:07:59.985058 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4c031229-b7c7-4dea-a9ee-df5ccc30c465/kube-rbac-proxy-thanos/0.log" May 22 11:08:00.004665 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:00.004643 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4c031229-b7c7-4dea-a9ee-df5ccc30c465/init-config-reloader/0.log" May 22 11:08:00.031193 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:00.031166 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-7l26n_fca21eb7-1c8b-4dab-bb32-8d933b497156/prometheus-operator/0.log" May 22 11:08:00.049455 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:00.049425 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-7l26n_fca21eb7-1c8b-4dab-bb32-8d933b497156/kube-rbac-proxy/0.log" May 22 11:08:00.073035 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:00.072975 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-fb7rh_e509b290-5763-4eaf-9657-944b739825b2/prometheus-operator-admission-webhook/0.log" May 22 11:08:00.097138 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:00.097118 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-756586f74d-cwck8_03bbe1ab-da55-4d33-b09b-e02c8098b59b/telemeter-client/0.log" May 22 11:08:00.116484 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:00.116462 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-756586f74d-cwck8_03bbe1ab-da55-4d33-b09b-e02c8098b59b/reload/0.log" May 22 11:08:00.136127 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:00.136097 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-756586f74d-cwck8_03bbe1ab-da55-4d33-b09b-e02c8098b59b/kube-rbac-proxy/0.log" May 22 11:08:00.160842 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:00.160821 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f48fb8bdd-55nqj_917b15f6-54fd-4d77-86e0-5faab1b9d996/thanos-query/0.log" May 22 11:08:00.179794 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:00.179777 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f48fb8bdd-55nqj_917b15f6-54fd-4d77-86e0-5faab1b9d996/kube-rbac-proxy-web/0.log" May 22 11:08:00.198472 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:00.198452 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f48fb8bdd-55nqj_917b15f6-54fd-4d77-86e0-5faab1b9d996/kube-rbac-proxy/0.log" May 22 11:08:00.217569 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:00.217548 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f48fb8bdd-55nqj_917b15f6-54fd-4d77-86e0-5faab1b9d996/prom-label-proxy/0.log" May 22 11:08:00.237453 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:00.237432 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f48fb8bdd-55nqj_917b15f6-54fd-4d77-86e0-5faab1b9d996/kube-rbac-proxy-rules/0.log" May 22 11:08:00.258439 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:00.258419 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f48fb8bdd-55nqj_917b15f6-54fd-4d77-86e0-5faab1b9d996/kube-rbac-proxy-metrics/0.log" May 22 11:08:01.570779 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:01.570747 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pk7x7/perf-node-gather-daemonset-5tq56"] May 22 11:08:01.571235 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:01.571135 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="336d30d4-be5f-4d0b-8576-705cd6dd0545" containerName="authorino" May 22 11:08:01.571235 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:01.571146 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="336d30d4-be5f-4d0b-8576-705cd6dd0545" containerName="authorino" May 22 11:08:01.571235 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:01.571226 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="336d30d4-be5f-4d0b-8576-705cd6dd0545" containerName="authorino" May 22 11:08:01.579564 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:01.579529 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pk7x7/perf-node-gather-daemonset-5tq56" May 22 11:08:01.581631 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:01.581608 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pk7x7\"/\"openshift-service-ca.crt\"" May 22 11:08:01.581772 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:01.581609 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pk7x7\"/\"kube-root-ca.crt\"" May 22 11:08:01.581772 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:01.581737 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pk7x7/perf-node-gather-daemonset-5tq56"] May 22 11:08:01.582296 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:01.582267 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pk7x7\"/\"default-dockercfg-z9nrg\"" May 22 11:08:01.669059 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:01.669023 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7ce49f73-34d6-4a32-ac01-81ce6a5254f9-podres\") pod \"perf-node-gather-daemonset-5tq56\" (UID: \"7ce49f73-34d6-4a32-ac01-81ce6a5254f9\") " pod="openshift-must-gather-pk7x7/perf-node-gather-daemonset-5tq56" May 22 11:08:01.669234 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:01.669077 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7ce49f73-34d6-4a32-ac01-81ce6a5254f9-proc\") pod \"perf-node-gather-daemonset-5tq56\" (UID: \"7ce49f73-34d6-4a32-ac01-81ce6a5254f9\") " pod="openshift-must-gather-pk7x7/perf-node-gather-daemonset-5tq56" May 22 11:08:01.669234 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:01.669142 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sk92\" (UniqueName: \"kubernetes.io/projected/7ce49f73-34d6-4a32-ac01-81ce6a5254f9-kube-api-access-5sk92\") pod \"perf-node-gather-daemonset-5tq56\" (UID: \"7ce49f73-34d6-4a32-ac01-81ce6a5254f9\") " pod="openshift-must-gather-pk7x7/perf-node-gather-daemonset-5tq56" May 22 11:08:01.669234 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:01.669192 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ce49f73-34d6-4a32-ac01-81ce6a5254f9-lib-modules\") pod \"perf-node-gather-daemonset-5tq56\" (UID: \"7ce49f73-34d6-4a32-ac01-81ce6a5254f9\") " pod="openshift-must-gather-pk7x7/perf-node-gather-daemonset-5tq56" May 22 11:08:01.669234 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:01.669218 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ce49f73-34d6-4a32-ac01-81ce6a5254f9-sys\") pod \"perf-node-gather-daemonset-5tq56\" (UID: \"7ce49f73-34d6-4a32-ac01-81ce6a5254f9\") " pod="openshift-must-gather-pk7x7/perf-node-gather-daemonset-5tq56" May 22 11:08:01.769910 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:01.769867 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7ce49f73-34d6-4a32-ac01-81ce6a5254f9-podres\") pod \"perf-node-gather-daemonset-5tq56\" (UID: \"7ce49f73-34d6-4a32-ac01-81ce6a5254f9\") " pod="openshift-must-gather-pk7x7/perf-node-gather-daemonset-5tq56" May 22 11:08:01.770082 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:01.769940 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7ce49f73-34d6-4a32-ac01-81ce6a5254f9-proc\") pod \"perf-node-gather-daemonset-5tq56\" (UID: \"7ce49f73-34d6-4a32-ac01-81ce6a5254f9\") " pod="openshift-must-gather-pk7x7/perf-node-gather-daemonset-5tq56" May 22 11:08:01.770082 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:01.769969 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5sk92\" (UniqueName: \"kubernetes.io/projected/7ce49f73-34d6-4a32-ac01-81ce6a5254f9-kube-api-access-5sk92\") pod \"perf-node-gather-daemonset-5tq56\" (UID: \"7ce49f73-34d6-4a32-ac01-81ce6a5254f9\") " pod="openshift-must-gather-pk7x7/perf-node-gather-daemonset-5tq56" May 22 11:08:01.770082 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:01.770009 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ce49f73-34d6-4a32-ac01-81ce6a5254f9-lib-modules\") pod \"perf-node-gather-daemonset-5tq56\" (UID: \"7ce49f73-34d6-4a32-ac01-81ce6a5254f9\") " pod="openshift-must-gather-pk7x7/perf-node-gather-daemonset-5tq56" May 22 11:08:01.770082 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:01.770032 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ce49f73-34d6-4a32-ac01-81ce6a5254f9-sys\") pod \"perf-node-gather-daemonset-5tq56\" (UID: \"7ce49f73-34d6-4a32-ac01-81ce6a5254f9\") " pod="openshift-must-gather-pk7x7/perf-node-gather-daemonset-5tq56" May 22 11:08:01.770082 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:01.770038 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7ce49f73-34d6-4a32-ac01-81ce6a5254f9-podres\") pod \"perf-node-gather-daemonset-5tq56\" (UID: \"7ce49f73-34d6-4a32-ac01-81ce6a5254f9\") " pod="openshift-must-gather-pk7x7/perf-node-gather-daemonset-5tq56" May 22 11:08:01.770082 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:01.770066 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7ce49f73-34d6-4a32-ac01-81ce6a5254f9-proc\") pod \"perf-node-gather-daemonset-5tq56\" (UID: \"7ce49f73-34d6-4a32-ac01-81ce6a5254f9\") " pod="openshift-must-gather-pk7x7/perf-node-gather-daemonset-5tq56" May 22 11:08:01.770380 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:01.770129 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ce49f73-34d6-4a32-ac01-81ce6a5254f9-sys\") pod \"perf-node-gather-daemonset-5tq56\" (UID: \"7ce49f73-34d6-4a32-ac01-81ce6a5254f9\") " pod="openshift-must-gather-pk7x7/perf-node-gather-daemonset-5tq56" May 22 11:08:01.770380 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:01.770162 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ce49f73-34d6-4a32-ac01-81ce6a5254f9-lib-modules\") pod \"perf-node-gather-daemonset-5tq56\" (UID: \"7ce49f73-34d6-4a32-ac01-81ce6a5254f9\") " pod="openshift-must-gather-pk7x7/perf-node-gather-daemonset-5tq56" May 22 11:08:01.777725 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:01.777699 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sk92\" (UniqueName: \"kubernetes.io/projected/7ce49f73-34d6-4a32-ac01-81ce6a5254f9-kube-api-access-5sk92\") pod \"perf-node-gather-daemonset-5tq56\" (UID: \"7ce49f73-34d6-4a32-ac01-81ce6a5254f9\") " pod="openshift-must-gather-pk7x7/perf-node-gather-daemonset-5tq56" May 22 11:08:01.890929 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:01.890835 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pk7x7/perf-node-gather-daemonset-5tq56" May 22 11:08:02.020998 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:02.020974 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pk7x7/perf-node-gather-daemonset-5tq56"] May 22 11:08:02.023611 ip-10-0-138-186 kubenswrapper[2558]: W0522 11:08:02.023581 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7ce49f73_34d6_4a32_ac01_81ce6a5254f9.slice/crio-a1264b1b987e5b3585a0f6f648625531f44a4f605d8dae0a7f65b985952df6ce WatchSource:0}: Error finding container a1264b1b987e5b3585a0f6f648625531f44a4f605d8dae0a7f65b985952df6ce: Status 404 returned error can't find the container with id a1264b1b987e5b3585a0f6f648625531f44a4f605d8dae0a7f65b985952df6ce May 22 11:08:02.025247 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:02.025229 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 22 11:08:02.293788 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:02.293751 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pk7x7/perf-node-gather-daemonset-5tq56" event={"ID":"7ce49f73-34d6-4a32-ac01-81ce6a5254f9","Type":"ContainerStarted","Data":"b215a890f616573c2dbaf6f20c5ab394f1a38fbb3884b4ffc07c28a7e2e1d883"} May 22 11:08:02.293788 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:02.293796 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pk7x7/perf-node-gather-daemonset-5tq56" event={"ID":"7ce49f73-34d6-4a32-ac01-81ce6a5254f9","Type":"ContainerStarted","Data":"a1264b1b987e5b3585a0f6f648625531f44a4f605d8dae0a7f65b985952df6ce"} May 22 11:08:02.294006 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:02.293832 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pk7x7/perf-node-gather-daemonset-5tq56" May 22 11:08:02.308491 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:02.308443 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-pk7x7/perf-node-gather-daemonset-5tq56" podStartSLOduration=1.308428336 podStartE2EDuration="1.308428336s" podCreationTimestamp="2026-05-22 11:08:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-22 11:08:02.306631626 +0000 UTC m=+1973.613891372" watchObservedRunningTime="2026-05-22 11:08:02.308428336 +0000 UTC m=+1973.615688081" May 22 11:08:02.348878 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:02.348848 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-68bbb6577c-sg68z_6ff246fb-d774-4400-b5f4-1bbdaaafa25e/console/0.log" May 22 11:08:03.650731 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:03.650695 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kzbqx_3fa09c0c-5066-401d-b52f-6bf653c7e16a/dns/0.log" May 22 11:08:03.670355 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:03.670312 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kzbqx_3fa09c0c-5066-401d-b52f-6bf653c7e16a/kube-rbac-proxy/0.log" May 22 11:08:03.736727 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:03.736696 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7mj84_206f863a-6549-4ed7-9b1c-3a20fd243d51/dns-node-resolver/0.log" May 22 11:08:04.241896 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:04.241860 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cxx7z_5a26bab0-ee1f-4322-9413-91c337de805a/node-ca/0.log" May 22 11:08:05.252504 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:05.252464 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f4bf49c7f-n5jv2_4d465498-d6c7-451a-b98e-4303a75be227/kube-auth-proxy/0.log" May 22 11:08:05.882583 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:05.882553 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dkpsq_b3ffc24b-3fd6-4134-964e-a2227bac423d/serve-healthcheck-canary/0.log" May 22 11:08:06.498293 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:06.498268 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9qzlm_c269b171-f1f4-4551-8858-30a160b62289/kube-rbac-proxy/0.log" May 22 11:08:06.517769 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:06.517744 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9qzlm_c269b171-f1f4-4551-8858-30a160b62289/exporter/0.log" May 22 11:08:06.537998 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:06.537976 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9qzlm_c269b171-f1f4-4551-8858-30a160b62289/extractor/0.log" May 22 11:08:08.307845 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:08.307813 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pk7x7/perf-node-gather-daemonset-5tq56" May 22 11:08:08.409054 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:08.409027 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6f7f75cb-wzlr8_6d8811a6-7013-4b28-bc1c-13bd0ad9ee3b/maas-api/0.log" May 22 11:08:08.534925 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:08.534896 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-649ffb4464-cz6z6_8b4d3031-812b-4e31-b27d-15a3d7b634a7/manager/0.log" May 22 11:08:08.621701 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:08.621629 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-5xf6k_9a5de466-2462-4eab-8201-458be46a4299/postgres/0.log" May 22 11:08:09.687350 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:09.687303 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8578576cfb-29v45_d4eaeebb-01ea-4053-bed4-7c5bce108ff2/manager/0.log" May 22 11:08:09.740739 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:09.740708 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-72wzb_95f5a756-e2f8-4096-a082-4f9d104301a2/openshift-lws-operator/0.log" May 22 11:08:15.317420 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:15.317375 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6j2d5_9f91428b-8137-4a51-9b7e-1b7d8b8011fd/kube-multus/0.log" May 22 11:08:15.345726 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:15.345698 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r5lqn_cb2a30bd-3761-45fe-80d6-b247b6ef6a31/kube-multus-additional-cni-plugins/0.log" May 22 11:08:15.366878 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:15.366846 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r5lqn_cb2a30bd-3761-45fe-80d6-b247b6ef6a31/egress-router-binary-copy/0.log" May 22 11:08:15.386849 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:15.386824 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r5lqn_cb2a30bd-3761-45fe-80d6-b247b6ef6a31/cni-plugins/0.log" May 22 11:08:15.405791 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:15.405767 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r5lqn_cb2a30bd-3761-45fe-80d6-b247b6ef6a31/bond-cni-plugin/0.log" May 22 11:08:15.425393 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:15.425367 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r5lqn_cb2a30bd-3761-45fe-80d6-b247b6ef6a31/routeoverride-cni/0.log" May 22 11:08:15.445009 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:15.444977 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r5lqn_cb2a30bd-3761-45fe-80d6-b247b6ef6a31/whereabouts-cni-bincopy/0.log" May 22 11:08:15.465848 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:15.465820 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r5lqn_cb2a30bd-3761-45fe-80d6-b247b6ef6a31/whereabouts-cni/0.log" May 22 11:08:15.876460 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:15.876433 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4t6q7_d7db0942-cfd5-4727-b490-62198c86d1e6/network-metrics-daemon/0.log" May 22 11:08:15.893914 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:15.893889 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4t6q7_d7db0942-cfd5-4727-b490-62198c86d1e6/kube-rbac-proxy/0.log" May 22 11:08:16.993142 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:16.993106 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jzgxh_0265449b-fdb7-4537-a446-8d97653b2097/ovn-controller/0.log" May 22 11:08:17.021388 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:17.021330 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jzgxh_0265449b-fdb7-4537-a446-8d97653b2097/ovn-acl-logging/0.log" May 22 11:08:17.071989 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:17.071948 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jzgxh_0265449b-fdb7-4537-a446-8d97653b2097/kube-rbac-proxy-node/0.log" May 22 11:08:17.095103 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:17.095069 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jzgxh_0265449b-fdb7-4537-a446-8d97653b2097/kube-rbac-proxy-ovn-metrics/0.log" May 22 11:08:17.119698 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:17.119671 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jzgxh_0265449b-fdb7-4537-a446-8d97653b2097/northd/0.log" May 22 11:08:17.140615 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:17.140568 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jzgxh_0265449b-fdb7-4537-a446-8d97653b2097/nbdb/0.log" May 22 11:08:17.160252 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:17.160211 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jzgxh_0265449b-fdb7-4537-a446-8d97653b2097/sbdb/0.log" May 22 11:08:17.258588 ip-10-0-138-186 kubenswrapper[2558]: I0522 11:08:17.258507 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jzgxh_0265449b-fdb7-4537-a446-8d97653b2097/ovnkube-controller/0.log"